Language & AI Voice Evaluator [Remote]
$20 per hourAuraOne Human Data
- Remote job
Language & AI Voice Evaluator is a remote evaluation track for reviewing language ai voice evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn language ai voice evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate language ai voice evaluation model outputs against a versioned rubric and assign severity tags for Language & AI Voice Evaluator assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on language ai voice evaluation or adjacent content for Language & AI Voice Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two language ai voice evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Language AI Voice evaluation
- Active listening and vocal analysis
- Objective feedback reporting
- Strong verbal and written communication
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$20 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- Dutch Voice AI Evaluator (Healthcare Front Desk Conversations) About the Role What if your voice could help teach AI how to handle a real phone... ...varieties of Dutch and colloquial speech Linguistics or language-focused studies Familiarity with medical terminology in Dutch...LanguageContract workWork at officeRemote workFlexible hours
$20 - $55 per hour
...provider focused on realtime AI for consumer-facing applications... ...to instructions Score voices against rubrics for naturalness... ...act on For multilingual roles: evaluate pronunciation, dialect accuracy... ...and naturalness in your native language WHAT WE'RE LOOKING FOR A trained...LanguageHourly payFor contractorsRemote work- YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation, and provide structured written feedback to improve AI models...LanguageRemote jobFor contractors
- SpaceXSI is hiring to train and refine Grok's voice and language capabilities in German for a global user base. This remote role supports multilingual data annotation, translation, and audio production, ensuring accurate pronunciation and cultural nuance. The position...LanguageRemote job
$8 - $65 per hour
...short scripted reads. Think light voice acting/voiceover: clean... ...want to hear you. Must speak 2 languages well (preferably non-English).... ...the exact rate determined after evaluating your experience, expertise,... ...Hungarian Voice Acting Specialist - AI Trainer Employment type:...LanguageHourly payContract workFor contractorsFreelanceRemote work- ...remote, hourly contractor role supporting AI data and language projects on a project-based, flexible... ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for... ...responses, or recording high-quality voice samples, to guide AI learning across diverse...LanguageHourly payFor contractorsRemote workFlexible hours
- Remotebridge seeks Bengali bilingual experts to join a remote language/AI training project. You will review Bengali audio, rate nativeness... ...AI experience required, but domain knowledge in linguistics or voice work is valuable. This contractor role emphasizes accuracy, timely...LanguageRemote jobFor contractors
$26 - $28 per hour
...Labeling Analysts, supporting speech and voice AI systems. This is a high‑impact... ...You’ll be working with audio, speech, and language data — helping ensure models are trained... ...this role is more execution‑focused than evaluation‑heavy roles, it still requires strong judgment...LanguageFull timeRemote workVisa sponsorship- micro1 Inc. is seeking an English Voice Expert (US) to contribute to language data and AI advancement as a remote contractor. You will evaluate English audio for nativeness and fluency, and provide written feedback to help train AI models. Applicants must be native English...LanguageRemote jobFor contractors
$26 - $28 per hour
...Labeling Analysts, supporting speech and voice AI systems. This is a high-impact... ...You'll be working with audio, speech, and language data — helping ensure models are trained... ...this role is more execution-focused than evaluation-heavy roles, it still requires strong judgment...LanguageFull timeWork experience placementRemote workVisa sponsorship- ...is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency... ...per week) and is ideal for linguists or voice specialists. You will assess pronunciation... ...helps clarify requirements and improve AI language understanding. #J-18808-Ljbffr Crossing...LanguageRemote jobContract workFlexible hours
- LILT invites professional or semi-professional voice talents to join an exciting AI-language project. We value natural delivery, clear speech, and a conversational tone that engages listeners. Ideal candidates are native English speakers with voice acting, narration, podcasting...LanguageRemote job
$8 - $65 per hour
Agency seeks a Thai voice acting specialist for AI training. You will record short scripted reads with expressive, conversational delivery in a quiet... ...mic. Responsibilities include recording in your dominant language, following directions, and delivering clean audio files...LanguageRemote jobHourly payFor contractors- CNTXT, Inc. is seeking a fully remote hourly contractor to support AI data and language projects. You will work on prompts, voice samples, data annotation, LLM evaluation, and localization QA for American English content. The ideal candidate is a native American English...LanguageRemote jobHourly payFor contractors
- LILT is seeking professional voice talents with a passion for language and technology for an exciting project. We are looking for native English speakers,... ...recording setup and ability to meet tight deadlines are required; licensing your voice for AI/TTS may #J-18808-Ljbffr LILTLanguageRemote jobFor contractors
- ...seeking professional or semi-professional voice talents for an exciting project. Open to independent... ...US English skills and a passion for language and technology. You will work remotely,... ...recordings, and potentially contribute to AI-related training. Applicants should have a...LanguageRemote jobFor contractors
- LILT is seeking professional or semi-professional voice talents with a passion for language and technology for an exciting project. We require a native speaker... ...payments, and join a global community advancing multilingual AI and human-verified services. #J-18808-Ljbffr LiltLanguageRemote jobFor contractorsFlexible hours
- ...Vietnamese Voice Actor - Freelance AI Trainer Project World Wide - Remote Are you an experienced Vietnamese... ...shape the future of AI? Large-scale language models and speech technologies are... ...cutting-edge AI tools, record and evaluate Vietnamese speech samples, and provide...LanguageHourly payContract workFor contractorsFreelanceRemote work
- Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge naturalness and accuracy, and help refine voices for real-time applications. This role is remote within the United States and involves structured reporting to...Remote job
- Lifted is seeking experts to engage in live conversations with AI systems, review and label transcripts, and provide written justifications based on rubrics. You will assess language quality, technical accuracy, and JSON formatting while capturing session artifacts and...LanguageRemote workFlexible hours
- SpaceXSI is seeking a detail‑oriented Vietnamese language trainer to annotate, translate, and refine Grok's voice capabilities. You will work on multilingual audio, ensure natural pronunciation, and help adapt UI prompts for Vietnamese users. This remote role supports...Remote jobContract work
- Alignerr Corp. is seeking a Professional Voice Actor for German (AI Training). Record expressive, professional-grade German audio and assess AI-generated speech to teach next-generation AI systems how authentic German sounds. Role is fully remote and flexible, designed...Remote jobFlexible hours
- Alignerr is seeking a French Generalist Voice Actor for AI training. This fully remote, hourly contract role involves recording high-quality French audio and evaluating AI-generated speech to help train language models. You should have native or near-native French, experience...LanguageRemote jobHourly payContract workFlexible hours
$26 - $28 per hour
...Labeling Analysts, supporting speech and voice AI systems. This is a high-impact... ...You’ll be working with audio, speech, and language data — helping ensure models are trained... ...this role is more execution-focused than evaluation-heavy roles, it still requires strong judgment...LanguageFull timeRemote workVisa sponsorship$26 per hour
Prolific is seeking fluent Danish speakers to act as evaluators for AI training. You will compare text and AI-generated speech, assess naturalness, and flag cultural mismatches. A typical task pays up to $26/hr and can be completed at home with one hour of uninterrupted...Remote job- Alignerr is seeking a French-speaking voice actor to record high-quality vocal samples for AI training. The role focuses on evaluating AI-generated speech for naturalness, pronunciation, and expressiveness, and providing clear feedback to improve AI voices. A professional...Remote jobHourly payContract work
- Italian Voice Actor - Freelance AI Trainer Project World Wide - Remote Are you an experienced Italian... ...shape the future of AI? Large-scale language models and speech technologies are evolving... ...cutting‑edge AI tools, record and evaluate Italian speech samples, and provide...LanguageHourly payContract workFor contractorsFreelanceRemote work
- ...Recording sessions should include appropriate breaks to protect the voice and maintain performance quality. Work availability is based on... ...fluency may be offered work on other projects in additional languages, depending on their qualifications. Equipment Requirements:...LanguageContract workFreelanceRemote work
- micro1 is a data lab that helps AI labs and Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve... ...and English to craft, review, and enhance language data powering emerging AI technologies....LanguageRemote jobFor contractors
$28 per hour
...Labeling Analysts, supporting speech and voice AI systems.This is a high-impact production... ...’ll be working with audio, speech, and language data — helping ensure models are trained... ...this role is more execution-focused than evaluation-heavy roles, it still requires strong...LanguageFull timeWork experience placementRemote workVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Language & AI Voice Evaluator [Remote]. Be the first to apply!

