Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Language & AI Voice Evaluator [Remote]

$20 per hour

AuraOne Human Data

Remote
  • Remote job

Language & AI Voice Evaluator is a remote evaluation track for reviewing language ai voice evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn language ai voice evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate language ai voice evaluation model outputs against a versioned rubric and assign severity tags for Language & AI Voice Evaluator assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on language ai voice evaluation or adjacent content for Language & AI Voice Evaluator work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two language ai voice evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Language AI Voice evaluation
  • Active listening and vocal analysis
  • Objective feedback reporting
  • Strong verbal and written communication

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$20 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Language & AI Voice Evaluator [Remote] in Remote vacancy
  • Dutch Voice AI Evaluator (Healthcare Front Desk Conversations) About the Role What if your voice could help teach AI how to handle a real phone...  ...varieties of Dutch and colloquial speech Linguistics or language-focused studies Familiarity with medical terminology in Dutch... 
    Language
    Contract work
    Work at office
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    5 days ago
  • $20 - $55 per hour

     ...provider focused on realtime AI for consumer-facing applications...  ...to instructions Score voices against rubrics for naturalness...  ...act on For multilingual roles: evaluate pronunciation, dialect accuracy...  ...and naturalness in your native language WHAT WE'RE LOOKING FOR A trained... 
    Language
    Hourly pay
    For contractors
    Remote work

    Inworld, Inc.

    Mountain View, CA
    1 day ago
  • YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation, and provide structured written feedback to improve AI models... 
    Language
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    1 day ago
  • SpaceXSI is hiring to train and refine Grok's voice and language capabilities in German for a global user base. This remote role supports multilingual data annotation, translation, and audio production, ensuring accurate pronunciation and cultural nuance. The position... 
    Language
    Remote job

    xAI

    New York, NY
    1 day ago
  • $8 - $65 per hour

     ...short scripted reads. Think light voice acting/voiceover: clean...  ...want to hear you. Must speak 2 languages well (preferably non-English)....  ...the exact rate determined after evaluating your experience, expertise,...  ...Hungarian Voice Acting Specialist - AI Trainer Employment type:... 
    Language
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    2 days ago
  •  ...remote, hourly contractor role supporting AI data and language projects on a project-based, flexible...  ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for...  ...responses, or recording high-quality voice samples, to guide AI learning across diverse... 
    Language
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT AI

    New York, NY
    4 days ago
  • Remotebridge seeks Bengali bilingual experts to join a remote language/AI training project. You will review Bengali audio, rate nativeness...  ...AI experience required, but domain knowledge in linguistics or voice work is valuable. This contractor role emphasizes accuracy, timely... 
    Language
    Remote job
    For contractors

    Remotebridge

    New York, NY
    19 hours ago
  • $26 - $28 per hour

     ...Labeling Analysts, supporting speech and voice AI systems. This is a high‑impact...  ...You’ll be working with audio, speech, and language data — helping ensure models are trained...  ...this role is more execution‑focused than evaluation‑heavy roles, it still requires strong judgment... 
    Language
    Full time
    Remote work
    Visa sponsorship

    Welo Global

    Sunnyvale, CA
    4 days ago
  • micro1 Inc. is seeking an English Voice Expert (US) to contribute to language data and AI advancement as a remote contractor. You will evaluate English audio for nativeness and fluency, and provide written feedback to help train AI models. Applicants must be native English... 
    Language
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    1 day ago
  • $26 - $28 per hour

     ...Labeling Analysts, supporting speech and voice AI systems. This is a high-impact...  ...You'll be working with audio, speech, and language data — helping ensure models are trained...  ...this role is more execution-focused than evaluation-heavy roles, it still requires strong judgment... 
    Language
    Full time
    Work experience placement
    Remote work
    Visa sponsorship

    Welocalize

    Boston, MA
    4 days ago
  •  ...is seeking a French bilingual expert to evaluate audio samples for nativeness and fluency...  ...per week) and is ideal for linguists or voice specialists. You will assess pronunciation...  ...helps clarify requirements and improve AI language understanding. #J-18808-Ljbffr Crossing... 
    Language
    Remote job
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • LILT invites professional or semi-professional voice talents to join an exciting AI-language project. We value natural delivery, clear speech, and a conversational tone that engages listeners. Ideal candidates are native English speakers with voice acting, narration, podcasting... 
    Language
    Remote job

    LILT (Production)

    New York, NY
    1 day ago
  • $8 - $65 per hour

    Agency seeks a Thai voice acting specialist for AI training. You will record short scripted reads with expressive, conversational delivery in a quiet...  ...mic. Responsibilities include recording in your dominant language, following directions, and delivering clean audio files... 
    Language
    Remote job
    Hourly pay
    For contractors

    Agency

    New York, NY
    4 days ago
  • CNTXT, Inc. is seeking a fully remote hourly contractor to support AI data and language projects. You will work on prompts, voice samples, data annotation, LLM evaluation, and localization QA for American English content. The ideal candidate is a native American English... 
    Language
    Remote job
    Hourly pay
    For contractors

    CNTXT, Inc.

    New York, NY
    1 day ago
  • LILT is seeking professional voice talents with a passion for language and technology for an exciting project. We are looking for native English speakers,...  ...recording setup and ability to meet tight deadlines are required; licensing your voice for AI/TTS may #J-18808-Ljbffr LILT
    Language
    Remote job
    For contractors

    LILT

    New York, NY
    3 days ago
  •  ...seeking professional or semi-professional voice talents for an exciting project. Open to independent...  ...US English skills and a passion for language and technology. You will work remotely,...  ...recordings, and potentially contribute to AI-related training. Applicants should have a... 
    Language
    Remote job
    For contractors

    LILT

    New York, NY
    3 days ago
  • LILT is seeking professional or semi-professional voice talents with a passion for language and technology for an exciting project. We require a native speaker...  ...payments, and join a global community advancing multilingual AI and human-verified services. #J-18808-Ljbffr Lilt
    Language
    Remote job
    For contractors
    Flexible hours

    Lilt

    New York, NY
    3 days ago
  •  ...Vietnamese Voice Actor - Freelance AI Trainer Project World Wide - Remote Are you an experienced Vietnamese...  ...shape the future of AI? Large-scale language models and speech technologies are...  ...cutting-edge AI tools, record and evaluate Vietnamese speech samples, and provide... 
    Language
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    1 day ago
  • Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge naturalness and accuracy, and help refine voices for real-time applications. This role is remote within the United States and involves structured reporting to... 
    Remote job

    Inworld AI

    New York, NY
    5 days ago
  • Lifted is seeking experts to engage in live conversations with AI systems, review and label transcripts, and provide written justifications based on rubrics. You will assess language quality, technical accuracy, and JSON formatting while capturing session artifacts and... 
    Language
    Remote work
    Flexible hours

    Lifted (Upwork)

    New York, NY
    5 days ago
  • SpaceXSI is seeking a detail‑oriented Vietnamese language trainer to annotate, translate, and refine Grok's voice capabilities. You will work on multilingual audio, ensure natural pronunciation, and help adapt UI prompts for Vietnamese users. This remote role supports... 
    Remote job
    Contract work

    xAI

    New York, NY
    5 days ago
  • Alignerr Corp. is seeking a Professional Voice Actor for German (AI Training). Record expressive, professional-grade German audio and assess AI-generated speech to teach next-generation AI systems how authentic German sounds. Role is fully remote and flexible, designed... 
    Remote job
    Flexible hours

    Alignerr Corp.

    New York, NY
    2 days ago
  • Alignerr is seeking a French Generalist Voice Actor for AI training. This fully remote, hourly contract role involves recording high-quality French audio and evaluating AI-generated speech to help train language models. You should have native or near-native French, experience... 
    Language
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    Alignerr Corp.

    Chicago, IL
    3 days ago
  • $26 - $28 per hour

     ...Labeling Analysts, supporting speech and voice AI systems. This is a high-impact...  ...You’ll be working with audio, speech, and language data — helping ensure models are trained...  ...this role is more execution-focused than evaluation-heavy roles, it still requires strong judgment... 
    Language
    Full time
    Remote work
    Visa sponsorship

    Welo Global

    Sunnyvale, CA
    1 day ago
  • $26 per hour

    Prolific is seeking fluent Danish speakers to act as evaluators for AI training. You will compare text and AI-generated speech, assess naturalness, and flag cultural mismatches. A typical task pays up to $26/hr and can be completed at home with one hour of uninterrupted... 
    Remote job

    Prolific Academic Ltd

    New York, NY
    1 day ago
  • Alignerr is seeking a French-speaking voice actor to record high-quality vocal samples for AI training. The role focuses on evaluating AI-generated speech for naturalness, pronunciation, and expressiveness, and providing clear feedback to improve AI voices. A professional... 
    Remote job
    Hourly pay
    Contract work

    Alignerr Corp.

    New York, NY
    3 days ago
  • Italian Voice Actor - Freelance AI Trainer Project World Wide - Remote Are you an experienced Italian...  ...shape the future of AI? Large-scale language models and speech technologies are evolving...  ...cutting‑edge AI tools, record and evaluate Italian speech samples, and provide... 
    Language
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    1 day ago
  •  ...Recording sessions should include appropriate breaks to protect the voice and maintain performance quality. Work availability is based on...  ...fluency may be offered work on other projects in additional languages, depending on their qualifications. Equipment Requirements:... 
    Language
    Contract work
    Freelance
    Remote work

    Lifted (Upwork)

    New York, NY
    19 hours ago
  • micro1 is a data lab that helps AI labs and Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve...  ...and English to craft, review, and enhance language data powering emerging AI technologies.... 
    Language
    Remote job
    For contractors

    micro1

    New York, NY
    5 days ago
  • $28 per hour

     ...Labeling Analysts, supporting speech and voice AI systems.This is a high-impact production...  ...’ll be working with audio, speech, and language data — helping ensure models are trained...  ...this role is more execution-focused than evaluation-heavy roles, it still requires strong... 
    Language
    Full time
    Work experience placement
    Remote work
    Visa sponsorship

    Welo Data

    Washington DC
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Language & AI Voice Evaluator [Remote]. Be the first to apply!