Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Voice Quality Evaluator

Innodata Inc.

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI models via real-time voice conversations. You will compare two models, record your interactions, and provide structured evaluations across five criteria to determine the stronger overall conversational experience. The role emphasizes maintaining consistent turns, careful listening, and objective reporting, with the goal of delivering fair, actionable insights for model improvement. #J-18808-Ljbffr Innodata Inc.

Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the AI Voice Quality Evaluator in New York, NY vacancy
  •  ...Korean Voice AI Evaluator (Healthcare Front Desk Conversations) About The Role What if your voice could help teach AI how to handle a...  ...Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Korean speaker... 
    Quality
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    New York, NY
    12 hours ago
  • $15 per hour

     ...Get paid to spot what AI-generated media gets wrong Hold live conversations with AI voice models, compare image and video pairs...  ...improve. Through Outlier’s evaluation and feedback loop, your work helps...  ...dimensions like adherence, quality, and realism , then writing a... 
    Quality
    Weekly pay
    Contract work
    Freelance
    Internship
    Remote work
    Flexible hours

    Outlier

    New York, NY
    12 hours ago
  •  ...a native or near-native Korean speaker to remotely evaluate healthcare front desk conversations with an AI, role-playing as a patient and recording dialogue for...  ...flexible hours and a quiet home workspace for quality contributions to AI research. #J-18808-Ljbffr Alignerr... 
    Quality
    Remote job
    Contract work
    Flexible hours

    Alignerr Corp.

    New York, NY
    2 days ago
  • $15 per hour

     ...Outlier invites detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain why something looks off, all from home on your own schedule. This freelance, remote role offers flexible... 
    Suggested
    Hourly pay
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    New York, NY
    12 hours ago
  •  ...detail-oriented, English-speaking reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare image and video pairs, and...  ...audio, and video, rate them on adherence and quality, and help improve frontier AI systems. This is... 
    Quality
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    New York, NY
    12 hours ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, rank outputs for naturalness and accuracy, and provide written explanations of what went wrong... 
    Quality
    Remote job
    Weekly pay
    Flexible hours

    Outlier

    New York, NY
    2 days ago
  • $15 per hour

    Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on your own schedule. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing. Work from home or while traveling, with... 
    Quality
    Remote job
    Hourly pay
    Weekly pay
    Work from home
    Flexible hours

    Outlier

    New York, NY
    2 days ago
  •  ...hourly contractor role supporting AI data and language projects on a...  ...generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across...  ...AI training datasets. LLM evaluation: reviewing AI-generated responses... 
    Quality
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    CNTXT AI

    New York, NY
    2 days ago
  •  ...Corp. is seeking native Korean speakers in the United States to evaluate an AI healthcare receptionist through simulated patient...  ...labeling guidelines and contribute to improving the accuracy and safety of voice AI in healthcare #J-18808-Ljbffr Alignerr Corp.
    Remote job
    Contract work
    Flexible hours

    Alignerr Corp.

    New York, NY
    3 days ago
  • Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context.... 
    Quality
    Remote job
    For contractors
    Local area

    Embedded Shishya

    New York, NY
    1 day ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Quality
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    12 hours ago
  •  ...Alignerr Corp. is seeking a Search Quality Evaluator (AI Training) for a fully remote, hourly contract role. You will assess search results, evaluate AI-generated answers, and rate content recommendations to help improve AI performance. The position offers flexible hours... 
    Quality
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    New York, NY
    2 days ago
  •  ...Medical Translation AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade...  ...published evidence or specialty guidelines. Maintain reviewer-quality scores in weekly inter-rater calibration cycles. Qualifications... 
    Quality
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    1 day ago
  • Innodata India seeks skilled Audio Speech Evaluators Experts to assess speech quality and conversational performance with an AI bot, following established guidelines. Candidates should be near-native English speakers with strong listening and analytical skills, capable... 
    Quality

    Innodata India

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a detail-oriented evaluator to score prompt-response pairs from large language models. You will use structured rubrics to rate factual accuracy, instruction-following, and coherence across batches, typically 20-50 pairs per session. You will... 
    Quality

    Claru

    New York, NY
    1 day ago
  • $30 per hour

     ...: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous...  ...agent systems using defined rubrics and quality standards. Review multi-step agent...  ...Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research,... 
    Quality
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Quality
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $13 per hour

     ...years Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to...  ...internet access. AI evaluation, annotation, content review or quality assurance experience is helpful but not required.... 
    Quality
    Hourly pay
    For contractors
    Remote work

    Braintrust

    New York, NY
    4 days ago
  • YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and evaluate next-generation AI systems through high-quality input. No prior AI... 
    Quality
    Remote job

    YO AI Labs

    New York, NY
    4 days ago
  • RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday queries from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms... 
    Quality
    Remote job
    Part time
    Work from home
    Flexible hours

    RWS

    New York, NY
    4 days ago
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages... 
    Quality
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language... 
    Quality
    Remote job
    Hourly pay
    Part time
    For contractors

    OpenKrill

    New York, NY
    1 day ago
  • $20 - $30 per hour

     ...technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills,... 
    Quality
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    2 days ago
  • $20 per hour

    Review and rate AI-generated Kannada responses, write reference answers, and apply mathematical...  ...20+ hours per week. The Work You will evaluate AI-generated Kannada content and help...  ...corrections. Create prompts and high-quality reference answers across several writing... 
    Quality
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research...  ...textbooks, papers, or community standards. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications... 
    Quality
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test...  ...proficiency Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow Preferred Experience Prior... 
    Quality
    Remote job
    Hourly pay
    Full time
    For contractors

    CNTXT AI

    New York, NY
    2 days ago
  • Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Quality
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  • $18 per hour

    AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible...  ...with strong English skills and a keen eye for language quality? Join a remote AI project where you’ll evaluate AI-generated... 
    Quality
    Remote job
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    New York, NY
    1 day ago
  • $18 per hour

    Description: Interact with an AI assistant in Telugu. Translate English prompts into...  ...to interact with the AI application. Evaluate AI-generated responses according to project...  ...linguistic accuracy, naturalness, localization quality, and cultural appropriateness. Provide... 
    Quality
    Hourly pay
    Temporary work
    Freelance
    Immediate start
    Remote work
    Flexible hours

    RWS Group

    New York, NY
    4 days ago
  • Create challenging prompts and evaluate large language model responses for accuracy, reasoning...  ...operational execution to assess how well AI handles management-related topics. Create...  ..., reasoning, relevance, and overall quality. Find factual errors, logical inconsistencies... 
    Quality
    Contract work
    Part time
    For contractors
    Remote work
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Voice Quality Evaluator. Be the first to apply!