Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Voice Model Evaluator - English (Remote)

$18 per hour

Outlier Ai

New Orleans, LA
  • Remote job

Get paid to spot what AI-generated media gets wrong Hold live conversations with AI voice models, compare image and video pairs, and explain what’s off. Fully remote, flexible hours. Rates vary based on expertise and project requirements. Weekly payments via ACH, PayPal and AirTM Work the hours you want, from home or as you travel Get free access to leading LLMs — worth $200+/month Use GPT, Claude and more — completely free About the Opportunity We are seeking detail-oriented English speakers to review AI-generated media . Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on your own schedule. At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. Through Outlier’s evaluation and feedback loop, your work helps turn frontier research into AI that performs better in the real world. $600M+ Paid to Experts 52 Countries Responsibilities Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded. Comparing pairs of AI-generated images and videos and judging which one better follows the prompt. Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video. Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard. Common Tasks Image evaluations: compare two AI-generated images for the same text prompt and pick the better one, judging how well each follows the instructions, visual quality and visible AI artifacts. Some tasks rank edited images against the original. Video evaluations: rank AI-generated videos against a text prompt, or edited videos against their source clip. Video caption labeling: label first-person videos of people or robots doing hands‑on tasks. Contributors split each clip into individual actions and write precise captions, starting from an AI draft and correcting it. Audio and voice evaluations: rate AI-generated speech on naturalness, pronunciation and how closely it matches a target voice. Some tasks require recording a short voice explanation of the choice. Ideal Qualifications Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech. Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off. Nice to have: Pursuing or holding a Bachelor's degree or above. Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way. Experience writing short, evidence-based explanations or reviews. Comfortable making a clear decision when both options have flaws. Currently accepting applicants from: Australia Canada Ireland United Kingdom United States Why Join Outlier Earn Up to $18 USD/hr - Plus additional incentives Work flexibly from anywhere, anytime - no minimum hours Free access to leading LLMs — worth $200+/month On average, contributors earn an additional 7.5% through Missions — Outlier's version of surge pricing. The top quartile boosts their earnings by an average of 11%. ** Frequently Asked Questions (FAQs) What is Outlier? How is it related to Scale AI? What's the expected time commitment for participants? When and how will I be paid? How can I get support? Who do I contact with questions as I onboard? What do I need to sign up for this opportunity? Ready to use your brilliance to outsmart AI? #J-18808-Ljbffr Outlier Ai

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Ai Voice Model Evaluator - English (Remote) in New Orleans, LA vacancy
  • Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off. This remote role offers flexible hours and allows you to work... 
    Remote job
    English language skills
    Work from home
    Flexible hours

    Outlier

    New Orleans, LA
    1 day ago
  • Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated...  ...roleplay live conversations with AI voice models, evaluate image/video prompts, and explain...  ...what looked or sounded wrong, all remotely and on your own schedule. Responsibilities... 
    Remote job
    English language skills

    Outlier (by Scale AI)

    New York, NY
    4 days ago
  • $15 per hour

    Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplaying live conversations with AI voice models and scoring exchanges. You will compare AI-generated...  ...what looked or sounded wrong, all remotely and on your own schedule. Work remotely... 
    Remote job
    English language skills
    Hourly pay
    Weekly pay
    Freelance

    Outlier

    New York, NY
    2 days ago
  • $50 - $60 per hour

     ...technology company specializing in AI and finance is seeking a Wealth Advisor to help train AI models. In this independent contract...  ...candidate should be fluent in English, attentive to detail, and...  ...position offers flexibility to work remotely and competitive hourly pay starting... 
    Remote job
    English language skills
    Hourly pay
    Contract work

    DataAnnotation

    Brooklyn, NY
    10 hours ago
  • YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation...  ...feedback to improve AI models. No prior AI experience is... 
    Remote job
    English language skills
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  • $26 per hour

    Prolific is seeking fluent Danish speakers to act as evaluators for AI training. You will compare text and AI-generated speech, assess naturalness...  ...account to receive payments. Excellent Danish and fluent English are required, with attention to detail and an ability to... 
    Remote job
    English language skills

    Prolific Academic Ltd

    New York, NY
    2 days ago
  • $18 per hour

    Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely. You will roleplay live conversations with an AI voice model, score each exchange, and explain in writing what looked or sounded off, focusing on how well prompts were followed... 
    Remote job
    English language skills
    Work from home
    Flexible hours

    Outlier

    Boca Raton, FL
    1 day ago
  • Outlier Ai is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with AI voice models, and score exchanges for naturalness and prompt adherence. You will compare images and videos, identify errors, and provide written explanations... 
    Remote job
    English language skills

    Outlier Ai

    Scottsdale, AZ
    5 days ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media. You will...  ...live conversations with AI voice models, rank outputs, and explain...  ...or sounded off. This remote opportunity lets you work...  ...schedule while contributing to evaluating AI systems in real-world scenarios... 
    Remote job
    English language skills
    Flexible hours

    Outlier

    Scottsdale, AZ
    1 day ago
  • $18 per hour

    Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges for naturalness and usefulness...  ...what looked or sounded off, all remotely and on your own schedule. You'll compare... 
    Remote job
    English language skills
    Flexible hours

    Outlier

    Tallahassee, FL
    1 day ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off. You will compare image and video... 
    Remote job
    English language skills
    Flexible hours

    Outlier

    Boca Raton, FL
    1 day ago
  • Productive Playhouse Inc. is a remote AI-evaluation partner assessing French-language chatbots and language models through structured conversations. You will engage in voice-based interactions when...  ...native French (France) and strong English, hands-on AI/LLM experience,... 
    Remote job
    English language skills
    Flexible hours

    Productive Playhouse Inc.

    New York, NY
    2 days ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule. You will rate outputs on adherence, quality... 
    Remote job
    English language skills

    Outlier

    Naperville, IL
    1 day ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will participate in live conversations with AI voice models, evaluate image and video prompts, and explain issues in writing for feedback to improve... 
    Remote job
    English language skills
    Weekly pay
    Flexible hours

    Outlier

    Naperville, IL
    1 day ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model and score each exchange, compare generated...  ...writing what looked or sounded off, all remotely and on your own schedule. At Outlier, your... 
    Remote job
    English language skills

    Outlier

    Fort Worth, TX
    1 day ago
  • Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set... 
    Remote job
    English language skills
    Weekly pay
    Freelance
    Flexible hours

    Outlier (by Scale AI)

    New York, NY
    4 days ago
  •  ...seeking contributors to test and evaluate AI chatbots through structured...  .... You will also engage in voice-based interactions when required...  ...each task. The role is fully remote with flexible hours, ideal...  ...Indonesian fluency and strong English skills, plus hands-on AI experience... 
    Remote job
    English language skills
    Flexible hours

    Productive Playhouse Inc.

    New York, NY
    2 days ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible...  ...schedule. You will roleplay with AI voice models, rate exchanges for naturalness and...  ...improve AI reasoning and output. Remote, with weekly payments. #J-18808-Ljbffr... 
    Remote job
    English language skills
    Weekly pay
    Flexible hours

    Outlier

    Tempe, AZ
    1 day ago
  • Remotebridge is seeking a British English Voice Expert to support an AI training project by evaluating British English audio recordings for naturalness and pronunciation...  ...feedback following project guidelines. This remote contract role requires native command, attention... 
    Remote job
    English language skills
    Contract work

    Frontier AI Lab

    New York, NY
    2 days ago
  • $20 per hour

    Productive Playhouse Inc. seeks a remote AI evaluation tester to assess chatbots and language models through structured conversations, with occasional voice-based tasks. You will submit deliverables...  ...(South Korea dialect) and strong English skills, 18+ years old, hands-on AI... 
    Remote job
    English language skills
    Flexible hours

    Productive Playhouse Inc.

    New York, NY
    3 days ago
  • RWS is seeking a Speech AI Evaluation Specialist to work remotely from anywhere. The role involves short voice interactions with AI models, following given scenarios, and evaluating responses...  ...or Chinese Simplified, with strong English skills (B2-C2). #J-18808-Ljbffr Rws
    Remote job
    English language skills
    Part time
    Freelance
    Immediate start
    Flexible hours

    Rws

    Tallahassee, FL
    4 days ago
  • $40 - $65 per hour

    Crossing Hurdles is seeking a British English Voice Expert to evaluate short British English audio recordings and...  ...pronunciation, and accents. The role is remote and paid per hour. You will provide structured feedback to support AI training and evaluation projects and ensure... 
    Remote job
    English language skills
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • RWS is seeking a Speech AI Evaluation Specialist to support the...  ...freelance, part-time role is remote from Korea with flexible...  .... You will conduct short voice conversations with AI models, follow scenarios,...  ...Korean speakers with strong English skills, experience in data... 
    Remote job
    English language skills
    Part time
    Freelance
    Immediate start
    Flexible hours

    Rws

    Tallahassee, FL
    4 days ago
  • $15 per hour

    Outlier, operating under Scale AI, seeks detail-oriented English speakers to review AI-generated media...  ...in live conversations with AI voice models and evaluating image, video, and audio outputs....  ...in English. Role is freelance and remote with flexible scheduling, paying... 
    Remote work
    English language skills
    Hourly pay
    Freelance
    Flexible hours

    Outlier (by Scale AI)

    New York, NY
    4 days ago
  • $17 per hour

     ...a Music Audio Expert (Thai) for a remote contract role. Compensation is $17/...  ...degree in music, and proficiency in Thai and English. You will evaluate AI-generated lyrics and voice outputs and collaborate with AI teams to improve data and models. #J-18808-Ljbffr Mercor
    Remote job
    English language skills
    Contract work
    Immediate start
    10 hours per week

    Mercor

    San Francisco, CA
    2 days ago
  • RWS is seeking a Speech AI Evaluation Specialist to support the improvement...  ...is a freelance, part-time remote role with a flexible schedule...  ...You will participate in short voice conversations, follow prompts...  ...to project guidelines. English proficiency (B2-C2) and native... 
    Remote job
    English language skills
    Part time
    Freelance
    Immediate start
    Flexible hours

    Rws

    Tallahassee, FL
    4 days ago
  • RWS is seeking a Speech AI Evaluation Specialist to support the...  ...Vietnamese (USA). This freelance, remote, part-time role offers...  ...participate in short voice conversations with AI models, follow prompts, evaluate...  ...speakers with fluent English (B2-C2). #J-18808-Ljbffr... 
    Remote job
    English language skills
    Part time
    Freelance
    Immediate start
    Flexible hours

    RWS

    Seattle, WA
    1 day ago
  • $20 - $26 per hour

     .... is seeking fluent Marathi speakers to act as evaluators. You will listen to AI-generated audio, compare text and voice snippets, and assess naturalness and authenticity...  ...and be comfortable following instructions in English. #J-18808-Ljbffr Prolific Academic Ltd
    Remote job
    English language skills
    Work from home

    Prolific Academic Ltd

    New York, NY
    3 days ago
  • CNTXT, Inc. is seeking a fully remote hourly contractor to support AI data and language projects. You will work on prompts, voice samples, data annotation, LLM evaluation, and localization QA for American English content. The ideal candidate is a native American English... 
    Remote job
    English language skills
    Hourly pay
    For contractors

    CNTXT, Inc.

    New York, NY
    2 days ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with AI voice models, and score each exchange. You will compare AI-generated...  ...of observed issues, all on a flexible, remote schedule. Responsibilities include rating... 
    Remote job
    English language skills
    Flexible hours

    Outlier

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Voice Model Evaluator - English (Remote). Be the first to apply!