Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Evaluation Specialist — Spot AI Mistakes

Outlier

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video pairs, and explain what’s off, helping improve AI systems.

Ideal candidates are fluent in English, have strong writing skills, and can commit to regular, schedule-based work from home. Prior degrees are favorable, but not required, with competitive hourly pay.

#J-18808-Ljbffr
Vacancy posted 40 minutes ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist — Spot AI Mistakes in Fresno, CA vacancy
  •  ...experienced Employment Law Specialist to contribute to a...  ...reliability of advanced AI systems. In this contractor...  ...law scenarios, evaluate AI-generated legal analyses...  ...written English LOCATION: Remote — United States only...  ...Apply strong issue-spotting and critical analysis skills... 
    Remote work
    Contract work
    For contractors

    Gramian Consulting Group

    Remote
    13 days ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media from home. You will host live conversations with AI...  ...video pairs, and explain what’s off in writing. The role is fully remote with flexible hours and up to $15/hr, paid weekly via ACH, PayPal... 
    Remote work
    Weekly pay
    Flexible hours

    Outlier

    Lubbock, TX
    40 minutes ago
  •  ...expertise to support the training and evaluation of next-generation AI systems. You will analyze tax law...  ...Excellent written English LOCATION: Remote — United States only Key...  ...law. Strong legal reasoning, issue-spotting, and legal document review skills.... 
    Remote work
    Contract work

    Gramian Consulting Group

    Remote
    13 days ago
  • Ophthalmology AI Evaluation Specialist — Clinical Reasoning Review is a remote evaluation track for reviewing ophthalmology ai evaluation evaluation prompts and responses...  ...lead. Propose a rubric clarification after spotting a recurring failure mode. Nice to have... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  •  ...Category: Frontier Model Evaluation Pay: Hourly rate confirmed...  ...process Location: Remote US-eligible Contractor AI Trainer & Evaluator is a...  ...rubric clarification after spotting a recurring failure mode....  ...eligible. Remote Independent specialist contractor. Employment type... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations...  ...or sounded off in writing. Responsibilities include evaluating images and videos, inspecting outputs, and describing in... 
    Remote work
    Flexible hours

    Outlier

    Tacoma, WA
    40 minutes ago
  •  ...Outlier seeks detail-oriented reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare...  ...and video outputs, and explain in writing what was off, remotely and on your own schedule. Applicants should have fluent English... 
    Remote work
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Bozeman, MT
    40 minutes ago
  • $41.6k - $114.4k

     ...and inference provider focused on realtime AI for consumer-facing applications. We...  ...engineers can act on For multilingual roles: evaluate pronunciation, dialect accuracy, and...  ...evaluation or annotation work Location: Remote within the United States. Compensation... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    Inworld

    Remote
    3 days ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models...  ...all on your own schedule. Responsibilities include evaluating outputs for naturalness and adherence, ranking... 
    Remote work

    Outlier

    Tulsa, OK
    40 minutes ago
  •  ...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media from the comfort of a remote setup. You will participate in live conversations with AI voice models, compare AI-generated media pairs, and describe what looks or sounds off in written form.... 
    Remote work
    Flexible hours

    Outlier

    Bakersfield, CA
    40 minutes ago
  •  ...Outlier is hiring remote-based evaluators to review AI-generated media by holding live conversations with AI voice models, ranking outputs, and explaining discrepancies in writing. You can work on your own schedule from home or while traveling, with pay per hour and additional... 
    Remote work
    Hourly pay
    Contract work
    Flexible hours

    Outlier

    Seattle, WA
    40 minutes ago
  •  ...detail-oriented English speakers to review AI-generated media. You will hold live...  ...video pairs, and explain what’s off. Work remotely on your own schedule across multiple projects...  ...for naturalness, usefulness, and realism, spot issues like distorted motion or text errors... 
    Remote work
    Freelance
    Flexible hours

    Outlier

    Cheyenne, WY
    40 minutes ago
  • $15 per hour

     ...Outlier is hiring detail-oriented English speakers to evaluate AI-generated media remotely and on a flexible schedule. You will lead live conversations with AI voice models, compare image and video outputs, and explain what is off, evaluating adherence to prompts and... 
    Remote work
    Hourly pay
    Freelance
    Flexible hours

    Outlier

    Champaign, IL
    40 minutes ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will roleplay live conversations...  ...how advanced AI systems reason and learn by providing evaluation feedback. This is a freelance, 1099 opportunity with... 
    Remote work
    Freelance
    Flexible hours

    Outlier

    Fort Lauderdale, FL
    40 minutes ago
  • $15 per hour

     ...Outlier is recruiting detail-oriented reviewers to evaluate AI-generated media from home. You will hold live conversations with AI voice...  ...describe what looks off in concise English explanations. This remote opportunity offers flexible hours and weekly payments. You can... 
    Remote work
    Weekly pay
    Flexible hours

    Outlier

    Des Moines, IA
    40 minutes ago
  •  ...detail-oriented English speakers to review AI-generated media. You will roleplay live...  ...in writing what looked or sounded off, all remotely and on your own schedule. Ideal candidates...  ..., and patience to replay or zoom in to spot issues like artifacts or audio mismatches.... 
    Remote work
    Weekly pay
    Contract work
    Flexible hours

    Outlier

    Little Rock, AR
    40 minutes ago
  • $15 per hour

     ...detail-oriented English speakers to review AI-generated media and rate how well...  ...explain in writing what looked off, all remotely and on your own schedule. Work from home...  ...ll get free access to leading LLMs to aid evaluations as you contribute to AI improvements. #J... 
    Remote job
    Weekly pay
    Work from home
    Flexible hours

    Outlier

    Bellevue, WA
    2 days ago
  • $15 per hour

     ...Outlier is hiring detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will hold live conversations...  ...on expertise. Contributors help shape AI systems by evaluating realism, prompt adherence, and overall quality across images... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    Flexible hours

    Outlier

    Ithaca, NY
    40 minutes ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor... 
    Remote work
    Contract work
    Summer work

    Mercor

    Philadelphia, PA
    19 days ago
  • $41.6k

     ...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models...  ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    14 days ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Chicago, IL
    22 days ago
  • $18 per hour

    We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified (USA) . Job Type: Freelance...  ...-home parent, gig worker, or professional seeking flexible remote work? Are you interested in shaping the development and... 
    Remote work
    Hourly pay
    Extra income
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging... 
    Remote job

    AuraOne

    New York, NY
    1 day ago
  • A leading research accelerator is seeking a Geospatial Expert to enhance AI systems through advanced geospatial analysis. This entry-level, remote role involves evaluating geospatial datasets and supporting tasks aligned with crisis management and agriculture. Candidates... 
    Remote job
    Contract work

    Turing

    Seattle, WA
    5 days ago
  • AuraOne, Inc. seeks a remote contractor to review voice actor CX Agent Voice Cloning Northern UK evaluation outputs. You will label and rate outputs, compare paired responses, and provide structured feedback to retrain the model. Responsibilities include applying rubrics... 
    Remote job
    For contractors
    Flexible hours

    AuraOne, Inc.

    New York, NY
    2 days ago
  •  ...DataAnnotation is where 100k+ experts train the world’s leading AI models. You’ll evaluate AI on Slovak translation tasks, review real projects, and help train the next generation of AI. Flexible, remote, and always project-available. You’ll review frontier models,... 
    Remote work
    Flexible hours

    DataAnnotation

    Detroit, MI
    40 minutes ago
  • A forward-thinking tech company is seeking an AI Trainer specializing in visual and graphic design to evaluate AI outputs. Responsibilities include assessing design...  ...with design tools like Figma and Adobe. This remote role offers the chance to impact AI development while... 
    Remote work
    Flexible hours

    Prolific

    San Francisco, CA
    40 minutes ago
  • A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities... 
    Remote job
    For contractors
    Flexible hours

    Turing

    Seattle, WA
    2 days ago
  •  ...seeking detail-oriented English speakers to review AI-generated media from the comfort of their home on...  ...and explain in writing what looked or sounded off, remotely and on your own schedule. As part of Outlier’s evaluation loop, your work helps shape how advanced AI... 
    Remote job
    Flexible hours

    Outlier

    Newark, NJ
    2 days ago
  •  ...detail-oriented English speakers to review AI-generated media from the comfort of your...  ...on your schedule. As part of Outlier’s evaluation loop, your insights help shape how advanced...  ...is a freelance, 1099 opportunity with remote work and incentives. #J-18808-Ljbffr Outlier
    Remote job
    Freelance

    Outlier

    Overland Park, KS
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluation Specialist — Spot AI Mistakes. Be the first to apply!