Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Evaluation Specialist

Outlier

Outlier is hiring remote-based evaluators to review AI-generated media by holding live conversations with AI voice models, ranking outputs, and explaining discrepancies in writing. You can work on your own schedule from home or while traveling, with pay per hour and additional incentives.

Ideal candidates are fluent in English, detail-oriented, and capable of clear, concise explanations. This contract role offers freedom, flexible hours, and the chance to influence how AI systems interpret media.

#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist in Seattle, WA vacancy
  •  ...an experienced Employment Law Specialist to contribute to a project focused...  ..., and reliability of advanced AI systems. In this contractor...  ...employment law scenarios, evaluate AI-generated legal analyses and...  ...written English LOCATION: Remote — United States only Key... 
    Remote work
    Contract work
    For contractors

    Gramian Consulting Group

    Remote
    13 days ago
  •  ...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video pairs, and explain what’s off, helping improve AI systems. Ideal candidates... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Outlier

    Fresno, CA
    1 hour ago
  • $41.6k - $114.4k

     ...and inference provider focused on realtime AI for consumer-facing applications. We...  ...engineers can act on For multilingual roles: evaluate pronunciation, dialect accuracy, and...  ...evaluation or annotation work Location: Remote within the United States. Compensation... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    Inworld

    Remote
    3 days ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models...  ...all on your own schedule. Responsibilities include evaluating outputs for naturalness and adherence, ranking... 
    Remote work

    Outlier

    Tulsa, OK
    1 hour ago
  •  ...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media from the comfort of a remote setup. You will participate in live conversations with AI voice models, compare AI-generated media pairs, and describe what looks or sounds off in written form.... 
    Remote work
    Flexible hours

    Outlier

    Bakersfield, CA
    1 hour ago
  • $15 per hour

     ...Outlier is hiring detail-oriented English speakers to evaluate AI-generated media remotely and on a flexible schedule. You will lead live conversations with AI voice models, compare image and video outputs, and explain what is off, evaluating adherence to prompts and... 
    Remote work
    Hourly pay
    Freelance
    Flexible hours

    Outlier

    Champaign, IL
    1 hour ago
  •  ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will roleplay live conversations...  ...how advanced AI systems reason and learn by providing evaluation feedback. This is a freelance, 1099 opportunity with... 
    Remote work
    Freelance
    Flexible hours

    Outlier

    Fort Lauderdale, FL
    1 hour ago
  • $15 per hour

     ...Outlier is recruiting detail-oriented reviewers to evaluate AI-generated media from home. You will hold live conversations with AI voice...  ...describe what looks off in concise English explanations. This remote opportunity offers flexible hours and weekly payments. You can... 
    Remote work
    Weekly pay
    Flexible hours

    Outlier

    Des Moines, IA
    1 hour ago
  • $15 per hour

     ...Outlier is hiring detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will hold live conversations...  ...on expertise. Contributors help shape AI systems by evaluating realism, prompt adherence, and overall quality across images... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    Flexible hours

    Outlier

    Ithaca, NY
    1 hour ago
  • $15 per hour

     ...detail-oriented English speakers to review AI-generated media and rate how well...  ...explain in writing what looked off, all remotely and on your own schedule. Work from home...  ...ll get free access to leading LLMs to aid evaluations as you contribute to AI improvements. #J... 
    Remote job
    Weekly pay
    Work from home
    Flexible hours

    Outlier

    Bellevue, WA
    2 days ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor... 
    Remote work
    Contract work
    Summer work

    Mercor

    Seattle, WA
    9 days ago
  • $41.6k

     ...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models...  ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    14 days ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Chicago, IL
    22 days ago
  • $18 per hour

    We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified (USA) . Job Type: Freelance...  ...-home parent, gig worker, or professional seeking flexible remote work? Are you interested in shaping the development and... 
    Remote work
    Hourly pay
    Extra income
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging... 
    Remote job

    AuraOne

    New York, NY
    1 day ago
  • Rex.zone is seeking a Remote AI Data Annotation Specialist to support end-to-end LLM training pipelines and model evaluation datasets. You will apply detailed rubrics to improve data quality and model reliability, working asynchronously from home in the US. You will label... 
    Remote job
    Work from home

    Rex.zone

    Detroit, MI
    2 days ago
  • ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models. The role requires clear American... 
    Remote job
    For contractors

    Executive Staff Recruiters / ESR Healthcare

    New York, NY
    13 hours ago
  • $15 per hour

    Outlier is seeking detail-oriented English speakers to review AI-generated media on a remote, flexible schedule. You will hold live conversations...  .... You’ll review tasks across image, video, and audio evaluations, and contribute to an evaluation loop #J-18808-Ljbffr Outlier
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Dallas, TX
    2 days ago
  • AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll... 
    Remote job
    For contractors

    YO AI Labs

    Austin, TX
    3 days ago
  •  ...detail-oriented English speakers to review AI-generated media from the comfort of your...  ...on your schedule. As part of Outlier’s evaluation loop, your insights help shape how advanced...  ...is a freelance, 1099 opportunity with remote work and incentives. #J-18808-Ljbffr Outlier
    Remote job
    Freelance

    Outlier

    Overland Park, KS
    2 days ago
  • Mercor is seeking an Electrical & Electronics Expert for a remote, part-time contract role at $50/hour, supporting 15-20 hours per week. You will evaluate AI models on visual document understanding within the Electrical & Electronics domain and author tasks with clear... 
    Remote job
    Contract work
    Part time

    mercor

    New York, NY
    3 days ago
  •  ...detail-oriented English speakers to review AI-generated media. You will hold live...  ...and videos, and explain what’s off, all remotely and on your own schedule. This freelance,...  ...flexible hours, and get paid weekly for your evaluations. Access to leading LLMs is provided at no... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Phoenix, AZ
    2 days ago
  • $15 per hour

     ...detail-oriented English speakers to review AI-generated media. You will hold live...  ...weekly payments and additional incentives. You can work remotely from anywhere with no minimum hours, and you’ll gain access to leading LLMs to aid your evaluations. #J-18808-Ljbffr Outlier
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Flexible hours

    Outlier

    Evanston, IL
    2 days ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will engage in live...  ...explain in writing what looked or sounded off. Role focuses on evaluating realism, adherence to prompts, and quality, with paid... 
    Remote job
    Weekly pay
    Contract work
    Flexible hours

    Outlier

    Austin, TX
    2 days ago
  • A forward-thinking tech company is seeking an AI Trainer specializing in visual and graphic design to evaluate AI outputs. Responsibilities include assessing design...  ...with design tools like Figma and Adobe. This remote role offers the chance to impact AI development while... 
    Remote work
    Flexible hours

    Prolific

    San Francisco, CA
    1 hour ago
  • A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities... 
    Remote job
    For contractors
    Flexible hours

    Turing

    Seattle, WA
    2 days ago
  • AuraOne, Inc. seeks a remote contractor to review voice actor CX Agent Voice Cloning Northern UK evaluation outputs. You will label and rate outputs, compare paired responses, and provide structured feedback to retrain the model. Responsibilities include applying rubrics... 
    Remote job
    For contractors
    Flexible hours

    AuraOne, Inc.

    New York, NY
    2 days ago
  • A leading research accelerator is seeking a Geospatial Expert to enhance AI systems through advanced geospatial analysis. This entry-level, remote role involves evaluating geospatial datasets and supporting tasks aligned with crisis management and agriculture. Candidates... 
    Remote job
    Contract work

    Turing

    Seattle, WA
    5 days ago
  • Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability. Responsibilities include assessing accuracy, helpfulness, and instruction... 
    Remote job
    For contractors

    Anyone AI Inc.

    New York, NY
    1 day ago
  •  ...detail-oriented English speakers to review AI-generated media. You will roleplay live...  ...in writing what looks or sounds off, all remotely and on your own schedule. At Outlier, your...  ...reason, learn, and improve through evaluation and feedback. This freelance opportunity... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Scottsdale, AZ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluation Specialist. Be the first to apply!