Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Specialist - Remote, Flexible Hours

Outlier

Austin, TX
  • Remote job

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos, and explain in writing what looked or sounded off, all remotely and on your own schedule. At Outlier, your reviews help shape how advanced AI systems reason, learn, and improve. This flexible, remote opportunity pays per task with weekly payouts and free access to leading LLMs, plus performance #J-18808-Ljbffr Outlier

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist - Remote, Flexible Hours in Austin, TX vacancy
  • $60 per hour

    Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. If you have a CS research or technical analysis...  ...participant and paid for tasks. Participants can expect flexible hours and the ability to work from home. Prolific... 
    Remote job
    Flexible hours
    Work from home

    Prolific Academic Ltd

    New York, NY
    2 days ago
  • A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities... 
    Remote job
    Flexible hours
    For contractors

    Turing

    Seattle, WA
    5 days ago
  •  ...keep their own judgments accurate. You will finish evaluation workflows and verify consistency across your judgments while assessing AI-generated voice, image and video content. The role is remote with flexible hours and project-based assignments. Applicants must have... 
    Remote job
    Flexible hours
    Freelance

    Hired

    New York, NY
    4 days ago
  • $30 per hour

    BANGLA AI EVALUATION SPECIALIST Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview Handshake is looking for Bangla speakers as it’s spoken in Singapore to help make AI responses more personalized. This is not a traditional... 
    Remote work
    Flexible hours
    Part time
    Local area

    Handshake

    New York, NY
    4 days ago
  • A leading AI research platform is seeking an AI Trainer with expertise in Graphic...  ...and Visual Design. The role involves evaluating designs, ensuring they meet...  ...This project offers competitive pay, flexible hours, and remote work options. #J-18808-Ljbffr Prolific
    Remote job
    Flexible hours

    Prolific

    Los Angeles, CA
    2 days ago
  • AI Trainer Jobs is seeking contributors for remote language evaluation work. You will assess Slovak translations and localization, rate model outputs, and provide...  ...answers to improve AI training. The role offers flexible hours, remote collaboration, and weekly payouts with... 
    Remote job
    Flexible hours
    For contractors

    DataAnnotation

    New York, NY
    4 days ago
  • $25 per hour

    Prolific is seeking AI Training Experts to help train and evaluate cutting‑edge AI models. You’ll complete paid tasks...  ..., with pay up to $25 per hour. Most tasks take about one hour, though...  ..., and you can work from home with flexible hours. Applicants should have verifiable... 
    Remote job
    Flexible hours
    Hourly pay
    Work from home

    Prolific Academic Ltd

    New York, NY
    5 days ago
  •  ...Prolific Academic Ltd. is seeking Registered Nurses to help train and evaluate AI models. You’ll be invited to join Prolific as a Domain Expert participant and get paid to perform AI tasks from home. A quick skills/eligibility screener is required, and researchers may... 
    Remote work
    Flexible hours

    Prolific Academic Ltd

    United States
    3 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  .../ environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...  ...Work independently with flexible hours to meet deadlines and... 
    Remote work
    Flexible hours
    Contract work
    Summer work
    Work at office

    Mercor

    Washington DC
    29 days ago
  • $102k - $120k

     ...company, is looking for a AI Evaluation Specialist . The AI Evaluation Specialist...  ...PTO / Vacation – 5.67 hours accrued per pay period / 13...  ...Insurance Spending Account Flexible Spending Account Health...  ...Teleworking Details Remote - Continental US... 
    Remote work
    Flexible hours
    Full time
    Contract work
    Temporary work

    Chenega Corporation

    Remote
    8 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  .../ regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...  ...Work independently with flexible hours to meet deadlines.... 
    Remote work
    Flexible hours
    Contract work
    Summer work
    Work at office

    Mercor

    Chicago, IL
    29 days ago
  •  ...is seeking strong analytical thinkers to evaluate AI-generated responses and provide detailed...  ...reasoning and work independently in a remote setting. The role emphasizes clear, well...  ...and adherence to established guidelines. Flexible, project-based work with competitive compensation... 
    Remote job
    Flexible hours

    Synthires

    Austin, TX
    2 days ago
  • Outlier Ai is seeking detail-oriented, fluent English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to determine which follows prompts... 
    Remote job
    Flexible hours

    Outlier Ai

    New York, NY
    6 days ago
  • Synthires seeks analytical thinkers to contribute to advanced AI research and evaluation projects. You will evaluate AI-generated responses, assess...  ...written communication, and the ability to work independently in a remote, project-based role. #J-18808-Ljbffr Synthires
    Remote job
    Flexible hours

    Synthires

    Sacramento, CA
    2 days ago
  • $18 per hour

    We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content...  ...) Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want. Start...  ..., or professional seeking flexible remote work? Are you interested in shaping... 
    Remote work
    Flexible hours
    Hourly pay
    Extra income
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week

    RWS

    Austin, TX
    5 days ago
  • DataAnnotation is where 100k+ experts train the world’s leading AI models. You’ll evaluate AI on Slovak translation tasks, review real projects, and help train the next generation of AI. Flexible, remote, and always project-available. You’ll review frontier models, identify... 
    Remote job
    Flexible hours

    DataAnnotation

    Detroit, MI
    4 days ago
  • $60 per hour

     ...time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong...  ...data formats. Candidates will review evaluation tasks, identify inconsistencies, and...  ...role offers competitive pay up to $60/hour and is ideal for those in academia or... 
    Remote job
    Flexible hours
    Part time

    Mindrift

    Kansas City, MO
    5 days ago
  • $40 per hour

     ...All Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up AI EVALUATION SPECIALIST Sign up now Up to $40/hr Depending on the project Associate's , Bachelor's Remote Part-time Flexible hours About Handshake AI Overview Handshake is seeking... 
    Remote work
    Flexible hours
    Temporary work
    Part time

    Handshake

    San Francisco, CA
    a month ago
  • $50 per hour

     ...seeking Product Designers and UX Specialists to join our Expert Network to train and evaluate AI models using real design...  ...can reach up to $50 per hour, with many tasks requiring about...  ...tasks exist. You can work remotely from home in a flexible schedule. #J-18808-Ljbffr Prolific... 
    Remote job
    Flexible hours
    Hourly pay
    Work from home

    Prolific Academic Ltd

    New York, NY
    5 days ago
  • $40 per hour

    DataAnnotation is seeking contributors to evaluate AI translations in Slovak, focusing on localization and cultural nuance across real...  ..., training-quality feedback from a linguistic perspective. Remote, flexible work with project-based tasks. No degree required;... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • Mindrift is seeking licensed physicians to participate in a flexible, remote, project-based evaluation of clinical AI materials. You will review written cases, assess diagnostic and treatment decisions, and provide structured reasoning for each evaluation. There is no employment... 
    Remote job
    Flexible hours

    Toloka

    Columbus, OH
    5 days ago
  •  ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include...  ...support AI training datasets. LLM evaluation: reviewing AI-generated responses for... 
    Remote work
    Flexible hours
    Hourly pay
    Temporary work
    For contractors

    CNTXT AI

    Brooklyn, NY
    11 days ago
  •  ...seeking a Biology Subject Matter Expert (AI Training) to design advanced...  ...rigorous, step‑by‑step solutions for evaluating AI reasoning. You will assess AI...  ...guide dataset improvements. This is a remote, hourly contract role with flexible scheduling and global collaboration... 
    Remote job
    Flexible hours
    Hourly pay
    Contract work

    Alignerr Corp.

    Seattle, WA
    5 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...Compensation: $150/hour Location: Remote Commitment: 1020 hours...  ...Role Responsibilities Evaluate and compare AI-generated responses...  ...Work independently with flexible hours to meet deadlines.... 
    Remote work
    Flexible hours
    Full time
    Contract work
    Summer work
    Immediate start

    Mercor

    Houston, TX
    27 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  .../ regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...  ...asynchronously to meet deadlines with flexible hours . Qualifications... 
    Remote work
    Flexible hours
    Contract work
    Summer work
    Work at office

    Mercor

    Chicago, IL
    5 days ago
  •  ...seeking a Social Sciences PhD Expert for a remote part-time role, requiring strong...  ...creating historically relevant prompts, evaluating AI outputs, and contributing to research initiatives...  ...This is a project-based position with flexible hours, offering competitive pay. #J-18808-... 
    Remote work
    Flexible hours
    Part time

    Crossing Hurdles

    United States
    5 days ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  •  ...Evaluating enterprise AI tools and capabilities, the full-time AI Evaluation Specialist will assess effectiveness, safety, usability, and readiness for business adoption while working remotely. Key responsibilities Plan and execute hands-on evaluations of AI tools using... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    1 day ago
  • Outlier Ai is seeking detail-oriented English speakers to review AI-generated media on a flexible, freelance basis. You will roleplay live conversations with an AI voice model, rate naturalness, and compare AI-generated visuals to prompts. Responsibilities include inspecting... 
    Remote job
    Flexible hours
    Freelance

    Outlier Ai

    Austin, TX
    4 days ago
  • OpenTrain AI, Inc. is hiring a remote contractor with theater and voice acting expertise to create prompts, evaluate AI responses, and judge performance in vocal arts. The role offers asynchronous, flexible scheduling and independent project work. Responsibilities include... 
    Remote job
    Flexible hours
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Specialist - Remote, Flexible Hours. Be the first to apply!