Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote - AI Evaluator - English

$15 per hour

Outlier

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?

About the opportunity:

  • Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
  • This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by…

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:

  • Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
  • Pursuing or holding a Bachelor's degree or above
  • Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
  • Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
  • Experience writing short, evidence-based explanations or reviews
  • Comfortable making a clear decision when both options have flaws

What you'll need:

  • A computer with a reliable internet connection and headphones
  • A quiet place to talk for projects that involve live conversation
  • Your ratings and written explanations must be your own work; AI tools can't be used to write them
  • Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:

  • Project work: Earn up to USD $15 per hour for core project work
  • Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
  • Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.

PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.

This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Remote - AI Evaluator - English in Huntsville, AL vacancy
  • $15 per hour

     ...s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...models This freelance opportunity is remote and hours are flexible, so you can work... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Freelance
    Internship
    Work from home
    Flexible hours

    Outlier

    Providence, RI
    16 hours ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute...  ...subtle errors in quantitative reasoning Fluent written English with the ability to communicate complex ideas clearly... 
    Remote work
    English language skills
    Full time
    Contract work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  • $50 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: English Language and Literature Expert Type...  ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    San Jose, CA
    19 days ago
  • Synthires is seeking a remote contract evaluator to support an AI training project. You will review short English audio recordings, judge naturalness for regional accents, and provide structured feedback to improve AI speech quality. Ideal candidates have native-level... 
    Remote job
    English language skills
    Hourly pay
    Contract work

    Synthires

    Sacramento, CA
    2 days ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Remote job
    English language skills
    Work from home

    RWS

    New York, NY
    2 days ago
  • Create challenging prompts and evaluate large language model responses...  ...-time role requires strong English writing, analytical thinking,...  ...team management experience. 100% Remote Contract, part-time Engagement...  ...execution to assess how well AI handles management-related topics... 
    Remote work
    English language skills
    Contract work
    Part time
    For contractors
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $20 - $30 per hour

    A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback...  ...communication abilities in English. This position allows for... 
    Remote job
    English language skills
    Hourly pay

    Crossing Hurdles

    New York, NY
    12 hours ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language... 
    Remote job
    English language skills
    Hourly pay
    Part time
    For contractors

    OpenKrill

    New York, NY
    4 days ago
  • Lever, Inc. is seeking native Telugu speakers for a remote AI linguistic evaluation project. You will engage with an AI assistant in Telugu, translate prompts from English, and assess the linguistic accuracy and cultural relevance of AI outputs. This freelance role offers... 
    Remote job
    English language skills
    Freelance
    Immediate start
    Flexible hours

    RWS Group

    Dallas, TX
    3 days ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time contractor role offers up to 3 months of work and compensation in the $7-$12/hour range. You’ll interact... 
    Remote job
    English language skills
    Part time
    For contractors

    OpenKrill

    New York, NY
    4 days ago
  • RWS is seeking AI Linguistic Evaluators to assess Tamil-language outputs for a short-term collaboration. This remote role is open to applicants in the United States, with a flexible...  ...assistant in Tamil, translate prompts from English, and evaluate AI-generated responses for... 
    Remote job
    English language skills
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    Edison, NJ
    12 hours ago
  • $15 per hour

     ...that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking...  ...and regional expressions. The position is remote and hourly, begins immediately, and... 
    Remote job
    English language skills
    Hourly pay
    Immediate start
    Flexible hours

    SaidGig

    New York, NY
    5 days ago
  • $18 per hour

    Freelance, remote from the United States Flexible schedule, approximately 10-15 total hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance... 
    Remote job
    English language skills
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    4 days ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language...  ...role requires fluent Tamil and English, high emotional intelligence, and...  ...for tasks, with flexible hours and remote work options. J-18808-Ljbffr Prolific
    Remote job
    English language skills
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • $18 per hour

    RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote, freelance role offers flexible scheduling with an estimated...  ...native Marathi speakers with strong English, attention to linguistic nuance, and... 
    Remote job
    English language skills
    Freelance
    Immediate start
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday...  ...5-20 hours weekly, have strong online research skills, English and Thai proficiency, and the discipline to meet SLAs in a... 
    Remote job
    English language skills
    Part time
    Work from home
    Flexible hours

    RWS

    New York, NY
    2 days ago
  • Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context.... 
    Remote job
    English language skills
    For contractors
    Local area

    Embedded Shishya

    New York, NY
    4 days ago
  • $23 per hour

    RWS is seeking a web-savvy search evaluator to influence global AI search. You will test and evaluate how our...  ...major search engines. This flexible, remote, part-time role is open to...  ...hours weekly; strong online research and English/Norwegian language skills are required... 
    Remote job
    English language skills
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    2 days ago
  • Volga Partners is seeking an AI Language Quality Evaluator fluent in Greek and English to assess localization accuracy across UI texts and app screens. This freelance, task-based role offers flexible remote engagement with on-demand tasks and no guaranteed hours. As part... 
    Remote job
    English language skills
    Freelance
    Flexible hours

    Employers from Greece

    New York, NY
    12 hours ago
  • $30 - $50 per hour

     ...A leading AI training company is seeking a Remote Annotator to support human-in-the-loop AI training workflows...  ...reviewing labeled datasets, performing evaluations for helpfulness and safety, and...  ...quality in training data. Strong written English and attention to detail are... 
    Remote work
    English language skills
    Hourly pay

    Rex USA

    New York, NY
    5 days ago
  • RWS TrainAI is seeking a web-savvy evaluator to improve AI search data from real users. You will test search results and provide feedback on text...  ...residing in Austria, strong online research skills, English and German proficiency, and a commitment of 5-20 hours per... 
    Remote job
    English language skills
    Part time

    RWS TrainAI

    New York, NY
    2 days ago
  • $30 per hour

    RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text, audio, images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in Switzerland... 
    Remote job
    English language skills
    Part time
    Freelance
    Flexible hours

    OpenKrill

    New York, NY
    3 days ago
  • $13 per hour

     ...a flexible, part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...major search engines and platforms. This remote role is open to freelancers, students...  .... Language requirements include English and Hebrew; Israeli residents preferred... 
    Remote job
    English language skills
    Extra income
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    2 days ago
  • $18 per hour

    Description: Interact with an AI assistant in Telugu. Translate English prompts into Telugu and use them to interact with the AI application. Evaluate AI-generated responses according to project...  ..., or macOS. Availability to work remotely from the United States on a... 
    Remote work
    English language skills
    Hourly pay
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS Group

    New York, NY
    2 days ago
  • $18 per hour

    AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible Immediately Approximately 10-1...  ...native-level speaker of Telugu with strong English skills and a keen eye for language quality... 
    Remote job
    English language skills
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    New York, NY
    4 days ago
  • $18 per hour

     ...recruiter directly. We are looking for AI Linguistic Evaluators to assess how effectively an AI...  ...Job Type: Freelance Location: Remote from the United States Work Schedule...  ...level speaker of Telugu with strong English skills and a keen eye for language quality... 
    Remote work
    English language skills
    Full time
    Freelance
    Immediate start
    Flexible hours

    RWS

    Dallas, TX
    2 days ago
  • at Volga Partners Remote | Independent Contractor | Global AI Project | Flexible Engagement Role Overview We are seeking detail-oriented AI Language Quality Evaluator with fluency in Greek and English to evaluate the accuracy of AI models that detect localization and UI... 
    Remote work
    English language skills
    Hourly pay
    Extra income
    For contractors
    Freelance
    Currently hiring
    Local area
    Flexible hours

    Employers from Greece

    New York, NY
    12 hours ago
  • YO AI Labs is seeking a Creative & Design Specialist (Contractor) to support projects across graphic design, multimedia production,...  ...Resolve, and Canva. Must have prior paid experience in AI-human data work and strong English communication. #J-18808-Ljbffr YO AI Labs
    Remote job
    English language skills
    For contractors

    YO AI Labs

    Seattle, WA
    1 day ago
  • $100 - $120 per unit

     ...technical talent with leading AI research labs. Headquartered in...  ...Fan - Live MLB Game AI Evaluator (US) Type Contract Compensation $100-$120 per task Location Remote Commitment Event-based Role Responsibilities...  ...web search. Strong written English and sharp attention to detail.... 
    Remote work
    English language skills
    Contract work
    Work experience placement
    Summer work

    mercor

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking experts to evaluate AI responses to questions about explosives and energetic materials. You will...  ...relevant degree or certification. This is a remote, project-based contractor role requiring English proficiency. #J-18808-Ljbffr OpenTrain AI,... 
    Remote job
    English language skills
    For contractors

    OpenTrain AI, Inc.

    Brooklyn, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote - AI Evaluator - English. Be the first to apply!