Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Work From Home AI Evaluator - English

$18 per hour

Scale AI

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?

About the opportunity:

  • Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
  • This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by…

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:

  • Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
  • Pursuing or holding a Bachelor's degree or above
  • Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
  • Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
  • Experience writing short, evidence-based explanations or reviews
  • Comfortable making a clear decision when both options have flaws

What you'll need:

  • A computer with a reliable internet connection and headphones
  • A quiet place to talk for projects that involve live conversation
  • Your ratings and written explanations must be your own work; AI tools can't be used to write them
  • Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:

  • Project work: Earn up to USD $18 per hour for core project work
  • Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
  • Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Work From Home AI Evaluator - English in Reno, NV vacancy
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    Work from home
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Boca Raton, FL
    6 hours ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Work from home
    English language skills
    Remote job

    RWS

    New York, NY
    3 days ago
  •  ...Gujarati speakers to act as evaluators for side-by-side evaluations...  ...will assess how naturally the AI captures Gujarati speech and...  ...flexible hours and the ability to work from home. Ideal candidates are fluent...  ...intuition and good English for reporting, and have a quiet... 
    Work from home
    English language skills
    Remote job
    Freelance
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  •  ...seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...major platforms. Ideal candidates work well from home in Thailand, commit 5-20 hours weekly...  ...strong online research skills, English and Thai proficiency, and the discipline... 
    Work from home
    English language skills
    Remote job
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets...  ...hour Location Remote/work from home, Georgia - Note: Even though the...  ...Experience & Requirements Fluent in English (written and spoken) Strong... 
    Work from home
    English language skills
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Aurora, CO
    6 hours ago
  • $100 - $160 per hour

     ...% remote • Part-time • Fully flexible schedule Work on the cutting edge of legal AI, on your own schedule, and get paid for the litigation judgment...  ..., along with dependable written communication in English • No AI experience needed. You bring the expertise; we... 
    English language skills
    Hourly pay
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI

    United States
    16 hours ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    United States
    6 hours ago
  • Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking regions... 
    English language skills
    Remote job
    Contract work
    10 hours per week

    mercor

    San Francisco, CA
    2 days ago
  • A leading global AI service provider is looking for a Search Quality Rater in Idaho,...  ...role where you'll use your search skills to evaluate how search engines respond to queries....  ..., a smartphone, and a personal computer, working up to 29 hours a week. Ideal for someone... 
    English language skills
    Part time
    Flexible hours

    RWS Group

    Boise, ID
    3 days ago
  •  ...PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to...  ...subtle errors in quantitative reasoning Fluent written English with the ability to communicate complex ideas clearly... 
    English language skills
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    4 days ago
  • $50k

    CSAA Insurance Group is hiring a Casualty Evaluator for a remote role spanning multiple states with the option to work from home. You will own cases, investigate, negotiate...  ...claims, strong analytical skills, and solid English communication. Occasional travel and extended... 
    Work from home
    English language skills
    Remote job

    CSAA

    New York, NY
    2 days ago
  • MarketLister, Inc. is seeking a Personalized Ads Evaluator to work from home and contribute to enhancing online advertising effectiveness. This...  ...meet basic requirements. Must be a USA resident for 3+ years with excellent English skills.J-18808-Ljbffr MarketLister, Inc.
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    MarketLister, Inc.

    Miami, FL
    7 days ago
  • $30 per hour

    RWS Group offers a flexible, part-time evaluator position focused on improving AI data for search engines. Work from home in Switzerland with a weekly 5-20 hour commitment, requiring English and Italian proficiency and the ability to sign an NDA. Compensation is up to 3... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    3 days ago
  •  ...Group is seeking a web-savvy evaluator to improve search results. You will work remotely from Israel,...  ...images, and videos to refine AI data used by global platforms. The role requires English and Hebrew proficiency, 5...  ...SLAs while working from home. No prior experience... 
    Work from home
    English language skills
    Remote job
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • $19 per hour

     ...flexible, detail-oriented Search Quality Evaluator to improve online search results for major platforms. Work from home in the Netherlands with English and Dutch proficiency, 5-20 hours per...  ...and videos, provide feedback to refine AI data used by search engines and social... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  • RWS in China offers a flexible, work-from-home part-time role to help improve AI models. You will assess content in English and Chinese (Simplified) on a 5-20 hour weekly schedule with pay up to $6 per hour. No prior experience required; training and an NDA are provided... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  •  ...layout, contributing to a better user experience. The role requires strong English and Japanese communication, familiarity with Japanese media and culture, and daily internet access. Works from home with flexible hours, ideal for candidates seeking meaningful project work... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    TELUS Digital

    New York, NY
    1 day ago
  •  ...is seeking a flexible, web-savvy evaluator to test how search engines...  ...audio, images and videos to improve AI data used by major platforms, while working from home. The role suits freelancers, students...  ...part-time, remote arrangement. English and Swedish language skills are... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $17 per hour

     ...technology people use every day. Our work creates the examples and feedback that...  ...consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and...  ...completed or in progress Excellent written English — clear, precise, well-organized... 
    English language skills
    Contract work
    Remote work
    Flexible hours

    Workada

    Sunset, LA
    2 days ago
  • $50k

    Job Title Casualty Evaluator Requisition Number R8039 Casualty Evaluator (Open) Location Colorado - Home Teleworkers Additional Locations Alabama...  ...success through meaningful work. We are actively hiring for...  ...and good command of the English language. Ability to function... 
    Work from home
    English language skills
    Work experience placement
    H1b
    Work at office
    Remote work
    Flexible hours
    Weekend work

    CSAA Insurance Group

    Sacramento, CA
    2 days ago
  • $18 per hour

     ...18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural...  ...-term freelance collaboration with flexible remote work from the United States. #J-18808-Ljbffr RWS
    English language skills
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    5 days ago
  • $20 - $30 per hour

     ...firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing...  ...detail, and excellent communication abilities in English. This position allows for flexibility, with a commitment... 
    English language skills
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    1 day ago
  • $60 per hour

     ...Engineers to join our Expert Network to train and evaluate AI models using real-world chemical knowledge. A quick...  ...hour. Tasks require about one hour of uninterrupted work, though many are shorter, and you can work from home with flexible hours. #J-18808-Ljbffr Prolific
    Work from home
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time contractor role offers up to 3 months of work and compensation in the $7-$12/hour range. You’ll interact... 
    English language skills
    Remote job
    Part time
    For contractors

    OpenKrill

    New York, NY
    5 days ago
  • SaidGig is seeking a remote, hourly independent contractor to evaluate AI-generated Thai music lyrics. You will compare outputs to published...  ...or journalism experience, good listening gear, and the ability to follow precise English directions. #J-18808-Ljbffr SaidGig
    English language skills
    Remote job
    Hourly pay
    For contractors

    SaidGig

    New York, NY
    1 day ago
  • $15 per hour

    SaidGig is seeking a role that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking quality, originality, and prompt adherence while considering linguistic... 
    English language skills
    Remote job
    Hourly pay
    Immediate start
    Flexible hours

    SaidGig

    New York, NY
    1 day ago
  • $15 - $40 per hour

    The work You will evaluate AI assistant responses to realistic English teaching and classroom coordination scenarios. These may involve communication with students and parents, scheduling, educational events, and collaboration with colleagues. You will give assistants... 
    English language skills
    Hourly pay
    Contract work
    Part time

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote...  ...lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language prompts, assess accuracy and... 
    English language skills
    Remote job
    Hourly pay
    Part time
    For contractors

    OpenKrill

    New York, NY
    5 days ago
  • Mercor is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. This remote hourly engagement...  ...should have 5+ years of relevant experience, English fluency, and strong Microsoft Office and Google... 
    English language skills
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Work From Home AI Evaluator - English. Be the first to apply!