Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Work From Home AI Evaluator - English

$18 per hour

Scale AI

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?

About the opportunity:

  • Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
  • This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by…

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:

  • Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
  • Pursuing or holding a Bachelor's degree or above
  • Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
  • Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
  • Experience writing short, evidence-based explanations or reviews
  • Comfortable making a clear decision when both options have flaws

What you'll need:

  • A computer with a reliable internet connection and headphones
  • A quiet place to talk for projects that involve live conversation
  • Your ratings and written explanations must be your own work; AI tools can't be used to write them
  • Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:

  • Project work: Earn up to USD $18 per hour for core project work
  • Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
  • Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Work From Home AI Evaluator - English in Garland, TX vacancy
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    Work from home
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Newark, NJ
    14 hours ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Work from home
    English language skills
    Remote job

    RWS

    New York, NY
    3 days ago
  •  ...Gujarati speakers to act as evaluators for side-by-side evaluations...  ...will assess how naturally the AI captures Gujarati speech and...  ...flexible hours and the ability to work from home. Ideal candidates are fluent...  ...intuition and good English for reporting, and have a quiet... 
    Work from home
    English language skills
    Remote job
    Freelance
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  •  ...seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...major platforms. Ideal candidates work well from home in Thailand, commit 5-20 hours weekly...  ...strong online research skills, English and Thai proficiency, and the discipline... 
    Work from home
    English language skills
    Remote job
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets...  ...hour Location Remote/work from home, Georgia - Note: Even though the...  ...Experience & Requirements Fluent in English (written and spoken) Strong... 
    Work from home
    English language skills
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Cambridge, MA
    14 hours ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Corpus Christi, TX
    14 hours ago
  • $100 - $160 per hour

     ...% remote • Part-time • Fully flexible schedule Work on the cutting edge of legal AI, on your own schedule, and get paid for the litigation judgment...  ..., along with dependable written communication in English • No AI experience needed. You bring the expertise; we... 
    English language skills
    Hourly pay
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI

    United States
    23 hours ago
  • Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking regions... 
    English language skills
    Remote job
    Contract work
    10 hours per week

    mercor

    San Francisco, CA
    2 days ago
  • A leading global AI service provider is looking for a Search Quality Rater in Idaho,...  ...role where you'll use your search skills to evaluate how search engines respond to queries....  ..., a smartphone, and a personal computer, working up to 29 hours a week. Ideal for someone... 
    English language skills
    Part time
    Flexible hours

    RWS Group

    Boise, ID
    3 days ago
  •  ...PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to...  ...subtle errors in quantitative reasoning Fluent written English with the ability to communicate complex ideas clearly... 
    English language skills
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    4 days ago
  • $50k

    CSAA Insurance Group is hiring a Casualty Evaluator for a remote role spanning multiple states with the option to work from home. You will own cases, investigate, negotiate...  ...claims, strong analytical skills, and solid English communication. Occasional travel and extended... 
    Work from home
    English language skills
    Remote job

    CSAA

    New York, NY
    2 days ago
  • MarketLister, Inc. is seeking a Personalized Ads Evaluator to work from home and contribute to enhancing online advertising effectiveness. This...  ...meet basic requirements. Must be a USA resident for 3+ years with excellent English skills.J-18808-Ljbffr MarketLister, Inc.
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    MarketLister, Inc.

    Miami, FL
    7 days ago
  • $30 per hour

    RWS Group offers a flexible, part-time evaluator position focused on improving AI data for search engines. Work from home in Switzerland with a weekly 5-20 hour commitment, requiring English and Italian proficiency and the ability to sign an NDA. Compensation is up to 3... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    3 days ago
  •  ...layout, contributing to a better user experience. The role requires strong English and Japanese communication, familiarity with Japanese media and culture, and daily internet access. Works from home with flexible hours, ideal for candidates seeking meaningful project work... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    TELUS Digital

    New York, NY
    1 day ago
  •  ...Group is seeking a web-savvy evaluator to improve search results. You will work remotely from Israel,...  ...images, and videos to refine AI data used by global platforms. The role requires English and Hebrew proficiency, 5...  ...SLAs while working from home. No prior experience... 
    Work from home
    English language skills
    Remote job
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • RWS in China offers a flexible, work-from-home part-time role to help improve AI models. You will assess content in English and Chinese (Simplified) on a 5-20 hour weekly schedule with pay up to $6 per hour. No prior experience required; training and an NDA are provided... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    Part time
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $19 per hour

     ...flexible, detail-oriented Search Quality Evaluator to improve online search results for major platforms. Work from home in the Netherlands with English and Dutch proficiency, 5-20 hours per...  ...and videos, provide feedback to refine AI data used by search engines and social... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    3 days ago
  •  ...is seeking a flexible, web-savvy evaluator to test how search engines...  ...audio, images and videos to improve AI data used by major platforms, while working from home. The role suits freelancers, students...  ...part-time, remote arrangement. English and Swedish language skills are... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    3 days ago
  • $17 per hour

     ...technology people use every day. Our work creates the examples and feedback that...  ...consistent, and useful. What You'll Do Evaluate outputs from AI models, text, images, video, and...  ...completed or in progress Excellent written English — clear, precise, well-organized... 
    English language skills
    Contract work
    Remote work
    Flexible hours

    Workada

    Church Point, LA
    2 days ago
  • $15 - $40 per hour

    The work You will evaluate AI assistant responses to realistic English teaching and classroom coordination scenarios. These may involve communication with students and parents, scheduling, educational events, and collaboration with colleagues. You will give assistants... 
    English language skills
    Hourly pay
    Contract work
    Part time

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $50k

    Job Title Casualty Evaluator Requisition Number R8039 Casualty Evaluator (Open) Location Colorado - Home Teleworkers Additional Locations Alabama...  ...success through meaningful work. We are actively hiring for...  ...and good command of the English language. Ability to function... 
    Work from home
    English language skills
    Work experience placement
    H1b
    Work at office
    Remote work
    Flexible hours
    Weekend work

    CSAA Insurance Group

    King, WI
    2 days ago
  • $20 - $30 per hour

     ...firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing...  ...detail, and excellent communication abilities in English. This position allows for flexibility, with a commitment... 
    English language skills
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    1 day ago
  • $18 per hour

     ...18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural...  ...-term freelance collaboration with flexible remote work from the United States. #J-18808-Ljbffr RWS
    English language skills
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    5 days ago
  • Mercor is seeking a contract Evaluator for nonprofit/philanthropy programs...  ...role focuses on assessing AI-generated artifacts and providing...  ...and presentation errors, work with teams asynchronously to meet...  ..., and slide decks. Fluent English and Office/Workspace proficiency... 
    English language skills
    Remote job
    Contract work
    Work at office

    mercor

    San Francisco, CA
    3 days ago
  • $15 per hour

    SaidGig is seeking a role that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking quality, originality, and prompt adherence while considering linguistic... 
    English language skills
    Remote job
    Hourly pay
    Immediate start
    Flexible hours

    SaidGig

    New York, NY
    1 day ago
  • $20 - $26 per hour

    Prolific is seeking a fluent Punjabi speaker to act as an AI trainer/evaluator. You will listen to audio and compare it with text, rating...  ...competitive, with pay rates between $20-26 per hour. You can work from home with flexible hours, and PayPal is used for payments. #J-... 
    Work from home
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $18 per hour

    RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote, freelance role offers...  .... Ideal candidates are native Marathi speakers with strong English, attention to linguistic nuance, and the ability to follow... 
    English language skills
    Remote job
    Freelance
    Immediate start
    Flexible hours

    RWS TrainAI

    New York, NY
    4 days ago
  • Mercor is seeking an evaluator for nonprofit/philanthropy programs in...  ...contract role. You will assess AI-generated artifacts against quality...  ...guide grading and you will work independently to meet tight...  ...in nonprofit settings, fluent English, and strong skills in Microsoft... 
    English language skills
    Remote job
    Contract work
    Work at office

    mercor

    San Francisco, CA
    3 days ago
  • Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will...  ...in product launch readiness and be fluent in English. Proficiency in Microsoft Office and Google Workspace... 
    English language skills
    Remote job
    Hourly pay
    Work at office

    Mercor

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Work From Home AI Evaluator - English. Be the first to apply!