Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Work From Home AI Evaluator - English

$18 per hour

Scale AI

Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?

About the opportunity:
Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you

You may contribute your expertise by…
Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Examples of desirable expertise:
Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
Pursuing or holding a Bachelor's degree or above
Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
Experience writing short, evidence-based explanations or reviews
Comfortable making a clear decision when both options have flaws

What you'll need:
A computer with a reliable internet connection and headphones
A quiet place to talk for projects that involve live conversation
Your ratings and written explanations must be your own work; AI tools can't be used to write them
Getting started includes a short screening and onboarding, which may include a brief spoken English check

Payment:
Project work:

Earn up to USD $18 per hour for core project work
Additional incentives:

On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Work From Home AI Evaluator - English in New Orleans, LA vacancy
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    Work from home
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Birmingham, AL
    11 hours ago
  • $18 per hour

     ...'s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for youYou may contribute... 
    Work from home
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Newark, NJ
    11 hours ago
  •  ...Gujarati speakers to act as evaluators for side-by-side evaluations...  ...will assess how naturally the AI captures Gujarati speech and...  ...flexible hours and the ability to work from home. Ideal candidates are fluent...  ...intuition and good English for reporting, and have a quiet... 
    Work from home
    English language skills
    Remote job
    Freelance
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Work from home
    English language skills
    Remote job

    RWS

    New York, NY
    4 days ago
  •  ...seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test...  ...major platforms. Ideal candidates work well from home in Thailand, commit 5-20 hours weekly...  ...strong online research skills, English and Thai proficiency, and the discipline... 
    Work from home
    English language skills
    Remote job
    Part time
    Flexible hours

    RWS

    New York, NY
    4 days ago
  • $15 per hour

    Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity...  ...are seeking detail-oriented English speakers to review AI-... 
    Work from home
    English language skills
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Remote work
    Night shift

    Scale AI

    Cincinnati, OH
    1 day ago
  • $100 - $160 per hour

     ...in the following description. Work on the cutting edge of legal AI, on your own schedule, and get paid...  ...dependable written communication in English • No AI experience needed. You bring...  ...right now. Remote working/work at home options are available for this role.... 
    Work from home
    English language skills
    Hourly pay
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI

    United, PA
    2 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets...  ...Location Remote/work from home, Georgia – Note: Even though the...  ...& Requirements Fluent in English (written and spoken) Strong understanding... 
    Work from home
    English language skills
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Welo Data

    Georgia
    11 hours ago
  • Mercor is seeking an Internet-Native Bilingual Evaluator Expert (French) for a remote contract role. You will evaluate AI outputs for linguistic accuracy and cultural relevance in French and English, drawing on experience with online communities across French-speaking regions... 
    English language skills
    Remote job
    Contract work
    10 hours per week

    mercor

    San Francisco, CA
    3 days ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Cary, NC
    11 hours ago
  • $18 per hour

     ...’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train...  ...remote and hours are flexible, so you can work whenever is best for you You may... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Denton, TX
    11 hours ago
  • A leading global AI service provider is looking for a Search Quality Rater in Idaho,...  ...role where you'll use your search skills to evaluate how search engines respond to queries....  ..., a smartphone, and a personal computer, working up to 29 hours a week. Ideal for someone... 
    English language skills
    Part time
    Flexible hours

    RWS Group

    Boise, ID
    4 days ago
  • $50 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: English Language and Literature Expert...  ...Remote Role Responsibilities Evaluate the quality and accuracy of...  ...evaluation, or NLP data work in English. Strong understanding... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    San Jose, CA
    16 days ago
  •  ...PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to...  ...subtle errors in quantitative reasoning Fluent written English with the ability to communicate complex ideas clearly... 
    English language skills
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    5 days ago
  • $50k

    CSAA Insurance Group is hiring a Casualty Evaluator for a remote role spanning multiple states with the option to work from home. You will own cases, investigate, negotiate...  ...claims, strong analytical skills, and solid English communication. Occasional travel and extended... 
    Work from home
    English language skills
    Remote job

    CSAA

    New York, NY
    3 days ago
  • MarketLister, Inc. is seeking a Personalized Ads Evaluator to work from home and contribute to enhancing online advertising effectiveness. This...  ...meet basic requirements. Must be a USA resident for 3+ years with excellent English skills.J-18808-Ljbffr MarketLister, Inc.
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    MarketLister, Inc.

    Miami, FL
    8 days ago
  • $30 per hour

    RWS Group offers a flexible, part-time evaluator position focused on improving AI data for search engines. Work from home in Switzerland with a weekly 5-20 hour commitment, requiring English and Italian proficiency and the ability to sign an NDA. Compensation is up to 3... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    4 days ago
  •  ...Group is seeking a web-savvy evaluator to improve search results. You will work remotely from Israel,...  ...images, and videos to refine AI data used by global platforms. The role requires English and Hebrew proficiency, 5...  ...SLAs while working from home. No prior experience... 
    Work from home
    English language skills
    Remote job
    Flexible hours

    RWS Group

    New York, NY
    4 days ago
  • $19 per hour

     ...flexible, detail-oriented Search Quality Evaluator to improve online search results for major platforms. Work from home in the Netherlands with English and Dutch proficiency, 5-20 hours per...  ...and videos, provide feedback to refine AI data used by search engines and social... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    RWS TrainAI

    New York, NY
    4 days ago
  •  ...layout, contributing to a better user experience. The role requires strong English and Japanese communication, familiarity with Japanese media and culture, and daily internet access. Works from home with flexible hours, ideal for candidates seeking meaningful project work... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    TELUS Digital

    New York, NY
    2 days ago
  • $16 per hour

    RWS Group is seeking a part-time evaluator to enhance search engine results. You will review...  ..., audio, images, and videos to refine AI data used by major search engines, social...  ...or students. 5-20 hours weekly, work from home in New Zealand. Training will be provided... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance

    OpenKrill

    New York, NY
    11 hours ago
  • RWS in China offers a flexible, work-from-home part-time role to help improve AI models. You will assess content in English and Chinese (Simplified) on a 5-20 hour weekly schedule with pay up to $6 per hour. No prior experience required; training and an NDA are provided... 
    Work from home
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    Part time
    Flexible hours

    RWS

    New York, NY
    4 days ago
  •  ...is seeking a flexible, web-savvy evaluator to test how search engines...  ...audio, images and videos to improve AI data used by major platforms, while working from home. The role suits freelancers, students...  ...part-time, remote arrangement. English and Swedish language skills are... 
    Work from home
    English language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    RWS

    New York, NY
    4 days ago
  • $15 - $40 per hour

    The work You will evaluate AI assistant responses to realistic English teaching and classroom coordination scenarios. These may involve communication with students and parents, scheduling, educational events, and collaboration with colleagues. You will give assistants... 
    English language skills
    Hourly pay
    Contract work
    Part time

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $50k

     ...EvaluatorRequisition NumberR8039 Casualty Evaluator (Open)LocationColorado - Home TeleworkersAdditional...  ...our shared success through meaningful work.We are actively hiring for a Casualty...  ...communication skills and good command of the English language.Ability to function in a... 
    Work from home
    English language skills
    Work experience placement
    H1b
    Work at office
    Remote work
    Flexible hours
    Weekend work

    CSAA Insurance Group

    Saint Louis, MO
    3 days ago
  • $18 per hour

     ...18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural...  ...-term freelance collaboration with flexible remote work from the United States. #J-18808-Ljbffr RWS
    English language skills
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    1 day ago
  • $20 - $30 per hour

     ...firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing...  ...detail, and excellent communication abilities in English. This position allows for flexibility, with a commitment... 
    English language skills
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    2 days ago
  • $60 per hour

     ...Engineers to join our Expert Network to train and evaluate AI models using real-world chemical knowledge. A quick...  ...hour. Tasks require about one hour of uninterrupted work, though many are shorter, and you can work from home with flexible hours. #J-18808-Ljbffr Prolific
    Work from home
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • SaidGig is seeking a remote, hourly independent contractor to evaluate AI-generated Thai music lyrics. You will compare outputs to published...  ...or journalism experience, good listening gear, and the ability to follow precise English directions. #J-18808-Ljbffr SaidGig
    English language skills
    Remote job
    Hourly pay
    For contractors

    SaidGig

    New York, NY
    2 days ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time contractor role offers up to 3 months of work and compensation in the $7-$12/hour range. You’ll interact... 
    English language skills
    Remote job
    Part time
    For contractors

    OpenKrill

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Work From Home AI Evaluator - English. Be the first to apply!