Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Response Evaluator - English Speaker (Remote)

$18 per hour

Scale AI

Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you You may contribute your expertise by… Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded Comparing pairs of AI-generated images and videos and judging which one better follows the prompt Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Examples of desirable expertise: Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech Pursuing or holding a Bachelor's degree or above Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way Experience writing short, evidence-based explanations or reviews Comfortable making a clear decision when both options have flaws What you'll need: A computer with a reliable internet connection and headphones A quiet place to talk for projects that involve live conversation Your ratings and written explanations must be your own work; AI tools can't be used to write them Getting started includes a short screening and onboarding, which may include a brief spoken English check Payment: Project work:

Earn up to USD $18 per hour for core project work Additional incentives:

On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%. Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Response Evaluator - English Speaker (Remote) in Salt Lake City, UT vacancy
  • $15 per hour

    Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...in the real world. Responsibilities: Holding a live,... 
    Remote job
    English language skills
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Columbia, MD
    2 days ago
  • Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language... 
    Remote job
    English language skills
    Hourly pay
    Part time
    For contractors

    OpenKrill

    New York, NY
    2 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...the real world. Responsibilities: Holding a live,... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Plymouth, IN
    1 day ago
  •  ...Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...the real world. Responsibilities: * Holding a live,... 
    Remote work
    English language skills
    Work experience placement
    Freelance

    Scale AI

    United States
    8 hours ago
  • $15 per hour

     ...Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...the real world. Responsibilities: Holding a live,... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Fort Worth, TX
    2 days ago
  •  ...Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...the real world. Responsibilities: * Holding a live,... 
    Remote work
    English language skills
    Work experience placement

    Scale AI

    United States
    5 hours ago
  •  ...The Work You will evaluate how AI models respond to sensitive questions...  ...judgment to assess whether responses are accurate, relevant, safe...  ...per week. Work arrangement: Remote, project-based contractor work...  ...Language: Professional fluency in English. Experience: Professional... 
    Remote work
    Hourly pay
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $15 per hour

     ...Outlier is an AI training platform owned and...  ...generating training data to evaluating the performance of...  ...detail-oriented English speakers to review AI-generated...  ...or sounded wrong, all remotely and on your own schedule...  ...the real world. Responsibilities: Holding a live,... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Wilkes Barre, PA
    2 days ago
  • OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines... 
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $18 per hour

     ...RWS TrainAI is seeking AI Linguistic Evaluators to assess Telugu-language performance...  ...Native Telugu with strong English skills and a keen eye for...  ...an AI assistant, evaluate responses, and provide structured...  ...feedback per project guidelines. Remote from the United States,... 
    Remote work
    English language skills
    Freelance
    Immediate start
    Flexible hours

    RWS TrainAI

    United States
    19 hours ago
  • $18 per hour

     ...Evaluate AI-generated Malayalam content for linguistic accuracy and cultural...  ...assistant in Malayalam. Translate English prompts to Malayalam and assess responses. Provide structured evaluations and...  ...to follow guidelines. Logistics: Remote from the US with flexible hours.... 
    Remote work
    English language skills
    Freelance
    Flexible hours

    RWS

    United States
    1 day ago
  •  ...Mercor is seeking an AI Session Annotator (English) for a remote, contract role. You will review recorded sessions...  ...via voice and video, compare responses to visible content, and score sessions...  ...a native or near-native English speaker with clear, precise writing, strong... 
    Remote work
    English language skills
    Contract work

    Mercor Inc

    San Francisco, CA
    3 days ago
  • $15 per hour

     ...innovative companies improve their AI models by providing human...  ...communicator with fluency in English who would like to lend your expertise...  ..., detail-oriented English speakers to help train generative AI...  ...This freelance opportunity is remote and hours are flexible, so you... 
    Remote work
    English language skills
    Hourly pay
    Contract work
    Freelance
    Internship
    Flexible hours

    Outlier

    Delaware, OH
    55 minutes ago
  • $18 per hour

     ...Description Interact with an AI assistant in Malayalam. Translate English prompts into Malayalam and use them...  ...with the AI application. Evaluate AI-generated responses according to project guidelines...  ...macOS device. Benefits Freelance, remote work from the United States. Flexible... 
    Remote work
    English language skills
    Hourly pay
    Freelance
    Immediate start
    Flexible hours

    RWS Group

    New York, NY
    4 days ago
  • $18 per hour

     ...innovative companies improve their AI models by providing human...  ...communicator with fluency in English who would like to lend your expertise...  ..., detail-oriented English speakers to help train generative AI...  ...This freelance opportunity is remote and hours are flexible, so you... 
    Remote work
    English language skills
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    Yuma, AZ
    2 days ago
  •  ...quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial...  ...flexible, remote contract role. Key Responsibilities Assessing the factuality and...  ...quantitative reasoning Fluent written English with the ability to communicate... 
    Remote work
    English language skills
    Full time
    Contract work
    Flexible hours

    Virtual Vocations Inc

    United States
    1 day ago
  •  ...quantitative finance experts for remote, flexible contract work to train and evaluate AI models on financial reasoning...  ...focused questions, and evaluate responses, leveraging deep knowledge in stochastic...  ...pricing. Excellent written English is required. #J-18808-Ljbffr
    Remote work
    English language skills
    Contract work
    Temporary work
    Flexible hours

    Brain Trust Inc

    United States
    3 days ago
  •  ...short-term project, a freelance AI Linguistic Evaluator for Tamil will evaluate AI-...  ...structured feedback while working remotely with a flexible schedule. Key responsibilities Interact with an AI assistant...  ...and translate prompts from English Evaluate the quality of AI-generated... 
    Remote work
    English language skills
    Temporary work
    Freelance
    Flexible hours

    Virtual Vocations Inc

    United States
    19 hours ago
  • $18 per hour

     ...We are looking for AI Linguistic Evaluators to assess how effectively...  ...Freelance Location: Remote from the United States...  ...Are you a native-level speaker of Tamil with strong English skills and a keen eye for...  ...quality of AI-generated responses according to project... 
    Remote work
    English language skills
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    Edison, NJ
    3 days ago
  •  ...To support a growing AI project, the freelance AI Linguistic Evaluator for Bengali (India) will...  ...cultural relevance, working remotely with a flexible...  ...approximately 10-15 hours. Key responsibilities Interacting with an AI...  ...prompts from English Evaluating the quality... 
    Remote work
    English language skills
    Freelance
    Flexible hours

    Virtual Vocations Inc

    United States
    4 days ago
  •  ...Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality...  ...or related areas, with excellent written English and strong analytical skills to assess... 
    Remote work
    English language skills
    Contract work

    Mercor Inc

    United States
    4 days ago
  • $11 per hour

     ...RWS TrainAI is looking for a Speech AI Evaluation Specialist to help improve AI-...  ...engage in part-time work from home. Responsibilities include interacting with AI models...  ...fluency in Italian and be fluent in English. This is a remote role with a starting rate of 11 USD... 
    Remote work
    English language skills
    Hourly pay
    Part time
    Work from home
    Flexible hours

    RWS TrainAI

    United States
    19 hours ago
  • $50 - $150 per hour

     ...experts to help train and evaluate advanced AI models on financial and quantitative...  ...reasoning. This is remote, flexible contract work where...  ...to extend. Key Responsibilities You may contribute your...  ...reasoning Fluent written English and the ability to communicate... 
    Remote work
    English language skills
    Contract work
    Temporary work
    Flexible hours

    Brain Trust Inc

    United States
    4 days ago
  • $18 per hour

     ...innovative companies improve their AI models by providing human...  ...communicator with fluency in English who would like to lend your expertise...  ..., detail-oriented English speakers to help train generative AI...  ...modelsThis freelance opportunity is remote and hours are flexible, so you... 
    Remote work
    English language skills
    Hourly pay
    Freelance
    Flexible hours

    Scale AI

    Cincinnati, OH
    1 day ago
  • $17 per hour

     ...Data Labeling Specialist: Remote Contract Remote Flexible...  .... What You'll Do Evaluate outputs from AI models, text, images,...  ...progress Excellent written English — clear, precise, well-organized...  ...that reflects the added responsibility. These opportunities... 
    Remote work
    English language skills
    Contract work
    Flexible hours

    Workada

    Norman, OK
    19 hours ago
  •  ...DataAnnotation is seeking a Chemist to evaluate AI chemical reasoning, identify unsafe or incorrect steps, and craft accurate responses for trained chemists. You’ll write prompts...  ...across organic, inorganic, or physical chemistry, and clear written English. #J-18808-Ljbffr
    Remote work
    English language skills

    DataAnnotation

    United States
    1 day ago
  •  ...Writer contractor to participate in evaluating advanced AI-generated writing from a remote environment. Your expertise will...  ...AI systems by assessing responses, scoring quality, and providing...  ...editorial background and superior English fluency are essential. You will... 
    Remote work
    English language skills
    For contractors

    micro1

    New York, NY
    3 days ago
  • $50 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: English Language and Literature Expert Type...  ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    San Jose, CA
    17 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo...  ...passion for quality. Key Responsibilities Analyze search result performance...  .... Seeks a flexible, remote job that can easily fit...  ...Requirements Fluent in English (written and spoken)... 
    Remote work
    English language skills
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    19 hours ago
  • $100 - $120 per unit

     ...technical talent with leading AI research labs....  ...Fan – Live MLB Game AI Evaluator (US) Type Contract Compensation...  ...–$120 per task Location Remote Commitment Event-based Role Responsibilities Follow live MLB...  ...search. Strong written English and sharp attention to detail... 
    Remote work
    English language skills
    Contract work
    Work experience placement
    Summer work

    Mercor Inc

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Response Evaluator - English Speaker (Remote). Be the first to apply!