AI Response Evaluator - English Speaker (Remote)
$18 per hourScale AI
Outlier helps the world's most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?
About the opportunity:
Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you
You may contribute your expertise by…
Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard
Examples of desirable expertise:
Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
Pursuing or holding a Bachelor's degree or above
Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
Experience writing short, evidence-based explanations or reviews
Comfortable making a clear decision when both options have flaws
What you'll need:
A computer with a reliable internet connection and headphones
A quiet place to talk for projects that involve live conversation
Your ratings and written explanations must be your own work; AI tools can't be used to write them
Getting started includes a short screening and onboarding, which may include a brief spoken English check
Payment:
Project work: Earn up to USD $18 per hour for core project work
Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier's version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Response Evaluator - English Speaker (Remote) in Salt Lake City, UT vacancy
$15 per hour
Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...in the real world. Responsibilities: Holding a live,...Remote jobEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language...Remote jobEnglish language skillsHourly payPart timeFor contractors
$15 per hour
...Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...the real world. Responsibilities: Holding a live,...Remote workEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- ...Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...the real world. Responsibilities: * Holding a live,...Remote workEnglish language skillsWork experience placementFreelance
$15 per hour
...Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...the real world. Responsibilities: Holding a live,...Remote workEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- ...Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...the real world. Responsibilities: * Holding a live,...Remote workEnglish language skillsWork experience placement
- ...The Work You will evaluate how AI models respond to sensitive questions... ...judgment to assess whether responses are accurate, relevant, safe... ...per week. Work arrangement: Remote, project-based contractor work... ...Language: Professional fluency in English. Experience: Professional...Remote workHourly payFor contractors
$15 per hour
...Outlier is an AI training platform owned and... ...generating training data to evaluating the performance of... ...detail-oriented English speakers to review AI-generated... ...or sounded wrong, all remotely and on your own schedule... ...the real world. Responsibilities: Holding a live,...Remote workEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines...Remote jobFor contractors
$18 per hour
...RWS TrainAI is seeking AI Linguistic Evaluators to assess Telugu-language performance... ...Native Telugu with strong English skills and a keen eye for... ...an AI assistant, evaluate responses, and provide structured... ...feedback per project guidelines. Remote from the United States,...Remote workEnglish language skillsFreelanceImmediate startFlexible hours$18 per hour
...Evaluate AI-generated Malayalam content for linguistic accuracy and cultural... ...assistant in Malayalam. Translate English prompts to Malayalam and assess responses. Provide structured evaluations and... ...to follow guidelines. Logistics: Remote from the US with flexible hours....Remote workEnglish language skillsFreelanceFlexible hours- ...Mercor is seeking an AI Session Annotator (English) for a remote, contract role. You will review recorded sessions... ...via voice and video, compare responses to visible content, and score sessions... ...a native or near-native English speaker with clear, precise writing, strong...Remote workEnglish language skillsContract work
$15 per hour
...innovative companies improve their AI models by providing human... ...communicator with fluency in English who would like to lend your expertise... ..., detail-oriented English speakers to help train generative AI... ...This freelance opportunity is remote and hours are flexible, so you...Remote workEnglish language skillsHourly payContract workFreelanceInternshipFlexible hours$18 per hour
...Description Interact with an AI assistant in Malayalam. Translate English prompts into Malayalam and use them... ...with the AI application. Evaluate AI-generated responses according to project guidelines... ...macOS device. Benefits Freelance, remote work from the United States. Flexible...Remote workEnglish language skillsHourly payFreelanceImmediate startFlexible hours$18 per hour
...innovative companies improve their AI models by providing human... ...communicator with fluency in English who would like to lend your expertise... ..., detail-oriented English speakers to help train generative AI... ...This freelance opportunity is remote and hours are flexible, so you...Remote workEnglish language skillsHourly payFreelanceFlexible hours- ...quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial... ...flexible, remote contract role. Key Responsibilities Assessing the factuality and... ...quantitative reasoning Fluent written English with the ability to communicate...Remote workEnglish language skillsFull timeContract workFlexible hours
- ...quantitative finance experts for remote, flexible contract work to train and evaluate AI models on financial reasoning... ...focused questions, and evaluate responses, leveraging deep knowledge in stochastic... ...pricing. Excellent written English is required. #J-18808-LjbffrRemote workEnglish language skillsContract workTemporary workFlexible hours
- ...short-term project, a freelance AI Linguistic Evaluator for Tamil will evaluate AI-... ...structured feedback while working remotely with a flexible schedule. Key responsibilities Interact with an AI assistant... ...and translate prompts from English Evaluate the quality of AI-generated...Remote workEnglish language skillsTemporary workFreelanceFlexible hours
$18 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively... ...Freelance Location: Remote from the United States... ...Are you a native-level speaker of Tamil with strong English skills and a keen eye for... ...quality of AI-generated responses according to project...Remote workEnglish language skillsTemporary workFreelanceImmediate startFlexible hours- ...To support a growing AI project, the freelance AI Linguistic Evaluator for Bengali (India) will... ...cultural relevance, working remotely with a flexible... ...approximately 10-15 hours. Key responsibilities Interacting with an AI... ...prompts from English Evaluating the quality...Remote workEnglish language skillsFreelanceFlexible hours
- ...Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality... ...or related areas, with excellent written English and strong analytical skills to assess...Remote workEnglish language skillsContract work
$11 per hour
...RWS TrainAI is looking for a Speech AI Evaluation Specialist to help improve AI-... ...engage in part-time work from home. Responsibilities include interacting with AI models... ...fluency in Italian and be fluent in English. This is a remote role with a starting rate of 11 USD...Remote workEnglish language skillsHourly payPart timeWork from homeFlexible hours$50 - $150 per hour
...experts to help train and evaluate advanced AI models on financial and quantitative... ...reasoning. This is remote, flexible contract work where... ...to extend. Key Responsibilities You may contribute your... ...reasoning Fluent written English and the ability to communicate...Remote workEnglish language skillsContract workTemporary workFlexible hours$18 per hour
...innovative companies improve their AI models by providing human... ...communicator with fluency in English who would like to lend your expertise... ..., detail-oriented English speakers to help train generative AI... ...modelsThis freelance opportunity is remote and hours are flexible, so you...Remote workEnglish language skillsHourly payFreelanceFlexible hours$17 per hour
...Data Labeling Specialist: Remote Contract Remote Flexible... .... What You'll Do Evaluate outputs from AI models, text, images,... ...progress Excellent written English — clear, precise, well-organized... ...that reflects the added responsibility. These opportunities...Remote workEnglish language skillsContract workFlexible hours- ...DataAnnotation is seeking a Chemist to evaluate AI chemical reasoning, identify unsafe or incorrect steps, and craft accurate responses for trained chemists. You’ll write prompts... ...across organic, inorganic, or physical chemistry, and clear written English. #J-18808-LjbffrRemote workEnglish language skills
- ...Writer contractor to participate in evaluating advanced AI-generated writing from a remote environment. Your expertise will... ...AI systems by assessing responses, scoring quality, and providing... ...editorial background and superior English fluency are essential. You will...Remote workEnglish language skillsFor contractors
$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: English Language and Literature Expert Type... ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Remote workEnglish language skillsContract workSummer work$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo... ...passion for quality. Key Responsibilities Analyze search result performance... .... Seeks a flexible, remote job that can easily fit... ...Requirements Fluent in English (written and spoken)...Remote workEnglish language skillsHourly payPart timeImmediate startWork from home10 hours per weekFlexible hours$100 - $120 per unit
...technical talent with leading AI research labs.... ...Fan – Live MLB Game AI Evaluator (US) Type Contract Compensation... ...–$120 per task Location Remote Commitment Event-based Role Responsibilities Follow live MLB... ...search. Strong written English and sharp attention to detail...Remote workEnglish language skillsContract workWork experience placementSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Response Evaluator - English Speaker (Remote). Be the first to apply!
Related searches
- evaluator Salt Lake City, UT
- social media evaluator Salt Lake City, UT
- education evaluator Salt Lake City, UT
- ai evaluator Salt Lake City, UT
- english full time jobs Salt Lake City, UT
- english part time Salt Lake City, UT
- english speaking jobs no experience Salt Lake City, UT
- english speaking Salt Lake City, UT
- teach english online part time Salt Lake City, UT
- english assistant Salt Lake City, UT



