Remote - AI Evaluator - English
$15 per hourOutlier
Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?
About the opportunity:
- Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models
- This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you
You may contribute your expertise by…
- Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
- Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
- Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
- Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard
Examples of desirable expertise:
- Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
- Pursuing or holding a Bachelor's degree or above
- Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
- Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
- Experience writing short, evidence-based explanations or reviews
- Comfortable making a clear decision when both options have flaws
What you'll need:
- A computer with a reliable internet connection and headphones
- A quiet place to talk for projects that involve live conversation
- Your ratings and written explanations must be your own work; AI tools can't be used to write them
- Getting started includes a short screening and onboarding, which may include a brief spoken English check
Payment:
- Project work: Earn up to USD $15 per hour for core project work
- Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions — Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%.
- Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
$15 per hour
...s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train... ...models This freelance opportunity is remote and hours are flexible, so you can work...Remote workEnglish language skillsHourly payContract workFreelanceInternshipWork from homeFlexible hours- ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute... ...subtle errors in quantitative reasoning Fluent written English with the ability to communicate complex ideas clearly...Remote workEnglish language skillsFull timeContract workFlexible hours
$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: English Language and Literature Expert Type... ...: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Remote workEnglish language skillsContract workSummer work- Create challenging prompts and evaluate large language model responses... ...-time role requires strong English writing, analytical thinking,... ...team management experience. 100% Remote Contract, part-time Engagement... ...execution to assess how well AI handles management-related topics...Remote workEnglish language skillsContract workPart timeFor contractorsWorldwide
- RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates...Remote jobEnglish language skillsWork from home
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback... ...communication abilities in English. This position allows for...Remote jobEnglish language skillsHourly pay- Lever, Inc. is seeking native Telugu speakers for a remote AI linguistic evaluation project. You will engage with an AI assistant in Telugu, translate prompts from English, and assess the linguistic accuracy and cultural relevance of AI outputs. This freelance role offers...Remote jobEnglish language skillsFreelanceImmediate startFlexible hours
$15 per hour
...that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking... ...and regional expressions. The position is remote and hourly, begins immediately, and...Remote jobEnglish language skillsHourly payImmediate startFlexible hours- Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language...Remote jobEnglish language skillsHourly payPart timeFor contractors
$18 per hour
Freelance, remote from the United States Flexible schedule, approximately 10-15 total hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance...Remote jobEnglish language skillsHourly payTemporary workFreelanceFlexible hours$24 per hour
Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language... ...role requires fluent Tamil and English, high emotional intelligence, and... ...for tasks, with flexible hours and remote work options. J-18808-Ljbffr ProlificRemote jobEnglish language skillsFlexible hours$18 per hour
RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote, freelance role offers flexible scheduling with an estimated... ...native Marathi speakers with strong English, attention to linguistic nuance, and...Remote jobEnglish language skillsFreelanceImmediate startFlexible hours- RWS is seeking AI Linguistic Evaluators to assess Tamil-language outputs for a short-term collaboration. This remote role is open to applicants in the United States, with a flexible... ...assistant in Tamil, translate prompts from English, and evaluate AI-generated responses for...Remote jobEnglish language skillsTemporary workFreelanceImmediate startFlexible hours
- RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday... ...5-20 hours weekly, have strong online research skills, English and Thai proficiency, and the discipline to meet SLAs in a...Remote jobEnglish language skillsPart timeWork from homeFlexible hours
$23 per hour
RWS is seeking a web-savvy search evaluator to influence global AI search. You will test and evaluate how our... ...major search engines. This flexible, remote, part-time role is open to... ...hours weekly; strong online research and English/Norwegian language skills are required...Remote jobEnglish language skillsPart timeFreelanceFlexible hours- Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context....Remote jobEnglish language skillsFor contractorsLocal area
- Volga Partners is seeking an AI Language Quality Evaluator fluent in Greek and English to assess localization accuracy across UI texts and app screens. This freelance, task-based role offers flexible remote engagement with on-demand tasks and no guaranteed hours. As part...Remote jobEnglish language skillsFreelanceFlexible hours
- RWS TrainAI is seeking a web-savvy evaluator to improve AI search data from real users. You will test search results and provide feedback on text... ...residing in Austria, strong online research skills, English and German proficiency, and a commitment of 5-20 hours per...Remote jobEnglish language skillsPart time
$30 - $50 per hour
...A leading AI training company is seeking a Remote Annotator to support human-in-the-loop AI training workflows... ...reviewing labeled datasets, performing evaluations for helpfulness and safety, and... ...quality in training data. Strong written English and attention to detail are...Remote workEnglish language skillsHourly pay$30 per hour
RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text, audio, images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in Switzerland...Remote jobEnglish language skillsPart timeFreelanceFlexible hours$13 per hour
...a flexible, part-time Search Quality Evaluator to help improve AI-driven search results. You will test... ...major search engines and platforms. This remote role is open to freelancers, students... .... Language requirements include English and Hebrew; Israeli residents preferred...Remote jobEnglish language skillsExtra incomePart timeFreelanceFlexible hours$18 per hour
Description: Interact with an AI assistant in Telugu. Translate English prompts into Telugu and use them to interact with the AI application. Evaluate AI-generated responses according to project... ..., or macOS. Availability to work remotely from the United States on a...Remote workEnglish language skillsHourly payTemporary workFreelanceImmediate startFlexible hours$18 per hour
AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible Immediately Approximately 10-1... ...native-level speaker of Telugu with strong English skills and a keen eye for language quality...Remote jobEnglish language skillsTemporary workFreelanceImmediate startFlexible hours$18 per hour
...recruiter directly. We are looking for AI Linguistic Evaluators to assess how effectively an AI... ...Job Type: Freelance Location: Remote from the United States Work Schedule... ...level speaker of Telugu with strong English skills and a keen eye for language quality...Remote workEnglish language skillsFull timeFreelanceImmediate startFlexible hours- at Volga Partners Remote | Independent Contractor | Global AI Project | Flexible Engagement Role Overview We are seeking detail-oriented AI Language Quality Evaluator with fluency in Greek and English to evaluate the accuracy of AI models that detect localization and UI...Remote workEnglish language skillsHourly payExtra incomeFor contractorsFreelanceCurrently hiringLocal areaFlexible hours
- YO AI Labs is seeking a Creative & Design Specialist (Contractor) to support projects across graphic design, multimedia production,... ...Resolve, and Canva. Must have prior paid experience in AI-human data work and strong English communication. #J-18808-Ljbffr YO AI LabsRemote jobEnglish language skillsFor contractors
$100 - $120 per unit
...technical talent with leading AI research labs. Headquartered in... ...Fan - Live MLB Game AI Evaluator (US) Type Contract Compensation $100-$120 per task Location Remote Commitment Event-based Role Responsibilities... ...web search. Strong written English and sharp attention to detail....Remote workEnglish language skillsContract workWork experience placementSummer work$15 per hour
Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models. About... ...are seeking detail-oriented English speakers to review AI-... ...looked or sounded wrong, all remotely and on your own schedule. At...Remote jobEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift- OpenTrain AI, Inc. is seeking experts to evaluate AI responses to questions about explosives and energetic materials. You will... ...relevant degree or certification. This is a remote, project-based contractor role requiring English proficiency. #J-18808-Ljbffr OpenTrain AI,...Remote jobEnglish language skillsFor contractors
$15 per hour
Outlier is an AI training platform owned and operated by Scale... ...generating training data to evaluating the performance of models. About... ...are seeking detail-oriented English speakers to review AI-... ...looked or sounded wrong, all remotely and on your own schedule. At...Remote jobEnglish language skillsHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote - AI Evaluator - English. Be the first to apply!
- senior devops engineer remote Norman, OK
- remote senior project manager Norman, OK
- part-time virtual/remote assistant Norman, OK
- web developer internship remote Norman, OK
- remote entry level web developer Norman, OK
- remote virtual Norman, OK
- remote clinical Norman, OK
- part time software developer remote Norman, OK
- data science internship remote Norman, OK
- frontend internship remote Norman, OK




