AI Evaluator - English - native speaker reviewing AI outputs
$15 per hourOutlier
Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models. This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you. You may contribute your expertise by… Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded Comparing pairs of AI-generated images and videos and judging which one better follows the prompt Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Examples of desirable expertise: Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech Bachelor's degree or higher (preferred) Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way Experience writing short, evidence-based explanations or reviews Comfortable making a clear decision when both options have flaws What you'll need: A computer with a reliable internet connection and headphones A quiet place to talk for projects that involve live conversation Payment: Project work: Earn up to USD $15 per hour for core project work. Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions - Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%. Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project. Getting started includes a short screening and onboarding, which may include a brief spoken English check. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances. #J-18808-Ljbffr Outlier
$80 - $120 per hour
Weekday AI is seeking experienced Evaluators to review AI-generated artifacts for data quality and CRM operations.... ...structured feedback, and help improve output accuracy. Compensation is $80-$120... ...contractor role requires English fluency and 5+ years in relevant work...English language skillsRemote jobHourly payWeekly payFor contractorsWeekday work- Obsidian is hiring expert Evaluators in Special education/IEP to review AI-generated work products for accuracy and rigor... ...subject-matter expertise to grade outputs. Candidates must possess at least... ..., professional fluency in English, and proficiency in Microsoft Office...SuggestedHourly payWork at officeRemote work
$50 - $70 per hour
Mercor is seeking a Generalist Expert to review and assess documents and AI-generated outputs. This contract-remote role requires a US/Canada base and strong written English, with flexible hours and independence across docs, slides, and sheets. Compensation ranges from...English language skillsRemote jobHourly payContract workFlexible hours- AI Trainer Jobs is seeking a remote Database and SQL AI Evaluator to review prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining. Role details: freelance contractor, hourly...SuggestedRemote jobHourly payFor contractorsFreelance
- ...seeks a Professional Services Practice Reviewer to assess AI-generated content for professional... ...compliance. You will review AI agent outputs, scoresheets, and domain materials to... ...development, or IT management, plus near-native English and strong skills with spreadsheets...SuggestedRemote job
- Obsidian is seeking expert Evaluators in Biology and environmental science to review AI-generated outputs for accuracy and domain quality. Work is remote and paid hourly, leveraging deep subject-matter knowledge to assess and grade documents, spreadsheets, and slide decks...Remote jobHourly pay
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy... ...-matter expertise to grade outputs and provide structured... ...Humanities / arts / culture, native or professional English, and strong proficiency with...Remote jobHourly payWork at office
$20 - $30 per hour
...is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable... ...and excellent communication abilities in English. This position allows for flexibility, with...English language skillsRemote jobHourly pay$24 per hour
Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the... ...assessing audio clips, reviewing tones for cultural relevancy... ...quality control in audio outputs. The role requires fluent Tamil and English, high emotional intelligence...English language skillsRemote jobFlexible hours- ...an experienced contractor to evaluate AI-generated artifacts and provide... ...feedback. You will review documents, spreadsheets, and... ...SRE best practices to grade outputs. The role is remote, hourly,... ...incident management or SRE, strong English, and proficiency in Microsoft...English language skillsRemote jobHourly payWeekly payFor contractorsWork at officeFlexible hours
- Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy... ...-matter expertise to grade outputs and provide clear, structured... ...5+ years in user research, native or professional English, and strong MS Office/Google...Remote jobHourly pay
- ...the next generation of AI-narrated audiobooks sound... ...We're building a team of native Dutch speakers who love audiobooks to help evaluate AI-narrated (text-to-... ...where it occurs, using our review tooling. Report on... ...listen. Enough working English to report clearly and communicate...English language skillsPart timeRemote work
$80 - $120 per hour
...talent with leading AI research labs.... ...financial-services AI Evaluator Type: Contract... ...to improve AI model outputs. Apply deep... ...services AI . ~ Native or professional fluency in English . ~ Highly proficient... ...PS: Our team reviews applications daily....Contract workSummer workWork at officeRemote work- Mercor is seeking a Document Review Expert to evaluate AI-generated responses and provide detailed corrections in a remote contract role. You... ...to high-impact AI research projects. This role requires native English fluency, strong reading and writing skills, and the ability...Remote jobContract work
$60 - $70 per hour
...technical talent with leading AI research labs.... ...Role Responsibilities Evaluate AI-generated responses... ...and overall quality. Review content involving... .... Identify unsafe outputs, hallucinations, reasoning... ...~ Excellent written English , critical thinking, and...English language skillsContract workSummer workRemote work$70 - $110 per hour
...technical talent with leading AI research labs.... ...Role Responsibilities Evaluate AI-generated financial... ...and analytical rigor. Review financial scenarios... ...while enhancing AI model outputs . Qualifications... .... ~ Strong written English communication skills....English language skillsHourly payContract workSummer workWork at officeImmediate startRemote work$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology... .... Some weeks there is more data to review, other weeks less. Start Date ASAP... ...Experience & Requirements Fluent in English (written and spoken) Strong...English language skillsHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- DataAnnotation seeks a Chemist to evaluate AI chemical reasoning, identify unsafe or incorrect... ...that probe mechanisms and analyses, review AI outputs for accuracy and safety, and deliver... ...role emphasizes clarity in written English and strong chemistry knowledge. Remote...English language skillsRemote jobFlexible hours
- ...to a language and AI training project... ...systems. You will evaluate Thai audio... ...focused on your native-level Thai language... ...— native level; English — minimum B2 Key... ...and fluency of the speaker or AI-generated output. Assess pronunciation... ...assigned audio review tasks accurately...English language skillsRemote work
- ...Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and... ...expectations in Turkish. The ideal candidates are native or fluent Turkish speakers with strong cultural insight, attention to...Contract workTemporary workImmediate startRemote work
$70 per hour
...technical talent with leading AI research labs. Headquartered... ...Remote Role Responsibilities Evaluate AI-generated responses to ensure... ...feedback to improve AI model outputs. Identify nuances, implicit... ...critical reading skills. Native English fluency required. Preferred None...Contract workSummer workRemote work$18 per hour
RWS TrainAI is seeking AI Linguistic Evaluators to assess Telugu-language performance for a short freelance collaboration. Native Telugu with strong English skills and a keen eye for linguistic quality are required. You'll translate prompts from English into Telugu, interact...English language skillsRemote jobFreelanceImmediate startFlexible hours- ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Hourly payFor contractorsRemote work10 hours per week
- ...opportunity for a Media/Journalism/Communications Evaluator. You will assess AI-generated artifacts, identify errors,... ...structured feedback to improve model outputs. The role requires 5+ years in media or related fields, native English proficiency, and strong MS Office/Google...Remote jobContract work
$18 per hour
...hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance Qualifications: Native-level fluency in Telugu and strong English Degree in...English language skillsRemote jobHourly payTemporary workFreelanceFlexible hours- Hippocratic AI is seeking an HCP Sales Evaluator to review AI-driven sales interactions with healthcare professionals. This contractor role involves listening... .../virtual HCP-facing sales experience, with strong English communication and reliable internet access. Flexible,...English language skillsPart timeFor contractorsFlexible hours
- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates... ...in product launch readiness and be fluent in English. Proficiency in Microsoft Office and Google Workspace...English language skillsRemote jobHourly payWork at office
$18 per hour
RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote... ...personal device to participate. Ideal candidates are native Marathi speakers with strong English, attention to linguistic nuance, and the ability...English language skillsRemote jobFreelanceImmediate startFlexible hours- Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context....English language skillsRemote jobFor contractorsLocal area
$30 per hour
...hours/week Role Responsibilities Evaluate outputs from large language models... ...and quality standards. Review multi-step agent workflows, including... ...in LLM evaluation, AI output analysis, QA/testing,... ...ambiguous cases. Proficient English communication skills (written...Remote jobHourly payContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluator - English - native speaker reviewing AI outputs. Be the first to apply!
- work from home web search evaluator New York, NY
- evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- ads evaluator New York, NY


