Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluator - English - native speaker reviewing AI outputs

$15 per hour

Outlier

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video models. This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you. You may contribute your expertise by… Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded Comparing pairs of AI-generated images and videos and judging which one better follows the prompt Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Examples of desirable expertise: Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech Bachelor's degree or higher (preferred) Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way Experience writing short, evidence-based explanations or reviews Comfortable making a clear decision when both options have flaws What you'll need: A computer with a reliable internet connection and headphones A quiet place to talk for projects that involve live conversation Payment: Project work: Earn up to USD $15 per hour for core project work. Additional incentives: On average, Outlier Contributors earn an additional 7.5% on top of the core project rates through Missions - Outlier’s version of surge pricing. The top quartile of contributors boost their earnings by an average of 11%. Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project. Getting started includes a short screening and onboarding, which may include a brief spoken English check. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances. #J-18808-Ljbffr Outlier

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluator - English - native speaker reviewing AI outputs in New York, NY vacancy
  • $80 - $120 per hour

    Weekday AI is seeking experienced Evaluators to review AI-generated artifacts for data quality and CRM operations....  ...structured feedback, and help improve output accuracy. Compensation is $80-$120...  ...contractor role requires English fluency and 5+ years in relevant work... 
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    For contractors
    Weekday work

    Weekday AI

    New York, NY
    2 days ago
  • Obsidian is hiring expert Evaluators in Special education/IEP to review AI-generated work products for accuracy and rigor...  ...subject-matter expertise to grade outputs. Candidates must possess at least...  ..., professional fluency in English, and proficiency in Microsoft Office... 
    Suggested
    Hourly pay
    Work at office
    Remote work

    Obsidian

    New York, NY
    4 days ago
  • $50 - $70 per hour

    Mercor is seeking a Generalist Expert to review and assess documents and AI-generated outputs. This contract-remote role requires a US/Canada base and strong written English, with flexible hours and independence across docs, slides, and sheets. Compensation ranges from... 
    English language skills
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    mercor

    New York, NY
    4 days ago
  • AI Trainer Jobs is seeking a remote Database and SQL AI Evaluator to review prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and write structured feedback for retraining. Role details: freelance contractor, hourly... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    Freelance

    AuraOne

    New York, NY
    21 hours ago
  •  ...seeks a Professional Services Practice Reviewer to assess AI-generated content for professional...  ...compliance. You will review AI agent outputs, scoresheets, and domain materials to...  ...development, or IT management, plus near-native English and strong skills with spreadsheets... 
    Suggested
    Remote job

    Mercor Inc

    New York, NY
    3 days ago
  • Obsidian is seeking expert Evaluators in Biology and environmental science to review AI-generated outputs for accuracy and domain quality. Work is remote and paid hourly, leveraging deep subject-matter knowledge to assess and grade documents, spreadsheets, and slide decks... 
    Remote job
    Hourly pay

    Obsidian

    New York, NY
    1 day ago
  • Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy...  ...-matter expertise to grade outputs and provide structured...  ...Humanities / arts / culture, native or professional English, and strong proficiency with... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    4 days ago
  • $20 - $30 per hour

     ...is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable...  ...and excellent communication abilities in English. This position allows for flexibility, with... 
    English language skills
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    3 days ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the...  ...assessing audio clips, reviewing tones for cultural relevancy...  ...quality control in audio outputs. The role requires fluent Tamil and English, high emotional intelligence... 
    English language skills
    Remote job
    Flexible hours

    Prolific

    New York, NY
    21 hours ago
  •  ...an experienced contractor to evaluate AI-generated artifacts and provide...  ...feedback. You will review documents, spreadsheets, and...  ...SRE best practices to grade outputs. The role is remote, hourly,...  ...incident management or SRE, strong English, and proficiency in Microsoft... 
    English language skills
    Remote job
    Hourly pay
    Weekly pay
    For contractors
    Work at office
    Flexible hours

    RemoteLeads

    New York, NY
    2 days ago
  • Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy...  ...-matter expertise to grade outputs and provide clear, structured...  ...5+ years in user research, native or professional English, and strong MS Office/Google... 
    Remote job
    Hourly pay

    Mercor

    New York, NY
    2 days ago
  •  ...the next generation of AI-narrated audiobooks sound...  ...We're building a team of native Dutch speakers who love audiobooks to help evaluate AI-narrated (text-to-...  ...where it occurs, using our review tooling. Report on...  ...listen. Enough working English to report clearly and communicate... 
    English language skills
    Part time
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...talent with leading AI research labs....  ...financial-services AI Evaluator Type: Contract...  ...to improve AI model outputs. Apply deep...  ...services AI . ~ Native or professional fluency in English . ~ Highly proficient...  ...PS: Our team reviews applications daily.... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    8 days ago
  • Mercor is seeking a Document Review Expert to evaluate AI-generated responses and provide detailed corrections in a remote contract role. You...  ...to high-impact AI research projects. This role requires native English fluency, strong reading and writing skills, and the ability... 
    Remote job
    Contract work

    Mercor Inc

    New York, NY
    4 days ago
  • $60 - $70 per hour

     ...technical talent with leading AI research labs....  ...Role Responsibilities Evaluate AI-generated responses...  ...and overall quality. Review content involving...  .... Identify unsafe outputs, hallucinations, reasoning...  ...~ Excellent written English , critical thinking, and... 
    English language skills
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    29 days ago
  • $70 - $110 per hour

     ...technical talent with leading AI research labs....  ...Role Responsibilities Evaluate AI-generated financial...  ...and analytical rigor. Review financial scenarios...  ...while enhancing AI model outputs . Qualifications...  .... ~ Strong written English communication skills.... 
    English language skills
    Hourly pay
    Contract work
    Summer work
    Work at office
    Immediate start
    Remote work

    Mercor

    New York, NY
    24 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology...  .... Some weeks there is more data to review, other weeks less. Start Date ASAP...  ...Experience & Requirements Fluent in English (written and spoken) Strong... 
    English language skills
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    5 days ago
  • DataAnnotation seeks a Chemist to evaluate AI chemical reasoning, identify unsafe or incorrect...  ...that probe mechanisms and analyses, review AI outputs for accuracy and safety, and deliver...  ...role emphasizes clarity in written English and strong chemistry knowledge. Remote... 
    English language skills
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    21 hours ago
  •  ...to a language and AI training project...  ...systems. You will evaluate Thai audio...  ...focused on your native-level Thai language...  ...— native level; English — minimum B2 Key...  ...and fluency of the speaker or AI-generated output. Assess pronunciation...  ...assigned audio review tasks accurately... 
    English language skills
    Remote work

    Remote Worker LTD.

    New York, NY
    1 day ago
  •  ...Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and...  ...expectations in Turkish. The ideal candidates are native or fluent Turkish speakers with strong cultural insight, attention to... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    2 days ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Remote Role Responsibilities Evaluate AI-generated responses to ensure...  ...feedback to improve AI model outputs. Identify nuances, implicit...  ...critical reading skills. Native English fluency required. Preferred None... 
    Contract work
    Summer work
    Remote work

    Mercor Inc

    New York, NY
    3 days ago
  • $18 per hour

    RWS TrainAI is seeking AI Linguistic Evaluators to assess Telugu-language performance for a short freelance collaboration. Native Telugu with strong English skills and a keen eye for linguistic quality are required. You'll translate prompts from English into Telugu, interact... 
    English language skills
    Remote job
    Freelance
    Immediate start
    Flexible hours

    RWS TrainAI

    New York, NY
    8 hours ago
  •  ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AI Trainer Jobs

    New York, NY
    2 days ago
  •  ...opportunity for a Media/Journalism/Communications Evaluator. You will assess AI-generated artifacts, identify errors,...  ...structured feedback to improve model outputs. The role requires 5+ years in media or related fields, native English proficiency, and strong MS Office/Google... 
    Remote job
    Contract work

    mercor

    New York, NY
    4 days ago
  • $18 per hour

     ...hours Rate: $18 USD per hour What You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy and cultural relevance Qualifications: Native-level fluency in Telugu and strong English Degree in... 
    English language skills
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    2 days ago
  • Hippocratic AI is seeking an HCP Sales Evaluator to review AI-driven sales interactions with healthcare professionals. This contractor role involves listening...  .../virtual HCP-facing sales experience, with strong English communication and reliable internet access. Flexible,... 
    English language skills
    Part time
    For contractors
    Flexible hours

    Openkrill

    New York, NY
    4 days ago
  • Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates...  ...in product launch readiness and be fluent in English. Proficiency in Microsoft Office and Google Workspace... 
    English language skills
    Remote job
    Hourly pay
    Work at office

    Mercor

    New York, NY
    21 hours ago
  • $18 per hour

    RWS TrainAI is seeking AI Linguistic Evaluators to assess Marathi-language performance for a short collaboration. This remote...  ...personal device to participate. Ideal candidates are native Marathi speakers with strong English, attention to linguistic nuance, and the ability... 
    English language skills
    Remote job
    Freelance
    Immediate start
    Flexible hours

    RWS TrainAI

    New York, NY
    1 day ago
  • Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context.... 
    English language skills
    Remote job
    For contractors
    Local area

    Embedded Shishya

    New York, NY
    2 days ago
  • $30 per hour

     ...hours/week Role Responsibilities Evaluate outputs from large language models...  ...and quality standards. Review multi-step agent workflows, including...  ...in LLM evaluation, AI output analysis, QA/testing,...  ...ambiguous cases. Proficient English communication skills (written... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluator - English - native speaker reviewing AI outputs. Be the first to apply!