Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

Full-time

CNTXT AI

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor) in Brooklyn, NY vacancy
  • $100 per hour

     ...Pay: up to $100/hour As a React Native Engineer, you will work remotely on an hourly paid basis to review AI-generated React Native...  ..., hourly paid contractor role is with SME Careers...  ...AI Performance: Evaluate and rank AI...  ...familiarity. ~ Minimum C1 English proficiency (... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Immediate start
    Worldwide

    SuperAnnotate

    San Francisco, CA
    1 day ago
  •  ...a Benefits Specialist (Contractor) at Worldwide Play...  ...in delivering critical U.S. benefits programs that...  ...ll Work This is a REMOTE role open to candidates...  .... Proficiency in English; CBP, CEBS, or related...  ...position is annually (For hourly paid positions, the... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Immediate start
    Worldwide

    Worldwide Clinical Trials

    Remote
    11 days ago
  • $50 per hour

     ...technical talent with leading AI research labs....  ...Dorsey . Position: English Language and Literature...  ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy...  ...Qualifications Must-Have Native or near-native fluency... 
    Remote work
    English language skills
    Contract work
    Summer work

    Mercor

    San Jose, CA
    10 days ago
  •  ...based in the United States to provide EN → native language translations remotely for diverse clients. This 1099 independent contractor role supports global projects across...  ...workloads. Applicants should have native English plus another language, CAT tools knowledge... 
    For contractors
    Remote job
    English language skills
    Freelance
    Flexible hours

    Piedmont Global

    New York, NY
    2 days ago
  • $9 - $30 per hour

     ...the Job The Testing Evaluator position is a remote, on demand, part-time...  ...examinee in the evaluator's native language. Support for...  ...Language: A minimum English proficiency level of...  ...must be based in the U.S. Unfortunately, we...  ...as a federal contractor, we are happy to make... 
    For contractors
    Remote work
    English language skills
    Full time
    Part time
    Currently hiring
    Work at office
    Flexible hours

    ALTA Language Services, Inc.

    New York, NY
    2 days ago
  •  ...psychologist for a fully remote, contract engagement....  ...development in Gujarati and English, AI-output evaluation, and cultural-...  ...psychology experience, native or near-native fluency...  ...a remote, independent contractor opportunity with hourly compensation. #J-18808... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Contract work

    24-MAG LLC

    New York, NY
    21 hours ago
  •  ...STRATEGIES is seeking experienced Thai-to-English and/or English-to-Thai translators and editors for a remote, ongoing freelance contractor role. Work focuses on a U.S. govt client translating vital...  ...transcripts. Candidates must be native Thai and near-native English, hold... 
    For contractors
    Remote job
    English language skills
    Freelance

    Global Language Strategies LLC

    New York, NY
    2 days ago
  • $28 per hour

     ...speech and voice AI systems. This...  ...execution-focused than evaluation-heavy roles, it...  ...-dependent)  Hours: Full-time, 40...  ...authorized to work in the U.S. (no visa...  ...position — remote work is not available...  ...Looking For ~ Native-level fluency in English (UK) ~ Strong written... 
    Hourly pay
    Remote work
    English language skills
    Full time
    Work experience placement
    Visa sponsorship

    Welo Data

    Los Angeles, CA
    7 days ago
  • An online education platform is looking for native English-speaking tutors to conduct one-on-one online sessions with adult learners. You will...  ...real-time feedback to boost fluency. The role offers a fully remote and flexible schedule, making it ideal for passionate... 
    Remote work
    English language skills
    Flexible hours

    Leadintop

    New York, NY
    4 days ago
  • $80 - $120 per hour

     ...$80 - $120 per hour We are hiring expert Evaluators in Special education...  ...and assess AI-generated work products...  .... This is a remote, hourly...  ...education / IEP. # Native or professional fluency in English. # Highly...  ...an independent contractor. This is a fully... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Work at office

    Weekday AI

    United States
    1 day ago
  • Overview Are you a Native‑French writer with experience writing about...  ...Us We are a fast‑growing, remote‑first company based in Munich...  ...French and near‑native fluency in English. Basic experience with Canva...  ...and willing to work additional hours in exceptional situations. Benefits... 
    Remote job
    English language skills
    Freelance
    Flexible hours

    Feedinkoo: Remote Jobs

    New York, NY
    5 days ago
  • $90 per hour

     ...talent with leading AI research labs. Headquartered...  ...Compensation: $90/hour Location: Remote Duration:...  ...ensure high-quality evaluations. Qualifications...  ...role. ~ Fluent or native English . Preferred...  ...& Legal ~ Hourly contractor Application Process... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Summer work

    Mercor

    Houston, TX
    5 days ago
  •  ...Specialist - Freelance AI Trainer Project World Wide - Remote Are you a...  ...models to evaluate translations, assess...  ...Albanian and English, review...  ...references. Native or near-native...  ...$6 to $65 per hour, with the exact...  ...listed above. As a contractor you'll supply a... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Freelance

    Meridial

    United States
    1 day ago
  • YO AI Labs is seeking a Thai Bilingual Expert to support an AI training project by evaluating Thai audio for fluency, pronunciation, and linguistic accuracy. This remote contractor role requires native Thai and English at B2 or higher, plus strong written and verbal communication... 
    For contractors
    Remote job
    English language skills

    YO AI Labs

    New York, NY
    1 day ago
  • This is a remote position. Amharic to English Translator and/or Editor - (Remote - ongoing basis) Freelance Independent Contractor Must be a U.S. citizen willing to undergo a Tier 1 background investigation...  .... Requirements 1. A native speaker of Amharic and near-native... 
    For contractors
    Remote work
    English language skills
    Freelance

    GLOBAL LANGUAGE STRATEGIES

    New York, NY
    5 days ago
  • Category: Frontier Model Evaluation Pay: Hourly rate confirmed after the interview process Location: Remote US-eligible Contractor AI Trainer & Evaluator is a remote evaluation track for reviewing ai trainer evaluation prompts and responses against AuraOne's quality rubric... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • Mercor is hiring experienced U.S. Dermatologists on...  ...projects that help develop and evaluate advanced AI models for dermatology....  ...education preferred. English fluency required. Why Join...  ...as an independent contractor. This is a fully remote role that can be completed... 
    For contractors
    Remote work
    English language skills
    Contract work

    Modern MedEd LLC

    New York, NY
    2 days ago
  • $29.74 - $41.04 per hour

     ...The Clinical Trainer will be responsible...  ...of the English language, including...  ...experience per hour. Hourly Pay...  ...Looking for remote This position...  ...are a federal contractor or subcontractor...  ...form, visit the U.S. Department of...  ...Races Native Hawaiian or Other... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Temporary work
    Work experience placement
    For subcontractor
    H1b
    H-2A Visa
    Live in
    H2b
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Relocation package
    Flexible hours

    Vail Health

    Avon, CO
    1 day ago
  • $75 - $90 per hour

     ...talent with leading AI research labs. Headquartered...  ...: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI work product in...  ...and records. Near-native business English proficiency....  ...& Legal ~ Hourly contractor Application Process... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Summer work

    Mercor

    Nashville, TN
    5 days ago
  • $22 - $70 per hour

     ...quality of text used in AI evaluation and training. This remote contract role...  ...structure, and natural English usage. No prior AI...  ...English. Native-level English proficiency...  ...Terms Remote contractor engagement. Assignments...  .... Compensation Hourly compensation ranges... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work

    SaidGig

    United States
    17 days ago
  • $1,280 per month

     ...Receptionist Location: Remote — Dominican...  ...Type: Full-Time (Contractor) Number of Openings...  ...,280 USD/month English Proficiency:...  ...Time | US Business Hours Start Date: As...  ...a rapidly growing U.S.-based healthcare...  ...role. Candidate Evaluation Considerations... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Freelance
    Work at office
    Immediate start

    Entrepreneur Cooperative

    United States
    3 days ago
  •  ...multilingual learning content evaluation project. Remote work is available for...  ...is freelance/independent contractor, approx. 5.5 hours across 3 rounds from the week...  ...be German residents, native-level German speakers, proficient in English, and qualified as middle or... 
    For contractors
    Remote job
    English language skills
    Freelance

    DataForce by TransPerfect

    New York, NY
    4 days ago
  • $40 - $120 per hour

     ...English Writing Generalist $40-120/hr Remote Freelance GENERAL About the Role...  ...directly influence how AI communicates with...  ...Alignerr Type: Hourly Contract Location...  ...stylistic consistency Evaluate AI-generated...  ...Who You Are Native or near-native English... 
    Hourly pay
    Remote work
    English language skills
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr

    United States
    5 days ago
  • $75 - $125 per hour

     ...UX Product Designer - AI Trainer to help evaluate how frontier AI...  ...bring Fluency in English at native or bilingual level....  ...Location: Evanston, IL (remote) Pay: USD $75-$125 per hour Bonus rates: available...  ...is an independent contractor position. #J-18808... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Work at office

    DataAnnotation

    Evanston, IL
    5 days ago
  •  .../ . . $ $, . These roles are open to U.S. citizens with an active TS/SCI clearance...  ...- Public trust clearances - Remote-only candidates - Candidates who are not...  ...careers. Our clients include government contractors of all sizes and venture-backed technology... 
    For contractors
    Remote work
    Contract work
    Visa sponsorship

    Task Force Talent

    Fairfax, VA
    1 day ago
  • $20 per hour

     ...Job Application for English Language...  ...Only) - Freelance AI Trainer Project at Meridial...  ...Project World Wide - Remote Are you eager to...  ...test model outputs, evaluate responses for...  ...range of $20 per hour, with the exact rate...  ...listed above. As a contractor you’ll supply a secure... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Freelance
    H1b
    Immediate start

    Invisible Technologies

    San Francisco, CA
    1 day ago
  •  ...or a related field. Native or near-native...  ...Japan. Minimum C1 English proficiency (reading/writing...  ...prompts, sources, and evaluation guidelines. 5+ years...  ...Comfort working as an hourly contractor: dependable throughput...  ...Previous experience with AI data training /... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    SME Careers

    United States
    4 days ago
  •  ...related field. Native or near-native Arabic...  ...). Minimum C1 English proficiency (...  ...writing) for bilingual evaluation and instruction...  ...consistently in high-volume, hourly contractor work. Strong...  ...in a remote, asynchronous environment...  ...experience with AI data training, annotation... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    SME Careers

    United States
    4 days ago
  •  ...the roleWe are hiring expert Evaluators in Finance to review and assess AI-generated work products (...  ...to grade outputs.This is a remote, hourly engagement.Requirements (must...  ...Australia, or New Zealand.Native or professional fluency in English.Highly proficient in... 
    Hourly pay
    Remote work
    Work at office

    Mercor

    Charlotte, NC
    5 days ago
  •  ...English Writing Generalist (AI Training) About The Role We're looking for...  ...writers to help evaluate and improve AI-generated...  ...Powered by Labelbox) Type: Hourly Contract Location: Remote Commitment: 10–40...  ...schedule Who You Are Native or near-native English... 
    Hourly pay
    Remote work
    English language skills
    Ongoing contract
    Contract work
    Freelance
    Flexible hours

    Alignerr Corp.

    Chicago, IL
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor). Be the first to apply!