Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor) in Brooklyn, NY vacancy
  • This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based...  ...AI training datasets. LLM evaluation: reviewing AI-generated responses...  .... Profile Requirements Native speakers of American English born and raised in the United... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Flexible hours

    CNTXT AI

    New York, NY
    3 days ago
  • $40 - $65 per hour

     ...Listen to British English recordings and AI-generated speech and judge how natural they...  ...coordinators What you need Native-level British English Clear...  ...guidelines Contract Remote, hourly contract (independent contractor) Part-time, flexible: 10–40... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Weekly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    United States
    18 hours ago
  •  ...CNTXT AI is a fully remote, hourly contractor role supporting AI data and language projects...  ...data annotation, LLM evaluation, content generation, and...  ...judgment alongside minimum C1 English proficiency. Ideal...  ...hold a bachelor’s degree, native European Portuguese, strong... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    CNTXT AI

    United States
    2 days ago
  • $25 per hour

     ...Review and improve AI answers written in Czech so they read...  ...questions What you need Native-level Czech and professional English Strong writing and grammar...  ...across many tasks Contract Remote, hourly contract (independent contractor) Part-time, flexible: 10–40... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Weekly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    United States
    18 hours ago
  •  ...learning. We are seeking a U.S.-based Part‑Time...  ...growing multi‑country, remote team. Role Overview The...  ...employees and international contractors. Develop scalable...  ...or BambooHR. Fluent in English (other languages a plus...  ...Part‑time (approx. 15–20 hours/week; flexible scheduling... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Part time
    Local area
    Flexible hours

    TrueLeap Inc.

    New York, NY
    17 hours ago
  • $15 per hour

     ...Judge whether an AI assistant uses personal context...  ...language What you need Native-level skill in the project language, plus English Willingness to use your...  ...Able to commit 20+ hours a week Contract Remote, hourly contract (independent contractor) Part-time, flexible: 1... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Weekly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    19 hours ago
  •  ...Our client is a remote product studio that...  ...week sprints with AI coding tools used...  ..., including React Native applications released...  ...and spoken English for PR descriptions...  ...field, frontline or hourly workers A localized...  ...: Fully remote contractor role from LATAM,... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Local area

    Atomic HR

    Remote
    14 days ago
  •  ...Job Title: Freelance Remote Interpreter (Hindi / English, US-Based) Location:...  .../Independent Contractor | Schedule: Flexible...  ...Requirements Language: Native or near-native fluency...  ...States, with proof of U.S. residency (...  ...work. Choose your own hours (daytime, evening, overnight... 
    For contractors
    Remote work
    English language skills
    Freelance
    Immediate start
    Flexible hours
    Night shift
    Afternoon shift

    Tonguepoint

    New York, NY
    3 days ago
  • $21 - $65 per hour

     ...Photographer – AI Image Quality Evaluation (Remote, U.S.) Our client is seeking photography...  ...and clear, concise written English. Participate in iterative...  ...Engagement: Independent contractor. Compensation: USD $21–$65 per hour. Qualifications... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work

    pofft Technology Inc.

    United States
    17 hours ago
  • $276.17k - $334.65k

     ...Excellent written and spoken English. ~ Role model...  ...Rayzebio Exempt, Non-Exempt, Hourly Employees: 160 hours...  ...is for United States (U.S.) office-based employees...  ...centers. Employees in remote-by-design or lab-based...  ...if they are eligible. Contractors, leased workers and other... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Temporary work
    Part time
    Summer work
    Live in
    Work at office
    Local area
    Flexible hours
    Shift work

    Bristol-Myers Squibb Co

    New Jersey
    2 days ago
  • $25 - $50 per hour

    Review AI code and the technical explanations around...  ...a language other than English. You check both that...  ...reads like a native engineer wrote it. What...  ...technical terminology 20+ hours a week Contract Remote, hourly contract (independent contractor) Part-time, flexible:... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Weekly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    2 days ago
  • $50 - $70 per hour

     ...Type: Freelance Hourly Contract...  ...Location: Remote About the Opportunity...  ...thinkers and experienced evaluators interested in contributing...  ...to advanced AI research and...  ...Eligibility Native English fluency is required...  ...hour. Independent contractor engagement. Flexible... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Freelance
    Flexible hours

    Synthires

    United States
    11 hours ago
  • Vettedlance is seeking a remote contractor to review and improve AI Croatian responses, rate accuracy, fluency, tone, and instruction...  ...with reasoning examples. This part-time, hourly role requires Croatian native and professional English, strong writing, research skills, and... 
    Hourly pay
    For contractors
    Remote job
    Weekly pay
    Part time

    Vettedlance

    New York, NY
    2 days ago
  •  ...Location: Remote (approved countries) · Type: Independent contractor What this pays Rates are set by the...  ...place. Work is paid hourly or per task depending...  ...the Role We are seeking native U.S. English speakers with authentic...  ...conversations for an AI data project. As a Customer... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    10 hours per week
    Flexible hours

    Pasiflora AI LLC

    New York, NY
    1 day ago
  •  ...a medical professional to review AI medical content in Japanese and English and annotate clinical cases with...  ...correct terminology. The role is remote as an independent contractor, part-time with 10–40 hours per week, paid hourly. Native Japanese and professional English... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Part time
    10 hours per week

    Vettedlance

    United States
    18 hours ago
  •  ...editor capable of handling Japanese-English or English-Japanese projects. This remote, ongoing independant contractor role involves translating and...  ...needed. Candidates must be U.S. citizens residing in the United States, with native or near-native Japanese and English... 
    For contractors
    Remote work
    English language skills
    Freelance

    Global Language Strategies

    Fairfax, VA
    17 hours ago
  • Position Summary In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases...  ...in writing Full professional English proficiency Reliable and self-...  ...products, with deep expertise in Arabic-native and secure, sovereign solutions.... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Full time

    CNTXT AI

    New York, NY
    3 days ago
  •  ...Latin America to join our remote team. You will speak with U.S.-based Medicare patients...  ...join. This independent contractor role is remote and available...  ...time with a minimum of 20 hours per week. You must have...  ...healthcare experience, clear English, reliable internet, and a... 
    For contractors
    Remote work
    English language skills
    Full time
    Part time
    Home office

    1bios

    United States
    3 days ago
  •  ...Category: Frontier Model Evaluation Pay: Hourly rate confirmed after the interview process Location: Remote US-eligible Contractor AI Trainer & Evaluator is a remote evaluation track for reviewing ai trainer evaluation prompts and responses against AuraOne's quality rubric... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  • $9 - $30 per hour

     ...THE JOB The Testing Evaluator position is a remote, on demand, part-time...  ...examinee in the evaluator's native language. Support for...  ...Language: A minimum English proficiency level of...  ...must be based in the U.S. Unfortunately, we...  ...as a federal contractor, we are happy to make... 
    For contractors
    Remote work
    English language skills
    Full time
    Part time
    Currently hiring
    Work at office
    Flexible hours

    ALTA Language Services, Inc.

    New York, NY
    4 days ago
  • Overview Are you a Native‑French writer with experience writing about...  ...Us We are a fast‑growing, remote‑first company based in Munich...  ...French and near‑native fluency in English. Basic experience with Canva...  ...and willing to work additional hours in exceptional situations. Benefits... 
    Remote job
    English language skills
    Freelance
    Flexible hours

    Feedinkoo: Remote Jobs

    New York, NY
    2 days ago
  • $37.9 - $60.45 per hour

     ...working knowledge of the English language, including...  ...and experience per hour. Hourly Pay:...  ...Looking for remote Have you ever been...  ...? We are a federal contractor or subcontractor. The...  ...form, visit the U.S. Department of Labors...  ...Races Native Hawaiian or Other Pacific... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Temporary work
    Work experience placement
    For subcontractor
    Live in
    H2b
    H1b
    H-2A Visa
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work
    Night shift

    Vail Health

    Vail, CO
    1 day ago
  • $41.6k - $114.4k

     ...focused on realtime AI for consumer-facing...  ...roles: evaluate pronunciation, dialect...  ...naturalness in your native language What we...  ...Strong written English for reporting findings...  ...work Location: Remote within the United States...  ...Compensation: $20-$55 per hour. Rate depends on... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work

    Inworld

    Remote
    14 days ago
  • $35 - $65 per hour

     ...Review AI medication answers, write expert pharmacy responses...  ...safety issues. Work is remote and part-time, and you start...  ...need Licensed pharmacist C1 English 20+ hours a week Clinical pharmacy knowledge...  ...contract (independent contractor) Part-time, flexible: 10–40... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Weekly pay
    Contract work
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    18 hours ago
  • CNTXT AI is seeking a senior Hindi localization specialist for a fully remote, hourly contractor role. You will apply localization judgment to data annotation, evaluation, and content generation tasks, ensuring tone...  .... You will leverage C1 English proficiency to interpret... 
    Hourly pay
    For contractors
    Remote job
    English language skills

    CNTXT AI

    New York, NY
    2 days ago
  • $50 - $60 per hour

     ...professionals to help train AI models from home. Physicians...  ...scheduling around their commitments. Contractors are paid hourly at $50-$60 USD, with...  .... To qualify, you need English fluency and a current or in-progress medical degree; remote work is available to eligible... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    DataAnnotation

    California
    17 hours ago
  • $23 - $29 per hour

     ...an experienced debt collection operator who is a native Spanish speaker and fluent in English. This full-time remote role requires handling calls, negotiating...  ...firmness with customer care. Compensation ranges hourly from $23.00 to $29.00, with opportunities for growth... 
    Hourly pay
    Remote work
    English language skills
    Full time

    MBA-Consult-US-LL

    New York, NY
    4 days ago
  •  ...coordinating with consultants and contractors, resolving technical...  ...experience working on U.S. architectural...  ...Excellent written and spoken English and confidence...  ...Availability for full‑time remote work with overlap...  ...Eastern Time business hours. Preferred Qualifications... 
    For contractors
    Remote work
    English language skills
    Full time

    Uptalent.io

    New York, NY
    17 hours ago
  • $10 - $65 per hour

     ...Partner - Freelance AI Trainer Project United...  ...) to provide native-level language...  ...project is to evaluate, annotate, and...  ...this project, contractors must possess a...  ...annotation. Verified English language...  ...$10‑to‑$65 per hour, with the exact...  ...Workplace Type Remote #J-18808-Ljbffr... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Freelance

    Meridial

    New York, NY
    1 day ago
  • $18 per hour

    RWS is seeking a Speech AI Evaluation Specialist to support Vietnamese-language...  ...part-time role offers about 10+ hours weekly and an hourly rate of $18,...  ...and accuracy. Ideal candidates are native Vietnamese speakers with strong English (B2-C2) proficiency and an #J-18... 
    Hourly pay
    Remote job
    English language skills
    Part time
    Freelance
    Immediate start
    Work from home
    Flexible hours

    RWS

    Austin, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor). Be the first to apply!