Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor) in Brooklyn, NY vacancy
  •  ...Supporting AI data and language projects, the hourly contractor AI Trainer and Evaluator will work remotely on a flexible basis, focusing on content generation, data...  ...nuances Required qualifications Native speaker of American English born and raised in the United States... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...seeking a Pyxis Technician to train AI models and ensure their...  ...with a choice of projects and hourly pay starting at $20, along with...  ...must be fluently bilingual in English and located in the United States. This is an independent contractor position with payments processed... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    DataAnnotation

    Wyoming, OH
    3 days ago
  •  ...Specialist to help train AI models in the...  ...The role involves evaluating AI outputs related...  ...must be fluent in English and hold a current...  ...This independent contractor position offers...  ...project selection and hourly pay rates starting...  ...Work can be done remotely. #J-18808-Ljbffr... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $20 per hour

     ...Pyxis Technician to help train AI models by evaluating AI outputs for logic and performance...  ...is required to be fluent in English. This role offers flexible work hours, with projects paid hourly...  ...States only, and this is an independent contractor position. #J-18808-Ljbffr
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    3 days ago
  • $40 per hour

    **DataTricks AI** is a U.S.-based artificial intelligence...  ...model (LLM) training, evaluation, and optimization. We...  ...ET), United States Remote – Hourly Contract Ongoing project...  ...proficient **LLM Trainer with a native or near-native US English accent** to support AI... 
    Hourly pay
    Remote work
    English language skills
    Contract work
    Flexible hours

    DatatricksAI

    Tampa, FL
    3 days ago
  •  ...learning. We are seeking a U.S.-based Part‑Time...  ...growing multi‑country, remote team. Role Overview The...  ...employees and international contractors. Develop scalable...  ...or BambooHR. Fluent in English (other languages a plus...  ...‑time (approx. 15-20 hours/week; flexible scheduling... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Part time
    Local area
    Flexible hours

    TrueLeap Inc.

    New York, NY
    1 day ago
  • $50 - $60 per hour

     ...creating high-quality AI. Enjoy the flexibility of remote work and the...  ...as an independent contractor.   We're currently...  ...Projects are paid hourly starting at USD $50...  ...complex problems and evaluate their outputs Evaluate...  ...: Fluency in English (native or bilingual level)... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Work experience placement

    Data Annotation

    Lincolnshire, IL
    more than 2 months ago
  • $50 - $60 per hour

     ...creating high-quality AI. Enjoy the flexibility of remote work and the...  ...as an independent contractor.   We're currently...  ...Projects are paid hourly starting at USD $50...  ...complex problems and evaluate their outputs Evaluate...  ...: Fluency in English (native or bilingual level)... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Work experience placement

    Data Annotation

    Sparks, NV
    more than 2 months ago
  • $50 - $60 per hour

     ...creating high-quality AI. Enjoy the flexibility of remote work and the...  ...as an independent contractor.   We're currently...  ...Projects are paid hourly starting at USD $50...  ...complex problems and evaluate their outputs Evaluate...  ...: Fluency in English (native or bilingual level)... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Work experience placement

    Data Annotation

    Terrytown, LA
    more than 2 months ago
  • $20 per hour

     ...Coding Specialist to train AI models and ensure the...  ...starting at $20+ per hour. Ideal for independent contractors in the U.S., it aims to improve...  ...interactions through expert evaluations, making it essential to have bilingual or native-level English proficiency. #J-18808-... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Jackson, MS
    3 days ago
  • $37.9 - $60.45 per hour

     ...working knowledge of the English language, including...  ...and experience per hour. Hourly Pay:...  ...Looking for remote Have you ever been...  ...? We are a federal contractor or subcontractor. The...  ...form, visit the U.S. Department of Labors...  ...Races Native Hawaiian or Other Pacific... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Temporary work
    Work experience placement
    For subcontractor
    H1b
    H-2A Visa
    Live in
    H2b
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Relocation package
    Flexible hours

    Vail Health

    Edwards, CO
    1 day ago
  •  ...contract as independent contractors. In this role, you will...  ...develop prompts to train AI chatbots, write quality responses, and evaluate AI model outputs. This position...  ..., permits flexible hours between 5-40 per week...  ...Applicants must be in the U.S., U.K., or Canada.... 
    Hourly pay
    For contractors
    Remote work
    Contract work
    Freelance
    Flexible hours

    DataAnnotation

    Wausau, WI
    4 days ago
  • $20 per hour

     ...educational, and short $20.00 hourly Remote Full-time Location: Remote...  ...Language Skills Required: English & Gujarati Native fluency in English and...  ...Safety & Toxicology Expert. AI data lab for training frontier models and evaluating AI agents. Experts contribute... 
    Hourly pay
    Remote job
    English language skills
    Full time
    Part time
    Monday to Friday

    Mercor Inc

    Pasadena, TX
    1 day ago
  • $40 per hour

     ...join our team to train AI models. You will...  ...of these AI chatbots, evaluate their logic, and solve...  ...full-time or part-time REMOTE position You’ll be...  ...Projects are paid hourly starting at $40+ USD per...  ...Qualifications Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Contract work
    Part time

    DataAnnotation

    Santa Fe, NM
    4 days ago
  • $20 - $27 per hour

     ...creating quality AI. Join our team to...  ...the flexibility of remote work and choosing...  ..., and independent contractors to join our team and...  ...demonstrate excellence, and evaluate different model...  ...work between 5-40 hours per week....  ...Qualifications Fluent in English A bachelor's... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Part time
    Self employment
    Freelance

    DataAnnotation

    Oklahoma City, OK
    3 days ago
  • $50 - $60 per hour

     ...creating high-quality AI. We are looking for a...  ...enjoying the flexibility of remote work and the freedom...  ...Projects are paid hourly starting at USD $50-$6...  ...complex problems and evaluate their outputs Evaluate...  ...Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Contract work
    Part time
    Work experience placement
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • DataAnnotation is hiring a Japanese-English Language Instructor based in the...  ...United States. This independent contractor role allows you to train AI models by evaluating their writing and editing tasks...  ...grammar skills. Projects pay hourly rates starting at $25, and additional... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Flexible hours

    DataAnnotation

    Kansas City, MO
    2 days ago
  • $20 per hour

     ...creating quality AI. Join our team to...  ...the flexibility of remote work and choosing...  ..., and independent contractors to join our team and...  ...demonstrate excellence, and evaluate different model...  ...work between 5-40 hours per week....  ...Qualifications Fluent in English Experience... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Full time
    Contract work
    Part time
    Self employment
    Freelance

    DataAnnotation

    New York, NY
    21 hours ago
  • $60 per hour

     ...developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your...  ...models on tasks like evaluating AI-generated quantitative...  ...: projects are paid hourly, up to $60 USD/hour....  ...forecasting). ~ Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...you need to succeed in this role: Native Hungarian and strong English proficiency (minimum C1 level) At least...  ...schedule Opportunity to work fully remotely Inclusive international environment...  ...apply to employees; independent contractors may not be eligible for all of these... 
    For contractors
    Remote job
    English language skills
    Home office
    Trial period
    Flexible hours
    Shift work

    Framework Ventures

    New York, NY
    1 day ago
  • $20 per hour

     ...for the Freelance Contractor role at DataAnnotation...  ...our team to train AI models. You will...  ...AI chatbots, evaluate their logic, and solve...  ...model. This is a remote, flexible position with paid hourly work. Responsibilities...  ...Fluency in English (native or bilingual level... 
    Hourly pay
    For contractors
    Remote work
    Full time
    Contract work
    Part time
    Freelance
    Flexible hours

    DataAnnotation

    Hartford, CT
    3 days ago
  • $50 per hour

     ...our team to train AI models. You will measure...  ...AI chatbots, evaluate their logic, and...  ...time or part-time remote position Choose...  ...Projects are paid hourly starting at $50+ per...  ...Fluency in English (native or bilingual level...  ...is an independent contractor position. #J-188... 
    Hourly pay
    For contractors
    Remote work
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Montgomery, AL
    2 days ago
  • Overview Are you a Native‑French writer with experience writing about...  ...Us We are a fast‑growing, remote‑first company based in Munich...  ...French and near‑native fluency in English. Basic experience with Canva...  ...and willing to work additional hours in exceptional situations. Benefits... 
    Remote job
    English language skills
    Freelance
    Flexible hours

    Feedinkoo

    New York, NY
    21 hours ago
  • $50 - $60 per hour

     ...Attorney to assist in training AI models by evaluating their logic and legal...  ...selection and scheduling. As a contractor, you will work from home and can earn hourly rates between $50-$60,...  ...the project. Fluency in English is essential, and only U.S. applicants will be considered... 
    Hourly pay
    For contractors
    Remote job
    Work from home

    DataAnnotation

    Florida, NY
    2 days ago
  • $20 per hour

     ...their team for training AI models and evaluating AI chatbot logic. The role is remote and offers flexible scheduling...  ...starting at $20 per hour. Candidates should be fluent in English and have a current or in-...  ...degree. This independent contractor position focuses on providing... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    3 days ago
  • $50 - $60 per hour

     ...Specialist to aid in training AI models by providing...  ...problems and evaluating outputs. This independent contractor position allows you to work remotely, on your schedule, and offers hourly rates starting at $50-...  ...degree and fluency in English. You'll help ensure the... 
    Hourly pay
    For contractors
    Remote job

    DataAnnotation

    New York, NY
    1 day ago
  •  ...English Language Program Adjunct The Reves Center for...  ...language courses for non-native English speakers,...  ...may require additional hours beyond the typical work...  ...poster published by the U.S. Equal Employment Opportunity...  ...driving history check. Remote work eligibility is not... 
    Hourly pay
    Remote work
    English language skills
    Part time

    Virginia Department of Human Resource Management

    Williamsburg, VA
    2 days ago
  • $50 - $60 per hour

     ...an experienced Nurse Practitioner to evaluate AI outputs related to healthcare. You...  ...the United States. This independent contractor position offers hourly pay starting at $50-$60 USD, ensuring...  ...medical degree in progress or completed and fluent English skills. #J-18808-Ljbffr... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    DataAnnotation

    Raleigh, NC
    4 days ago
  • Freelance Native-Level German Technical Translator Location: Remote (EU-based preferred) Hours: Variable (depending on project needs) VeraContent...  .... We’re seeking English-to-German translators who are...  ...of architects, engineers, contractors and logistics professionals... 
    For contractors
    Remote work
    English language skills
    Freelance
    Flexible hours

    VeraContent

    New York, NY
    1 day ago
  • $40 per hour

    DataAnnotation is seeking an AI Trainer in New York, NY. The...  ...problems and evaluating AI outputs. This independent contractor position offers flexible...  ...Applicants should be fluent in English and possess a strong mathematical...  .... Projects pay hourly starting at $40+ USD. #J... 
    Hourly pay
    For contractors
    Remote job
    English language skills
    Work from home
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor). Be the first to apply!