Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

CNTXT AI

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor) in Brooklyn, NY vacancy
  •  ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on...  ...AI training datasets. LLM evaluation: reviewing AI-generated...  ...position exclusively seeks native speakers of American English born and raised in the United... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    22 days ago
  •  ...Hebrew AI Data Trainer - Remote Location: Remote This is a fully remote, hourly‑paid contractor role focused on improving the quality...  ...systems. You will evaluate AI‑generated responses in Hebrew and English, assess step‑by‑step...  ...or a related field Native or near‑native... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    YO IT Consulting

    Chicago, IL
    1 day ago
  • $20 per hour

     ...company is seeking a Receptionist to evaluate and train AI models remotely. This role involves assessing...  ...schedule, with projects paid hourly starting from $20+ USD. While a...  ...detail-oriented and fluent in English, and only applicants in the U.S. will be considered. #J-18808... 
    Hourly pay
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Lansing, MI
    23 hours ago
  •  ...seeking a Pyxis Technician to train AI models and ensure their...  ...with a choice of projects and hourly pay starting at $20, along with...  ...must be fluently bilingual in English and located in the United States. This is an independent contractor position with payments processed... 
    Hourly pay
    For contractors
    Remote work
    English language skills

    DataAnnotation

    Wyoming, OH
    23 hours ago
  • $20 per hour

     ...Pyxis Technician to help train AI models by evaluating AI outputs for logic and performance...  ...is required to be fluent in English. This role offers flexible work hours, with projects paid hourly...  ...States only, and this is an independent contractor position. #J-18808-Ljbffr
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    23 hours ago
  •  ...learning. We are seeking a U.S.-based Part‑Time...  ...growing multi‑country, remote team. Role Overview The...  ...employees and international contractors. Develop scalable...  ...or BambooHR. Fluent in English (other languages a plus...  ...Part‑time (approx. 15–20 hours/week; flexible scheduling... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Part time
    Local area
    Flexible hours

    TrueLeap Inc.

    New York, NY
    3 days ago
  • $80k - $100k

     ...Holdings Inc. / ARTE MUSEUM U.S. Entities Santa Monica...  ...and annual performance evaluations and promotion reviews Assist...  ...independently English Proficiency: Native or native-equivalent proficiency...  ..., Monday through Friday Remote / Hybrid: Not available. Daily... 
    Remote work
    English language skills
    Full time
    Local area
    Worldwide
    Monday to Friday

    d'strict

    Santa Monica, CA
    4 days ago
  • $50 - $60 per hour

     ...technology company in the U.S. seeks a Clinical Specialist to train AI models by evaluating their logic and...  ...The position is flexible, remote, and part-time or full-time, with hourly pay starting at $50-$60,...  ...Applicants must be fluent in English and hold a current or in... 
    Hourly pay
    Remote work
    English language skills
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Wisconsin
    2 days ago
  •  ...with a strong focus on AI‑Native development....  ...speed, prototype in hours, and measure in real...  ...outsized rewards. We evaluate both what you achieve...  ...preferred. Fluent in English. Responsibilities Write...  ...leading rate paid in U.S. dollars. 100% Remote (Home Country Only):... 
    For contractors
    Remote work
    English language skills
    Full time
    Local area
    Work from home
    Relocation
    Flexible hours

    Varsity Tutors, a Nerdy Company

    New York, NY
    3 days ago
  •  ...seeking an Italian Data Trainer for a remote, hourly-paid contractor role. The position...  ...and reasoning quality of AI systems by evaluating AI-generated content and...  ...candidates must possess native-level Italian proficiency...  ...a minimum C1 level in English, along with experience... 
    Hourly pay
    For contractors
    Remote job
    English language skills

    YO IT Consulting

    Newark, NJ
    3 days ago
  •  ...Mercor is seeking native Italian speakers from Switzerland...  ...to a high-impact AI research project. Freelancers...  ...will author Italian/English prompt pairs that train...  ...approximately 20 hours a week for 2–4 months,...  ...background in writing and evaluation is a plus, as well as familiarity... 
    Remote work
    English language skills
    Freelance
    Local area

    Mercor Inc

    Scottsdale, AZ
    1 day ago
  •  ...Consulting is seeking an Italian Data Trainer for a remote, hourly-paid contractor role. The candidate will evaluate AI-generated content, providing...  ...’s degree in a relevant field, native or near-native Italian proficiency, and C1 English proficiency. Experience in Trust... 
    Hourly pay
    For contractors
    Remote job
    English language skills

    YO IT Consulting

    New York, NY
    3 days ago
  • $20 per hour

     ...Coding Specialist to train AI models and ensure the...  ...starting at $20+ per hour. Ideal for independent contractors in the U.S., it aims to improve...  ...interactions through expert evaluations, making it essential to have bilingual or native-level English proficiency. #J-18808-... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Jackson, MS
    23 hours ago
  •  ...What you need to succeed in this role: Native German and strong English proficiency (minimum C1 level) At...  ...schedule Opportunity to work fully remotely Inclusive international environment...  ...typically apply to employees; independent contractors may not be eligible for all of these... 
    For contractors
    Remote work
    English language skills
    Home office
    Trial period
    Flexible hours
    Shift work

    Framework Ventures

    New York, NY
    3 days ago
  • $40 per hour

     ...join our team to train AI models. You will...  ...of these AI chatbots, evaluate their logic, and solve...  ...full-time or part-time REMOTE position You’ll be...  ...Projects are paid hourly starting at $40+ USD per...  ...Qualifications Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Contract work
    Part time

    DataAnnotation

    Santa Fe, NM
    1 day ago
  • CNTXT AI is seeking native American English speakers for a fully remote contractor role in AI data and language projects. Responsibilities include content generation, data annotation, LLM evaluation, and localization QA. Candidates must exhibit excellent editorial judgment... 
    For contractors
    Remote job

    CNTXT AI

    New York, NY
    4 days ago
  • $50 - $60 per hour

     ...creating high-quality AI. We are looking for a...  ...enjoying the flexibility of remote work and the freedom...  ...Projects are paid hourly starting at USD $50-$6...  ...complex problems and evaluate their outputs Evaluate...  ...Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Contract work
    Part time
    Work experience placement
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $60 per hour

     ...developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your...  ...models on tasks like evaluating AI-generated quantitative...  ...: projects are paid hourly, up to $60 USD/hour....  ...forecasting). Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...A leading AI development company is seeking proficient...  ...to join their remote team. In this role, you...  ...coding problems for AI, evaluate AI-generated code, and...  ...Candidates should be fluent in English, preferably with...  ...scheduling and competitive hourly rates are key features... 
    Hourly pay
    Remote work
    English language skills

    DataAnnotation

    Brooklyn, NY
    1 day ago
  •  ...cybersecurity professionals for a REMOTE position. Candidates will evaluate AI-generated security content and solve...  ...essential. Strong communication in English is required, along with a preferred...  ...Flexible project work and competitive hourly pay are offered. #J-18808-Ljbffr
    Hourly pay
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Kansas City, MO
    1 day ago
  • $25 per hour

    A technology company is seeking a Remote Interpreter (Japanese/English) who will work on training AI models. This role involves evaluating the AI chatbots' progress and writing novel...  ...project selection and scheduling, along with hourly pay starting at $25+ USD. #J-18808-... 
    Hourly pay
    Remote work
    English language skills

    DataAnnotation

    Springfield, IL
    1 day ago
  • $60 per hour

     ...developing cutting‑edge AI systems, while enjoying the flexibility of remote work and setting your...  ...pay: projects are paid hourly, up to $60 USD/hour. Opportunities...  ...detailed explanations. Evaluate AI‑generated code for...  ...Fluency in English (native or bilingual level). Preferred... 
    Hourly pay
    Remote work
    Full time
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $20 per hour

     ...join our team to train AI models. You will...  ...of these AI chatbots, evaluate their logic, and solve...  ...full-time or part-time REMOTE position You’ll be able...  ...schedule Projects are paid hourly starting at $20+ USD...  ...Qualifications Fluency in English (native or bilingual level)... 
    Hourly pay
    Remote work
    Full time
    Contract work
    Part time

    DataAnnotation

    Providence, RI
    23 hours ago
  • $60k - $90k

     ...client is a profitable U.S. B2B SaaS company...  ...The work spans React Native, Swift, and Kotlin across...  ...lived codebase * Clear English for design documents,...  ...* Full-time contractor (around 40 hours per week, paid weekly in USD) * Fully remote, with at least 50% overlap... 
    For contractors
    Remote work
    English language skills
    Weekly pay
    Full time
    Local area

    Atomic HR

    United States
    2 days ago
  •  ...Specialist - Freelance AI Trainer Project World Wide - Remote Are you a...  ...models to evaluate translations, assess...  ...Albanian and English, review generated...  ...references. Native or near-native...  ...$6 to $65 per hour, with the exact...  ...listed above. As a contractor you’ll supply a... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Contract work
    Freelance

    Invisible Agency

    New York, NY
    3 days ago
  • A leading AI training company is seeking a Senior Underwriter to evaluate AI Assistant outputs and improve their reasoning...  ...financial contexts. This remote position offers...  ...detail-oriented and fluent in English. Projects are compensated hourly, starting at $50-$60, with... 
    Hourly pay
    Remote work
    English language skills

    DataAnnotation

    Florida, NY
    23 hours ago
  •  ...technology company specializing in AI model training is looking...  ...to train AI models and evaluate their logic. This remote position offers flexible...  ...your own schedule, and pays hourly starting at $20+ with potential...  ...have a fluent command of English, be detail-oriented, and... 
    Hourly pay
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Salt Lake City, UT
    3 days ago
  • $40 per hour

    A leading AI company in the U.S. is looking for a Software Consultant to evaluate the performance of AI models. You...  ...candidates should have strong English skills and experience...  ...allowing you to work remotely and on your own...  ...starting at $40+ USD per hour based on project... 
    Hourly pay
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Springfield, IL
    1 day ago
  • $20 per hour

     ...support the training of AI models from Hawaii. In this remote role, you will evaluate AI chatbot outputs,...  ...Candidates should be fluent in English and detail-oriented....  ...various projects, with hourly pay starting at $20 USD. This independent contractor role is open to... 
    Hourly pay
    For contractors
    Remote work
    English language skills
    Flexible hours

    DataAnnotation

    Honolulu, HI
    1 day ago
  • $40 per hour

     ...Software Consultant to train AI models and evaluate chatbot logic. The role...  ...Candidates should be fluent in English, detail-oriented, and have experience...  ...data structures. This is a remote position, available either...  ...part-time, with competitive hourly pay starting at $40, plus... 
    Hourly pay
    Remote work
    English language skills
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Indiana, PA
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor). Be the first to apply!