Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English (U.S. Native) AI Trainer & Evaluator

CNTXT AI

Position Summary

This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:

  • Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.

  • Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.

  • LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.

  • Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.

Profile Requirements

  • Native speakers of American English born and raised in the United States.

  • Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.

  • Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.

  • Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.

  • Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.

  • Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.

Preferred Experience

  • Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.

  • Familiarity with QA workflows.

  • Previous experience with AI data training, annotation, or evaluation.

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the English (U.S. Native) AI Trainer & Evaluator in Brooklyn, NY vacancy
  •  ...A leading AI development company is seeking proficient programmers to join their remote...  ..., you'll design coding problems for AI, evaluate AI-generated code, and contribute to...  ...systems. Candidates should be fluent in English, preferably with experience in Kotlin and... 
    English language skills
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $60 per hour

     ...technology company is seeking proficient programmers to advance AI development in a fully remote setting. As part of this team, you...  ...to $60/hour based on performance. Candidates should be fluent in English and have experience in programming languages such as Kotlin,... 
    English language skills
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...A leading AI security solutions provider is seeking experienced cybersecurity professionals to evaluate AI-generated content and solve technical cybersecurity problems. The role...  ...cybersecurity domains and a strong command of English. This is a flexible remote position... 
    English language skills
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development company in New York seeks experienced quantitative professionals to evaluate AI-generated analyses and enhance model validity. This fully remote position...  ...field, coding experience, and strong English skills. Competitive pay of up to $60 an hour... 
    English language skills
    Remote work

    DataAnnotation

    New York, NY
    5 days ago
  • $20 per hour

     ...healthcare technology company is seeking a Pyxis Technician to evaluate AI chatbots and improve model quality through healthcare-related...  ...selection and a remote work setting. Candidates must be fluent in English and possess a relevant healthcare degree. Compensation starts... 
    English language skills
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    1 day ago
  •  ...An online education platform is looking for native English-speaking tutors to conduct one-on-one online sessions with adult learners. You will help improve their speaking, listening, and pronunciation skills while providing real-time feedback to boost fluency. The role... 
    English language skills
    Remote work
    Flexible hours

    LeadInTop

    New York, NY
    3 days ago
  • $50 - $60 per hour

     ...DataAnnotation is committed to creating high-quality AI. We are looking for a Sales & Trading...  ...diverse and complex problems and evaluate their outputs Evaluate the quality...  ...performance Qualifications Fluency in English (native or bilingual level) Detail-oriented... 
    Hourly pay
    Full time
    Contract work
    Part time
    Work experience placement
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • CNTXT AI is seeking native American English speakers for a fully remote contractor role in AI data and language projects. Responsibilities include content generation, data annotation, LLM evaluation, and localization QA. Candidates must exhibit excellent editorial judgment... 
    Remote job
    For contractors

    CNTXT AI

    New York, NY
    4 days ago
  •  ...A leading AI language services provider is looking for detail-oriented linguists with native speaker fluency in Indonesian for remote freelance...  ...projects focusing on prompt evaluation, video understanding, and...  ...possess a strong command of English, a keen attention to detail,... 
    English language skills
    Freelance
    Remote work

    LILT (Production)

    New York, NY
    3 days ago
  •  ...A leading AI training company is seeking detail-oriented linguists with native fluency in German for a remote freelance opportunity...  ...multimedia content, prompt evaluation, and text review. Ideal candidates...  ...possess a strong command of English and have experience in content... 
    English language skills
    Freelance
    Remote work

    Lilt

    New York, NY
    3 days ago
  •  ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity....  ...related projects that involve prompt evaluation and multimedia content...  ...will have a strong command of English and experience as reviewers or... 
    English language skills
    Freelance
    Remote work

    Lilt

    New York, NY
    3 days ago
  • $750 per month

     ...Customer Service Specialist - Near-Native English Agent Callplex Canada Inc. is a leading provider of outsourced Customer Care and Sales solutions. We help companies save money and scale faster by providing near-native-speaker agents at competitive prices. Job Description... 
    English language skills
    Full time
    Remote work
    Work from home
    Monday to Friday

    Jobs for Lebanon

    New York, NY
    5 days ago
  • $11.5 per hour

     ...Contributor. In this role, you will evaluate and provide feedback on content to enhance...  ...is needed, but proficiency in English and residency in the U.S. for the last three years is required...  ...supportive community of contributors involved in AI advancements. #J-18808-Ljbffr... 
    English language skills
    Hourly pay
    Part time
    Remote work

    University of Delaware

    New York, NY
    3 days ago
  • SEO Content Writer For U.S. Market Day Translations, Inc. is hiring...  ...Google Analytics. Excellent English writing skills and deep...  .... market and search behavior. Native-level English skills Please include...  ...to move forward in the evaluation process. Please note: Candidates... 
    Freelance
    Immediate start

    Day Translations

    New York, NY
    1 day ago
  •  ...seeking a Pyxis Technician to join their team to train AI models. The role involves evaluating AI outputs and ensuring medical accuracy. Candidates should...  ...possess a healthcare-related degree and be fluent in English. This is a remote independent contractor position with... 
    English language skills
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $35 per hour

     ...the world's largest streaming platforms. Ideal candidates are native English speakers with an advanced level of Brazilian Portuguese, deep knowledge...  ...English. These synopses are written by human copywriters, not AI. In addition, you'll implement feedback following multiple... 
    English language skills
    Remote job
    Freelance
    Live in

    Wordbank

    New York, NY
    3 days ago
  •  ...Hebrew AI Data Trainer - Remote Location: Remote This is a fully remote, hourly...  ...accuracy of AI systems. You will evaluate AI‑generated responses in Hebrew and English, assess step‑by‑step reasoning,...  ...Journalism, or a related field Native or near‑native Hebrew proficiency... 
    English language skills
    Hourly pay
    For contractors
    Remote work

    YO IT Consulting

    New York, NY
    3 days ago
  •  ...for a remote Italian Data Trainer to enhance AI systems' safety and reasoning...  .... Responsibilities include evaluating AI-generated content,...  ...relevant field and strong native or near-native proficiency...  ...Italian along with C1 level English. This role demands experience... 
    English language skills
    Remote job
    Flexible hours

    YO IT Consulting

    New York, NY
    4 days ago
  •  ...Consulting is looking for a Hebrew AI Data Trainer to join their team remotely. The ideal candidate will evaluate AI-generated responses in Hebrew and English, ensuring accuracy and clarity....  ...’s degree in a relevant field and native or near-native proficiency in Hebrew... 
    English language skills
    Remote work

    YO IT Consulting

    New York, NY
    3 days ago
  • $20 - $23 per hour

     ...About Us Volga Partners, a U.S.-based company, specializes in...  ...understanding in writing and evaluation (location is not a factor). Resources...  .... Position We are looking for AI Writing Evaluators (Domain...  .... Proficiency in written English with meticulous attention to detail... 
    English language skills
    Hourly pay
    Full time
    Freelance
    Immediate start
    Remote work
    Monday to Friday
    3 days per week

    Volga Partners

    New York, NY
    3 days ago
  •  ...Consulting is seeking an Italian Data Trainer for a remote, hourly-paid contractor role. The candidate will evaluate AI-generated content, providing...  ...’s degree in a relevant field, native or near-native Italian proficiency, and C1 English proficiency. Experience in Trust... 
    English language skills
    Remote job
    Hourly pay
    For contractors

    YO IT Consulting

    New York, NY
    3 days ago
  •  ...services Communicate with developers and other departments of various IT companies What you need to succeed in this role: Native German and English communication skills At least 6 months of experience in a customer support role Personal or professional experience in crypto... 
    English language skills
    Remote work
    Home office
    Trial period
    Flexible hours

    Framework Ventures

    New York, NY
    3 days ago
  •  ...commitment, and adaptability to different shifts including weekends and holidays What you need to succeed in this role: Native Hungarian and strong English proficiency (minimum C1 level) At least 6 months of live chat support experience, preferably in crypto or financial... 
    English language skills
    For contractors
    Remote work
    Home office
    Trial period
    Flexible hours
    Shift work

    Framework Ventures

    New York, NY
    3 days ago
  • $50 - $60 per hour

    A leading tech company in the United States is seeking a Chief Information Officer (CIO) to enhance AI capabilities, especially in finance. This role is ideal for experienced finance professionals who can improve AI Assistant models through feedback on macro trends and... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $40 per hour

    A leading AI training company is seeking a Mathematics Instructor to train AI models by evaluating their logic, progress, and problem-solving skills. This role is fully remote, provides flexible scheduling, and pays $40+ per hour depending on the volume and quality of... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

     ...A technology company specializing in AI is seeking a Back End Developer to join their remote team. You'll be responsible for training AI models by giving coding challenges to chatbots and evaluating their outputs for correctness and performance. Proficiency in Python or... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $40 per hour

    A leading cybersecurity AI firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content, solve technical problems, and shape the future of AI security models. The role offers flexibility with remote work and a project-based compensation... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    5 days ago
  • A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. Candidates should have at least 2 years of hands-on experience in cybersecurity, strong writing, and analytical skills... 
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $40 per hour

    A technology company specializing in AI training is looking for a Biology Expert based in the United States. This role involves training AI chatbots by providing complex biology questions and evaluating their maturity and performance. Candidates should have strong knowledge... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

     ...A cybersecurity solutions firm is searching for experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This position is remote, allowing for flexible scheduling and project selection. Ideal candidates should have... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English (U.S. Native) AI Trainer & Evaluator. Be the first to apply!