Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Trainer & Evaluator

$20 - $80 per hour

SaidGig

Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate and score AI-generated responses against defined rubrics and metrics across a range of subjects. Annotate and categorize datasets to improve model accuracy and reliability. Review content for relevance, coherence, and factual accuracy with close attention to detail. Provide clear, actionable feedback that informs ongoing AI model improvements. Work with the customer team to interpret evaluation guidelines and refine rubrics. Document findings and maintain accurate records of annotations and evaluations. Critically read and analyze complex material in areas including business, finance, marketing, healthcare, and legal topics. Qualifications Bachelor''s degree required. Exceptional attention to detail and accuracy in data annotation and content evaluation. Strong critical-reading and analytical skills, including the ability to interpret and apply rubrics. Clear written and verbal communication skills, with the ability to explain nuanced feedback. Experience evaluating or scoring high volumes of content against detailed criteria. Ability to work both independently and collaboratively in a fully remote environment. Preferred Qualifications Experience with AI training, machine learning data annotation, human-in-the-loop systems, or quality assurance for AI-generated content. Background in business, finance, legal, marketing, healthcare, or research. Familiarity with industry-standard annotation tools or AI evaluation platforms. Work Terms Remote contract engagement. Compensation$20 to $80 per hour. #J-18808-Ljbffr SaidGig

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Trainer & Evaluator in New York, NY vacancy
  • $70 per hour

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Details Position:... 
    Suggested
    Contract work
    Summer work
    Immediate start
    Remote work

    mercor

    New York, NY
    2 days ago
  • $50 per hour

    Mercor is seeking experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces and files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role... 
    Suggested
    Remote job
    Hourly pay

    Mercor

    New York, NY
    3 days ago
  • $11 - $30.65 per hour

    Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires... 
    Suggested
    Remote job
    Hourly pay
    For contractors

    Meridial

    New York, NY
    3 days ago
  • About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (...  ...connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks... 
    Suggested
    Trial period

    Mercor

    New York, NY
    2 days ago
  • $40 per hour

    A leading company in AI training solutions is seeking a Content Developer specialized in Physics. The role involves enhancing AI models by providing and evaluating complex physics problems. Ideal candidates hold advanced degrees in physics or related fields, ensuring high... 
    Suggested
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    2 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning... 
    Contract work
    Summer work
    Remote work

    mercor

    New York, NY
    2 days ago
  •  ...Expert for a six-week remote contract. The role demands deep knowledge of materials science and the ability to craft prompts to test AI models. Responsibilities include sourcing data from papers and open sources, building grading criteria, and calibrating tasks against... 
    Remote job
    Contract work

    Mercor Inc

    New York, NY
    2 days ago
  • Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality. Candidates... 
    Remote job
    Full time

    Feitong Buke

    New York, NY
    3 days ago
  • $20 per hour

    Prolific is seeking a Sales Professional to join our Expert Network for AI model training and evaluation. You will be paid to contribute real sales and business development expertise via paid tasks, with a quick screening test if selected. All work is remote and ad hoc... 
    Remote job
    Hourly pay
    Freelance

    Prolific

    New York, NY
    5 days ago
  • $50 - $190 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Remote Commitment: 20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows, including personal... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Trial period

    Mercor

    New York, NY
    16 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...and Jack Dorsey . Position: Public health communications Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $55 per hour

     ...power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI...  ...reasoning skills. If you join the platform as a Data Science AI Trainer, you'll have the opportunity to collaborate on these projects.... 
    Part time
    Freelance
    Remote work

    Mindrift

    New York, NY
    1 day ago
  • $23 per hour

    A leading AI project firm is seeking remote freelance annotators to engage in critical tasks that help develop artificial intelligence. As an annotator, you will review and classify diverse content based on specific guidelines. Candidates should be proficient in Portuguese... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Toloka Annotators

    New York, NY
    3 days ago
  • # AI TraineriMerit Technologyvia RemoteOKUS, UK, Canada, Australia + 35 other countriesUSD 50000–70000 / yearPosted 2 days agoUSARemoteApply...  ...short video clips by identifying objects, actions and events.* Evaluate video quality, relevance and accuracy against established... 
    For contractors
    Remote work

    Userc Dehradun

    New York, NY
    5 days ago
  • $25 - $80 per hour

     ...Contract / Part-time / Project-based Abaka AI is a fast-growing AI data provider...  ...are seeking motivated Data Annotators / AI Trainers to join our growing Talent Pool. As part...  ...Participate in specialized tasks such as evaluation of AI model outputs or domain-specific labeling... 
    Contract work
    Part time
    Remote work
    Flexible hours

    CommonCreatives, LLC

    New York, NY
    5 days ago
  •  ...Prolific is seeking Advanced Korean speakers to train and evaluate AI models. You will be paid for tasks that may require about one hour of uninterrupted work, with the flexibility to work from home. Responsibilities include completing Korean AI training tasks, judging... 
    Remote work
    Work from home

    Prolific

    New York, NY
    1 day ago
  • $23 per hour

     ...Do The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock...  ...take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are... 
    Part time
    Freelance
    Remote work

    Toloka Annotators

    New York, NY
    3 days ago
  • $18 per hour

     ...artificial intelligence. About The Role Annotation is what helps AI make sense of the world. As an annotator, you may be invited to...  ...take part in online projects such as rating AI‑generated content, evaluating factual accuracy, or comparing responses – when projects are... 
    Part time
    Freelance
    Internship
    Remote work

    Toloka Annotators

    New York, NY
    1 day ago
  • $23 per hour

    Toloka is seeking an on-demand annotator to join our global freelance QA network. This part-time, remote role offers flexible hours on AI project tasks and compensation up to $23 per hour equivalent. You will review data types (text, images, or videos), label content per... 
    Remote job
    Hourly pay
    Part time
    Freelance
    Flexible hours

    Mindrift Data Annotation Projects

    New York, NY
    3 days ago
  • $37.5 per hour

     ...originals programming. We are looking to create a golden data set for AI generated ad copy for various advertisers looking for placements...  ...Amazon originals. In this role you will be responsible for evaluating advertising copy generated by a large language model (LLM) to... 
    Contract work
    Temporary work
    Remote work

    TEKsystems

    New York, NY
    2 days ago
  • $160k - $210k

    BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products Location New York Business Area Product Ref # 10053894 Description & Requirements Bloomberg’s Evaluated Pricing Service, BVAL, provides transparent and accurate... 
    Price work
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • $18 per hour

     ...Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for... 
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    New York, NY
    5 hours ago
  • $16 - $17 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Game Annotator... 
    Contract work
    Summer work
    Remote work

    Mercor Inc

    New York, NY
    1 day ago
  • LILT is seeking detail-oriented human reviewers to support AI training and evaluation projects. You will assess prompts and outputs, review and correct text, and analyze multimedia content, applying local cultural context and brand alignment. This independent contractor... 
    For contractors
    Local area

    LILT

    New York, NY
    4 days ago
  • $16 - $28 per hour

    Social Media Annotation - Freelance AI Trainer Project United States of America Are you a social media annotation eager to shape the future...  ..., and suggest improvements to our prompt engineering and evaluation metrics. No formal degree or educational background is required... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Remote work

    Meridial

    New York, NY
    4 days ago
  • $50 - $60 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey. Position: Visual Slide... 
    Contract work
    Summer work
    Remote work

    Mercor Inc

    New York, NY
    1 day ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    5 days ago
  • $29 per hour

    Job Description Outlier partners with leading AI companies to improve how artificial intelligence understands real people: how we speak, express emotion, communicate intent, and respond naturally in everyday situations. We are looking for native German speakers who are... 
    Hourly pay

    Brain Trust Inc

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Trainer & Evaluator. Be the first to apply!