Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Lesson Plan AI Quality Evaluator

AI Trainer Jobs

New York, NY
  • Remote job

AI Trainer Jobs is seeking a Lesson Plan AI Evaluator for a remote, contractor role. You will review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback to help retrain models. Responsibilities include evaluating model outputs, tagging edge cases, calibrating against rubrics, and reporting discrepancies to the program team. Strong attention to detail and clear written reasoning are essential. #J-18808-Ljbffr AI Trainer Jobs

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Lesson Plan AI Quality Evaluator in New York, NY vacancy
  •  ...Lesson Plan AI Evaluator is a remote evaluation track for reviewing lesson plan ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Operations / inventory / capacity planning Evaluator Type: Contract...  ...80–$120/hour Location: Remote Role Responsibilities Evaluate...  ...against domain-specific quality rubrics. Ensure accuracy and... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Dallas, TX
    19 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Operations / inventory / capacity planning Evaluator Type: Contract...  ...80–$120/hour Location: Remote Role Responsibilities Evaluate...  ...against domain-specific quality rubrics. Identify factual,... 
    Remote work
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Houston, TX
    24 days ago
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works...  ...provide datasets that are high-quality, ethically sourced, relevant...  .... Seeks a flexible, remote job that can easily fit around...  ...Insurance 401(k) Retirement Plan Federal Law Compliance Verify... 
    Remote work
    Quality
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • Surgical Planning Safety Evaluator is a remote evaluation track for reviewing surgical planning safety evaluation...  ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs...  ...modeling team can use to retrain. AI data reviewers help turn surgical... 
    Remote job
    Quality

    AI Trainer Jobs

    New York, NY
    4 days ago
  •  ...Lesson Plan Learning Content Reviewer is a remote review track for evaluating AI outputs across lesson plan learning content specialist operations workflows. Reviewers grade...  ...or firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles.... 
    Remote job
    Quality
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    27 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Remote work
    Quality
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    United States
    4 days ago
  • $37.5 per hour

     ...a golden data set for AI generated ad copy for various...  ...be responsible for evaluating advertising copy...  ...meets their benchmark in quality, structure, brand voice...  ...to specific elections, plan, or program terms. If eligible...  ...TypeThis is a fully remote position.Application DeadlineThis... 
    Remote work
    Quality
    Contract work
    Temporary work

    TEKsystems

    New York, NY
    10 hours ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Remote work
    Quality
    Work at office

    Obsidian

    New York, NY
    1 day ago
  • $11.5 per hour

     ...institution is offering a part-time remote position as an Online Task...  .... In this role, you will evaluate and provide feedback on content...  ...enhance search engine results and quality. No prior experience is needed...  ...of contributors involved in AI advancements. #J-18808-Ljbffr... 
    Remote work
    Quality
    Hourly pay
    Part time

    University of Delaware

    United States
    4 days ago
  • $30 per hour

     ...not just another player in the AI space - we are building the biggest pool of quality human data in the world. About Prolific...  ...Experts for a high-level AI evaluation project. AI models are evolving...  ...and global organisation planning. Prolific's Candidate Privacy Notice... 
    Remote job
    Quality
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $20 per hour

    A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include...  ...developing prompts, writing high-quality responses, and evaluating AI outputs. The ideal candidates... 
    Remote work
    Quality
    Hourly pay
    Flexible hours

    SupportFinity

    United States
    4 days ago
  •  ...Polish Bilingual Expert (contractor) to evaluate Polish audio content for AI training. The role emphasizes nativeness, fluency, and linguistic quality, with feedback delivered in English....  ...to detail and the ability to work remotely. No prior AI experience is required;... 
    Remote job
    Quality
    For contractors

    YO AI Labs

    Annapolis, MD
    8 hours ago
  • YO AI Labs is seeking an AI Evaluation Specialist to remotely assess enterprise AI outputs against detailed rubrics, measuring accuracy, relevance and quality. You will provide concise, actionable feedback to drive improvements. Responsibilities include identifying reasoning... 
    Remote job
    Quality
    For contractors

    YO AI Labs

    Austin, TX
    1 day ago
  • $20 - $30 per hour

    A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong... 
    Remote job
    Quality
    Hourly pay

    Crossing Hurdles

    New York, NY
    18 hours ago
  • $24 per hour

    Prolific is seeking Fluent Tamil speakers to serve as AI evaluators on a remote, freelance basis. You will assess how well AI models capture emotions...  ...nuance, and fluent English communication. A quiet setup and quality audio equipment are expected. #J-18808-Ljbffr Prolific
    Remote job
    Quality
    Freelance

    Prolific

    New York, NY
    1 day ago
  • Turing is a leading AI company enabling the rapid deployment of...  ...We are seeking a contractor to evaluate chatbot responses across real-...  ...decisions. You will work remotely on a 16-week project, collaborating...  ...a global team to ensure high-quality evaluations and practical recommendations... 
    Remote job
    Quality
    For contractors
    Freelance

    turing

    New York, NY
    3 days ago
  • Mercor is seeking expert Evaluators in Clinical / biomedical / pharma to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter... 
    Remote job
    Quality
    Hourly pay

    Mercor

    New York, NY
    8 hours ago
  • Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks.... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    2 days ago
  • AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses, and label content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    4 days ago
  • YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and...  ...skills are what matter. Work is remote with collaboration across project coordinators... 
    Remote job
    Quality

    YO AI Labs

    New York, NY
    2 days ago
  • AuraOne is seeking a Spanish Dialect AI Evaluator to review prompts and responses against its quality rubric. This remote contractor track involves comparing paired outputs, labeling edge cases, and writing structured feedback for retraining. You will help turn Spanish... 
    Remote job
    Quality
    For contractors

    AI Trainer Jobs

    New York, NY
    4 days ago
  • YO AI Labs is seeking a Healthcare Expert for a remote contract to support AI training and evaluation projects. You will apply clinical knowledge to assess AI outputs, workflows, and real-world use of healthcare systems. Key tasks include evaluating EHR applications, reviewing... 
    Remote job
    Quality
    Contract work

    YO AI Labs

    San Jose, CA
    18 hours ago
  • Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade...  ...structured feedback. This is a remote, hourly engagement, with work delivered... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    1 day ago
  • $30 per hour

     ...Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language...  ...systems using defined rubrics and quality standards. Review multi-step...  ...Strong experience in LLM evaluation, AI output analysis, QA/testing, UX... 
    Remote job
    Quality
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    18 hours ago
  • YO AI Labs is seeking an experienced AI Evaluation Specialist to remotely assess AI assistant outputs for an enterprise training project. The contractor will evaluate responses against detailed rubrics, identify issues, and provide actionable feedback to improve AI systems... 
    Remote job
    Quality
    For contractors

    YO AI Labs

    Los Angeles, CA
    1 day ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language...  ...cultural relevancy, and ensuring quality control in audio outputs. The role...  ...for tasks, with flexible hours and remote work options. J-18808-Ljbffr... 
    Remote job
    Quality
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over... 
    Remote job
    Quality
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    18 hours ago
  • About the role Conversational AI Evaluator is a remote evaluation track for reviewing conversational ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the... 
    Remote work
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    2 days ago
  • About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Remote work
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Lesson Plan AI Quality Evaluator. Be the first to apply!