AI Training Quality Control Lead
$80 - $105 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Training Scenarios - Reviewer (Quality Control)
Type: Contract
Compensation: $80–$105/hour
Location: Remote
Role Responsibilities
- Audit and evaluate richly detailed personas, digital environments, and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
- Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agent's ability to reason, filter, and prioritize without being broken or impossible.
- Identify logical inconsistencies, factual errors, missing context, and technical flaws such as invalid JSON structures within simulated environments.
- Provide clear, constructive, and actionable feedback to scenario designers. Help refine their worlds and improve overall output.
- Document outcomes by logging review outcomes, scores, and feedback clearly in Airtable and Crucible .
Qualifications
Must-Have
- Undergrad degree
- 2+ years professional experience
Preferred
- Editing / QA background — Senior editor, QA tester, technical reviewer, compliance auditor, or peer-reviewer.
- Technical / data comfort — JSON familiarity, Jira/Asana power user, data analyst, SQL/Python exposure.
- Process & Systems thinking — Operations managers, technical PMs, or systems designers with a strong understanding of complex workflows.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the AI Training Quality Control Lead in New York, NY vacancy
$145.2k - $217.88k
...includes cohort query tools, AI agents, and thousands... ..., research, and quality improvement initiatives... .... healthcare data. The Lead Physician Informaticist... ...research data. Educates, trains and mentors users on... ...assurance and quality control assessments of queries,...TrainingTraineeshipLocal areaIcahn School of Medicine at Mount Sinai
New York, NY1 day ago$160.5k - $321k
...&C) Leadership Team as the AI Enablement Leader. The US&C... ...change to improve cycle time, quality, consistency, risk control, operating leverage, and... ...overall client experience. This lead role will collaborate with... ...requirements into training, communications, and playbooks...TrainingMinimum wageWork at officeFlexible hours3 days per week- ...To ensure the safe and trusted expansion of AI initiatives, the full-time remote AI Governance Lead will manage the AI program and its operational infrastructure... ...risk management, governance processes, and training for cross-functional teams. Key responsibilities Own...TrainingFull timeRemote work
Thyme Care Inc.
New York, NY2 days ago $200k
...Growth Lead at GrowthX AI – United States – Remote Growth Lead at GrowthX AI – United States – Remote Overview At GrowthX, we help companies... ...off each year Professional Growth: Access to continuous training, coaching, and development opportunities Innovative Environment...TrainingRemote workVictrays
New York, NY5 days ago$130k - $160k
...Overview We are seeking a dynamic and forward-thinking AI Adoption Lead to join our AI team. This hybrid role is designed for a... ...Enterprise) across business units. Design and deliver engaging training programs, workshops, and enablement materials (videos, guides...TrainingAvePoint
Jersey City, NJ1 day ago- ...are looking for a Demands Team Lead to manage our growing Demand... ...and Assistants, provide quality control on demand letters, coach team... ...overseeing performance, workload, and training. Review and approve demand... ...with modern technology and AI-driven processes to deliver consistent...TrainingFull timeRemote workMonday to Friday
Corebridge Solutions
New York, NY5 days ago - ...Plan and execute large scale AI deployments of 1,000s of users... ...customer demands Co-design training with our customers and deliver... ...experienced customer success lead who: ~2+ years consulting -... ...with a rigorous focus on high-quality client outcomes and operational...TrainingWork at office
Junior Company
New York, NY4 days ago - ...Role: AI Team Lead Location: NYC, NY Project description We're seeking an AI Engineer to design, build, and deploy production... ...validation, and feature pipelines. ~ Implement model training, evaluation, versioning, and monitoring workflows (CI/CD for...Training
Lorven Technologies
New York, NY4 days ago $150k - $155k
...About The AI Access Initiative About The AI Access Initiative,... ...development actors, top AI labs, and leading researchers to drive... ...design and execution of high-quality programs that harness frontier... ...agriculture/weather is a plus. Training or early career experience in...TrainingLocal areaRemote workWork visaFlexible hoursEvidence Action
New York, NY5 days ago- ...Sector in Cybersecurity & Tech Controls team, you will deploy, monitor... ...infrastructure, and ensure AI systems perform reliably and efficiently... ...address performance and data quality issues. Working knowledge... ...with synthetic datasets for model training and evaluation....Training
Chase
Jersey City, NJ14 days ago - ...close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic... ...activities for AI centric programs AI Training Leadership Experience: Experience delivering...TrainingWorldwide
IBM
New York, NY2 days ago $150k - $200k
...into accounts payable, AI-powered analytics, and... ...seeking an Applied AI Lead to join our team and own... ...reduce effort, increase quality, or accelerate timelines... ...policies, and access controls. Support the biz-ops... ...organization and facilitate training sessions. Support...TrainingAlternative Payments®
New York, NY2 days ago$85k - $130k
...relationship-driven Lending Operations Lead to serve as the critical... ...: File Verification & Quality Control: Perform meticulous "desk reviews... ...internal "buy boxes" and training materials for Sales and Product... ...services through our AI and machine learning-powered...TrainingFull timeSummer workWork at officeLocal areaRemote workMonday to FridayShift workEnova
New York, NY3 days ago$19 - $21.6 per hour
...of companies! Aramsco, a family of companies, is a leading solutions provider to specialty contractors across... ...for the month and year. Facilitates team reviews, quality control/assurance and follow up training. Provide a safe work environment which promotes productive...TrainingFull timeFor contractorsLocal areaAramsco
New York, NY3 days ago$28 - $33 per hour
...requisitioning of internal and external controls and auditing with the objective of maximizing... ...and department staff Assist with training on proper check-in procedures, equipment... ...with: Camera Prep Department QC / Quality Control Shipping & Logistics...TrainingFlexible hoursAdorama
New York, NY3 days ago$92k - $115k
...Lead, CS AI Content Flex is a growth-stage, NYC headquartered FinTech company that... ...to improve AI reasoning and response quality. Drive content for cross-functional... ...capabilities roll out. Maintain version-controlled AI training content that is audit-ready and...TrainingFull timeLocal areaRelocation packageFlexible hours2 days per week3 days per weekFLEX Inc
New York, NY2 days ago$94k - $110k
...AI Adoption Lead The International Rescue Committee (IRC) responds to... ...people to survive, reclaim control of their future and strengthen... ...are addressed first and that quality expectations are clear.... ...Provide hands-on coaching, training, and feedback loops that build...TrainingWork at officeLocal areaInternational Rescue Committee
New York, NY4 days ago$143.85k - $236.33k
...and resilient communities and quality of life. We bring together planners... ...just a job, it's a chance to lead progress, drive meaningful... ...program including planning staff training and development; maintaining... ...Manager and/or Quality Control Reviewer for bridge, tunnel, and...TrainingFull timeTemporary workPart timeWork at officeLocal areaLong distanceNight shiftWeekend workHDR
New York, NY2 days ago$77k - $128k
...Relation Insurance, Inc. - Corporate is seeking a seasoned training and development professional with at least 10 years of experience. In this role, you will assess learning needs, develop and implement training programs, and analyze customer interactions to enhance efficiencies...TrainingRelation Insurance Inc
New York, NY2 days ago- ...The AI Platform Lead owns the definition, creation, and ongoing management of ULS’s enterprise... ...reference architectures, guardrails, and quality processes; provides architectural... ...thinking ahead. It means investing in training and empowering our people to learn and...TrainingLocal areaRemote workFlexible hoursShift work
UL Solutions
New York, NY5 days ago - ...A technology transformation firm is hiring an AI Tools Specialist & Enablement Lead to enhance AI adoption utilizing Microsoft Copilot. The ideal candidate... ...on Copilot developments, and maintain comprehensive training content for diverse roles. This position requires deep...Training
Pragmatico
New York, NY5 days ago $80.5k - $100k
...Lead - Talent Acquisition Ready to turn bold ideas into real-world impact? At Genpact... ...don't just adapt to change, we lead it. AI and digital innovation are transforming the... ...scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.TrainingWork at officeRemote workShift workGenpact
New York, NY4 days ago- ...About WRITER WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence... ...programs, office hours, usage dashboards, customized trainings, and workshops Build champion communities Create...TrainingFull timeWork at officeLocal areaFlexible hours
Writer Corporation
New York, NY2 days ago $102.4k - $204.1k
...in innovative ideas, such as AI-enabled insights and technology... ...AI Solutions Consulting Lead About Crowe Studio Crowe... ...timeline, budget, and deliverable quality. Operating on the Lead Track,... ...Facilitate client workshops, training sessions, and capability building...TrainingLocal areaRemote workWorldwideFlexible hoursCrowe
New York, NY11 hours ago- ...Lead, Nuclear Pharmacist Memorial Sloan Kettering Cancer Center is hiring for a Lead... ..., and treat it. MSK is dedicated to training the next generation of scientists and clinicians... ...- 5+ years of experience in production, quality control testing, and handling of...Training
BANDANA
New York, NY4 days ago $72.7k - $144k
Join Crowe-Global as a Tax AI Senior Associate in New York. This role focuses on supporting the integration of AI technologies across tax workflows, assisting in the development of tools and training for tax professionals. Candidates need a Bachelor’s degree in Tax or...TrainingRemote job- Adobe is seeking a Principal Content Strategist to lead the content strategy for AI training for marketers. This role involves defining and executing the content strategy across Experience League, ensuring a cohesive learner experience, and managing the content creation...Training
- ...NLP PEOPLE is seeking a Senior Machine Learning Scientist to drive innovation in AI technologies. This role involves training and evaluating ML models for customer feedback, designing evaluation frameworks, and collaborating with cross-functional teams to deliver practical...TrainingRemote work
NLP PEOPLE
New York, NY5 days ago - A leading construction management firm is seeking a Project Manager in Idaho responsible... ..., safety protocols, and ensuring quality control while maintaining positive customer relations... .... An OSHA 30-Hour Construction Safety Training certification is required, and the...TrainingWork at office
- ...criminalistics. The role involves supervising evidence collection and training junior staff, engaging in laboratory analysis, and reviewing... ...'s degree in a relevant scientific field and knowledge of quality control protocols are essential. This position is located in New York...Training
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Training Quality Control Lead. Be the first to apply!
Related searches
- training coordinator New York, NY
- quality lead New York, NY
- quality distribution New York, NY
- quality advocate New York, NY
- rn quality New York, NY
- quality intern New York, NY
- quality facilitator New York, NY
- quality reviewer New York, NY
- quality improvement rn New York, NY
- quality and environmental manager New York, NY