Remote AI Evaluation QA Lead
Vettedlance
New York, NY
- Remote job
Vettedlance is seeking an experienced QA lead to run quality for AI evaluation projects, including rubric design, reviewer calibration and tracking agreement for agentic and RAG systems. You will own QA for agentic-workflow, write and refine rubrics and gold sets, calibrate reviewers and monitor inter-annotator agreement, audit samples, and report quality trends. Remote, hourly contract, part-time, 10-40 hrs/week. #J-18808-Ljbffr Vettedlance
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation QA Lead in New York, NY vacancy
$65 per hour
...SME Careers, a fast-growing AI Data Services company, seeks an... ...Anthropology Quality Assurance Lead (QAL) to oversee quality across... ...AI training projects. This remote contractor role pays up to $65... ...generated anthropology content, evaluating against guidelines, and providing...Remote workFor contractorsSuperAnnotate AI
United States3 days ago- ...Anthropology Quality Assurance Lead Job Type: Contract Location: Remote About This Role In this hourly... ...across anthropology-focused AI training projects. You will review... ...anthropology content and trainer/QA work, evaluate output quality against project guidelines...Remote workHourly payContract workFor contractorsImmediate start
YO IT Consulting
United States5 days ago - AI Trainer Jobs seeks a Maltese Quality Assurance Lead (QAL) to oversee quality and trainer performance across Maltese AI training projects in a remote, contractor role. You will review Maltese content and trainer/QA work, evaluate output against rubrics, and provide precise...Remote jobFor contractors
- AI Trainer Jobs is seeking a Chemistry Quality Assurance Lead to oversee quality, consistency, and trainer performance across chemistry... ...AI-generated chemistry content, evaluate output quality, and provide precise written feedback. This remote contractor role involves...Remote jobFor contractors
- ...seeking an Economics Quality Assurance Lead (QAL) to oversee quality, consistency... ...performance across economics-focused AI training projects in a remote, hourly contractor role. You will review AI-generated economics content, evaluate output against guidelines, and...Remote jobHourly payFor contractors
$60 - $90 per hour
Experienced QA leads run quality for AI evaluation projects: rubric design, reviewer calibration and agreement tracking for agentic and RAG systems. What... ...and spreadsheets. Fluent written English. Contract Remote, hourly contract (independent contractor) Part-time, flexible...Remote workHourly payWeekly payContract workPart timeFor contractorsFlexible hours- ...a Ukrainian Quality Assurance Lead to oversee quality and trainer performance across Ukrainian AI training projects. You will review... ...-generated Ukrainian content, evaluate output against guidelines, and... ...to standards. You will manage remote QA workflows, communicate updates...Remote job
- SME Careers, a fast-growing AI Data Services company and subsidiary... ...a Gujarati Quality Assurance Lead to oversee quality and trainer... ...-generated Gujarati content, evaluate output against rubrics, and... ...detail, and experience leading remote teams. #J-18808-Ljbffr SuperAnnotate...Remote job
- SME Careers is seeking a Physics Quality Assurance Lead to oversee quality and trainer performance across physics AI training projects. This remote hourly contractor role reviews AI-generated physics content, evaluates output against guidelines, and provides precise written...Remote jobHourly payFor contractors
- ...seeking a Slovak Quality Assurance Lead for a remote hourly contractor role to oversee quality across Slovak AI training projects. You will... ...content and trainer outputs, evaluate against guidelines, and... ...detail, and the ability to manage QA workflows across remote teams....Remote jobHourly payFor contractors
$105 per hour
About OpenTrain OpenTrain AI is the hiring and contracting organization for this remote opportunity. OpenTrain is the #1 platform... .... Specialists review examples, evaluate model responses, and provide... ...is seeking a Civil Engineering QA Lead to review AI-generated civil...Remote workHourly payPart timeFor contractors$80k - $90k
...Manager, IT Quality Assurance, the QA Lead owns the quality assurance strategy... ...artificial intelligence concepts and can evaluate, communicate, and apply AI-enabled approaches within a business... ...role works 40 hours per week in a remote Canadian home-office environment....Remote jobContract workHome officeFlexible hours- ...** Hybrid work model, mostly remote; on-site in Phoenix, AZ for design... ...an opening for a Software QA Automation Lead # 8377. This position is for... ...Azure, AWS, or GCP Maven AI experience Jira Confluence... ...Framework evolution (tool-agnostic): Evaluate and pilot modern UI/API...Remote workHourly payContract workFor subcontractorLocal areaRelocationShift work
$65 per hour
...Prolific is seeking registered nurses to join its Domain Expert pool to train and evaluate AI models. You will take a quick skills test and, if successful, be invited to join Prolific as a Domain Expert participant, earning payments for AI tasks. Researchers pay up...Remote workSelf employmentWork from homeFlexible hoursProlific Academic Ltd
United States1 day ago$80 - $150 per hour
...Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates...Remote workHourly payWork from homeProlific
Denver, CO4 days ago$80 - $150 per hour
...Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback...Remote workWork from homeProlific
Seattle, WA4 days ago$80 - $150 per hour
...Prolific is seeking Medical Doctors to train and evaluate AI models. You'll review AI-generated clinical responses and evaluate their accuracy and appropriateness, earning competitive pay of $80-$150 per hour depending on your skills and experience. Ideal candidates must...Remote workHourly payWork from homeFlexible hoursProlific
Portland, OR2 days ago- ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants...Remote workHourly payWork from homeFlexible hours
Prolific
United States5 days ago $60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Remote workHourly payWork from homeFlexible hoursProlific
San Jose, CA4 days ago$8 - $65 per hour
...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote workHourly payWork from homeFlexible hoursProlific
New York, NY4 days ago- CGS Immersive is seeking a hands-on Quality Assurance Lead to own the QA process and ensure release confidence for an AI learning platform. The role grants authority to pause production if quality criteria are not met and requires building a comprehensive testing strategy...Remote job
- Vettedlance is seeking a Lead quality specialist for Portuguese AI training data. You will verify reviewer outputs for grammar, tone, meaning, and cultural fit, and steer the team toward a single standard. You will maintain style guides, FAQs, examples, and calibration...Remote job
$30 per hour
SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, seeks a Hungarian Quality Assurance Lead for remote contractor work at up to $30/hour. You will oversee... ...documentation, and drive scalable QA workflows while ensuring #J-18808-Ljbffr...Remote jobFor contractors- ...Careers is seeking a Polish Quality Assurance Lead for an hourly, remote contractor role. You will oversee quality across Polish AI training projects, review AI-generated Polish... ..., maintain documentation, and drive remote QA workflows across distributed teams. Strong Polish...Remote jobHourly payFor contractors
- ...seeking a Senior Business Systems Analyst and Testing Lead for a remote contract role supporting an Agentic AI contact center program. You will own requirements... ...AI vendors. The ideal candidate has 5+ years of BSA/QA leadership, deep data platform skills, and experience...Remote jobContract work
- Vettedlance is seeking a Czech-language QA lead to ensure AI training data quality. You will spot-check Czech outputs and reviewers’ work for grammar, tone, meaning and cultural fit, helping keep every project on a single standard. You’ll track recurring issues, escalate...Remote job
- AI Trainer Jobs is seeking a Medicine Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across medical AI training projects.... ...expertise and excellent English communication, with remote collaboration across distributed teams. The...Remote jobFor contractors
- SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, seeks an Italian Quality Assurance Lead to oversee quality across Italian AI training projects... ...adherence to project rubrics. This is a remote hourly contractor role. This remote hourly...Remote jobHourly payFor contractors
- AI Trainer Jobs seeks a Japanese Quality Assurance Lead to oversee Japanese AI training projects, review content, and ensure... ...across guidelines, style sheets, and QA processes to improve training data... ...models. The role involves leading remote teams, communicating updates on...Remote job
- AI Trainer Jobs in the United States seeks a Political Science Quality Assurance Lead to oversee QA across political science AI training projects. This remote, hourly contractor role emphasizes accuracy, balance, and policy reasoning in reviewer feedback. You will assess...Remote jobHourly payFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation QA Lead. Be the first to apply!
Related searches
- quality assurance lead New York, NY
- graphic design remote New York, NY
- remote scrum master New York, NY
- remote document review New York, NY
- remote recruiter New York, NY
- remote infrastructure engineer New York, NY
- genetic counselor remote New York, NY
- remote appointment scheduler New York, NY
- junior angular developer remote New York, NY
- remote video game New York, NY