Autonomous AI QA & Evaluation Analyst (Remote)
$80 per hourMind Rift
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies, and help define expected behaviors for AI agents. Offering up to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects that positively influence future technology. #J-18808-Ljbffr
$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal... ...include reviewing evaluation tasks, identifying inconsistencies... ...rates up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors...Remote workFreelance$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule...Remote jobPart timeFlexible hours$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per week- AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train the...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking a SQL Support Analyst for a remote contractor role focused on evaluating AI outputs within sql support analyst specialist operations workflows. Reviewers assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk...Remote jobFor contractors
$60 - $120 per hour
AI Trainer Jobs is seeking a Management Analyst for a remote review role evaluating AI outputs across operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps for the modeling team to train on....Remote jobHourly payFor contractors- ...We are currently seeking a Senior QA/QC Data Analyst with AI/ML testing to join our team in Bangalore... ...independently in a collaborative environment. • Evaluate data across various dimensions,... ...’s needs. While many positions offer remote or hybrid work options, these...Remote workWork experience placementWork at officeFlexible hours
$153.2k - $234.1k
...systematic and data-driven improvements to the Autonomous Vehicle software by designing,... ...implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve... ...position, you will work closely with AI/ML Engineers, Simulation Engineers,...Full timeLocal areaWork from homeFlexible hours- KaiCalls is seeking a meticulous QA reviewer to sample and review real calls under privacy rules and to maintain rubrics... ..., and partner with engineering on remediation. This remote role supports evaluating calls across verticals and languages with emphasis on evidence...Remote job
- ...is seeking Chinese-speaking professionals for a short-term AI quality evaluation project. You will create conversational prompts, evaluate AI... ...multi-turn interactions, and delivering actionable feedback. Remote work is supported; prior AI evaluation or data annotation experience...Remote jobTemporary work
- ...next generation of safe and delightful personal autonomous vehicle experiences. About the Organization The Evaluation team builds and evolves the evaluation... ...for autonomy systems. Experience leveraging AI-assisted development and analytics tools to improve...Remote workLocal areaWork from home
$89k - $148.4k
...with the remaining days worked remotely. Specific in-office days may... ...Software Quality Assurance (QA) Analyst, you will ensure the quality,... ...testing practices and emerging AI-assisted testing capabilities... ..., equity, regular job market evaluations, and geographical markets....Remote workFull timeH1bWork at office2 days per week$144.7k - $261.3k
Job DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high... ....#GM-AV-1 This role is based remotely, but if the selected candidate lives...Remote workFull timeLocal areaWork from homeRelocation packageFlexible hours$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST),... ...include developing benchmarks for fully autonomous operations using scaffolding and... ...Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT),...Remote workWork experience placementWork from home- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
- ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
$30 per hour
...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for...Remote workSelf employmentWork from home$50 per hour
...Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree in Human-Computer... ...least a year of relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility, and refining...Remote workHourly payWork from homeFlexible hours$30 per hour
Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr ProlificRemote jobWork from home$150 - $180 per hour
Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological scenarios and completing related tasks, offering competitive pay up to $150-180/hr. You must have a valid mental...Remote jobWork from home$150 - $180 per hour
Prolific in Sacramento is seeking Mental Health Professionals to help train and evaluate advanced AI models. You will review AI-generated responses and engage in various training tasks, earning competitive pay rates up to $150-180/hr. Ideal candidates must hold a verified...Remote jobWork from home$80 - $150 per hour
Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback...Remote jobWork from home- Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge...Remote jobWork from homeFlexible hours
$80 - $150 per hour
Prolific is seeking Medical Doctors to train and evaluate AI models. You'll review AI-generated clinical responses and evaluate their accuracy and appropriateness, earning competitive pay of $80-$150 per hour depending on your skills and experience. Ideal candidates must...Remote jobHourly payWork from homeFlexible hours$80 per hour
...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for... ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/...Remote jobPart timeFlexible hours$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote jobPart timeFlexible hours- ...York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating chemical reactions...Remote jobWork from homeFlexible hours
$80 - $150 per hour
Prolific in New York, NY, is seeking Medical Doctors to join our Expert Network for training and evaluating AI models. As a Domain Expert participant, you will review and rate AI-generated clinical responses, providing crucial feedback for AI development. You must hold...Remote jobHourly payWork from homeFlexible hours$80 per hour
Prolific is recruiting AI & Machine Learning Engineers to join its Expert Network, helping train and evaluate next‑gen LLMs. You’ll complete quick skill tests and, if successful, join Prolific as a participant to get paid for AI tasks requiring one hour of work or less...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Autonomous AI QA & Evaluation Analyst (Remote). Be the first to apply!
- qa analyst New York, NY
- qa analyst - remote New York, NY
- quality assurance analyst New York, NY
- c++ remote New York, NY
- senior devops engineer remote New York, NY
- remote .net full stack web developer New York, NY
- nursing recruiter (remote) New York, NY
- agile coach / scrum master (remote) New York, NY
- clinical data coordinator remote New York, NY
- pmp - project manager - remote New York, NY



