Autonomous AI QA & Evaluation Analyst (Remote)
$80 per hourMind Rift
A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies, and help define expected behaviors for AI agents. Offering up to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects that positively influence future technology. #J-18808-Ljbffr
$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal... ...include reviewing evaluation tasks, identifying inconsistencies... ...rates up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors...Remote workFreelance$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule...Remote jobPart timeFlexible hours$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per week- AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train the...Remote jobFor contractors10 hours per week
- AI Trainer Jobs is seeking a SQL Support Analyst for a remote contractor role focused on evaluating AI outputs within sql support analyst specialist operations workflows. Reviewers assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk...Remote jobFor contractors
$60 - $120 per hour
AI Trainer Jobs is seeking a Management Analyst for a remote review role evaluating AI outputs across operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps for the modeling team to train on....Remote jobHourly payFor contractors- AuraOne is seeking a Computer Systems Analyst to remotely review AI outputs across specialist operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps to train the modeling team. This contractor role...Remote jobFor contractors10 hours per week
- Dynamics QA/Test Analyst Anywhere Contract Remote Open Development Technology Description Remote Our client seeks... ...utilizes artificial intelligence (AI) tools as part of its initial... ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human...Remote workHourly payContract work
- ...We are currently seeking a Senior QA/QC Data Analyst with AI/ML testing to join our team in Bangalore... ...independently in a collaborative environment. • Evaluate data across various dimensions,... ...’s needs. While many positions offer remote or hybrid work options, these...Remote workWork experience placementWork at officeFlexible hours
- KaiCalls is seeking a meticulous QA reviewer to sample and review real calls under privacy rules and to maintain rubrics... ..., and partner with engineering on remediation. This remote role supports evaluating calls across verticals and languages with emphasis on evidence...Remote job
- ...is seeking Chinese-speaking professionals for a short-term AI quality evaluation project. You will create conversational prompts, evaluate AI... ...multi-turn interactions, and delivering actionable feedback. Remote work is supported; prior AI evaluation or data annotation experience...Remote jobTemporary work
- ...next generation of safe and delightful personal autonomous vehicle experiences. About the Organization The Evaluation team builds and evolves the evaluation... ...for autonomy systems. Experience leveraging AI-assisted development and analytics tools to improve...Remote workLocal areaWork from home
- RemoteJobsOne is seeking a Data Analyst (AI Evaluation) contractor to help assess data quality for a customer project. You will review datasets... ...to follow complex instructions are valued. This is a fully remote US-based opportunity with contract status. #J-18808-Ljbffr RemoteJobsOneRemote jobContract workFor contractors
$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST),... ...include developing benchmarks for fully autonomous operations using scaffolding and... ...Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT),...Remote workWork experience placementWork from home- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
- ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
$30 per hour
...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for...Remote workSelf employmentWork from home$50 per hour
...Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree in Human-Computer... ...least a year of relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility, and refining...Remote workHourly payWork from homeFlexible hours$153.2k - $234.1k
...systematic and data-driven improvements to the Autonomous Vehicle software by designing,... ...implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve... ...position, you will work closely with AI/ML Engineers, Simulation Engineers,...Full timeLocal areaWork from homeFlexible hours$30 per hour
Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr ProlificRemote jobWork from home$150 - $180 per hour
Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological scenarios and completing related tasks, offering competitive pay up to $150-180/hr. You must have a valid mental...Remote jobWork from home$80 - $150 per hour
Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates...Remote jobHourly payWork from home$20 - $26 per hour
Prolific is seeking fluent Kazakh speakers to evaluate AI-generated text for naturalness and authenticity. You will perform side-by-side comparisons and rate tone, style, and cultural alignment. This fast-paced, paid task work offers flexible hours and the option to work...Remote jobHourly payWork from homeFlexible hours$150 - $180 per hour
Prolific in Sacramento is seeking Mental Health Professionals to help train and evaluate advanced AI models. You will review AI-generated responses and engage in various training tasks, earning competitive pay rates up to $150-180/hr. Ideal candidates must hold a verified...Remote jobWork from home$65 per hour
Prolific is seeking Registered Nurses to help train and evaluate AI models. You’ll complete a quick test to assess your skills and, if successful, join Prolific as a Domain Expert participant, where you’ll get paid to train and evaluate powerful AI models. Researchers paying...Remote jobWork from homeFlexible hours- Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge...Remote jobWork from homeFlexible hours
$80 - $150 per hour
Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback...Remote jobWork from home$80 per hour
...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for... ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/...Remote jobPart timeFlexible hours$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...Remote jobHourly payWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Autonomous AI QA & Evaluation Analyst (Remote). Be the first to apply!
- qa analyst New York, NY
- qa analyst - remote New York, NY
- quality assurance analyst New York, NY
- c++ remote New York, NY
- senior devops engineer remote New York, NY
- remote .net full stack web developer New York, NY
- nursing recruiter (remote) New York, NY
- agile coach / scrum master (remote) New York, NY
- clinical data coordinator remote New York, NY
- pmp - project manager - remote New York, NY


