Remote AI Agent Evaluator & Logic QA Analyst
$80 per hourMindrift
Phoenix, AZ
- Remote job
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluator & Logic QA Analyst in Phoenix, AZ vacancy
$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong... ...will review AI evaluation tasks, identify inconsistencies... ...behaviors for agents. Ideal applicants... ...evaluation or logic puzzles and good communication...Remote jobFreelance- ...Job Description Job Description Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents performing everyday tasks. You'll test two AI agents side by side, assess their...Remote jobFor contractorsWork at office
YO AI Labs
New York, NY3 days ago - ...Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Required Skills: ChatGPT Muse AI agents Attention to Detail Following Instructions Screen Recording About the role: AI agents are starting to handle real-life errands...Remote jobContract workFor contractorsWork at officeWeekend work
$45 per hour
# AI Agent Evaluator$45per hourContractor Remote Last verified 21 Jul 2026Listed on micro1 micro1.aiApplyAffiliate disclosureWork Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated...Remote work- RemoteJobsOne is seeking an Everyday AI Agent Tester for a fully remote contractor role based in the United States. You will run real-life scenarios with two AI agents, screen record each attempt, and score results on completion, quality, control issues, and user satisfaction...Remote jobFor contractorsStart working today
- AuraOne, Inc. is seeking a remote AI data reviewer to evaluate agent evaluation outputs against a versioned rubric. You will label edge cases, provide rationales, and help calibrate review quality across long batches. Ideal candidates have prior evaluation or annotation...Remote jobFor contractorsFlexible hours
- OpenTrain AI, Inc. is seeking a remote, part-time contractor to test two AI agents on a smartphone, completing realistic errands and recording outcomes. You will evaluate task completion, quality, control issues, user satisfaction, and time, then provide clear feedback...Remote jobPart timeFor contractorsFlexible hours
- ...Dover is seeking an AI Agent Evaluator contractor based in the United States to test two AI agents by performing real-life tasks and recording... ...steps, note any issues, and rate performance. This role is remote and offers flexible scheduling. #J-18808-Ljbffr Jobleads-USRemote workFor contractorsFlexible hours
- ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality... ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs...Remote jobHourly payFor contractors10 hours per week
$25 - $45 per hour
...last step is done. If you do not see it check your spam folder. This is a fully remote position open to candidates based in United States. Pay: $25$45/hr Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay...Remote workFull timeFor contractorsWork at officeWeekend work- AuraOne is seeking a Primary Care Physician (MD) for a remote Clinical Documentation & AI Evaluation track. Review AI outputs, assess differential diagnosis, dosing logic, and adherence to guidelines, and document corrected clinical reasoning. This contractor role requires...Remote jobFor contractors
- AI Trainer Jobs seeks a remote independent contractor to review AI outputs for fintech operations evaluation. You will assess workflow adherence, tone, and escalation logic, assigning severity tags and documenting next steps for model training. The role requires experience...Remote jobHourly payFor contractorsFlexible hours
- ...About the role Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning...Remote workHourly payFor contractors10 hours per week
AI Trainer Jobs
New York, NY16 hours ago $60 per hour
...Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly... ...data accuracy, validating citations, and assessing experimental logic. A BS, MS, or PhD in Biology or a related field is required,...Remote jobHourly payWork from homeFlexible hours$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per weekCrossing Hurdles
United States3 days ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
MERIT Beauty
United States3 days ago $80 per hour
...thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote workFlexible hoursMind Rift
New York, NY21 hours ago- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
Virtual Vocations Inc
United States2 days ago $14.5 per hour
...diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data... ...insights on relevance and quality. Evaluate and rate the effectiveness of search engine... ...analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments...Remote workHourly payPart timeImmediate startWork from home10 hours per weekFlexible hoursKanz.us
Dallas, TX21 hours ago- ...YO AI Labs is seeking an Everyday AI Agent Tester based in the United States to evaluate AI agents performing common tasks. You will compare two agents side by side, document results, and provide actionable feedback to improve user experience and reliability. Responsibilities...
$80 per hour
...opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI.... ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can...Remote jobPart timeFlexible hours$89k - $148.4k
...remaining days worked remotely. Specific in-office days... ...Quality Assurance (QA) Analyst, you will ensure the quality... ..., business logic, and data integrity.Collaborate... ...and emerging AI-assisted testing capabilities... ..., regular job market evaluations, and geographical markets...Remote workFull timeH1bWork at office2 days per weekMcKesson
Atlanta, GA1 day ago$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hoursWelo Data
United States3 days ago- ...Principal Software Engineer to build and scale AI agent systems within our enterprise SaaS... ...You will own core engineering of agentic logic, frameworks, and high-performance backend... ...Go and data-layer work with MySQL. Hybrid/remote US-based applicants encouraged to apply,...Remote job
$190.9k - $334.1k
...ServiceNow is the AI control tower for business... ...Engineer, Voice AI Agent Engineering designs... ...through automated evaluation that the result... ...call-flow logic rather than selecting... ...calibrated to human QA review, CI gates, and... ...personas (flexible, remote, or required in office...Remote workWork at officeLocal areaImmediate startFlexible hoursServiceNow
Santa Clara, CA17 hours ago- ...Location: Burlington, VT (hybrid) or remote ABOUT OHMD OhMD is patient communication... ...forms, automated workflows, and OhMD AI, our voice and text agent. OhMD AI answers on the first ring,... ...definitions, escalation and transfer logic, and fallback paths for when things go...Remote workAgency workFreelanceLive in
OhMD
United States4 days ago $60 per hour
...shape the future of AI. What We Do The Mindrift... ...in ambiguity, enjoy remote asynchronous work,... ...are tested and evaluated, we want to hear from... ...Overview We are seeking QA experts for autonomous AI agents in a project focused... ...structures, policy logic, and agent...Remote workFreelanceFlexible hours$260k
# Head of AI Agent SystemsWonderschoolSan FranciscoFull-timeAI tools... ...production workflows.* Build evaluation and reporting systems to... ...learning jobs at 18 companies.Remote work: This job is on site. 4... ...Introduce validation layers, retry logic, and clear ownership across...Remote workPermanent employmentImmediate startWe Love AI Jobs
San Francisco, CA16 hours ago- ...Purple Drive ServiceNow Developer with AI agent experience Share Dallas, TX Overview: Must Have Technical/Functional Skills:... ...Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and usability...Remote work
Purple Drive
United States2 days ago - ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ16 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!
Related searches