Remote AI Agent Evaluator & Logic QA Analyst
$80 per hourMindrift
- Remote job
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift
$80 per hour
A leading AI consultancy is searching for QA analysts to validate AI agents in a project focused on improving... ...opportunity is a flexible, remote, part-time role ideal... ...review tasks, ensure logic and completeness, and... ...inconsistencies in AI evaluation. Competitive...Remote jobPart timeFlexible hours$20 - $40 per hour
Put AI agents through realistic multi-step jobs and judge whether they actually finish them... ...What you need Strong analytical and logical-reasoning skills Clear written English and... ...guidelines and work independently Contract Remote, hourly contract (independent contractor...Remote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours$60 per hour
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong... ...will review AI evaluation tasks, identify inconsistencies... ...behaviors for agents. Ideal applicants... ...evaluation or logic puzzles and good communication...Remote jobFreelance$60 per hour
A leading AI company is seeking QAs for autonomous AI agents to ensure quality assurance in complex task evaluations. This remote project-based role is ideal for individuals who excel in analytical... ...experience in evaluating system logic. The opportunity offers flexible...Remote jobFlexible hours- AuraOne is seeking an Everyday AI Agent Tester specialist operations contractor for remote US-eligible work. You will review AI outputs against workflows, policy, and playbooks, grade tone and escalation, and document next steps for model training. Ideal candidates have...Remote jobFor contractors
$55 per hour
A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention... ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/...Remote jobPart timeFlexible hours- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
- OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user...Remote jobPart timeFor contractors
$20 - $40 per hour
...seeking detail-oriented contributors to craft realistic AI task scenarios and evaluate agent performance. You will describe steps, judge outcomes, and... ...to help developers improve automation. The role is remote, part-time, hourly, 10-40 hours per week, paid weekly in...Remote jobHourly payWeekly payPart time10 hours per week- AuraOne, Inc. is seeking a Manufacturing Headhunter — Remote AI Evaluation Worker to review AI outputs against manufacturing headhunter workflows and policy. You will grade tone, escalation logic, and stakeholder fit, flag risks, and document the next steps to train the...Remote jobFor contractors10 hours per week
- ...AI Agent Evaluator is a remote evaluation track for reviewing ai agent evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain...Remote jobHourly payFor contractors10 hours per week
- ...Job Description Job Description Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents performing everyday tasks. You'll test two AI agents side by side, assess their...Remote jobFor contractorsWork at office
$25 - $45 per hour
...as bills, returns, bookings, groceries and travel through two AI agents side by side, using their own accounts on their phone. They approve... ..., step by step. Listed pay: $25 to $45 per hour. Where: Remote, US-based. Time: About 1.5 hours per run, on your own schedule....Remote workHourly payContract workWork at office$30 per hour
Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact... ...clear written explanations. This remote US contractor project pays $30 per... ...rating, online research, logical reasoning, and written evaluation...Remote workHourly payContract workPart timeFor contractors- Create challenging prompts and evaluate large language model responses... ...management experience. 100% Remote Contract, part-time Engagement... ...whether responses are accurate, logical, relevant, and useful in... ...execution to assess how well AI handles management-related topics...Remote workContract workPart timeFor contractorsWorldwide
$30 - $50 per hour
Review and improve AI answers written in Polish so they read naturally and get the facts... ...reasoning examples, including data and logic questions What you need Native-level Polish... ...Attention to detail across many tasks Contract Remote, hourly contract (independent contractor)...Remote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- AuraOne, Inc. is seeking a remote contractor to review AI outputs in network and computer systems administrators specialist operations. You will evaluate workflow and policy adherence, grade tone and escalation logic, and document next steps for model training. You must...Remote jobFor contractors10 hours per week
$104k
...What We're Researching We're hiring AI evaluators to assess the accuracy and helpfulness of... ...queries and where it falls short in its logic. Your analysis will directly feed into improving... ...response quality. This is an ongoing remote engagement requiring 20+ hours per week....Remote workHourly payContract work$8 - $65 per hour
Jobgether is seeking a remote freelance contractor to evaluate AI-generated Photoshop guidance and assess practical workflow logic. You will apply professional design expertise to review model responses and ensure accuracy and quality in photo editing workflows. The role...Remote jobHourly payContract workFor contractorsFreelance$30 per hour
...real user interaction traces with an AI shopping assistant Identify logical failures, inaccuracies, or poor... ...quality Commit to 20+ hours per week of evaluation work on our internal platform Who... ...contractor. This is a fully remote opportunity that can be completed on...Remote workContract workFor contractors$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hours$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...optimization or data analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments. Pay...Remote workHourly payPart timeImmediate startWork from home10 hours per weekFlexible hours- AI Agent Power User is a remote review track for evaluating AI outputs across ai agent power user specialist operations workflows... .... Grade tone, escalation logic, and stakeholder fit on a structured... ...experience training, calibrating, or QA-ing operations teams....Remote workHourly payFor contractorsWork experience placement10 hours per week
- ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and... ..., voice, coherence, and reader engagement. Work is fully remote on an hourly contract, with 10–40 hours per week available....Remote workHourly payContract work10 hours per week
$20 per hour
...A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hours$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant,... ...suits you—choose your hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from home anywhere in...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hours$25 - $45 per hour
micro1 Inc. is seeking an AI Agent Evaluator contractor based in the United States. You will run real-life scenarios using two AI agents, screen record, and score results, providing detailed written feedback to help improve next‑gen AI agents. Onboarding is available today...Hourly payFor contractorsImmediate start$104k - $108.16k
...GraphQL/API testing AI/GenAI GitHub Copilot, AWS... ...prompt engineering for QA/test automation. • Experience... ...or autonomous testing agents. • Experience with... ...A successful QA Test Analyst will not simply execute... ...or Test Automation. This is a remote position....Remote workFull timeShift work$25 - $45 per hour
Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12 Onboarding: Today (Fri), Saturday, or Sunday, so you're...For contractorsWork at officeWeekend work- ...is preferred. Open to remote talent able to overlap... ...Content and Compliance Agents Overview: The goal... ...expected to code the agent logic, integrations, structured outputs, tests and evaluations. The agents must... ...agree to receive calls, AI-generated calls, text messages...Remote workHourly payFor contractorsWork at officeLocal areaFlexible hours2 days per week1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!
- tsa agent Phoenix, AZ
- import export agent Phoenix, AZ
- cruise agent Phoenix, AZ
- agent assistant Phoenix, AZ
- telemarketer - state farm agent team member Phoenix, AZ
- agent Phoenix, AZ
- state farm agent work from home Phoenix, AZ
- title agent Phoenix, AZ
- executive protection agent Phoenix, AZ
- work from home chat agent Phoenix, AZ


