Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Agent Evaluator & Logic QA Analyst

$80 per hour

Mindrift

Phoenix, AZ
  • Remote job

A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluator & Logic QA Analyst in Phoenix, AZ vacancy
  • $80 per hour

    A leading AI consultancy is searching for QA analysts to validate AI agents in a project focused on improving...  ...opportunity is a flexible, remote, part-time role ideal...  ...review tasks, ensure logic and completeness, and...  ...inconsistencies in AI evaluation. Competitive... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Jackson, MS
    16 hours ago
  • $20 - $40 per hour

    Put AI agents through realistic multi-step jobs and judge whether they actually finish them...  ...What you need Strong analytical and logical-reasoning skills Clear written English and...  ...guidelines and work independently Contract Remote, hourly contract (independent contractor... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    4 days ago
  • $60 per hour

    A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong...  ...will review AI evaluation tasks, identify inconsistencies...  ...behaviors for agents. Ideal applicants...  ...evaluation or logic puzzles and good communication... 
    Remote job
    Freelance

    Mindrift

    Austin, TX
    16 hours ago
  • $60 per hour

    A leading AI company is seeking QAs for autonomous AI agents to ensure quality assurance in complex task evaluations. This remote project-based role is ideal for individuals who excel in analytical...  ...experience in evaluating system logic. The opportunity offers flexible... 
    Remote job
    Flexible hours

    Mindrift

    Madison, WI
    16 hours ago
  • AuraOne is seeking an Everyday AI Agent Tester specialist operations contractor for remote US-eligible work. You will review AI outputs against workflows, policy, and playbooks, grade tone and escalation, and document next steps for model training. Ideal candidates have... 
    Remote job
    For contractors

    Auraone

    New York, NY
    16 hours ago
  • $55 per hour

    A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention...  ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    16 hours ago
  • AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing... 
    Remote job

    Auraone

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user... 
    Remote job
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $20 - $40 per hour

     ...seeking detail-oriented contributors to craft realistic AI task scenarios and evaluate agent performance. You will describe steps, judge outcomes, and...  ...to help developers improve automation. The role is remote, part-time, hourly, 10-40 hours per week, paid weekly in... 
    Remote job
    Hourly pay
    Weekly pay
    Part time
    10 hours per week

    Vettedlance

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a Manufacturing Headhunter — Remote AI Evaluation Worker to review AI outputs against manufacturing headhunter workflows and policy. You will grade tone, escalation logic, and stakeholder fit, flag risks, and document the next steps to train the... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  •  ...AI Agent Evaluator is a remote evaluation track for reviewing ai agent evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Job Description Job Description Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents performing everyday tasks. You'll test two AI agents side by side, assess their... 
    Remote job
    For contractors
    Work at office

    YO AI Labs

    New York, NY
    6 days ago
  • $25 - $45 per hour

     ...as bills, returns, bookings, groceries and travel through two AI agents side by side, using their own accounts on their phone. They approve...  ..., step by step. Listed pay: $25 to $45 per hour. Where: Remote, US-based. Time: About 1.5 hours per run, on your own schedule.... 
    Remote work
    Hourly pay
    Contract work
    Work at office

    micro1

    Remote
    1 day ago
  • $30 per hour

    Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact...  ...clear written explanations. This remote US contractor project pays $30 per...  ...rating, online research, logical reasoning, and written evaluation... 
    Remote work
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • Create challenging prompts and evaluate large language model responses...  ...management experience. 100% Remote Contract, part-time Engagement...  ...whether responses are accurate, logical, relevant, and useful in...  ...execution to assess how well AI handles management-related topics... 
    Remote work
    Contract work
    Part time
    For contractors
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $30 - $50 per hour

    Review and improve AI answers written in Polish so they read naturally and get the facts...  ...reasoning examples, including data and logic questions What you need Native-level Polish...  ...Attention to detail across many tasks Contract Remote, hourly contract (independent contractor)... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a remote contractor to review AI outputs in network and computer systems administrators specialist operations. You will evaluate workflow and policy adherence, grade tone and escalation logic, and document next steps for model training. You must... 
    Remote job
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    1 day ago
  • $104k

     ...What We're Researching We're hiring AI evaluators to assess the accuracy and helpfulness of...  ...queries and where it falls short in its logic. Your analysis will directly feed into improving...  ...response quality. This is an ongoing remote engagement requiring 20+ hours per week.... 
    Remote work
    Hourly pay
    Contract work

    Terac

    Remote
    6 days ago
  • $8 - $65 per hour

    Jobgether is seeking a remote freelance contractor to evaluate AI-generated Photoshop guidance and assess practical workflow logic. You will apply professional design expertise to review model responses and ensure accuracy and quality in photo editing workflows. The role... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Freelance

    Jobgether

    New York, NY
    16 hours ago
  • $30 per hour

     ...real user interaction traces with an AI shopping assistant Identify logical failures, inaccuracies, or poor...  ...quality Commit to 20+ hours per week of evaluation work on our internal platform Who...  ...contractor. This is a fully remote opportunity that can be completed on... 
    Remote work
    Contract work
    For contractors

    Terac

    New York, NY
    16 hours ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Remote work
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are...  ...optimization or data analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments. Pay... 
    Remote work
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • AI Agent Power User is a remote review track for evaluating AI outputs across ai agent power user specialist operations workflows...  .... Grade tone, escalation logic, and stakeholder fit on a structured...  ...experience training, calibrating, or QA-ing operations teams.... 
    Remote work
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne, Inc.

    New York, NY
    16 hours ago
  •  ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and...  ..., voice, coherence, and reader engagement. Work is fully remote on an hourly contract, with 10–40 hours per week available.... 
    Remote work
    Hourly pay
    Contract work
    10 hours per week

    Alignerr Corp.

    United States
    1 day ago
  • $20 per hour

     ...A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    9 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant,...  ...suits you—choose your hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from home anywhere in... 
    Remote work
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $25 - $45 per hour

    micro1 Inc. is seeking an AI Agent Evaluator contractor based in the United States. You will run real-life scenarios using two AI agents, screen record, and score results, providing detailed written feedback to help improve next‑gen AI agents. Onboarding is available today... 
    Hourly pay
    For contractors
    Immediate start

    micro1 Inc.

    New York, NY
    4 days ago
  • $104k - $108.16k

     ...GraphQL/API testing AI/GenAI GitHub Copilot, AWS...  ...prompt engineering for QA/test automation. • Experience...  ...or autonomous testing agents. • Experience with...  ...A successful QA Test Analyst will not simply execute...  ...or Test Automation. This is a remote position.... 
    Remote work
    Full time
    Shift work

    Volantsoft Inc

    Remote
    1 day ago
  • $25 - $45 per hour

    Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12 Onboarding: Today (Fri), Saturday, or Sunday, so you're... 
    For contractors
    Work at office
    Weekend work

    micro1 Inc.

    New York, NY
    4 days ago
  •  ...is preferred. Open to remote talent able to overlap...  ...Content and Compliance Agents Overview: The goal...  ...expected to code the agent logic, integrations, structured outputs, tests and evaluations. The agents must...  ...agree to receive calls, AI-generated calls, text messages... 
    Remote work
    Hourly pay
    For contractors
    Work at office
    Local area
    Flexible hours
    2 days per week
    1 day per week

    The Fountain Group LLC

    South San Francisco, CA
    21 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!