Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Agent Evaluator & Logic QA Analyst

$80 per hour

Mindrift

Phoenix, AZ
  • Remote job

A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluator & Logic QA Analyst in Phoenix, AZ vacancy
  • $60 per hour

    A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong...  ...will review AI evaluation tasks, identify inconsistencies...  ...behaviors for agents. Ideal applicants...  ...evaluation or logic puzzles and good communication... 
    Remote job
    Freelance

    Mind Rift

    Austin, TX
    1 day ago
  •  ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality...  ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    8 days ago
  • $20 per hour

    A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $100 - $125 per hour

     ...Actuary) Engagement Type: Freelance/ 1099 Contractor, Remote Compensation: $100-$125 per hour Commitment:...  ...insurance workflows into structured tasks for AI systems Evaluate AI-generated outputs for accuracy, logical reasoning, and business relevance Work on use cases... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Work at office
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    15 hours ago
  • $40 per hour

    An AI training company in the United States is looking for a Statistician to help improve AI models. You will evaluate the mathematics logic behind chatbots and assess their performance. Candidates should...  ...will be considered for this remote contract role. #J-18808-Ljbffr
    Remote work
    Hourly pay
    Contract work

    DataAnnotation

    Honolulu, HI
    4 days ago
  • $112.09k - $160.33k

     ...Burlington, VT (hybrid) or remote About OhMD OhMD is an AI patient communication...  ...and OhMD AI, our AI voice agent. It picks up on the first...  ...conversation flows, decision logic, escalation rules, edge case...  ...made Familiarity with evaluating agent quality in a structured... 
    Remote work
    Live in

    OhMD

    Burlington, VT
    8 days ago
  •  ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and... 
    Remote work
    Full time
    Contract work
    Flexible hours

    Virtual Vocations Inc

    United States
    4 days ago
  • $80 per hour

     ...technology firm is seeking QAs for autonomous AI agents to validate and improve task structures...  ...systems, ensuring quality assurance and logical problem-solving. Ideal candidates are...  ...attention to detail and experience in evaluating scenarios. This flexible, project-based... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    1 day ago
  • $80 per hour

     ...opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI....  ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    1 day ago
  • $40 per hour

     ...tech firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This...  ...choosing their projects and schedules, earning $40+ per hour. Remote work is available for candidates in the US and select... 
    Remote work
    Hourly pay

    DataAnnotation

    Louisiana, MO
    3 days ago
  • $60 per hour

     ...shape the future of AI. What We Do The Mindrift...  ...in ambiguity, enjoy remote asynchronous work,...  ...are tested and evaluated, we want to hear from...  ...Overview We are seeking QA experts for autonomous AI agents in a project focused...  ...structures, policy logic, and agent... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Austin, TX
    16 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences...  ...you—choose your hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from home anywhere in... 
    Remote work
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Work from home
    Flexible hours

    Jobs for Humanity

    United States
    5 days ago
  • $40 per hour

    A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity... 
    Remote work
    Hourly pay

    DataAnnotation

    Lincoln, NE
    3 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Remote work
    Contract work
    Temporary work
    Immediate start

    MERIT Beauty

    New York, NY
    4 days ago
  •  ...practical, fast-moving AI Operations Specialist to...  ...deploy autonomous AI agents, data synchronizations,...  ...field, deconstruct their logic dependencies, and...  ...time automation streams, evaluate agent output qualities,...  ...Location Context: 100% remote-first full-time operational... 
    Remote work
    Full time
    Local area
    Work from home

    Proper

    Remote
    a month ago
  •  ...engagement to design and build an AI agent system that manages a complex,...  ...ML Engineers, a Lead Business Analyst, and the Engagement Director,...  ..., model services, business logic, and user-facing applications...  ...anywhere, forever - We are a fully remote and global team. We trust you... 
    Remote work
    Contract work

    Future Works

    Remote
    6 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Remote work
    Work at office

    Obsidian

    New York, NY
    2 days ago
  • $1,500 - $2,000 per month

    Builder Lead Converter AI Agent Specialist Builder Lead Converter is...  ...Design AI agent logic and workflows Deploy, test,...  ...frameworks, guardrails, and evaluation logic Optimize AI agents for...  ...earlier in the day This is a remote position, but collaboration during... 
    Remote work
    For contractors
    Work at office
    Monday to Friday

    Builder Lead Converter

    New York, NY
    2 days ago
  • $40 per hour

     ...cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical...  ...industry. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you... 
    Remote work
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Virginia, MN
    3 days ago
  •  ...QA Analyst Location: Richmond, VA, Hybrid Rate: Best competitive rate Local candidates...  ...when requested! Current team is 100% remote with some in person meetings in Richmond...  ...with use cases a plus. Experience with logical data flows a plus. Experience working with... 
    Remote work
    Contract work
    Local area

    InterSources

    Richmond, VA
    5 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Remote work
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  • $40 per hour

     ...annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement....  .... This independent contract position offers remote work with flexible scheduling and hourly pay starting... 
    Remote work
    Hourly pay
    Contract work
    Flexible hours

    DataAnnotation

    Iowa, LA
    3 days ago
  • $25 - $30 per hour

     ...seeking analytical, detail-oriented professionals to help train AI chatbots. This independent contractor role allows you to work from...  ...projects. Candidates will develop prompts, write responses, and evaluate AI models. Ideal for those experienced in business communication... 
    Remote work
    Hourly pay
    For contractors
    Work from home

    DataAnnotation

    Louisiana, MO
    3 days ago
  • $112k - $216k

     ...ambitious team building AI that transforms how...  ...together. As part of the AI agents team, you'll work at...  ...Build LLM-as-a-judge evaluations and AI observability —...  ...data model and LLM/agent logic to APIs and (where...  ...the option to be fully remote in all locations across... 
    Remote work
    Full time
    Work from home

    Hatch

    Remote
    22 days ago
  • $25 - $30 per hour

     ...DataAnnotation is seeking contractors to assist in training AI chatbots. This flexible role allows you to choose projects based on your schedule while working from home. Ideal candidates will manage business communications and possess excellent writing and research skills... 
    Remote work
    Hourly pay
    For contractors
    Work from home
    Flexible hours

    DataAnnotation

    Indiana, PA
    4 days ago
  • $25 - $30 per hour

     ...looking for analytical and detail-oriented independent contractors in New York to help train AI chatbots. You will manage various tasks, write high-quality responses, and evaluate AI models based on guidelines. This role offers flexibility as you can choose projects and... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Work from home

    DataAnnotation

    Florida, NY
    2 days ago
  • Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect...  ...Infrastructure Location: Remote (US Preferred) Compensation...  ...orchestration, simulation logic, and multi-role...  ...Develop and refine test plans, evaluation pipelines, and debug tools... 
    Remote work
    Full time
    Work at office

    Nivalto

    San Francisco, CA
    4 days ago
  • A leading AI research accelerator is looking for a detail-oriented Business Analyst to support evaluation and annotation workflows. The role involves performing evaluations, fact...  ...opportunity to contribute to impactful research. Remote work is available with a minimum... 
    Remote work
    Flexible hours

    Turing

    Los Angeles, CA
    2 days ago
  •  ...Senior Software Engineer, Agents on our Delivery team,...  ...customers: ~Own AI agents for your assigned...  ...discovery, design, build, evaluation, launch, and live operation...  ...enforces that business logic strictly. ~Design...  ...— we’ll fund them. ~Remote by design: Distributed... 
    Remote work
    Full time
    Flexible hours

    Replicant

    Remote
    1 day ago
  • $20 - $26 per hour

    Prolific is looking for an AI Trainer who is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in pronunciation. Candidates must possess... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Chicago, IL
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!