Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Agent Evaluator & Logic QA Analyst

$80 per hour

Mindrift

Phoenix, AZ
  • Remote job

A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention to detail, and experience with logical problem-solving. The role includes reviewing tasks, identifying inconsistencies, and defining expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while influencing AI developments in your field. Compensation can reach up to $80/hour based on experience and skills. #J-18808-Ljbffr Mindrift

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluator & Logic QA Analyst in Phoenix, AZ vacancy
  • $60 per hour

    A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong...  ...will review AI evaluation tasks, identify inconsistencies...  ...behaviors for agents. Ideal applicants...  ...evaluation or logic puzzles and good communication... 
    Remote job
    Freelance

    Mindrift

    Austin, TX
    2 days ago
  •  ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality...  ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $40 - $100 per hour

    About OpenTrain OpenTrain AI is the hiring and contracting organization...  ...technical conclusions. Remote contract engagement Part-time...  ...About AI Training and Scientific Evaluation AI training is the human side...  ...assess scientific accuracy, logical soundness, completeness, clarity... 
    Remote work
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI

    Brooklyn, NY
    18 hours ago
  • $60 per hour

     ...Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly...  ...data accuracy, validating citations, and assessing experimental logic. A BS, MS, or PhD in Biology or a related field is required,... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    2 days ago
  • $80 per hour

     ...opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI....  ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can... 
    Remote work
    Part time
    Flexible hours

    Mind Rift

    United States
    1 day ago
  • $55 - $65 per hour

     ...convert FTE. This is a remote role but candidates...  ...SailPoint and would want a QA Test Analyst who has experience...  ...vulnerabilities• Ability to evaluate IAM processes and...  ...other’s ideas, think logically and intuitively• Ability...  ...Intelligence (AI): We may use Artificial... 
    Remote work
    Long term contract
    Contract work
    Temporary work
    Work at office
    Local area

    TEKsystems

    Arlington, TX
    2 days ago
  • $186.1k - $292.81k

     ...Recognized by industry analysts like Forrester and G2...  ...revenue performance. AI agents are becoming central...  ...orchestration layer, and the evaluation and observability...  ...partners in a remote-first environment....  ...software with complex domain logic. Familiarity with Python... 
    Remote work
    Flexible hours
    Shift work

    CAPTIVATEIQ INC

    United States
    1 day ago
  • $80 per hour

     ...technology firm is seeking QAs for autonomous AI agents to validate and improve task structures...  ...systems, ensuring quality assurance and logical problem-solving. Ideal candidates are...  ...attention to detail and experience in evaluating scenarios. This flexible, project-based... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Remote work
    Contract work
    Temporary work
    Immediate start

    MERIT Beauty

    New York, NY
    1 day ago
  • $80 per hour

     ...A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for...  ...include reviewing evaluation tasks, identifying inconsistencies...  ...up to $80/hour, this flexible remote position allows candidates to influence... 
    Remote work
    Flexible hours

    Mind Rift

    United States
    1 day ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    United States
    4 days ago
  • $35 per hour

     ...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing... 
    Remote work
    10 hours per week

    Crossing Hurdles

    United States
    1 day ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Remote work
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    United States
    1 day ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    3 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Remote work
    Work at office

    Obsidian

    New York, NY
    3 days ago
  •  ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and... 
    Remote work
    Full time
    Contract work
    Flexible hours

    Virtual Vocations Inc

    United States
    18 hours ago
  • $125 per hour

     ...Engagement (Corp-to-Corp) | Remote with International...  ...that matter most — across AI and digital...  ...engaging a Principal AI Agent Architect to lead the most...  ...including comparative evaluations across the Enterprise tier...  ...value sizing, sequencing logic, and dependency mapping... 
    Remote work
    Hourly pay
    Temporary work

    Jobleads-US

    Kentucky
    4 days ago
  • $60 per hour

     ...shape the future of AI. What We Do The Mindrift...  ...in ambiguity, enjoy remote asynchronous work,...  ...are tested and evaluated, we want to hear from...  ...Overview We are seeking QA experts for autonomous AI agents in a project focused...  ...structures, policy logic, and agent... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Austin, TX
    2 days ago
  • $112.09k - $160.33k

     ...Burlington, VT (hybrid) or remote About OhMD...  ...OhMD is an AI patient communication platform...  ...OhMD AI, our AI voice agent. It picks up on the first...  ...conversation flows, decision logic, escalation rules, edge...  ...made Familiarity with evaluating agent quality in a structured... 
    Remote work
    Live in

    OhMD

    Burlington, VT
    2 days ago
  •  ...20 nationalities from our offices and remotely, who truly enjoys their work. We are looking...  ...engineers to build fast across BJAK's AI Finance Agent. This role is for product-minded...  ...product. Thinks about user flow, backend logic and business process together. Moves... 
    Remote work
    Full time

    Bjak

    United States
    18 hours ago
  • $1,500 - $2,000 per month

    Builder Lead Converter AI Agent Specialist Builder Lead Converter is...  ...Design AI agent logic and workflows Deploy, test,...  ...frameworks, guardrails, and evaluation logic Optimize AI agents for...  ...earlier in the day This is a remote position, but collaboration during... 
    Remote work
    For contractors
    Work at office
    Monday to Friday

    Builder Lead Converter

    New York, NY
    3 days ago
  • $20 - $26 per hour

    Prolific is seeking fluent Kannada speakers to act as evaluators. You will assess how naturally and authentically AI captures Kannada speech, by listening to audio clips and comparing text and voice. This fast-paced project pays $20-26 per hour and may require about one... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    4 days ago
  • Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect...  ...Infrastructure Location: Remote (US Preferred) Compensation...  ...orchestration, simulation logic, and multi-role...  ...Develop and refine test plans, evaluation pipelines, and debug tools... 
    Remote work
    Full time
    Work at office

    Nivalto

    San Francisco, CA
    18 hours ago
  • $50 per hour

    Prolific seeks Product Designers and UX Specialists to help train AI models using your expertise. You'll evaluate AI-generated designs and ensure usability and accessibility while working from home. Ideal candidates hold a BS, MS, or PhD in a relevant field and have at... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Sacramento, CA
    3 days ago
  • $20 - $26 per hour

    Prolific seeks fluent Kannada speakers to act as evaluators for AI language data. You will assess text and voice segments, rate naturalness, and help identify cultural nuances. A PayPal account is required to receive payments for tasks priced at $20-$26 per hour. Responsibilities... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Phoenix, AZ
    4 days ago
  •  ...Purple Drive ServiceNow Developer with AI agent experience Share Dallas, TX Overview: Must Have Technical/Functional Skills:...  ...Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and usability... 
    Remote work

    Purple Drive

    United States
    18 hours ago
  • $20 - $30 per hour

    A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong... 
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    2 days ago
  • YO AI Labs is seeking an Investment & Finance Expert to work remotely as a contractor. The role focuses on evaluating AI outputs related to valuation, financial modeling, markets, and investments, and crafting expert prompts plus reference answers to improve model reasoning... 
    Remote job
    For contractors

    YO AI Labs

    Austin, TX
    1 day ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    3 days ago
  • Harris Computer is seeking a Quality Assurance Analyst to join our team in Maryland. You will design, implement, and execute test plans...  ...feature demonstrations for customers and internal stakeholders. AI-assisted tools may be used to improve efficiency. #J-18808-Ljbffr... 
    Remote job

    Harris Computer

    Annapolis, MD
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Evaluator & Logic QA Analyst. Be the first to apply!