Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote QA Analyst for Autonomous AI Agent Evaluation

$60 per hour

Mindrift

Austin, TX
  • Remote job

A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models! #J-18808-Ljbffr Mindrift

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote QA Analyst for Autonomous AI Agent Evaluation in Austin, TX vacancy
  • $80 per hour

     ...A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for...  ...include reviewing evaluation tasks, identifying inconsistencies...  ...up to $80/hour, this flexible remote position allows candidates to influence... 
    Remote work
    Flexible hours

    Mind Rift

    Phoenix, AZ
    3 days ago
  • $80 per hour

     ...forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent...  ...$80/hour, this position allows for flexible, remote work while contributing to advanced AI projects... 
    Remote job
    Flexible hours

    Mindrift

    New York, NY
    2 days ago
  • $80 per hour

    A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention...  ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Phoenix, AZ
    1 day ago
  • $60 per hour

     ...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and...  ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define... 
    Remote work
    Part time
    Flexible hours

    Mind Rift

    Kansas City, MO
    4 days ago
  • $80 per hour

    A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work...  ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    1 day ago
  • $80 per hour

     ...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic,...  ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $8... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    1 day ago
  • $60 per hour

     ...ethically shape the future of AI. What We Do The Mindrift...  ...in ambiguity, enjoy remote asynchronous work, and want...  ...AI systems are tested and evaluated, we want to hear from you....  ...Project Overview We are seeking QA experts for autonomous AI agents in a project focused on... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Austin, TX
    1 day ago
  • $179k - $199k

     ...human-first and accelerated by AI to create meaningful and...  ...Office expectations** For Remote Roles : If this role is remote...  ...Summary The AI Engineer – Autonomous Agent will work closely with the Product...  .... We use this information to evaluate your candidacy for the posted... 
    Remote job
    Full time
    Work at office
    Flexible hours

    Pointclickcare

    Remote
    20 hours ago
  • $55 per hour

    A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical...  ...should be adept at evaluating scenarios and documenting findings... 
    Remote job
    Flexible hours

    Mindrift

    Dallas, TX
    5 days ago
  • $80 per hour

    A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working...  ...degree and has experience in QA or data analysis, with a strong command... 
    Remote work
    Part time

    Mindrift

    Houston, TX
    1 day ago
  •  ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background... 
    Remote job
    Part time

    Mindrift

    Brooklyn, NY
    2 days ago
  • AI Agent Development & Evaluation Primary Care, Acute Symptom Triage & Travel Health | Contract, up to 10 hrs/week About the Role We are seeking Nurses...  ...adherence, and patient safety. This is a part-time, remote contract position (1099) requiring up to 10 hours per week... 
    Remote work
    Hourly pay
    Contract work
    Part time
    10 hours per week
    Flexible hours

    Hippocratic AI Inc.

    Brooklyn, NY
    1 day ago
  • $200k

     ...startup is looking for a Software Engineer to develop AI agents that enhance security testing. The role is fully remote, offering a competitive salary of $200,000 along...  ...TypeScript skills, experience in building autonomous systems, and a collaborative mindset. Join us to... 
    Remote job

    Casco (YC X25)

    Seattle, WA
    2 days ago
  • $80 per hour

     ...ethically shape the future of AI. Our platform connects...  ...realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases...  ...related fields. Background in QA, software testing, data...  ...Take part in a flexible, remote, freelance project that fits... 
    Remote work
    Part time
    Freelance
    Flexible hours

    Mindrift

    Houston, TX
    1 day ago
  • $224k - $356.5k

    NVIDIA is building the future of autonomous driving, and evaluation is how we know the drive is getting better...  ...how our organization develops AI drivers!We are looking for a senior engineer...  ...: US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote; US,... 
    Remote work
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...Intelligence, Deep Learning and Autonomous Vehicles.We are looking for...  ...team to work on metrics and evaluation. In this role you will enable...  ...existing vacancy. NVIDIA uses AI tools in its recruiting...  ...US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote... 
    Remote work
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...looking for a Senior QA Analyst / Tester based in United...  ...risks across advanced AI systems. You will...  ...multimodal systems, and autonomous agents. The role combines...  ...also help strengthen evaluation frameworks, adversarial...  ...Benefits: Fully remote opportunity within the... 
    Remote work
    Full time

    jobgether

    United States
    2 days ago
  • $80 per hour

     ...the first 25 applicants Get AI‑powered advice on this job and...  ...tools for running and evaluating agent behavior. You'll implement base...  ...communication skills – you'll work with QA and writers We also value...  ...Take part in a flexible, remote, freelance project that fits around... 
    Remote work
    Temporary work
    Part time
    Freelance
    Flexible hours

    Mindrift

    North Carolina
    3 days ago
  • $162.8k - $244.2k

     ...company and a leading AI platform for managing people, money, and agents, we’re shaping the future...  ...Agent Factory builds autonomous AI agents that become standalone...  ...agent architectures, evaluation frameworks, and...  ...worlds: in-person time and remote. Our approach enables... 
    Remote work
    Full time
    Work at office
    Home office
    Flexible hours
    Weekend work

    Workday

    San Francisco, CA
    20 hours ago
  •  ...pioneering the future of agentic AI in property management. We build AI agents that act as property...  ...leasing agent, a fully autonomous AI that engages...  ...monitoring, and testing. ~ Remote friendly but needs to fully...  ..., model training and evaluation outside of LLM contexts.... 
    Remote work

    Zuma

    Mundelein, IL
    more than 2 months ago
  • $50 per hour

     ...ethically shape the future of AI. About the project We'...  ...the hunt for QAs for autonomous AI agents for a new project...  ...logic, and agent evaluation frameworks. Throughout...  ...properly. Work closely with QA, writers, or...  ...Take part in a flexible, remote, freelance project that... 
    Remote work
    Hourly pay
    Part time
    Freelance
    Internship
    Flexible hours

    Mindrift

    New York, NY
    1 day ago
  • $152k - $241.5k

     ...looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An...  ...for us. If you’re creative, analytical, and autonomous, we want to hear from you!Your base salary... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...AI Agent Interaction Specialist - Dialogue & Conversation Evaluation is a remote evaluation track for reviewing ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    9 days ago
  •  ...Description Keeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This is a 100% remote position from select locations, with an...  ...systems, develop Python-based automation and evaluation tools, and validate model outputs, guardrails,... 
    Remote work
    Temporary work

    Keeper Security

    Shingle Springs, CA
    3 days ago
  •  ...strategy and execution roadmap for Autonomous Agents in the conversational AI domain. This role is responsible for...  ...and Data Science to define evaluation criteria, benchmark programs, and quality...  ...(Runtime, Studio, Channels, SDKs), QA, and Delivery on scope, dependencies... 
    Full time

    Netomi

    Remote
    24 days ago
  •  ...A forward-thinking AI company in New York is seeking a Senior Software Engineer with a focus on security. In this role, you will build...  ...a diverse team that values innovation and inclusivity, offering competitive benefits and remote-flexible work options.#J-18808-Ljbffr... 
    Remote work
    Flexible hours

    Cohere

    New York, NY
    9 hours ago
  •  ...highly practical, fast-moving AI Operations Specialist to...  ...test, prototype, and deploy autonomous AI agents, data synchronizations, and...  ...real-time automation streams, evaluate agent output qualities, systematically...  ...~ Location Context: 100% remote-first full-time operational... 
    Remote work
    Full time
    Local area
    Work from home

    Proper

    India
    a month ago
  •  ...Kraken app. As a fully remote company, we have Krakenites...  ...and builder of the AI-native finance operating...  ...Finance operations - Evaluate how financial work currently...  ..., and MCP or similar agent coordination layers....  ...and the failure modes of autonomous AI workflows in high-... 
    Remote work
    Local area

    Kraken

    Poland, NY
    4 days ago
  • $90k - $250.3k

     ...the development of our Agent Assist product portfolio...  ..., and launch of AI-powered, real-time assistance...  ...ambiguity. Objectively evaluate product performance, prioritize...  ...-Oriented: A highly autonomous operator capable of...  ...: This role is fully remote for candidates who reside... 
    Remote work
    Temporary work
    Work at office
    Worldwide
    3 days per week

    Five9

    San Ramon, CA
    more than 2 months ago
  • AuraOne seeks a Renewable Generation Analyst specialist operations reviewer to evaluate AI outputs across real workflows. You will assess workflow correctness...  ...steps so the modeling team can train on it. The role is remote for US-based candidates as a CONTRACTOR. You should... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote QA Analyst for Autonomous AI Agent Evaluation. Be the first to apply!