Remote QA Analyst for Autonomous AI Agent Evaluation
$60 per hourMind Rift
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models! #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote QA Analyst for Autonomous AI Agent Evaluation in Austin, TX vacancy
$80 per hour
...forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...$80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote jobFlexible hours$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for... ...include reviewing evaluation tasks, identifying inconsistencies... ...up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own...Remote jobPart timeFlexible hours$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers...Remote jobFlexible hours$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote jobPart timeFlexible hours$80 per hour
...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic,... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $8...Remote jobPart timeFlexible hours$55 per hour
...25 applicants Get AI-powered advice on... ...complexity? Does an async, remote, flexible... ...systems are tested and evaluated? This is a... ...opportunity well‑suited for analysts, researchers, or... ...hunt for QAs for autonomous AI agents for a new project... ...closely with QA, writers, or developers...Remote workPermanent employmentPart timeFreelanceFlexible hours$179k - $199k
...human-first and accelerated by AI to create meaningful and... ...Office expectations** For Remote Roles : If this role is remote... ...Summary The AI Engineer – Autonomous Agent will work closely with the Product... .... We use this information to evaluate your candidacy for the posted...Remote jobFull timeWork at officeFlexible hoursPointclickcare
Remote23 hours ago$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical... ...should be adept at evaluating scenarios and documenting findings...Remote jobFlexible hours$55 per hour
A cutting-edge technology firm is seeking analysts and researchers for a part-time opportunity focused on evaluating AI systems. This remote role pays up to $55/hour, allowing flexibility to fit around other commitments. Ideal candidates possess strong analytical skills...Remote workPart timeMindrift
South Carolina2 days ago$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working... ...degree and has experience in QA or data analysis, with a strong command...Remote workPart time- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
$80 per hour
...ethically shape the future of AI. What We Do The... ...realistic and structured evaluation scenarios for LLM‑based agents. You’ll create test cases... ...fields. Background in QA, software testing, data analysis... ...Take part in a flexible, remote, freelance project that...Remote workTemporary workPart timeFreelanceFlexible hoursMindrift
Wisconsin2 days ago$200k
...startup is looking for a Software Engineer to develop AI agents that enhance security testing. The role is fully remote, offering a competitive salary of $200,000 along... ...TypeScript skills, experience in building autonomous systems, and a collaborative mindset. Join us to...Remote job$224k - $356.5k
NVIDIA is building the future of autonomous driving, and evaluation is how we know the drive is getting better... ...how our organization develops AI drivers!We are looking for a senior engineer... ...: US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote; US,...Remote workFull time$184k - $287.5k
...Intelligence, Deep Learning and Autonomous Vehicles.We are looking for... ...team to work on metrics and evaluation. In this role you will enable... ...existing vacancy. NVIDIA uses AI tools in its recruiting... ...US, CA, Santa Clara; US, GA, Remote; US, DC, Remote; US, NC, Remote...Remote workFull time$80 per hour
...the first 25 applicants Get AI‑powered advice on this job and... ...tools for running and evaluating agent behavior. You'll implement base... ...communication skills – you'll work with QA and writers We also value... ...Take part in a flexible, remote, freelance project that fits around...Remote workTemporary workPart timeFreelanceFlexible hoursMindrift
North Carolina1 day ago- ...seeking a backend-focused engineer to build scalable evaluation and observability tooling for our AI agent platform. You will shape how we measure and improve... ...reliability, and collaboration across teams in a fast-growing, remote-friendly environment. #J-18808-Ljbffr AlionRemote work
$162.8k - $244.2k
...company and a leading AI platform for managing people, money, and agents, we’re shaping the future... ...Agent Factory builds autonomous AI agents that become standalone... ...agent architectures, evaluation frameworks, and... ...worlds: in-person time and remote. Our approach enables...Remote workFull timeWork at officeHome officeFlexible hoursWeekend work- ...pioneering the future of agentic AI in property management. We build AI agents that act as property... ...leasing agent, a fully autonomous AI that engages... ...monitoring, and testing. ~ Remote friendly but needs to fully... ..., model training and evaluation outside of LLM contexts....Remote work
Zuma
Mundelein, ILmore than 2 months ago $35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per weekCrossing Hurdles
New York, NY4 days ago- ...Kraken app. As a fully remote company, we have... ...architect and builder of the AI-native finance... ...Finance operations – Evaluate how financial work currently... ...engines, and MCP or similar agent coordination layers.... ...and the failure modes of autonomous AI workflows in high-...Remote workLocal area
Kraken
Poland, NY2 days ago - ...strategy and execution roadmap for Autonomous Agents in the conversational AI domain. This role is responsible for... ...and Data Science to define evaluation criteria, benchmark programs, and quality... ...(Runtime, Studio, Channels, SDKs), QA, and Delivery on scope, dependencies...Full time
Netomi
Canada22 days ago - ...highly practical, fast-moving AI Operations Specialist to... ...test, prototype, and deploy autonomous AI agents, data synchronizations, and... ...real-time automation streams, evaluate agent output qualities, systematically... ...~ Location Context: 100% remote-first full-time operational...Remote workFull timeLocal areaWork from home
Proper
Indiaa month ago - ...AI Agent Interaction Specialist - Dialogue & Conversation Evaluation is a remote evaluation track for reviewing ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind...Remote jobHourly payFor contractors10 hours per week
$152k - $241.5k
...looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An... ...for us. If you’re creative, analytical, and autonomous, we want to hear from you!Your base salary...Full time$90k - $250.3k
...the development of our Agent Assist product portfolio... ..., and launch of AI-powered, real-time assistance... ...ambiguity. Objectively evaluate product performance, prioritize... ...-Oriented: A highly autonomous operator capable of... ...: This role is fully remote for candidates who reside...Remote workTemporary workWork at officeWorldwide3 days per weekFive9
San Ramon, CAmore than 2 months ago- A forward-thinking AI company in New York is seeking a Senior Software Engineer with a focus on security. In this role, you will build... ...team that values innovation and inclusivity, offering competitive benefits and remote-flexible work options. #J-18808-Ljbffr CohereRemote workFlexible hours
- AuraOne seeks a Renewable Generation Analyst specialist operations reviewer to evaluate AI outputs across real workflows. You will assess workflow correctness... ...steps so the modeling team can train on it. The role is remote for US-based candidates as a CONTRACTOR. You should...Remote jobFor contractors
- ...Kraken app. As a fully remote company, we have Krakenites... ...and builder of the AI-native finance operating... ...Finance operations - Evaluate how financial work currently... ..., and MCP or similar agent coordination layers.... ...and the failure modes of autonomous AI workflows in high-...Remote workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote QA Analyst for Autonomous AI Agent Evaluation. Be the first to apply!
Related searches
- qa analyst Austin, TX
- quality assurance analyst Austin, TX
- commissioning agent Austin, TX
- transfer agent Austin, TX
- state farm agent Austin, TX
- executive protection agent Austin, TX
- work from home chat agent Austin, TX
- cruise agent Austin, TX
- airport agent Austin, TX
- telemarketer - state farm agent team member Austin, TX