Remote QA Analyst for Autonomous AI Agent Evaluation
$60 per hourMindrift
Austin, TX
- Remote job
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models! #J-18808-Ljbffr Mindrift
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote QA Analyst for Autonomous AI Agent Evaluation in Austin, TX vacancy
$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for... ...include reviewing evaluation tasks, identifying inconsistencies... ...up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$80 per hour
...forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...$80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote jobFlexible hours$80 per hour
A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own...Remote jobPart timeFlexible hours$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote workPart timeFlexible hoursMind Rift
Kansas City, MO1 day ago$80 per hour
...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic,... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $8...Remote jobPart timeFlexible hours$60 per hour
...ethically shape the future of AI. What We Do The Mindrift... ...in ambiguity, enjoy remote asynchronous work, and want... ...AI systems are tested and evaluated, we want to hear from you.... ...Project Overview We are seeking QA experts for autonomous AI agents in a project focused on...Remote workFreelanceFlexible hours$135.2k
...benchmark artificial intelligence agents. Creating robust evaluation harnesses ensures that AI models are tested against... ...directly feeds into improving how autonomous agents handle complex coding objectives... ...How It Works During this remote session, you will review a...Remote workHourly payContract work$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical... ...should be adept at evaluating scenarios and documenting findings...Remote jobFlexible hours- ...Job Description Job Description Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents performing everyday tasks. You'll test two AI agents side by side, assess their...Remote jobFor contractorsWork at office
YO AI Labs
New York, NY2 days ago - ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
- ...connects specialists with project-based AI opportunities for testing, evaluating, and improving AI systems. You’ll... ...correct solutions. This freelance, remote role requires 5+ years in software development... ..., Postgres, Kafka, Redis, plus QA/testing experience. English...Remote jobFreelance
$30k
...intelligence to ethically shape the future of AI. What we do The Mindrift... ...can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that... ...guidelines. Our freelance role is fully remote so, you just need a laptop, internet...Remote workPart timeFreelance- OpenTrain AI, Inc. is seeking a remote, part-time contractor to test two AI agents on a smartphone, completing realistic errands and recording outcomes. You will evaluate task completion, quality, control issues, user satisfaction, and time, then provide clear feedback...Remote jobPart timeFor contractorsFlexible hours
$65 per hour
...and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure... ...will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities...Remote workContract workTemporary workFor contractorsTerac
San Francisco, CA1 day ago$100 - $150 per hour
...Role Overview Help improve AI coding agents by reviewing their work across real-world software... ...precise feedback will help create the evaluation signals used to strengthen model performance... ...but not required. Work Terms Remote independent-contractor engagement, available...Remote workHourly payFor contractorsImmediate startSaidGig
United States12 days ago- ...Freelance · Remote · North America, LATAM, or India About Turing... ...companies, working with frontier AI labs to accelerate model... ...through high-quality training data, evaluations, and engineering talent.... ...applications, you’ll work with coding agents across real-world repositories...Remote workHourly payTemporary workFor contractorsFreelanceImmediate start
Turing
Remotea month ago - Flodesk is a remote-first company shaping the future of AI-driven marketing tools for small businesses. The role focuses on owning prompts, agent instructions, evaluation criteria, and the continuous-improvement loop across prompts, context, tools and product state, ensuring...Remote work
- Pulumi is building Neo, an autonomous infrastructure engineering agent that plans and executes multi-step cloud operations. The role focuses on... ...cloud providers, and experience with production AI systems. This is a remote-first U.S. role with preference for Pacific Time...Remote work
- Flodesk, a remote-first email marketing company, seeks an experienced AI Systems professional to own prompts, agent instructions, quality definitions, and evaluation infrastructure. You’ll connect engineering, product, and language models to improve member experiences...Remote work
$150k - $250k
Senior Applied AI Engineer, Agent Quality & Evaluations Building AI dev tools and evaluation for LLMs and agents; focuses on prompts, agent loops, and... ...). $1,000 annual stipend for learning and development. Remote-first company with globally distributed team and in-person...Remote workFull timeTemporary workFlexible hours$196k - $294k
...company and a leading AI platform for managing people, money, and agents, we’re shaping the future... ...distribution to create autonomous AI agents that can move... ...agent architectures, evaluation harnesses, observability... ...worlds: in-person time and remote. Our approach enables...Remote workFull timeWork at officeHome officeFlexible hoursWorkday
Pleasanton, CA3 days ago- RemoteJobsOne is seeking an Everyday AI Agent Tester for a fully remote contractor role based in the United States. You will run real-life scenarios with two AI agents, screen record each attempt, and score results on completion, quality, control issues, and user satisfaction...Remote jobFor contractorsStart working today
$80 - $100 per hour
...help train and improve next-generation AI coding agents. In this contractor role you will provide... ...end feature development. Critically evaluate AI agents in diverse scenarios,... ...Engagement type: Contractor. Location: Remote. Work will involve contributing to a...Remote workHourly payFor contractorsSaidGig
United States9 days ago$35 per hour
A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing media...Remote job10 hours per week$15 per hour
Welo Global in the United States is seeking a detail-oriented Generative AI Analyst to support AI training, data annotation, evaluation, and quality review projects on a freelance basis. This remote role involves working on diverse content types—from text and...Remote jobHourly payFreelance- AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train the...Remote jobFor contractors10 hours per week
- Lightworks - Post-Production Specialist is a remote reviewer role evaluating AI outputs across post production workflows. You will grade workflow accuracy, policy adherence, and stakeholder fit, flag risks, and document next steps so the modeling team can train on it....Remote jobFor contractorsFlexible hours
- ...AI Agent Evaluator is a remote evaluation track for reviewing ai agent evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain...Remote jobHourly payFor contractors10 hours per week
- What the role actually is Nuro is hiring an applied AI researcher focused on agent systems and evaluation. The work sits around the research and measurement loop for autonomous driving systems, with emphasis on how agent behavior is tested, compared, and improved. For...
- Nuro is hiring an applied AI researcher focused on agent systems and evaluation. The work sits around the research and measurement loop for autonomous driving systems, with emphasis on how agent behavior is tested, compared, and improved. For an impact-focused role, the...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote QA Analyst for Autonomous AI Agent Evaluation. Be the first to apply!
