Remote QA Analyst for Autonomous AI Agent Evaluation
$60 per hourMind Rift
A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models! #J-18808-Ljbffr
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote QA Analyst for Autonomous AI Agent Evaluation in Austin, TX vacancy
$80 per hour
...forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent... ...$80/hour, this position allows for flexible, remote work while contributing to advanced AI projects...Remote workFlexible hoursMind Rift
New York, NY5 days ago$80 per hour
A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal for... ...include reviewing evaluation tasks, identifying inconsistencies... ...up to $80/hour, this flexible remote position allows candidates to influence...Remote jobFlexible hours$60 per hour
...Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and... ...structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define...Remote workPart timeFlexible hoursMind Rift
Kansas City, MO1 day ago$80 per hour
...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic,... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $8...Remote workPart timeFlexible hoursMind Rift
Raleigh, NC5 days ago$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers...Remote jobFlexible hours$179k - $199k
...human-first and accelerated by AI to create meaningful and... ...Office expectations** For Remote Roles : If this role is remote... ...Summary The AI Engineer – Autonomous Agent will work closely with the Product... .... We use this information to evaluate your candidacy for the posted...Remote jobFull timeWork at officeFlexible hoursPointclickcare
Remote1 day ago- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote workPart time
Mind Rift
Brooklyn, NY1 day ago $80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working... ...degree and has experience in QA or data analysis, with a strong command...Remote workPart time$60 per hour
...ethically shape the future of AI. About The Role We're... ...realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases... ...related fields. Background in QA, software testing, data... ...Our freelance role is fully remote so you just need a laptop,...Remote workPart timeFreelanceFlexible hours$80 per hour
...domain experts with cutting‑edge AI projects from innovative tech... ...tools for running and evaluating agent behavior. You’ll implement base... ...communication skills – you’ll work with QA and writers We also value... ...needs Take part in a flexible, remote, freelance project that fits...Remote workFreelanceFlexible hoursMind Rift
Lansing, MI4 days ago$35 per hour
...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing...Remote work10 hours per weekCrossing Hurdles
New York, NY3 days ago- ...Kraken app. As a fully remote company, we have... ...architect and builder of the AI-native finance... ...Finance operations – Evaluate how financial work currently... ...engines, and MCP or similar agent coordination layers.... ...and the failure modes of autonomous AI workflows in high-...Remote workLocal area
Kraken
Poland, NY5 days ago - ...IT Helpdesk Agent Evaluator is a remote evaluation track for reviewing it helpdesk agent evaluation prompts and responses against AuraOne's quality... ...team can use to retrain. Why this role matters AI data reviewers help turn it helpdesk agent evaluation outputs...Remote jobHourly payFor contractors10 hours per week
- Description Keeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This is a 100% remote position from select locations, with an... ...systems, develop Python-based automation and evaluation tools, and validate model outputs, guardrails,...Remote workTemporary work
- ...pioneering the future of agentic AI in property management. We build AI agents that act as property... ...leasing agent, a fully autonomous AI that engages... ...monitoring, and testing. ~ Remote friendly but needs to fully... ..., model training and evaluation outside of LLM contexts....Remote work
Zuma
Mundelein, IL14 days ago - ...Designing and owning the agent harness layer, the full-time AI Agent Engineer will develop autonomous workflows, implement robust evaluation loops, and optimize model strategies in a remote environment. Key responsibilities Design and manage the agent harness layer to...Remote workFull time
Virtual Vocations Inc
United States5 days ago $50 - $60 per hour
...DataAnnotation is seeking a Treasury Analyst to assist in training AI models by evaluating their logic and enhancing their financial decision-making capabilities. This role enables experienced finance professionals to influence AI’s understanding of financial principles...Remote workHourly payDataAnnotation
New York, NY4 days ago$50 - $60 per hour
...looking for an experienced Treasury Analyst to assist in training AI models, focusing on financial principles and decision-making. You will evaluate AI chatbot responses on topics such as... ...role offers the flexibility to work remotely with an hourly pay rate ranging between...Remote jobHourly pay$50 - $60 per hour
DataAnnotation is seeking a Treasury Analyst to train AI models focused on finance. In this role, you will evaluate the accuracy of AI chatbot responses regarding macro trends and corporate finance. You will work independently, providing feedback on AI reasoning and helping...Remote jobHourly payFlexible hours$108k - $170k
...About Us Observe.AI is the AI Agents platform for customer experience, designed... ...specialized AI Agents that autonomously execute work across the... ..., telephony setup, and evaluation frameworks. Client Engagement... ...Internet Stipend: Support for remote and hybrid work...Remote workFull timeWork at officeLocal areaFlexible hoursOBSERVE, LLC
Redwood City, CA2 days ago$50 - $60 per hour
DataAnnotation is looking for a Treasury Analyst to help train AI models in Connecticut. This role involves reviewing and improving AI Assistant responses related to finance, evaluating their logic, and providing structured feedback. Ideal candidates are finance professionals...Remote jobHourly pay$152k - $240k
...control spend effortlessly. Brex’s AI-native automation and world-... ...’ll do We're building AI agents to automate and augment... ...four weeks per year of fully remote work! Responsibilities:... ..., and data sources. Define evaluation frameworks, success metrics, and...Remote workFull timeWork at officeWork from homeBrex Inc.
New York, NY1 day ago- ...challenges. Recognized by industry analysts like Forrester and G2 and... ...performance. About the Role AI agents are becoming central to how... ...orchestration layer, and the evaluation and observability infrastructure... ...days per week) – Austin, TX Remote – Raleigh, NC Remote –...Remote workWork at officeFlexible hoursShift work3 days per week
CAPTIVATEIQ INC
Austin, TX5 days ago - ...Squid AI helps enterprises modernize in place and without disruption... ..., turnkey, private AI agents based on their own data and an... ...communication skills (crucial for our remote-friendly team). Can... ...platform enables companies to deploy autonomous agents that can understand,...Remote work
Squid Cloud, Inc.
New York, NY1 day ago - ...Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time... ...your critical thinking abilities. The role is onsite with no remote work available, and the company offers a range of benefits, including...Remote workFull time
Welocalize
New York, NY4 days ago - ManpowerGroup is seeking an AI Enablement Lead to accelerate AI adoption across non‑engineering teams. This role involves identifying... ...and strong communication skills. Responsibilities include evaluating processes for AI opportunities, aligning initiatives with governance...Remote job
$200k - $320k
...technical depth and a passion for AI-driven product development.... .... This is a full-time remote opportunity, with preference for... ...production-ready LLM pipelines and AI agent systems Develop AI-driven... ...new product initiatives Evaluate and recommend AI architectures...Remote workFull timeVisa sponsorshipVirco Talent
Remote1 day ago- ...Get AI-powered advice on this job and more exclusive features... ...FLORIDA. We are looking for QA Analysts with strong skills in mobile... ...paced environment . This is a remote opportunity, open to U.S.-based... ...DevOps for test management. Evaluate product code and ensure it meets...Remote workContract workFor contractorsLive inShift work
Synergy Business Consulting
Orlando, FL5 days ago $100k - $250k
...software engineer who specializes in building AI Agents. What are examples of projects you’... ...talk with users, come up with new ideas autonomously, and ship! What additional skills do... .... Is Hercules in-office or remote? Hercules founding team works in-office...Remote workFull timeWork at officeHercules
San Francisco, CA1 day ago$202.5k - $247.5k
...sharing localhost or running AI workloads in production. We... ...worth your time. About the Agent Team Our Agent team... ...AWS. Engineers develop by using remote development tools and/or ssh to... ...and actual compensation will be evaluated based on factors including,...Remote workPermanent employmentFull timeWork at officeLocal areaImmediate startHome officeFlexible hoursNgrok
Remote1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote QA Analyst for Autonomous AI Agent Evaluation. Be the first to apply!
Related searches
- operations agent Austin, TX
- cruise agent Austin, TX
- telemarketer - state farm agent team member Austin, TX
- import export agent Austin, TX
- state farm agent Austin, TX
- special agent Austin, TX
- remote chat agent Austin, TX
- agent assistant Austin, TX
- executive protection agent Austin, TX
- commissioning agent Austin, TX