Remote AI Agent Evaluation Specialist
$80 per hourMind Rift
A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Specialist in United States vacancy
- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote workPart time
Mind Rift
United States2 days ago $60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote workPart timeFlexible hoursMind Rift
Kansas City, MO1 day ago$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive...Remote workFlexible hoursMind Rift
Providence, RI5 days ago$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote workFreelanceMind Rift
United States2 days ago- ...SWE Agent Evaluation Specialist is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written...Remote jobHourly payFor contractors10 hours per week
- ...companies, working with frontier AI labs to accelerate model... ...through high-quality training data, evaluations, and engineering talent. We... ...used to develop and evaluate AI agents. You will be assigned to one... ...cutting-edge AI systems. Fully remote opportunity. Collaborate...Remote workFull timeContract workTemporary workFlexible hours
Turing
Remote5 days ago $80 - $100 per hour
...help train and improve next-generation AI coding agents. In this contractor role you will provide... ...end feature development. Critically evaluate AI agents in diverse scenarios,... ...Engagement type: Contractor. Location: Remote. Work will involve contributing to a...Remote workHourly payFor contractorsSaidGig
United States2 days ago- ...AI Agent Interaction Specialist - Dialogue & Conversation Evaluation is a remote evaluation track for reviewing ai agent interaction evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind...Remote jobHourly payFor contractors10 hours per week
$20 - $60 per hour
...Help train next-generation AI systems by creating rigorous, real-world evaluations that test how well advanced models learn, reason, and perform. This remote contract opportunity is open to recent graduates, advanced-degree holders, and professionals from any background...Remote workHourly payContract workFor contractorsSaidGig
United States2 days ago$20 - $60 per hour
...to a project that trains next-generation AI systems. You will design realistic Fortune... ...language model to create, edit, and evaluate Office Open XML files, with a focus on .pptx... ...Terms Role type: Contractor. Location: Remote, participating on a customer project...Remote workHourly payContract workFor contractorsWork at officeSaidGig
United States1 day ago- ...is seeking a Vietnamese Voice Acting Specialist for a freelance AI Trainer project. The role is critical... ...emotional expression. This position is remote and designed for individuals with... ...strong voice acting credentials. You will evaluate AI outputs and support the...Remote workHourly payFreelance
Meridial
New York, NY2 days ago $186.1k - $292.81k
...needed to drive revenue performance. AI agents are becoming central to how CaptivateIQ... ...agent SDK, LLM orchestration layer, and the evaluation and observability infrastructure that... ...effectively with cross-functional partners in a remote-first environment. High sense of...Remote workFlexible hoursShift workCAPTIVATEIQ INC
United States2 days ago$152k - $240k
...control spend effortlessly. Brex’s AI-native automation and world-... ...you’ll doWe're building AI agents to automate and augment internal... ...four weeks per year of fully remote work!Responsibilities:Embed... ...APIs, and data sources.Define evaluation frameworks, success metrics, and...Remote workWork at officeWork from home- ...Licensed Dietitian — Nutrition Review Specialist (Remote AI Evaluation) is a remote review track for evaluating AI outputs across licensed dietitian specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$70k - $140k
...Program Evaluation Specialist - Department of State The Position: We are seeking driven, thoughtful candidates with experience in program... ..., including paid vacation and sick leave, flexible and remote work opportunities, and tuition and training reimbursement....Remote workFull timeWork at officeWork from homeFlexible hoursNight shiftCenseo Consulting Group
Washington DC5 days ago$208k - $312k
...infrastructure company. We free people and agents to ship what’s next. For more than a... .... As the team behind Next.js, v0, and AI SDK, we create products that help builders... ...when chat alone is not enough. Develop evaluation, observability, and feedback systems that...Remote workFull timeWork from homeWorldwideFlexible hoursVercel
Remote28 days ago$147.9k - $200.1k
...passionate about driving meaningful business changes with Agentic AI? The Next Gen Developer Experience (NGDE) organization is... ...rapid pace. Join the team as a Sr. Technical Business Development Specialist, Agentic AI for Application ModernizationThe Worldwide Specialist...Immediate startWorldwideFlexible hours$68k - $113k
...Clearance Required : Ability to Obtain Public Trust What You Will Do: Support the design and implementation of program evaluation and performance measurement activities for public health programs. Collect, organize, maintain, and validate program and evaluation...Remote workTemporary workFlexible hoursGuidehouse
Atlanta, GA4 days ago- ...Program Evaluation Specialist The University of Michigan's Center for Global Health Equity was launched by a catalytic gift from Dr. Tachi... ...of Work Positions that are eligible for hybrid or mobile/remote work mode are at the discretion of the hiring department. Work...Remote workWork at officeWorldwideFlexible hoursAfternoon shift3 days per weekEarly shift
University of Michigan Flint
Ann Arbor, MI2 days ago $112.09k - $160.33k
...Location: Burlington, VT (hybrid) or remote About OhMD OhMD is an AI patient communication platform... ...— and OhMD AI, our AI voice agent. It picks up on the first ring,... ...choices you made Familiarity with evaluating agent quality in a structured...Remote workLive inOhMD
Burlington, VT13 days ago- ...(~15 hours/week) Location: Remote Job Summary We are seeking... ...Software Engineers to support an AI training project by creating... ...learning environments that evaluate AI models on complex software... ...reference solutions. Evaluate AI agents' ability to reason through...Remote workFor contractors
YO AI Labs
Miami, FL19 days ago - ...Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No... ...identified Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
$211k - $249k
...Horizon3 is a fast-growing, remote cybersecurity company dedicated... ...Learning Engineer on the Defensive Agent team, you'll be the person who... ...and keeps them there. Our AI researchers define how NodeZero... ...training pipeline, an evaluation suite that runs in CI, a versioned...Remote workFull timeWork at officeFlexible hours$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars...Full time$180k - $320k
...Software Engineer, AI Agents Location: Remote (North America) Compensation: $180,000–$320,000 base (location-independent) + equity Our client... ...with strong engineering fundamentals: observability, evaluations, safety/guardrails, cost control, and performance What...Remote workNxT Level
United States4 days ago- ...Francisco, California | Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the environments, evaluation... ...used to train and assess long-horizon enterprise AI agents. The Opportunity You will work on the engineering and...
MaxIT Consulting - Max Corporate Group
San Francisco, CA14 days ago $50 - $150 per hour
...quality voice recordings that help train and evaluate next-generation text-to-speech systems for an internal customer-experience AI agent. Recordings may be used to clone your... ...corporate, energetic, and calm. Work Terms ~ Remote, hourly engagement. Compensation ~$...Remote workHourly paySaidGig
United Statesmore than 2 months ago$50 - $150 per hour
...Swiss German voice recordings to train and evaluate a next-generation text-to-speech system for a client''s internal CX AI agent. This role focuses on delivering consistent,... ...corporate, energetic, and calm Work Terms Remote position, candidate must be based in...Remote workHourly pay10 hours per weekSaidGig
United Statesa month ago- ...their monetization. We're a remote-first team of 150+ people across... .... Or maybe you're a growth specialist at a company doing millions... ...dashboard. So we built two AI agents to do that work for you, or... ...execution, context management, evaluation and human-in-the-loop...Remote work
RevenueCat
United States1 day ago $205k - $270k
...competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent... ...detection, agentic workflows, voice evaluation, text to speech, speech-to-speech... ...Retirement savings support Remote work setup budget or work-from-home...Remote workFull timeWork at officeWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!
Related searches