Remote AI Agent Evaluation Specialist
$80 per hourMindrift
Raleigh, NC
- Remote job
A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments. #J-18808-Ljbffr Mindrift
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Specialist in Raleigh, NC vacancy
- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote workPart time
Mind Rift
Brooklyn, NY23 hours ago $60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote workPart timeFlexible hoursMind Rift
Kansas City, MO23 hours ago$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote workFreelanceMind Rift
Austin, TX4 days ago$60 per hour
...innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking... .... Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is...Remote jobFlexible hours$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive...Remote jobFlexible hours$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform... ...thrive in ambiguity, enjoy remote asynchronous work, and want to... ...modern AI systems are tested and evaluated, we want to hear from you.... ...QA experts for autonomous AI agents in a project focused on validating...Remote workFreelanceFlexible hours- YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world...Remote work
$80 per hour
A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures... ...allows contributors to work remotely while engaging in a complex AI project... ...detail, facilitating AI testing and evaluation without needing a coding...Remote jobFlexible hours$55 per hour
A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention... ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/...Remote jobPart timeFlexible hours$80 per hour
A leading AI consultancy in the United States is seeking Quality Assurance professionals to validate and improve autonomous AI agents. You will analyze complex systems, evaluate task structures, and ensure logical consistency through detailed reviews. Ideal candidates possess...Remote jobHourly payFlexible hours- Mercor is hiring experienced musicians to evaluate generative music AI models, focusing on Urdu and English lyrics. You will assess AI-generated... ...months, with a flexible commitment around 20 hours per week. Remote work is supported; candidates in the United States are...Remote workImmediate startFlexible hours
- YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic...Remote job
- YO AI Labs is seeking an Autodesk Fusion Expert for a remote contractor role to support an AI-focused manufacturing project. You will apply expertise in Fusion... ..., CNC machining, and manufacturing workflows to evaluate processes and AI-generated recommendations. This role...Remote jobFor contractors
$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical... ...should be adept at evaluating scenarios and documenting findings...Remote jobFlexible hours- ...Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply... ...meaningful errors within their field. Flexible, remote contract work starting ASAP. You will work on challenging...Remote jobContract workImmediate startFlexible hours
$80 per hour
...ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major... ...realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases... ...Take part in a flexible, remote, freelance project that fits...Remote workPart timeFreelanceFlexible hours- ...Alignerr, we partner with the world’s leading AI research teams and labs to build and... ...conversion is perfect. Technical Auditing: Evaluate AI-generated simulations and proofs for... ...Why Join Us Competitive pay and flexible remote work. Collaborate with a team working on...Remote workContract workFreelanceFlexible hours
- ...Expert Codebase Evaluation Specialist - Coding Agent Review is a remote evaluation track for reviewing codebase evaluation evaluation prompts and responses against... ...team can use to retrain. Why this role matters AI data reviewers help turn codebase evaluation...Remote jobHourly payFor contractors10 hours per week
$80 - $100 per hour
...help train and improve next-generation AI coding agents. In this contractor role you will provide... ...end feature development. Critically evaluate AI agents in diverse scenarios,... ...Engagement type: Contractor. Location: Remote. Work will involve contributing to a...Remote workHourly payFor contractorsSaidGig
United States9 days ago$40 - $50 per hour
...Overview Apply your linguistics expertise to evaluate large language model outputs and help train next-generation AI systems. You will analyze model-human conversations... ...contractor relationship. Location: Remote, applicants must be located in the United States...Remote jobHourly payFor contractorsImmediate startSaidGig
Europe3 days ago- A leading AI company is seeking a Biology Specialist to help fine-tune large language models. Ideal candidates will be pursuing or hold a Ph.D. in Biology... ...problems and collaborating on AI projects in a fully remote setting. Applicants with excellent communication and analytical...Remote job
$80 per hour
...technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking,... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while...Remote jobPart timeFlexible hours$20 - $60 per hour
...Help train next-generation AI systems by creating rigorous, real-world evaluations that test how well advanced models learn, reason, and perform. This remote contract opportunity is open to recent graduates, advanced-degree holders, and professionals from any background...Remote workHourly payContract workFor contractorsSaidGig
United States2 days ago$20 - $60 per hour
...to a project that trains next-generation AI systems. You will design realistic Fortune... ...language model to create, edit, and evaluate Office Open XML files, with a focus on .pptx... ...Terms Role type: Contractor. Location: Remote, participating on a customer project...Remote workHourly payContract workFor contractorsWork at officeSaidGig
United States3 days ago$1,750 - $2,150 per month
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...,750–$2,150 per completed task Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related to threat analysis,...Remote workHourly payFull timeContract workSummer workMercor
Remote23 hours ago$152k - $240k
...control spend effortlessly. Brex’s AI-native automation and world-... ...’ll do We're building AI agents to automate and augment... ...four weeks per year of fully remote work! Responsibilities:... ..., and data sources. Define evaluation frameworks, success metrics, and...Remote workFull timeWork at officeWork from homeBrex Inc.
New York, NY23 hours ago- ...(~15 hours/week) Location: Remote Job Summary We are seeking... ...Software Engineers to support an AI training project by creating... ...learning environments that evaluate AI models on complex software... ...reference solutions. Evaluate AI agents' ability to reason through...Remote jobFor contractors
$200k - $320k
...technical depth and a passion for AI-driven product development.... .... This is a full-time remote opportunity, with preference for... ...production-ready LLM pipelines and AI agent systems Develop AI-driven... ...new product initiatives Evaluate and recommend AI architectures...Remote workFull timeVisa sponsorshipVirco Talent
Remote23 hours ago- ...Francisco, California | Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the environments, evaluation... ...used to train and assess long-horizon enterprise AI agents. The Opportunity You will work on the engineering and...
MaxIT Consulting - Max Corporate Group
San Francisco, CA8 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!
