Remote AI Agent Evaluation Specialist
$80 per hourMindrift
- Remote job
A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments. #J-18808-Ljbffr Mindrift
$90 per hour
AI Agent Architecture / Agent-to-Agent Protocol Specialist Location: Charlotte, NC (Hybrid - 3 Days Onsite / 2 Days Remote) Duration: 6-9 Month Contract (Potential Extension) Interview Process... ...and reference architectures Evaluate emerging AI technologies, frameworks...Remote workContract work$125 per hour
ParaView specialists leverage their expertise in scientific visualization... ...fluid dynamics to enhance AI research through flexible, hourly... ...work. This role involves evaluating AI-generated content and providing... ...-time, flexible hours. Remote work environment....Remote workHourly payContract workPart timeFlexible hours$60 per hour
...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical... ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected...Remote workPart timeFlexible hours$80 - $110 per hour
...Join a leading AI lab''s cutting-edge GenAI team to be at the... ...leading AI lab is building and evaluating frontier models and needs experienced... ...then analyzing how models and agents behave against them. All... ...workforce. This role is fully remote within the United States, at approximately...Remote workHourly payPart timeWork at office$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background...Remote jobPart time
$60 per hour
...innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking... .... Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is...Remote jobFlexible hours$80 per hour
A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will... ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive...Remote jobFlexible hours$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate... ...and improve AI systems. This remote, freelance role requires... ...detail. Candidates will review AI evaluation tasks, identify inconsistencies... ...define expected behaviors for agents. Ideal applicants have experience...Remote workFreelance$60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform... ...thrive in ambiguity, enjoy remote asynchronous work, and want to... ...modern AI systems are tested and evaluated, we want to hear from you.... ...QA experts for autonomous AI agents in a project focused on validating...Remote workFreelanceFlexible hours$80 per hour
Mercor is hiring a Remote Fraud Engineer with coding agent experience for an AI Trainer role. This position involves evaluating AI coding models and improving fraud and risk engineering workflows. Candidates should have over 2 years of relevant experience and familiarity...Remote jobHourly pay$160k - $190k
Member of Technical Staff, Agent Workflow Systems and Evaluation The Member of Technical Staff, Agent Workflow Systems... ..., measures, observes, and scales AI-enabled workflows. This role defines... ...Bay Area, CA; Denver, CO; or remote option available. The position may require...Remote workWork at officeFlexible hours$400 per month
Mercor is seeking contributors to support a Frontier Code Agents project with a leading AI research lab. You will work on evaluating and improving frontier AI coding models through technical assessments, focusing on machine learning engineering workflows. The project offers...Remote job- Meridial Marketplace, by Invisible, is seeking independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design and execute customer service role-play scenarios, evaluate AI model performance, and generate high-quality datasets. The role...Remote jobHourly pay
$400 per month
...contributors for a systems engineering project in partnership with a leading AI research lab. Participants will evaluate frontier AI coding models and complete complex engineering tasks using AI coding agents. The role pays $400 per accepted task, with tasks typically lasting 2...Remote job$80 per hour
A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures... ...allows contributors to work remotely while engaging in a complex AI project... ...detail, facilitating AI testing and evaluation without needing a coding...Remote jobFlexible hours- ESR Healthcare is looking for a Robotics Evaluation Specialist to work remotely, applying expertise to train AI systems. This role includes executing physical actions on camera, evaluating robotic performance, and providing structured feedback. The ideal candidate should...Remote job
$55 per hour
A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention... ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/...Remote jobPart timeFlexible hours$80 per hour
A leading AI consultancy in the United States is seeking Quality Assurance professionals to validate and improve autonomous AI agents. You will analyze complex systems, evaluate task structures, and ensure logical consistency through detailed reviews. Ideal candidates possess...Remote jobHourly payFlexible hours$55 per hour
A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical... ...should be adept at evaluating scenarios and documenting findings...Remote jobFlexible hours$60 per hour
...intelligence to ethically shape the future of AI. About The Role We're looking for... ...can design realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that... ...Our freelance role is fully remote so you just need a laptop, internet...Remote workPart timeFreelanceFlexible hours- A technology company based in Washington is looking for an Analyst to train AI models. The role involves providing complex mathematics problems to AI chatbots and evaluating their outputs for correctness. Candidates should possess expert mathematical reasoning skills with...Remote jobHourly payContract workFlexible hours
- ...Alignerr, we partner with the world’s leading AI research teams and labs to build and... ...conversion is perfect. Technical Auditing: Evaluate AI-generated simulations and proofs for... ...Why Join Us Competitive pay and flexible remote work. Collaborate with a team working on...Remote workContract workFreelanceFlexible hours
$80 per hour
...connects domain experts with cutting‑edge AI projects from innovative tech clients.... ...servers and internal tools for running and evaluating agent behavior. You’ll implement base methods... ...project needs Take part in a flexible, remote, freelance project that fits around your...Remote workFreelanceFlexible hours$85 per hour
ChatGPT Jobs is looking for an ML Engineer (Coding Agent Experience) in Chicago, IL. The position focuses on using frontier AI coding agents for complex machine learning tasks. Candidates should have at least 2 years of experience and be familiar with various AI tools....Remote jobHourly pay$80 per hour
...technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking,... ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while...Remote jobPart timeFlexible hours- A leading AI company is seeking a Biology Specialist to help fine-tune large language models. Ideal candidates will be pursuing or hold a Ph.D. in Biology... ...problems and collaborating on AI projects in a fully remote setting. Applicants with excellent communication and analytical...Remote job
$20 - $30 per hour
...As an Image Evaluation Generalist, you will play a pivotal role in supporting an image assessment... ...to the training of next-generation AI systems. Your expertise will be essential... ...ambiguities or gaps. Operate independently in a remote environment, delivering high-quality,...Remote workHourly payFor contractors$65 per hour
...Responsibilities Develop prompts and scenarios to evaluate the robustness of large language models.... ...teams. Work Terms Part-time remote position with flexible hours.... ...Eligibility Open to applicants with relevant experience in AI and machine learning....Remote workPart timeFlexible hours$120k - $145k
...Summary The Senior Systems Specialist is responsible for installing... ...technical expert, providing support remotely and, as needed, at production... ...routine analysis to include evaluation of hardware and software... ...Microsoft Copilot Administration - Agent building, Prompt Engineering...Remote workFull timeContract workWork at officeWorldwideHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!
- work from home chat agent Raleigh, NC
- telemarketer - state farm agent team member Raleigh, NC
- cruise agent Raleigh, NC
- import export agent Raleigh, NC
- remote chat agent Raleigh, NC
- executive protection agent Raleigh, NC
- commissioning agent Raleigh, NC
- airport agent Raleigh, NC
- operations agent Raleigh, NC
- special agent Raleigh, NC


