Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Agent Evaluation Specialist

$60 per hour

Mind Rift

An innovative tech company in Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical thinking skills, alongside attention to detail and familiarity with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected AI behaviors. The role offers competitive pay up to $60/hour and is ideal for those in academia or consulting with an interest in AI. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Specialist in Kansas City, MO vacancy
  • $120k - $145k

     ...Summary The Senior Systems Specialist is responsible for installing...  ...technical expert, providing support remotely and, as needed, at production...  ...routine analysis to include evaluation of hardware and software...  ...Microsoft Copilot Administration - Agent building, Prompt Engineering... 
    Remote work
    Full time
    Contract work
    Work at office
    Worldwide
    Home office

    Trident Seafoods

    Seattle, WA
    5 days ago
  • $80 per hour

     ...-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and...  ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/... 
    Remote work
    Part time
    Flexible hours

    Mind Rift

    United States
    2 days ago
  •  ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background... 
    Remote work
    Part time

    Mind Rift

    United States
    3 days ago
  • $60 per hour

     ...innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking...  .... Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is... 
    Remote job
    Flexible hours

    Mindrift

    Raleigh, NC
    4 days ago
  • $80 per hour

    A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will...  ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    4 days ago
  • $80 per hour

    A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant... 
    Remote work
    Part time

    Mindrift

    Houston, TX
    4 days ago
  • $60 per hour

     ...ethically shape the future of AI. What We Do The Mindrift platform...  ...thrive in ambiguity, enjoy remote asynchronous work, and want to...  ...modern AI systems are tested and evaluated, we want to hear from you....  ...QA experts for autonomous AI agents in a project focused on validating... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Austin, TX
    4 days ago
  • AI Agent Development & Evaluation Primary Care, Acute Symptom Triage & Travel Health | Contract, up to 10 hrs/week About the Role We are seeking Nurses...  ...adherence, and patient safety. This is a part-time, remote contract position (1099) requiring up to 10 hours per week... 
    Remote work
    Hourly pay
    Contract work
    Part time
    10 hours per week
    Flexible hours

    Hippocratic AI Inc.

    Brooklyn, NY
    4 days ago
  • YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world... 
    Remote work

    YO AI Labs

    Austin, TX
    1 day ago
  • ESR Healthcare is looking for a Robotics Evaluation Specialist to work remotely, applying expertise to train AI systems. This role includes executing physical actions on camera, evaluating robotic performance, and providing structured feedback. The ideal candidate should... 
    Remote job

    ESR Healthcare

    Palo Alto, CA
    4 days ago
  • $55 per hour

    A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention...  ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    4 days ago
  • $80 per hour

    A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures...  ...allows contributors to work remotely while engaging in a complex AI project...  ...detail, facilitating AI testing and evaluation without needing a coding... 
    Remote job
    Flexible hours

    Mind Rift

    Houston, TX
    1 day ago
  • $60 per hour

    A leading AI firm in Austin is looking for QA experts to validate...  ...and improve AI systems. This remote, freelance role requires...  ...detail. Candidates will review AI evaluation tasks, identify inconsistencies...  ...define expected behaviors for agents. Ideal applicants have experience... 
    Remote job
    Freelance

    Mind Rift

    Austin, TX
    4 days ago
  • $24 - $30 per hour

    Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience... 
    Remote job
    Hourly pay
    Contract work
    Freelance
    Flexible hours

    United States Digital Space LLC

    New York, NY
    2 days ago
  • $55 per hour

    A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical...  ...should be adept at evaluating scenarios and documenting findings... 
    Remote job
    Flexible hours

    Mindrift

    Dallas, TX
    3 days ago
  • $80 per hour

     ...ethically shape the future of AI. Our platform connects specialists with AI projects from major tech...  ...realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that...  ...needs Take part in a flexible, remote, freelance project that fits around... 
    Remote work
    Part time
    Freelance
    Flexible hours

    Mindrift

    Houston, TX
    4 days ago
  •  ...Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply...  ...meaningful errors within their field. Flexible, remote contract work starting ASAP. You will work on challenging... 
    Remote job
    Contract work
    Immediate start
    Flexible hours

    BAM Ventures

    New York, NY
    5 days ago
  • $70 - $110 per hour

     ...Role Overview Evaluate and help improve AI systems by applying practical project management expertise...  ...of experience as a Project Management Specialist, Project Manager, Technical Project Manager...  ...skills. Work Terms Remote, hourly engagement with an immediate... 
    Remote work
    Hourly pay
    Immediate start

    SaidGig

    United States
    4 days ago
  •  ...SWE Agent Evaluation Specialist is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    25 days ago
  •  ...Alignerr, we partner with the world’s leading AI research teams and labs to build and...  ...conversion is perfect. Technical Auditing: Evaluate AI-generated simulations and proofs for...  ...Why Join Us Competitive pay and flexible remote work. Collaborate with a team working on... 
    Remote work
    Contract work
    Freelance
    Flexible hours

    Alignerr

    Atlanta, GA
    1 day ago
  • Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny.... 
    Remote job

    Dorado

    New York, NY
    4 days ago
  •  ...French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly... 
    Remote work
    Hourly pay
    For contractors
    Freelance

    Meridial

    United States
    4 days ago
  •  ...Expert Codebase Evaluation Specialist - Coding Agent Review is a remote evaluation track for reviewing codebase evaluation evaluation prompts and responses against...  ...team can use to retrain. Why this role matters AI data reviewers help turn codebase evaluation... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    29 days ago
  • $80 - $100 per hour

     ...help train and improve next-generation AI coding agents. In this contractor role you will provide...  ...end feature development. Critically evaluate AI agents in diverse scenarios,...  ...Engagement type: Contractor. Location: Remote. Work will involve contributing to a... 
    Remote work
    Hourly pay
    For contractors

    SaidGig

    United States
    2 days ago
  • $80 per hour

    Get AI‑powered advice on this job and more exclusive features. This opportunity is...  ...servers and internal tools for running and evaluating agent behavior. You’ll implement base methods...  ...project needs Take part in a flexible, remote, freelance project that fits around your... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Dallas, TX
    4 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $90/hour Location: Remote Role Responsibilities Render a reference...  ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel... 
    Remote work
    Contract work
    Summer work
    Local area

    Mercor

    San Francisco, CA
    10 days ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  .... Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Boston, MA
    19 days ago
  • $140 - $190 per hour

     ...safety data while helping assess AI-authored pharmacovigilance...  ...Reports and Periodic Benefit Risk Evaluation Reports, including their...  ...evaluation rubrics to measure an AI agent''s ability to produce...  ...PBRER reporting. Work Terms Remote, hourly engagement. Applicants... 
    Remote work
    Hourly pay

    SaidGig

    Canada
    4 days ago
  • $80 per hour

     ...technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking,...  ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Phoenix, AZ
    4 days ago
  • A leading AI company is seeking a Biology Specialist to help fine-tune large language models. Ideal candidates will be pursuing or hold a Ph.D. in Biology...  ...problems and collaborating on AI projects in a fully remote setting. Applicants with excellent communication and analytical... 
    Remote job

    Turing

    Boston, MA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!