Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Agent Evaluation Specialist

$80 per hour

Mindrift

Raleigh, NC
  • Remote job

A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments. #J-18808-Ljbffr Mindrift

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Evaluation Specialist in Raleigh, NC vacancy
  • $90 per hour

    AI Agent Architecture / Agent-to-Agent Protocol Specialist Location: Charlotte, NC (Hybrid - 3 Days Onsite / 2 Days Remote) Duration: 6-9 Month Contract (Potential Extension) Interview Process...  ...and reference architectures Evaluate emerging AI technologies, frameworks... 
    Remote work
    Contract work

    Strategic Staffing Solutions

    Charlotte, NC
    2 days ago
  • $125 per hour

    ParaView specialists leverage their expertise in scientific visualization...  ...fluid dynamics to enhance AI research through flexible, hourly...  ...work. This role involves evaluating AI-generated content and providing...  ...-time, flexible hours. Remote work environment.... 
    Remote work
    Hourly pay
    Contract work
    Part time
    Flexible hours

    SaidGig

    United States
    4 days ago
  • $60 per hour

     ...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical...  ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected... 
    Remote work
    Part time
    Flexible hours

    Mind Rift

    Kansas City, MO
    12 hours ago
  • $80 - $110 per hour

     ...Join a leading AI lab''s cutting-edge GenAI team to be at the...  ...leading AI lab is building and evaluating frontier models and needs experienced...  ...then analyzing how models and agents behave against them. All...  ...workforce. This role is fully remote within the United States, at approximately... 
    Remote work
    Hourly pay
    Part time
    Work at office

    SaidGig

    United States
    5 days ago
  • $80 per hour

    A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant... 
    Remote work
    Part time

    Mindrift

    Houston, TX
    2 days ago
  •  ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background... 
    Remote job
    Part time

    Mindrift

    Brooklyn, NY
    3 days ago
  • $60 per hour

     ...innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking...  .... Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is... 
    Remote job
    Flexible hours

    Mindrift

    Raleigh, NC
    2 days ago
  • $80 per hour

    A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will...  ...thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    2 days ago
  • $60 per hour

     ...A leading AI firm in Austin is looking for QA experts to validate...  ...and improve AI systems. This remote, freelance role requires...  ...detail. Candidates will review AI evaluation tasks, identify inconsistencies...  ...define expected behaviors for agents. Ideal applicants have experience... 
    Remote work
    Freelance

    Mind Rift

    Austin, TX
    4 days ago
  • $60 per hour

     ...ethically shape the future of AI. What We Do The Mindrift platform...  ...thrive in ambiguity, enjoy remote asynchronous work, and want to...  ...modern AI systems are tested and evaluated, we want to hear from you....  ...QA experts for autonomous AI agents in a project focused on validating... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Austin, TX
    2 days ago
  • $80 per hour

    Mercor is hiring a Remote Fraud Engineer with coding agent experience for an AI Trainer role. This position involves evaluating AI coding models and improving fraud and risk engineering workflows. Candidates should have over 2 years of relevant experience and familiarity... 
    Remote job
    Hourly pay

    Mercor

    Victorville, CA
    4 days ago
  • $160k - $190k

    Member of Technical Staff, Agent Workflow Systems and Evaluation The Member of Technical Staff, Agent Workflow Systems...  ..., measures, observes, and scales AI-enabled workflows. This role defines...  ...Bay Area, CA; Denver, CO; or remote option available. The position may require... 
    Remote work
    Work at office
    Flexible hours

    SB Energy

    California, MO
    4 days ago
  • $400 per month

    Mercor is seeking contributors to support a Frontier Code Agents project with a leading AI research lab. You will work on evaluating and improving frontier AI coding models through technical assessments, focusing on machine learning engineering workflows. The project offers... 
    Remote job

    Mercor

    Overland Park, KS
    1 day ago
  • Meridial Marketplace, by Invisible, is seeking independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design and execute customer service role-play scenarios, evaluate AI model performance, and generate high-quality datasets. The role... 
    Remote job
    Hourly pay

    Meridial Marketplace, by Invisible

    New York, NY
    2 days ago
  • $400 per month

     ...contributors for a systems engineering project in partnership with a leading AI research lab. Participants will evaluate frontier AI coding models and complete complex engineering tasks using AI coding agents. The role pays $400 per accepted task, with tasks typically lasting 2... 
    Remote job

    Mercor

    Buckeye, AZ
    1 day ago
  • $80 per hour

    A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures...  ...allows contributors to work remotely while engaging in a complex AI project...  ...detail, facilitating AI testing and evaluation without needing a coding... 
    Remote job
    Flexible hours

    Mind Rift

    Houston, TX
    5 days ago
  • ESR Healthcare is looking for a Robotics Evaluation Specialist to work remotely, applying expertise to train AI systems. This role includes executing physical actions on camera, evaluating robotic performance, and providing structured feedback. The ideal candidate should... 
    Remote job

    ESR Healthcare

    Palo Alto, CA
    2 days ago
  • $55 per hour

    A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention...  ...tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    2 days ago
  • $80 per hour

    A leading AI consultancy in the United States is seeking Quality Assurance professionals to validate and improve autonomous AI agents. You will analyze complex systems, evaluate task structures, and ensure logical consistency through detailed reviews. Ideal candidates possess... 
    Remote job
    Hourly pay
    Flexible hours

    Mindrift

    Providence, RI
    4 days ago
  • $55 per hour

    A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical...  ...should be adept at evaluating scenarios and documenting findings... 
    Remote job
    Flexible hours

    Mindrift

    Dallas, TX
    1 day ago
  • $60 per hour

     ...intelligence to ethically shape the future of AI. About The Role We're looking for...  ...can design realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that...  ...Our freelance role is fully remote so you just need a laptop, internet... 
    Remote work
    Part time
    Freelance
    Flexible hours

    Mindrift

    Brooklyn, NY
    3 days ago
  • A technology company based in Washington is looking for an Analyst to train AI models. The role involves providing complex mathematics problems to AI chatbots and evaluating their outputs for correctness. Candidates should possess expert mathematical reasoning skills with... 
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    DataAnnotation

    Washington DC
    2 days ago
  •  ...Alignerr, we partner with the world’s leading AI research teams and labs to build and...  ...conversion is perfect. Technical Auditing: Evaluate AI-generated simulations and proofs for...  ...Why Join Us Competitive pay and flexible remote work. Collaborate with a team working on... 
    Remote work
    Contract work
    Freelance
    Flexible hours

    Alignerr

    Atlanta, GA
    4 days ago
  • $80 per hour

     ...connects domain experts with cutting‑edge AI projects from innovative tech clients....  ...servers and internal tools for running and evaluating agent behavior. You’ll implement base methods...  ...project needs Take part in a flexible, remote, freelance project that fits around your... 
    Remote work
    Freelance
    Flexible hours

    Mind Rift

    Lansing, MI
    4 days ago
  • $85 per hour

    ChatGPT Jobs is looking for an ML Engineer (Coding Agent Experience) in Chicago, IL. The position focuses on using frontier AI coding agents for complex machine learning tasks. Candidates should have at least 2 years of experience and be familiar with various AI tools.... 
    Remote job
    Hourly pay

    ChatGPT Jobs

    Chicago, IL
    4 days ago
  • $80 per hour

     ...technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking,...  ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule while... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Phoenix, AZ
    2 days ago
  • A leading AI company is seeking a Biology Specialist to help fine-tune large language models. Ideal candidates will be pursuing or hold a Ph.D. in Biology...  ...problems and collaborating on AI projects in a fully remote setting. Applicants with excellent communication and analytical... 
    Remote job

    Turing

    Boston, MA
    22 days ago
  • $20 - $30 per hour

     ...As an Image Evaluation Generalist, you will play a pivotal role in supporting an image assessment...  ...to the training of next-generation AI systems. Your expertise will be essential...  ...ambiguities or gaps. Operate independently in a remote environment, delivering high-quality,... 
    Remote work
    Hourly pay
    For contractors

    SaidGig

    Indiana
    11 days ago
  • $65 per hour

     ...Responsibilities Develop prompts and scenarios to evaluate the robustness of large language models....  ...teams. Work Terms Part-time remote position with flexible hours....  ...Eligibility Open to applicants with relevant experience in AI and machine learning.... 
    Remote work
    Part time
    Flexible hours

    SaidGig

    United States
    4 days ago
  • $120k - $145k

     ...Summary The Senior Systems Specialist is responsible for installing...  ...technical expert, providing support remotely and, as needed, at production...  ...routine analysis to include evaluation of hardware and software...  ...Microsoft Copilot Administration - Agent building, Prompt Engineering... 
    Remote work
    Full time
    Contract work
    Work at office
    Worldwide
    Home office

    Trident Seafoods

    Seattle, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Agent Evaluation Specialist. Be the first to apply!