Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Autonomous AI QA & Evaluation Analyst (Remote)

$80 per hour

Mind Rift

A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies, and help define expected behaviors for AI agents. Offering up to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects that positively influence future technology. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Autonomous AI QA & Evaluation Analyst (Remote) in New York, NY vacancy
  • $80 per hour

    A forward-thinking AI company is seeking Quality Analysts for autonomous AI agents. This project-based opportunity is ideal...  ...include reviewing evaluation tasks, identifying inconsistencies...  ...rates up to $80/hour, this flexible remote position allows candidates to influence... 
    Remote job
    Flexible hours

    Mindrift

    Phoenix, AZ
    1 day ago
  • $60 per hour

     ...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors... 
    Remote work
    Freelance

    Mind Rift

    Austin, TX
    3 days ago
  • $80 per hour

    A technology company is seeking a part-time QA contributor for an AI project to validate autonomous agents. Candidates must have strong analytical thinking, attention...  ...expected behaviors for AI agents. This flexible remote opportunity allows you to work on your own schedule... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Phoenix, AZ
    1 day ago
  • $35 per hour

     ...A leading media company is seeking a Media Analyst to evaluate AI-generated videos for visual accuracy. This remote position requires strong experience in video production and attention to detail. Ideal candidates will have a Bachelor’s degree and skills in assessing... 
    Remote work
    10 hours per week

    Crossing Hurdles

    New York, NY
    1 day ago
  • AuraOne Human Data is seeking a Quality Analyst for AI Annotation Audit & Label Consistency Review. This remote contractor role evaluates AI outputs across workflows, grades workflow correctness, policy adherence, and stakeholder fit, and documents next steps to train the... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a SQL Support Analyst for a remote contractor role focused on evaluating AI outputs within sql support analyst specialist operations workflows. Reviewers assess workflow correctness, policy adherence, and stakeholder fit, flag operational risk... 
    Remote job
    For contractors

    AI Trainer Jobs

    New York, NY
    4 days ago
  • $60 - $120 per hour

    AI Trainer Jobs is seeking a Management Analyst for a remote review role evaluating AI outputs across operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps for the modeling team to train on.... 
    Remote job
    Hourly pay
    For contractors

    AI Trainer Jobs

    New York, NY
    11 hours ago
  • AuraOne is seeking a Computer Systems Analyst to remotely review AI outputs across specialist operations. You will evaluate workflow correctness, policy adherence, and stakeholder fit, flag risks, and document next steps to train the modeling team. This contractor role... 
    Remote job
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    4 days ago
  • Dynamics QA/Test Analyst Anywhere Contract Remote Open Development Technology Description Remote Our client seeks...  ...utilizes artificial intelligence (AI) tools as part of its initial...  ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human... 
    Remote work
    Hourly pay
    Contract work

    Eliassen Group

    Phoenix, AZ
    1 day ago
  •  ...We are currently seeking a Senior QA/QC Data Analyst with AI/ML testing to join our team in Bangalore...  ...independently in a collaborative environment. • Evaluate data across various dimensions,...  ...’s needs. While many positions offer remote or hybrid work options, these... 
    Remote work
    Work experience placement
    Work at office
    Flexible hours

    NTT DATA, Inc.

    Indiana
    more than 2 months ago
  • KaiCalls is seeking a meticulous QA reviewer to sample and review real calls under privacy rules and to maintain rubrics...  ..., and partner with engineering on remediation. This remote role supports evaluating calls across verticals and languages with emphasis on evidence... 
    Remote job

    KaiCalls

    Brooklyn, NY
    4 days ago
  •  ...is seeking Chinese-speaking professionals for a short-term AI quality evaluation project. You will create conversational prompts, evaluate AI...  ...multi-turn interactions, and delivering actionable feedback. Remote work is supported; prior AI evaluation or data annotation experience... 
    Remote job
    Temporary work

    eDataBae

    New York, NY
    3 days ago
  •  ...next generation of safe and delightful personal autonomous vehicle experiences. About the Organization The Evaluation team builds and evolves the evaluation...  ...for autonomy systems. Experience leveraging AI-assisted development and analytics tools to improve... 
    Remote work
    Local area
    Work from home

    General Motors

    United States
    3 days ago
  • RemoteJobsOne is seeking a Data Analyst (AI Evaluation) contractor to help assess data quality for a customer project. You will review datasets...  ...to follow complex instructions are valued. This is a fully remote US-based opportunity with contract status. #J-18808-Ljbffr RemoteJobsOne
    Remote job
    Contract work
    For contractors

    RemoteJobsOne

    Detroit, MI
    3 days ago
  • $146.2k - $261.4k

     ...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST),...  ...include developing benchmarks for fully autonomous operations using scaffolding and...  ...Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT),... 
    Remote work
    Work experience placement
    Work from home

    Employment Opportunities Inc

    Washington DC
    4 days ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    2 days ago
  •  ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    3 days ago
  • $30 per hour

     ...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for... 
    Remote work
    Self employment
    Work from home

    Prolific

    New York, NY
    4 days ago
  • $50 per hour

     ...Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree in Human-Computer...  ...least a year of relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility, and refining... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    3 days ago
  • $153.2k - $234.1k

     ...systematic and data-driven improvements to the Autonomous Vehicle software by designing,...  ...implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve...  ...position, you will work closely with AI/ML Engineers, Simulation Engineers,... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, TX
    2 days ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    1 day ago
  • $150 - $180 per hour

    Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological scenarios and completing related tasks, offering competitive pay up to $150-180/hr. You must have a valid mental... 
    Remote job
    Work from home

    Prolific

    Virginia Beach, VA
    11 hours ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates... 
    Remote job
    Hourly pay
    Work from home

    Prolific

    Denver, CO
    3 days ago
  • $20 - $26 per hour

    Prolific is seeking fluent Kazakh speakers to evaluate AI-generated text for naturalness and authenticity. You will perform side-by-side comparisons and rate tone, style, and cultural alignment. This fast-paced, paid task work offers flexible hours and the option to work... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $150 - $180 per hour

    Prolific in Sacramento is seeking Mental Health Professionals to help train and evaluate advanced AI models. You will review AI-generated responses and engage in various training tasks, earning competitive pay rates up to $150-180/hr. Ideal candidates must hold a verified... 
    Remote job
    Work from home

    Prolific

    Sacramento, CA
    11 hours ago
  • $65 per hour

    Prolific is seeking Registered Nurses to help train and evaluate AI models. You’ll complete a quick test to assess your skills and, if successful, join Prolific as a Domain Expert participant, where you’ll get paid to train and evaluate powerful AI models. Researchers paying... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 hour ago
  • Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Austin, TX
    1 day ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback... 
    Remote job
    Work from home

    Prolific

    Seattle, WA
    2 days ago
  • $80 per hour

     ...flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for...  ...analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    1 day ago
  • $8 - $65 per hour

    Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Autonomous AI QA & Evaluation Analyst (Remote). Be the first to apply!