Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Specialist — Remote, Project-Based Pay

$60 per hour

prolificacademicltd

New York, NY
  • Remote job

Prolific Academic Ltd is seeking contributors to evaluate AI systems through paid, project-based tasks. You will judge technical answers, check research summaries, and review code and diagrams for accuracy. Applicants should hold a bachelor's degree in computer science, be able to interpret research papers and assess complex algorithms, and provide clear, expert feedback. Remote, flexible work with earnings up to $60 per hour; a short screening assessment (~10–15 minutes) is required. #J-18808-Ljbffr prolificacademicltd

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist — Remote, Project-Based Pay in New York, NY vacancy
  •  ...is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models...  ...help generate clean datasets based on realistic customer support...  ...a high-quality microphone. Remote freelance engagement with pay ranging $6-$65 per hour. #J-... 
    Remote job
    Project
    Hourly pay
    Freelance

    Invisible Technologies Inc.

    New York, NY
    5 days ago
  • $30 per hour

    Evaluate and rank AI-generated responses in Singaporean Malay, explain your...  ...provide written feedback. This remote, part-time project is open to candidates in the United States and pays up to $30 per hour. You...  ...This is part-time, project-based contractor work that can be... 
    Remote work
    Project
    Hourly pay
    Part time
    For contractors
    Local area

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  •  ...AI Image Specialist (US Based) - Remote Image Evaluation is a remote evaluation track for reviewing ai image evaluation prompts and responses against AuraOne'...  ...intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed... 
    Remote job
    Project
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  • $40 per hour

    A leading company in AI training solutions is seeking a Content Developer specialized...  ...involves enhancing AI models by providing and evaluating complex physics problems. Ideal...  ...development of AI systems. Flexibility in project selection and scheduling, with competitive... 
    Remote job
    Project
    Hourly pay

    DataAnnotation

    New York, NY
    5 days ago
  • $55 per hour

    A leading AI innovation firm in Dallas is seeking QAs for...  ...scenarios. This flexible, remote project is ideal for those with excellent...  ...should be adept at evaluating scenarios and documenting findings...  ...role offers competitive pay up to $55/hour based on expertise and experience... 
    Remote job
    Project
    Flexible hours

    Mindrift

    Dallas, TX
    2 days ago
  • $35 - $42 per hour

    Location:USA (Remote) Compensation:$35.00-$42...  ...hours per weekbased on project availability Help Shape the Future of AI in Finance, Audit &...  ...ofon-call AI Evaluation Specialistssupporting...  ...anon-call, project-based contract opportunitysupporting...  ...leave, holiday pay, or... 
    Remote work
    Project
    Hourly pay
    Extra income
    Permanent employment
    Contract work
    Temporary work
    Flexible hours

    Volga Partners

    New York, NY
    4 days ago
  •  ...seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design...  ...execute complex role-play based evaluation scenarios Audit...  ...before interviewing Pay range is USD per hour and...  ...Work environment is remote; no office required #J... 
    Remote work
    Project
    Hourly pay
    For contractors
    Freelance
    Work at office
    Worldwide

    remote work

    New York, NY
    5 days ago
  • Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced...  ...complex, role-play-based evaluation scenarios...  .... We offer a pay range of $6-to-$65 per...  ...Contractor Workplace Type: Remote #J-18808-Ljbffr... 
    Remote work
    Project
    Hourly pay
    For contractors
    Freelance

    Agency

    New York, NY
    5 days ago
  •  ...seeking strong analytical thinkers to evaluate AI-generated responses and provide detailed...  ...reasoning and work independently in a remote setting. The role emphasizes clear, well...  ...adherence to established guidelines. Flexible, project-based work with competitive compensation is... 
    Remote job
    Project
    Flexible hours

    Synthires

    Austin, TX
    6 days ago
  •  ...seeking Subject Matter Experts in project management to design Excel-based tasks that test AI's ability to perform real PM work...  ...will craft tasks, write precise evaluation rubrics, and work as an independent contractor on a fully remote, task-based program with weekly payments... 
    Remote job
    Project
    Weekly pay
    For contractors

    Aptura

    New York, NY
    6 days ago
  • Synthires is seeking evaluators to review AI-generated responses, judging quality and reasoning while...  ...well-supported rationales in a fully remote setting. The role emphasizes...  ...proficiency. Compensation is hourly and project-based, offering flexible scheduling. #J-18... 
    Remote job
    Project
    Hourly pay
    Flexible hours

    Synthires

    New York, NY
    5 days ago
  • Zekai is seeking Evaluation Specialists/Recent Grads for a remote, contractor role contributing to a high-impact AI project. You will develop QA pairs, conduct source-triangulated research...  .... Roles start quickly with output-based compensation and worldwide eligibility.... 
    Remote job
    Project
    For contractors
    Worldwide

    Confidential

    New York, NY
    4 days ago
  •  ...seeking experienced finance, audit, insurance, compliance, and legal professionals to join our on-call AI evaluation specialist network. This remote, project-based role supports AI training and evaluation initiatives across multiple domains. We offer flexible, on-call... 
    Remote job
    Project
    Contract work
    Flexible hours

    Volga Partners

    New York, NY
    4 days ago
  • DataAnnotation is inviting contributors to evaluate AI performance on Slovak translation and localization tasks. You will review model...  ...feedback to improve AI systems. This is a flexible, remote, project-based role with compensation per hour. Ideal candidates have professional... 
    Remote job
    Project
    Hourly pay
    Flexible hours

    DataAnnotation

    Cleveland, OH
    4 days ago
  •  ...seeks analytical thinkers to contribute to advanced AI research and evaluation projects. You will evaluate AI-generated responses, assess quality...  ...strong written communication, and the ability to work independently in a remote, project-based role. #J-18808-Ljbffr Synthires
    Remote job
    Project
    Flexible hours

    Synthires

    Sacramento, CA
    6 days ago
  • $30 per hour

    TAMIL AI EVALUATION SPECIALIST (SINGAPORE/MALAYSIA) Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours About Handshake AI Opportunity Overview Handshake is looking for Tamil speakers based in Singapore or Malaysia to help make AI responses... 
    Remote work
    Project
    Part time
    Flexible hours

    Handshake

    New York, NY
    5 days ago
  • $80 per hour

     ...focused on quality assurance for autonomous AI agents. You will analyze complex...  ...oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable... 
    Remote job
    Project
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    4 days ago
  • $21 - $35 per hour

     ...6 · expira em 04/01/2027# AI Image Specialist (US Based)Micro1 · GlobalPJRemotoGeneralistCompartilharWhatsAppLinkedInTelegramX##...  .... We provide frontier evaluations and reinforcement learning...  ...Location: United States, Remote**Skills*** Graphic Design*...  ...training or data labeling projects is a plus.**Remuneracao**$... 
    Remote work
    Project
    For contractors

    Casado

    New York, NY
    5 days ago
  • A leading AI research platform is seeking an AI Trainer with expertise...  ...Design. The role involves evaluating designs, ensuring they meet professional...  ...Figma and Adobe software. This project offers competitive pay, flexible hours, and remote work options. #J-18808-Ljbffr... 
    Remote job
    Project
    Flexible hours

    Prolific

    Los Angeles, CA
    6 days ago
  • $30 - $60 per hour

     ...professionals test personal AI agents with privacy-...  ..., the work is privacy evaluation. The contract is for people based in the United States, pays $30 to $60 per hour, is part-time and project-based, and lasts 6...  ...Where: United States, remote not stated. Time: Part-... 
    Remote work
    Project
    Hourly pay
    Contract work
    Part time

    micro1

    Remote
    2 days ago
  • $60 per hour

     ...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical...  ...formats. Candidates will review evaluation tasks, identify inconsistencies,...  .... The role offers competitive pay up to $60/hour and is ideal for... 
    Remote job
    Project
    Part time
    Flexible hours

    Mindrift

    Kansas City, MO
    4 days ago
  •  ...US-based photographers and designers supply...  ...compare each one with an AI-generated version,...  .... The contract is remote within the United States, with no pay or hours stated....  ...model development and evaluation Compare each of...  ...for AI training projects. Applications go... 
    Remote work
    Project
    Contract work

    micro1

    Remote
    3 days ago
  •  ...language domain-expert participants for a fully remote AI training and evaluation project. The role is project-based, home-based, and offers flexible, task-by-task...  ...skills verification, you join a pool of language specialists who read, edit, and rate Polish prompts and... 
    Remote job
    Project
    Hourly pay
    Work from home
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • $40 per hour

    DataAnnotation is seeking contributors to evaluate AI translations in Slovak, focusing...  ...and cultural nuance across real projects. You’ll review model outputs,...  ...feedback from a linguistic perspective. Remote, flexible work with project-based tasks. No degree required;... 
    Remote job
    Project
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...title, this is a video evaluation role: the listing describes Senior AI Video Trainers who...  .... The contract is remote and the title says US based. Pay and hours are not stated...  ...or motion graphics specialist Preferred:...  ...experts for AI training projects. Applications go... 
    Remote work
    Project
    Contract work

    micro1

    Remote
    2 days ago
  • Mindrift is seeking licensed physicians to participate in a flexible, remote, project-based evaluation of clinical AI materials. You will review written cases, assess diagnostic and treatment decisions, and provide structured reasoning for each evaluation. There is no employment... 
    Remote job
    Project
    Flexible hours

    Toloka

    Columbus, OH
    4 days ago
  • $30 - $50 per hour

    Review AI-generated guidance on federal student loans,...  ...default situations. This remote contractor project pays $30 to $50 per hour for about...  ...-related challenges. Evaluate AI-generated answers for inaccurate...  ...and make decisions. Specialists review examples and model... 
    Remote work
    Project
    Hourly pay
    Contract work
    Temporary work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  •  ...service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for...  ...methods. What we offer: Hourly compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful... 
    Remote job
    Project
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    5 days ago
  • $35 - $42 per hour

     ...Location: USA (Remote) Compensation: $35. 00–$42....  ...| 0–20 hours per week based on project availability Help Shape the Future of AI in Finance, Audit & Risk...  ...network of on-call AI Evaluation Specialists supporting the development...  ..., paid leave, holiday pay, or guaranteed minimum... 
    Remote work
    Project
    Hourly pay
    Extra income
    Permanent employment
    Full time
    Contract work
    Temporary work
    Flexible hours

    Volga Partners

    Remote
    24 days ago
  • This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include: Content...  ...content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for... 
    Remote work
    Project
    Hourly pay
    For contractors
    Flexible hours

    CNTXT, Inc.

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Specialist — Remote, Project-Based Pay. Be the first to apply!