Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physics & Chemistry - AI Evaluation Expert

Temporary

Rise Data Labs

What You'll Do

Apply your subject-matter expertise to advanced AI training and evaluation work
Develop or evaluate challenging problems within your area of expertise
Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes
What We're Looking For
Master's degree required; PhD strongly preferred in Physics, Chemistry, or a closely related scientific discipline
Advanced academic, research, laboratory, or industry expertise
Strong analytical reasoning and ability to evaluate complex scientific work
Prior AI training, evaluation, benchmarking, or LLM experience is a plus
Flexible, remote contract work starting ASAP.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Physics & Chemistry - AI Evaluation Expert in New York, NY vacancy
  •  ...Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating... 
    Suggested
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • Prolific is building the world's largest pool of quality human data for AI. We seek Chemistry Experts and Chemical Engineers to join our Expert Network to help train and evaluate models using real-world chemical expertise. After a quick test, you may be invited to join... 
    Suggested
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  •  ...Terac is seeking experienced chemistry professionals to participate in remote, AI-moderated sessions. You will review advanced prompts, explain mechanisms,...  ...and asynchronous, offering flexible scheduling and expert contributions on a per-task basis. #J-18808-Ljbffr... 
    Suggested
    Remote work
    Flexible hours

    Terac

    New York, NY
    2 days ago
  • $60 per hour

     ...Nutrition Experts — Planning AI Project About Vetto Vetto is a global platform that connects top-tier professionals to strategic Artificial...  ...performance adjustment, etc. You may anonymize it. We are not evaluating whether your conclusion was right. We are evaluating how... 
    Suggested
    Immediate start

    Vetto

    New York, NY
    5 days ago
  •  ...Mercor is partnering with a leading AI research lab to train frontier models on clinical and biomedical reasoning. We’re hiring Healthcare Experts to evaluate model outputs and ensure medical accuracy, evidence-based reasoning, and alignment with real-world patient care... 
    Suggested

    Mercor Inc

    New York, NY
    5 days ago
  • $80 - $150 per hour

     ...Anyone AI is seeking Chemistry Experts to design challenging tasks that assess AI agents’ ability to perform chemical reasoning, mechanisms, and...  ...You will create original tasks, reference solutions, and evaluate frontier models using reaction schemes, spectra, and analytical... 
    Hourly pay
    Remote work
    Flexible hours

    Anyone AI Inc.

    New York, NY
    5 days ago
  • $60 per hour

     ...Prolific is recruiting Chemistry Experts and Chemical Engineers to join our Expert Network for training and evaluating AI models using real-world chemical expertise. After a quick test, you may be invited to join as a participant to be paid for completing AI tasks. Pay... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  • $60 per hour

     ...Prolific seeks Chemistry Experts and Chemical Engineers to join its Expert Network for AI training and evaluation. You may complete a brief skill test; successful candidates join Prolific as paid participants to work on AI model tasks from home. Experts used by researchers... 
    Hourly pay
    Remote work

    Prolific

    New York, NY
    4 days ago
  •  ...Alpheva is seeking a senior clinical research expert to support AI evaluation projects centered on study protocols, endpoints, bias, safety reporting, and trial interpretation. This is remote, project-based contract work with scope, hours, and assignments determined by... 
    Contract work
    Remote work

    Alpheva

    New York, NY
    2 days ago
  •  ...YO AI Labs seeks a STEM & scientific AI expert to support AI training through complex problem-solving, scientific reasoning, data analysis, and Python-...  ...coding. This is a coding-heavy role requiring ability to evaluate AI-generated technical solutions. The position is... 
    For contractors
    Remote work
    Flexible hours

    YO AI Labs

    New York, NY
    1 day ago
  •  ...-based — no fixed working days Weekday is an AI-native recruiting platform. We are backed by...  ...them. We are now running an AI training and evaluation project as a YC-backed AI data lab, and we're looking for insurance experts to build and judge the tasks that advanced AI... 
    Full time
    Contract work
    Remote work
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    2 days ago
  • $8 - $65 per hour

     ...Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $55 - $60 per hour

     ...project-based independent contractor opportunity supporting the evaluation of advanced AI models. As with many AI projects, work is assigned based on...  ...seeking an experienced Investment Banking Subject Matter Expert (SME) to support the development, evaluation, and... 
    For contractors
    Bank staff
    Remote work

    Volga Partners

    New York, NY
    5 days ago
  • $60 per hour

     ...Prolific Academic Ltd seeks Chemistry Experts and Chemical Engineers to join its Expert Network for AI model training and evaluation. You will assess AI-generated chemistry content, validate reactions, and audit lab documentation, ensuring safety and accuracy. Eligible... 
    Remote work
    Work from home

    Prolific Academic Ltd

    New York, NY
    4 days ago
  • 24-MAG LLC is seeking experienced Dermatologists to contribute to AI training and clinical-evaluation projects. This remote, non-clinical role focuses on image interpretation, structured annotation, case reasoning, and AI-output review, with no live patient care. Ideal... 
    Weekly pay
    Remote work

    24 Mag

    New York, NY
    4 days ago
  • $180k - $250k

     ...Scientific builds and deploys AI scientist agents to...  ...institutions across biology, physics, chemistry, and AI. ROLE We're looking for...  ...Clinical Operations Subject Matter Expert to join our Forward Deployed...  ...actually run studies. You'll evaluate agent performance on clinical... 
    Work at office

    Openkrill

    New York, NY
    4 days ago
  •  ...Alpheva is seeking a senior nursing expert to evaluate AI-driven nursing assessments, care plans, escalation decisions, and patient safety outcomes on a remote, project-based basis. You will review model responses and worked examples for missing clinical evidence, unsafe... 
    Remote work

    Alpheva

    New York, NY
    2 days ago
  • $150 - $180 per hour

     ...Prolific Academic Ltd invites Mental Health Professionals to join its Expert Network to train and evaluate AI models. You will review AI-generated psychological scenarios, edit and write psychology-related content, and provide feedback to help models learn. Successful... 
    Self employment
    Remote work
    Work from home
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    3 days ago
  • $50 per hour

     ...Prolific is seeking HR and Talent Acquisition professionals to join our Expert Network to train and evaluate AI models using real-world HR expertise. You may complete a 10–15 minute test to assess fit; successful candidates join Prolific as participants and get paid to... 
    Hourly pay
    Remote work

    Prolific Academic Ltd

    New York, NY
    3 days ago
  •  ...Mercor is seeking experienced German Linguistic Experts to join a cutting-edge AI research project conducted in partnership with a leading research lab. You will evaluate how effectively a large language model performs in German-language tasks and curate high-quality... 
    Remote work

    Mercor Inc

    New York, NY
    2 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models... 
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    New York, NY
    18 hours ago
  •  ...contribute to a cutting-edge AI benchmarking project in the target...  .... As a Subject Matter Expert, you will create and review high...  ...sciences scenarios that evaluate AI systems in the target locale...  ...Natural Sciences (e.g. biology, chemistry, physics, environmental science, earth... 
    For contractors
    Local area
    Remote work

    LILT (Production)

    New York, NY
    4 days ago
  • $110 - $140 per hour

    Alpheva is seeking a senior terminology expert to support AI evaluation projects focused on term bases, controlled vocabulary, consistency, and subject-matter usage. You will review model responses and worked examples for terminology issues and assess alignment with professional... 
    Remote job
    Hourly pay
    Contract work

    Alpheva

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a Hindi bilingual Expert for AI evaluation. This remote contractor role focuses on reviewing Hindi prompts and responses, applying AuraOne's quality rubric, and providing structured feedback for retraining the model. You will compare paired outputs... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    4 days ago
  • $60 per hour

    Prolific is recruiting Chemistry Experts and Chemical Engineers to join its Expert Network for AI model training and evaluation. You will complete a brief test and, if selected, participate as a paid contributor in tasks requiring focused, uninterrupted work. Researchers... 
    Remote job
    Hourly pay

    Prolific

    New York, NY
    5 days ago
  • $80 - $120 per hour

    Aligned is expanding its team by adding 15 Senior Physics Experts for part-time, fully-remote work supporting frontier AI research. Projects start at $80-120 USD / hour...  ...solving complex, research-grade problems and evaluating leading AI models. This is a high-impact role... 
    Remote job
    Part time

    Aligned Labs

    New York, NY
    1 day ago
  • $45 - $90 per hour

     ...You will help train and benchmark AI systems by applying expert judgment to chemistry and computational chemistry work....  ...AI models and tools. Design, evaluate, and critique chemistry problems,...  ...area such as organic, inorganic, physical, analytical, computational, materials... 
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • Alpheva seeks a senior educator to support AI evaluation projects focused on lesson delivery, learner needs, classroom assessment, and feedback. This is remote, project-based contract work; scope and hours depend on project matching. You will review model responses for... 
    Remote job
    Contract work

    Alpheva

    New York, NY
    3 days ago
  • $30 per hour

    Prolific is seeking Fluent Hindi Speakers to join our Expert Network to train and evaluate AI models using real legal expertise. You will complete paid tasks that require focused, uninterrupted work and may earn up to $30 per hour. A quick skills verification test is required... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    1 day ago
  • Hindi Bilingual Expert — AI Evaluation is a remote evaluation track for reviewing hindi generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physics & Chemistry - AI Evaluation Expert. Be the first to apply!