Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Trainer (Physical Sciences) — Remote AI Evaluation

AuraOne Human Data

Remote
  • Remote job

AI Trainer (Physical Sciences) — Remote AI Evaluation is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Physics models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current physics methods, conventions, and prior work for AI Trainer (Physical Sciences) — Remote AI Evaluation assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in physics or a closely related field for AI Trainer (Physical Sciences) — Remote AI Evaluation work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a physics derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Physics
  • AI model evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Trainer (Physical Sciences) — Remote AI Evaluation in Remote vacancy
  • $40 per hour

    A leading company in AI training solutions is seeking a Content Developer specialized in Physics. The role involves enhancing AI models by providing and evaluating complex physics problems. Ideal candidates hold advanced degrees in physics or related fields, ensuring high... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    5 days ago
  • $60 - $120 per hour

     ...Computational physical scientists in areas such as...  ...astronomy and materials science, with paid AI training already...  ...The role is a fully remote global contract of 15...  ...reference solutions and evaluation criteria Judge model...  ...1's own site. AI Trainer Guide is an independent... 
    Remote work
    Hourly pay
    Contract work
    Worldwide
    Flexible hours

    micro1

    Australia
    3 days ago
  •  ...Description Job Description: Computational Physical Scientist – AI Training & Model Evaluation Role Type: Contractor Location: Global (Fully Remote) Time Commitment: 15+ hours per...  ...experience involving physical-science content. Key Responsibilities #... 
    Remote job
    For contractors
    Immediate start
    Flexible hours

    YO AI Labs

    New York, NY
    5 days ago
  • $60 per hour

    AI Trainer (Physical Sciences) Pay: $60 $120/hour equivalent, paid per accepted task Location: Global, fully remote Job Type: Contractor Time Commitment: 15+ hours per week...  ...AI-training or model-evaluation experience to support a project focused... 
    Remote work
    Full time
    For contractors
    Immediate start
    Flexible hours

    Pro Integrate

    New York, NY
    7 days ago
  • $30 per hour

     ...Freelance Physics QA Reviewer - AI Trainer 2 weeks ago - Be among the first 25 applicants Get AI-powered...  .... Auditing Work: Review and evaluate tasks completed by other experts, ensuring...  ...guidelines. Your role is fully remote, so you just need a laptop, internet... 
    Remote work
    Part time
    Freelance

    Mind Rift

    New York State
    1 day ago
  • $40 per hour

     ...expert talent network that supports AI research and model evaluation; entry to the pool does not guarantee...  ...scientific content. The work is fully remote, paid by the hour, and scheduled flexibly...  ...tasks. Responsibilities Audit physics research papers paired with LLM-generated... 
    Remote job
    Hourly pay
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • $70 - $85 per hour

     ...helping hire for one of the leading AI labs (via one of our partners)...  ...key specialised areas (like physics). We require your help in...  ...Physics domain. You will be evaluating advanced math tasks and solutions...  ...: 4-8 weeks Flexible, remote work that will have a significant... 
    Remote work
    Hourly pay
    Full time
    Part time
    For contractors
    Work experience placement
    Currently hiring
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    4 days ago
  • $55 per hour

    Freelance Physics QA (with Python) - AI Trainer 2 days ago Be among the first 25 applicants This opportunity...  ...guidelines. Auditing Work: review and evaluate tasks completed by other experts,...  ...guidelines. Our freelance role is fully remote, so you just need a laptop, internet... 
    Remote work
    Part time
    Freelance

    Mindrift

    New York, NY
    1 day ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Dallas, TX
    a month ago
  • $40 per hour

    Location: Remote Type: Contract / Part-time Commitment: 20 to 40 hours...  ...training data for frontier AI models. Our data is used directly in training and evaluation pipelines at leading AI labs to...  ...We are looking for experts in Physics to design rigorous, deterministic... 
    Remote work
    Contract work
    Part time

    Anyone AI Inc.

    New York, NY
    4 days ago
  • $8 - $65 per hour

    Physics Specialist - Freelance AI Trainer Project United States of America Are you a physics...  ...prompt engineering and evaluation metrics. A master’s or PhD...  ...closely related physical science field is ideal; peer‑...  ...Contract Workplace type: Remote Seniority level: Mid‑Senior... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Science Specialist (Fluent in German) - Freelance AI Trainer Project World Wide - Remote Are you a science specialist fluent in German, eager...  ...to prompt engineering and evaluation metrics. Qualifications...  ...’s, master’s, or PhD in a physical, earth, environmental, or... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Environmental Physics Specialist - Freelance AI Trainer Project United States of America Are...  ..., geophysical processes, remote sensing, hydrological systems...  ...prompt engineering and evaluation metrics. A PhD in...  ...environmental physics, atmospheric science, geophysics, or a related... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Worldwide

    Meridial

    New York, NY
    5 days ago
  • $8 - $65 per hour

    Science Specialist - Freelance AI Trainer Project United States of America Are you a science...  ...who live and breathe physical science, earth science, environmental...  ...prompt engineering and evaluation metrics. A bachelor’s,...  ...Contract Workplace type: Remote Seniority level: Mid -... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Environmental Physics Specialist - Freelance AI Trainer Project United States of America Are...  ..., geophysical processes, remote sensing, hydrological systems...  ...prompt engineering and evaluation metrics. A PhD in...  ...environmental physics, atmospheric science, geophysics, or a related... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Worldwide

    Meridial

    New York, NY
    5 days ago
  • $55 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is...  ...What This Opportunity Involves Design rigorous physics problems reflecting professional practice;... 
    Permanent employment
    Temporary work
    Freelance
    10 hours per week

    Mindrift

    Madison, WI
    3 days ago
  •  ...Analytical Chemistry Specialist - AI Trainer, New Grad (Remote) Join to apply for the...  ...prompt engineering and evaluation metrics Qualifications:...  ...closely related chemical science field • Expertise in spectroscopy...  ..., Remote) AI Trainer for Physical Chemistry (Freelance,... 
    Remote work
    Full time
    Contract work
    Freelance
    H1b
    Worldwide

    jobright.com

    United States
    3 days ago
  • $8 - $65 per hour

     ...Application for Materials Science/Engineering Specialist - Freelance AI Trainer Project at Meridial...  ...prompt engineering and evaluation metrics. A PhD in materials...  ..., or a closely related physical science field is ideal;...  ...Workplace type: Remote Seniority level: Mid‑Senior... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Invisible Technologies Inc.

    New York, NY
    5 days ago
  • $41.6k - $114.4k

     ...and inference provider focused on realtime AI for consumer-facing applications. We...  ...engineers can act on For multilingual roles: evaluate pronunciation, dialect accuracy, and...  ...evaluation or annotation work Location: Remote within the United States. Compensation... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    Inworld

    Remote
    20 days ago
  • AuraOne is seeking contractors to review multimodal physics evaluation prompts and responses. You will compare paired outputs, label edge cases...  ...and provide structured feedback to help retrain models. As a remote role with US-eligibility, you will judge model behavior on... 
    Remote job
    For contractors
    Flexible hours

    Auraone

    New York, NY
    4 days ago
  • $40 per hour

    Prolific is seeking AI Trainers - Physics Specialist to join our expert network in a remote advisory capacity. Tasks include auditing physics papers and graphical abstracts for accuracy and aiding in the improvement of AI models. A Masters degree in Physics or a related... 
    Remote job
    Hourly pay
    Work from home

    Prolific Academic Ltd

    New York, NY
    4 days ago
  • $65 - $85 per hour

     ...collaborating with a leading AI research lab to enhance advanced...  ...centers on developing and evaluating AI models that can replicate real...  ...including organic, inorganic, physical, analytical chemistry, and biochemistry...  ...0 hours/week Schedule: Fully remote and asynchronous — flexible... 
    Remote work
    Hourly pay
    Daily paid
    Contract work
    Part time
    For contractors
    Immediate start
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    4 days ago
  • $31.2k - $62.4k

    Are you a health sciences expert eager to shape the future of AI? Large‑scale language models are...  ...our prompt engineering and evaluation metrics. A bachelor’s...  ...Sciences Specialist – AI Trainer Employment type: Contract Workplace type: Remote Seniority level: Mid‑Senior... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    Remote
    7 days ago
  • $41.6k

     ...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models...  ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    7 days ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    28 days ago
  • £50 per hour

    Prolific seeks individuals with Psychology experience to work as self-employed AI Trainers, evaluating AI models and training datasets. After a quick test, successful candidates may join as a Domain Expert participant and receive payments for tasks. Researchers may pay... 
    Remote job
    Self employment
    Work from home

    Prolific

    New York, NY
    2 days ago
  •  ...Marathi to help train and refine AI models. You will review and...  ...and apply domain knowledge in science, technology, engineering, and...  ...the team to improve prompts and evaluation methods for Marathi-English outputs. This is a contract, remote position for mid-senior... 
    Remote job
    Contract work

    Invisible Technologies Inc.

    New York, NY
    4 days ago
  •  ...is seeking a Pashto language specialist to help train and evaluate large-scale AI language models. You will converse with the model in Pashto...  ...context, and document failures for remediation. This is a remote contractor role with pay negotiated per hour. A background... 
    Remote job
    Hourly pay
    For contractors

    Agency

    New York, NY
    4 days ago
  • $55 per hour

     ...intelligence to ethically shape the future of AI. What We Do The Mindrift platform...  ...Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers....  ...guidelines. Our freelance role is fully remote, so you just need a laptop, internet connection... 
    Remote work
    Part time
    Freelance

    Mind Rift

    Brooklyn, NY
    2 days ago
  • Agency seeks AI QA trainers to rigorously evaluate large language models across multilingual and domain-specific contexts. You will design tests, run regression suites, and document failure modes to raise the bar for model reasoning, reliability, and safety. You’ll work... 
    Remote job

    Agency

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Trainer (Physical Sciences) — Remote AI Evaluation. Be the first to apply!