Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physics Domain Expert — AI Evaluation (US Remote)

$90 - $140 per hour

AuraOne Human Data

Remote
  • Remote job

Physics Domain Expert — AI Evaluation (US Remote) is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Physics models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current physics methods, conventions, and prior work for Physics Domain Expert — AI Evaluation (US Remote) assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in physics or a closely related field for Physics Domain Expert — AI Evaluation (US Remote) work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a physics derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Physics

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$90–$140 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Physics Domain Expert — AI Evaluation (US Remote) in Remote vacancy
  •  ...Domain Expert, AI Evaluation (US) is a remote review track for evaluating AI outputs across domain ai evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...seekers Career centers Handshake AI Enterprise AI Research Log in Sign up DOMAIN EXPERT, AI EVALUATION (US) Sign up now Up to $200/hr...  ...Master's , Ph.D's , Postdocs Remote Part-time Flexible hours OPT/CPT...  ...Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science... 
    Remote work
    Part time
    Flexible hours

    Handshake

    San Francisco, CA
    3 days ago
  • $166.4k - $228.8k

     ...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback...  ...and seniority. Location Fully remote. US legal training and practice are important... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    Clera

    Remote
    6 days ago
  • $60 - $100 per hour

     ...Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy...  ...reasoning Legal review Work model Remote — US-eligible. Remote · Independent specialist contractor.... 
    Remote work
    For contractors
    10 hours per week

    AuraOne Human Data

    Bay County, FL
    1 day ago
  • $187.2k - $291.2k

     ...Contractor) Location: Remote (United States)...  ...the development, evaluation, and advancement...  ...Intelligence (AI) models. In this...  ...reason about complex physics concepts and real-...  ...and specialized domain knowledge to evaluate...  ...Expert Evaluation: Review... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    H1b
    Flexible hours

    Weekday AI

    Remote
    10 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ technical operations Evaluator Type: Contract Compensation...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...  ...-generated artifacts against domain-specific quality rubrics.... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Detroit, MI
    27 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ environmental science Evaluator Type: Contract Compensation...  ...$80–$120/hour Location: Remote Role Responsibilities...  ...AI-generated artifacts against domain-specific quality rubrics. Identify... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Los Angeles, CA
    15 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Education / school Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...  ...AI-generated artifacts against domain-specific quality rubrics. Identify... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    San Jose, CA
    8 days ago
  •  ...Independent Professional & Solopreneur — AI Workflow Review (Domain Expert) is a remote review track for evaluating AI outputs across independent solopreneur specialist operations...  ...specialist operations Work model Remote — US-eligible. Remote · Independent specialist... 
    Remote work
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    6 days ago
  • $170.6k - $250k

     ...cutting-edge generative AI. As ADAS and Automated Driving...  ...quality frameworks that evaluate synthetic data utility,...  ...You are a recognized expert in both deep learning...  ...or other safety-critical domains, including familiarity with...  .... Benefits available to US-based HERE employees... 
    Remote work

    Here

    Chicago, IL
    2 days ago
  • $145.6k - $208k

     ...hour Location: Remote (UK or US East Coast) Employment...  ...of advanced AI models for scientific...  ...As a subject-matter expert, you will work closely...  ...challenging benchmarks, and evaluate AI-generated solutions...  ...Create challenging, domain-specific biology tasks... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    H1b
    Flexible hours
    Weekday work

    Weekday AI

    Remote
    10 days ago
  • $80 - $110 per hour

     ...You'll help evaluate realistic US-law tasks and documents used to train and assess...  ...with a leading frontier AI lab, you'll review legal samples...  ...data. This is a focused expert-review engagement, not a client...  .... Location Fully remote. US legal training and practice... 
    Remote work
    Hourly pay
    Contract work

    Leading Frontier Lab

    United States
    9 days ago
  • $46.8k - $78k

     ...hour Location: Remote (United States) Employment...  ...Generative AI models. This opportunity...  ...healthcare subject-matter experts (SMEs) with active US licensure and...  ...quality training data, evaluating model outputs, and establishing...  ...across healthcare domains. Develop... 
    Remote work
    Hourly pay
    Contract work
    H1b
    Visa sponsorship
    Weekday work

    Weekday AI

    Remote
    10 days ago
  • $150 - $180 per hour

     ...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per...  ...tests to assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of... 
    Remote work
    Hourly pay
    Work from home

    Prolific

    United States
    1 day ago
  • $145.6k - $208k

     ...hour Location: Remote (UK or US East Coast)...  ...of next-generation AI models for scientific...  ...medicinal, analytical, or physical chemists from...  ...Subject-Matter Expert (SME), you will work...  ...datasets, and evaluate AI-generated solutions...  ...challenging, domain-specific chemistry... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    H1b
    Flexible hours
    Weekday work

    Weekday AI

    Remote
    10 days ago
  • $145.6k - $208k

     ...hour Location: Remote (UK or US East Coast) Engagement...  ...of next-generation AI models for scientific...  ...Discovery Subject-Matter Expert (SME), you will collaborate...  ...benchmarks, and evaluate AI-generated solutions...  ...Design challenging, domain-specific drug discovery... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    H1b
    Flexible hours
    Weekday work

    Weekday AI

    Remote
    10 days ago
  • $60 - $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety...  ..., biosecurity, and other sensitive domains. Apply and refine evaluation... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    17 days ago
  • $120 per hour

     ...Prolific is seeking Licensed Pharmacists to train and evaluate AI models in Nashville, TN. As a Domain Expert, you'll review AI-generated pharmaceutical scenarios, ensuring accuracy and safety. Participants can earn up to $120 USD/hr based on skills and experience. The... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    United States
    3 days ago
  • $120 per hour

     ...Prolific is seeking Licensed Pharmacists to join their Expert Network for AI training. As a Domain Expert, you will evaluate AI responses to pharmaceutical scenarios, offering your expertise for competitive pay of up to $120 USD/hr. Ideal candidates will have a current... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Antonio, TX
    3 days ago
  • $120 per hour

     ...Prolific is looking for Licensed Pharmacists to join as Domain Experts, influencing AI development by evaluating pharmaceutical scenarios. Applicants should have a current pharmacy license, clinical expertise, and strong attention to detail. The role offers competitive... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Washington DC
    3 days ago
  • $8 - $65 per hour

     ...for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological...  ...completed task, with flexible hours that allow for remote work. Applicants need verified professional status... 
    Remote work
    Flexible hours

    Prolific

    United States
    3 days ago
  • $120 per hour

     ...Prolific is seeking Licensed Pharmacists to train and evaluate AI models in Charlotte, NC. As a Domain Expert, you contribute to the development of AI in...  ...experience, and a focus on detail. Enjoy the flexibility of remote work and competitive pay rates. #J-18808-Ljbffr... 
    Remote work
    Flexible hours

    Prolific

    Charlotte, NC
    3 days ago
  • $120 per hour

     ...Prolific is seeking Licensed Pharmacists in Jacksonville, FL, to evaluate and train AI models in healthcare. As a Domain Expert, you'll work remotely, reviewing AI-generated pharmaceutical scenarios and providing feedback. This role requires a current license and clinical... 
    Remote work
    Hourly pay
    Flexible hours

    Prolific

    United States
    3 days ago
  • $166.4k - $249.6k

     ...Location: Global – Fully Remote Employment Type:...  ...skilled Aerodynamics Expert to contribute to an advanced AI training and evaluation project focused on computational...  ...computational domains and meshes, defining...  ...numerically stable and physically accurate. The ideal... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Immediate start
    Flexible hours

    Weekday AI

    Remote
    4 days ago
  • $60 - $80 per hour

     ...technical talent with leading AI research labs....  ...0/hour Location: Remote Role Responsibilities...  ...Design challenging, domain-relevant retail tasks and...  ...retail practice. Evaluate AI model outputs against...  ...other subject matter experts to ensure consistency... 
    Remote work
    Contract work
    Summer work
    Weekday work

    Mercor

    New York, NY
    5 days ago
  • $60 - $85 per hour

     ...Frontier AI models can draft a contract clause or summarise...  ...models are trained and evaluated. It is about 10 hours a week fully remote and paid by the hour so...  ...Openings: 12 legal experts. Time commitment: Approximately...  .... Compensation: US$60$85 per hour depending... 
    Remote work
    Hourly pay
    Full time
    Contract work
    10 hours per week
    Flexible hours

    Wintermeyer Ventures

    San Francisco, CA
    5 days ago
  •  ...Professionals in San Jose, California to join their Expert Network. Responsibilities include evaluating AI-generated content and creating HR scenarios. Ideal candidates...  ...rates, and the opportunity to work from home. Join us in shaping the AI of the future while enjoying a... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    5 days ago
  •  ...looking for an Aerodynamics Expert - AI Training & Evaluation based in the United States...  ...assess the numerical and physical accuracy of engineering...  ...advanced AI systems. This fully remote opportunity offers...  ...geometries, computational domains, and meshes for accurate aerodynamic... 
    Remote work
    Full time
    Flexible hours

    Jobgether

    Remote
    2 days ago
  • $41.6k - $124.8k

     ...Employment Location: Remote (United States) Work...  ...to contribute their domain expertise to the development...  ...-generation Generative AI (GenAI) models. In...  ...quality training data, evaluate AI-generated financial...  ...finance subject matter experts and AI researchers to maintain... 
    Remote work
    Hourly pay
    Contract work
    H1b
    Flexible hours
    Weekday work

    Weekday AI

    Remote
    10 days ago
  • $40 per hour

     ...Traditional Chinese Linguistic Expert — AI Evaluation and Review is a remote evaluation track for reviewing chinese...  ...metrics and calibration cycles. Domain expertise that lets you spot subject...  ...evaluation Work model Remote — US-eligible. Remote · Independent... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physics Domain Expert — AI Evaluation (US Remote). Be the first to apply!