Physics Domain Expert — AI Evaluation (US Remote)
$90 - $140 per hourAuraOne Human Data
- Remote job
Physics Domain Expert — AI Evaluation (US Remote) is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
Physics models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current physics methods, conventions, and prior work for Physics Domain Expert — AI Evaluation (US Remote) assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in physics or a closely related field for Physics Domain Expert — AI Evaluation (US Remote) work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce a physics derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- Physics
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$90–$140 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...Domain Expert, AI Evaluation (US) is a remote review track for evaluating AI outputs across domain ai evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right...Remote jobFor contractorsWork experience placement10 hours per week
- ...seekers Career centers Handshake AI Enterprise AI Research Log in Sign up DOMAIN EXPERT, AI EVALUATION (US) Sign up now Up to $200/hr... ...Master's , Ph.D's , Postdocs Remote Part-time Flexible hours OPT/CPT... ...Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science...Remote workPart timeFlexible hours
$166.4k - $228.8k
...About the Role Support the evaluation and improvement of AI systems by reviewing realistic US-law tasks and documents. This expert-review role focuses on legal accuracy, clear feedback... ...and seniority. Location Fully remote. US legal training and practice are important...Remote workHourly payFull timeFlexible hours$60 - $100 per hour
...Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy... ...reasoning Legal review Work model Remote — US-eligible. Remote · Independent specialist contractor....Remote workFor contractors10 hours per week$187.2k - $291.2k
...Contractor) Location: Remote (United States)... ...the development, evaluation, and advancement... ...Intelligence (AI) models. In this... ...reason about complex physics concepts and real-... ...and specialized domain knowledge to evaluate... ...Expert Evaluation: Review...Remote workHourly payContract workFor contractorsH1bFlexible hours$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ technical operations Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... ...-generated artifacts against domain-specific quality rubrics....Remote workContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ environmental science Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities... ...AI-generated artifacts against domain-specific quality rubrics. Identify...Remote workContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Education / school Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI-generated artifacts against domain-specific quality rubrics. Identify...Remote workContract workSummer workWork at office- ...Independent Professional & Solopreneur — AI Workflow Review (Domain Expert) is a remote review track for evaluating AI outputs across independent solopreneur specialist operations... ...specialist operations Work model Remote — US-eligible. Remote · Independent specialist...Remote workHourly payFor contractorsWork experience placement10 hours per week
$170.6k - $250k
...cutting-edge generative AI. As ADAS and Automated Driving... ...quality frameworks that evaluate synthetic data utility,... ...You are a recognized expert in both deep learning... ...or other safety-critical domains, including familiarity with... .... Benefits available to US-based HERE employees...Remote work$145.6k - $208k
...hour Location: Remote (UK or US East Coast) Employment... ...of advanced AI models for scientific... ...As a subject-matter expert, you will work closely... ...challenging benchmarks, and evaluate AI-generated solutions... ...Create challenging, domain-specific biology tasks...Remote workHourly payWeekly payContract workPart timeFor contractorsH1bFlexible hoursWeekday work$80 - $110 per hour
...You'll help evaluate realistic US-law tasks and documents used to train and assess... ...with a leading frontier AI lab, you'll review legal samples... ...data. This is a focused expert-review engagement, not a client... .... Location Fully remote. US legal training and practice...Remote workHourly payContract work$46.8k - $78k
...hour Location: Remote (United States) Employment... ...Generative AI models. This opportunity... ...healthcare subject-matter experts (SMEs) with active US licensure and... ...quality training data, evaluating model outputs, and establishing... ...across healthcare domains. Develop...Remote workHourly payContract workH1bVisa sponsorshipWeekday work$150 - $180 per hour
...Prolific is recruiting Mental Health Professionals to train and evaluate AI models. You’ll complete tasks that may pay $150–$180 per... ...tests to assess suitability. Successful candidates join as Domain Experts and are paid for AI tasks, many of which require one hour of...Remote workHourly payWork from home$145.6k - $208k
...hour Location: Remote (UK or US East Coast)... ...of next-generation AI models for scientific... ...medicinal, analytical, or physical chemists from... ...Subject-Matter Expert (SME), you will work... ...datasets, and evaluate AI-generated solutions... ...challenging, domain-specific chemistry...Remote workHourly payWeekly payContract workPart timeFor contractorsH1bFlexible hoursWeekday work$145.6k - $208k
...hour Location: Remote (UK or US East Coast) Engagement... ...of next-generation AI models for scientific... ...Discovery Subject-Matter Expert (SME), you will collaborate... ...benchmarks, and evaluate AI-generated solutions... ...Design challenging, domain-specific drug discovery...Remote workHourly payWeekly payContract workPart timeFor contractorsH1bFlexible hoursWeekday work$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety... ..., biosecurity, and other sensitive domains. Apply and refine evaluation...Remote workContract workSummer work$120 per hour
...Prolific is seeking Licensed Pharmacists to train and evaluate AI models in Nashville, TN. As a Domain Expert, you'll review AI-generated pharmaceutical scenarios, ensuring accuracy and safety. Participants can earn up to $120 USD/hr based on skills and experience. The...Remote workWork from homeFlexible hours$120 per hour
...Prolific is seeking Licensed Pharmacists to join their Expert Network for AI training. As a Domain Expert, you will evaluate AI responses to pharmaceutical scenarios, offering your expertise for competitive pay of up to $120 USD/hr. Ideal candidates will have a current...Remote workWork from homeFlexible hours$120 per hour
...Prolific is looking for Licensed Pharmacists to join as Domain Experts, influencing AI development by evaluating pharmaceutical scenarios. Applicants should have a current pharmacy license, clinical expertise, and strong attention to detail. The role offers competitive...Remote workHourly payWork from homeFlexible hours$8 - $65 per hour
...for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological... ...completed task, with flexible hours that allow for remote work. Applicants need verified professional status...Remote workFlexible hours$120 per hour
...Prolific is seeking Licensed Pharmacists to train and evaluate AI models in Charlotte, NC. As a Domain Expert, you contribute to the development of AI in... ...experience, and a focus on detail. Enjoy the flexibility of remote work and competitive pay rates. #J-18808-Ljbffr...Remote workFlexible hours$120 per hour
...Prolific is seeking Licensed Pharmacists in Jacksonville, FL, to evaluate and train AI models in healthcare. As a Domain Expert, you'll work remotely, reviewing AI-generated pharmaceutical scenarios and providing feedback. This role requires a current license and clinical...Remote workHourly payFlexible hours$166.4k - $249.6k
...Location: Global – Fully Remote Employment Type:... ...skilled Aerodynamics Expert to contribute to an advanced AI training and evaluation project focused on computational... ...computational domains and meshes, defining... ...numerically stable and physically accurate. The ideal...Remote workHourly payContract workFor contractorsImmediate startFlexible hours$60 - $80 per hour
...technical talent with leading AI research labs.... ...0/hour Location: Remote Role Responsibilities... ...Design challenging, domain-relevant retail tasks and... ...retail practice. Evaluate AI model outputs against... ...other subject matter experts to ensure consistency...Remote workContract workSummer workWeekday work$60 - $85 per hour
...Frontier AI models can draft a contract clause or summarise... ...models are trained and evaluated. It is about 10 hours a week fully remote and paid by the hour so... ...Openings: 12 legal experts. Time commitment: Approximately... .... Compensation: US$60$85 per hour depending...Remote workHourly payFull timeContract work10 hours per weekFlexible hours- ...Professionals in San Jose, California to join their Expert Network. Responsibilities include evaluating AI-generated content and creating HR scenarios. Ideal candidates... ...rates, and the opportunity to work from home. Join us in shaping the AI of the future while enjoying a...Remote jobHourly payWork from homeFlexible hours
- ...looking for an Aerodynamics Expert - AI Training & Evaluation based in the United States... ...assess the numerical and physical accuracy of engineering... ...advanced AI systems. This fully remote opportunity offers... ...geometries, computational domains, and meshes for accurate aerodynamic...Remote workFull timeFlexible hours
$41.6k - $124.8k
...Employment Location: Remote (United States) Work... ...to contribute their domain expertise to the development... ...-generation Generative AI (GenAI) models. In... ...quality training data, evaluate AI-generated financial... ...finance subject matter experts and AI researchers to maintain...Remote workHourly payContract workH1bFlexible hoursWeekday work$40 per hour
...Traditional Chinese Linguistic Expert — AI Evaluation and Review is a remote evaluation track for reviewing chinese... ...metrics and calibration cycles. Domain expertise that lets you spot subject... ...evaluation Work model Remote — US-eligible. Remote · Independent...Remote jobFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physics Domain Expert — AI Evaluation (US Remote). Be the first to apply!





