STEM PhD Expert for AI Reasoning & Evaluation
$50 - $150 per hourBraintrust
- Rate: $50 – $150/hr
- Hours: 35 hours / week
- Experience: 3 - 5 years
- Location: United States | Canada + 6 more
- Assessing the factuality and relevance of domain-specific text produced by AI models
- Crafting and answering questions related to Machine Learning and AI
- Evaluating and ranking domain-specific responses generated by AI models
- A PhD (completed or in final stages) in one of the following fields: Machine Learning / AI, Computer Science, Engineering, Statistics, or a closely related quantitative subdomain such as Mathematics or Physics
- Strong analytical and critical-thinking skills, with the ability to spot subtle errors in technical reasoning
- Fluent written English and the ability to communicate complex ideas clearly
- Research experience (academic or industry)
- Prior experience with data annotation or AI model evaluation
- Experience reviewing or publishing research papers
We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge models reason, answer, and improve. You'll review AI-generated content in your field, identify where the model gets things right or wrong, and help raise the quality bar on technical reasoning.
This is a short-term engagement running through the end of June, with potential to extend depending on project needs.
Key Responsibilities
You may contribute your expertise by:
What We're Looking For
Nice to Have
Compensation
Up to $150/hr , depending on your area of expertise, depth of experience, and assessment performance.
Location
This role is fully remote. We are currently accepting applicants based in:
United States, Canada, Puerto Rico, Mexico, United Kingdom, Australia, New Zealand, and Argentina.
Company: Outlier
$45 - $70 per hour
...Social Science Help a leading AI lab ensure its models... ...is seeking behavioral health experts to help evaluate and improve how its AI models... ...LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required.... ..., and to explain the reasoning behind a professional judgment...For phdContract workPart timeWeekday work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:...For phdContract workSummer workImmediate startRemote work$84 per hour
...technical talent with leading AI research labs.... ...Chemistry & Synthesis Expert Type: Contract... ...Role Responsibilities Evaluate technically complex problems... ...evaluations, and reasoning frameworks. Identify... ...Qualifications Must-Have PhD in Inorganic...For phdContract workSummer workRemote work$164.5k - $219k
...Information Job Title Expert Senior Manager, Data... ...to work with major AI ecosystem partners through... ...to prompt design, evaluation and output quality assuranceDevelop... ..., or PhD in a technical fieldBackground... ...require a good-faith, reasonable salary range to be included...For phdPermanent employmentFull timeApprenticeshipLocal areaHome office3 days per week$50 per hour
...projects with top AI labs while earning... ...(e.g., multi-step reasoning, abstraction, symbolic... ...with rigorous logic.Evaluate AI outputs for... ...across undergraduate to PhD-level math topics.... ...Assessment: Shortlisted experts complete an... ...coding, reasoning, STEM, multilinguality, multimodality...For phdContract workRemote workFlexible hours$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Clinician (MD/DO) - HLS Expert Pool Type: Contract... ...model response grading. Evaluate clinical dialogues for accuracy... ...advice. Annotate clinical reasoning by recording case work-throughs...Full timeContract workSummer workRemote work$50 per hour
...projects with top AI labs while earning... ...rigorous logic. Evaluate AI outputs for accuracy... ...and quality of reasoning. Collaborate with... ...across undergraduate to PhD-level chemistry... ...Assessment: Shortlisted experts complete an... ...coding, reasoning, STEM, multilinguality, multimodality...For phdContract workRemote workFlexible hours$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,... ...Identify unsafe outputs, hallucinations, reasoning failures, and policy violations. Provide...Contract workSummer workRemote work- ...world’s fastest-growing AI companies accelerating... ...capabilities in thinking, reasoning, coding, agentic... ...multimodality, multilinguality, STEM and frontier knowledge;... ...tuning models or as an evaluation set to benchmark the... ...& offer discussion) Skills: PhD Maths...For phdContract workFor contractorsWork experience placementFreelanceRemote work
$2,000 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract... ...push AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit...Contract workSummer workRemote work$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ...Machine Learning Engineer — Model Evaluation & Experimentation Type:... ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science , or a related STEM field. ~1+ years in a...For phdHourly payWeekly payContract workFor contractorsSummer workRemote work$60 - $120 per hour
...technical talent with leading AI research labs. Headquartered... ...Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract... ...training data through rigorous evaluation. Qualifications Must-Have PhD or advanced degree in Medicine...For phdFull timeContract workSummer workRemote workFlexible hours$235.03k - $352.29k
...and profound opportunity for AI to drive positive change in the... ...will lead the development of evaluation tooling that ensures our technology... ...Education: BS/MS/Phd in Computer Science, Robotics,... ...package. For this position, the reasonably expected base pay range is between...For phdImmediate startFlexible hours$145 per hour
...technical talent with leading AI research labs. Headquartered... .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications... ...Role Responsibilities Evaluate the accuracy and depth of AI... ...content to strengthen reasoning and rigor in model outputs...For phdRemote jobContract workSummer work$80 per hour
...technical talent with leading AI research labs.... ...Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation... ...in your domain. Evaluate and improve AI model performance... ...Must-Have PhD or advanced degree (or equivalent...For phdRemote jobContract workSummer work$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...Remote jobHourly payFlexible hours$75 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics... ...Responsibilities Evaluate and analyze complex... ...Develop structured reasoning approaches for quantitative... ...'s , Master's , or PhD in a STEM field (or...For phdContract workSummer workInternshipRemote workFlexible hours- ...Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the... ...train and assess long-horizon enterprise AI agents. The Opportunity You will work... ...system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped...For phd
$90 per hour
...technical talent with leading AI research labs. Headquartered in... ...and create prompts for model evaluation. Evaluate model designs using... ...and GitHub to improve model reasoning. Qualifications Must-... ...electronics, or mechanical design. PhD or equivalent industry track...For phdContract workSummer workRemote work$84 per hour
...Chemistry and Materials Synthesis Experts to contribute to advanced AI research initiatives. In this... ...characterisation to evaluate complex scientific problems,... ...capable of advanced scientific reasoning. This opportunity is ideal for PhD-level researchers, materials...For phdHourly payTemporary work10 hours per week- ...Design scientific tasks for AI training in Earth... ...capabilities in thinking, reasoning, coding, agentic... ...multimodality, multilinguality, STEM and frontier knowledge;... ...Earth Sciences experts to develop realistic, terminal... ...AI training and evaluation initiative. In this...Contract workPart timeFor contractorsRemote work
$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Science Physicist (PhD) Type: Contract Compensation... ...week Role Responsibilities Evaluate complex research-level physics... ...subfield to enhance AI model reasoning . Design and solve problems...For phdContract workSummer workRemote workFlexible hours$84 per hour
...technical talent with leading AI research labs.... ...Layer Deposition (ALD) Experts Type: Contract... ...high-quality training and evaluation data. Review and evaluate... ...-generated scientific reasoning , catching errors and... ...An advanced degree ( PhD/MS ) or equivalent hands...For phdContract workSummer workRemote work$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Stability Physicist (PhD) Type: Contract Compensation... ...week Role Responsibilities Evaluate research-level physics... ...subfield to enhance AI model reasoning . Design and solve complex...For phdRemote jobContract workSummer work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work$211k - $290.5k
...skilled team of Applied AI/ML Scientists specialize... ...easier to find, easier to evaluate, and easier to buy, and... ...: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous experience... ..., equal opportunity and reasonable accommodation for individuals...For phdWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$167.4k - $310.8k
...makes us Roche.Advances in AI, data, and... ...development of our internal reasoning Large Language Models (... ...training strategies, and evaluation methodologies.Model Capability... ...closely with domain experts.Scalable Systems &... ...years of industry or post-PhD experience with a demonstrated...For phdFull timeLocal areaWorldwideRelocation package$90 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: STEM Researcher — Computational... ...criteria for sound scientific reasoning versus superficial reasoning. Evaluate models by reviewing attempts... ...Must-Have ~ MSc or PhD in a STEM field or equivalent...For phdContract workSummer workImmediate startRemote work$70 - $100 per hour
...technical talent with leading AI research labs. Headquartered... ...Astrophysics & Cosmology Expert Type: Contract Compensation... ...computational problems to evaluate AI capabilities in... ...level training in a relevant STEM field ( MS, PhD, or equivalent ). Proven...For phdContract workSummer workRemote work$211k - $290.5k
...skilled team of Applied AI/ML Scientists specialize... ...recommended: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous... ...building and validating LLM evaluation pipelines, including prompt... ..., equal opportunity and reasonable accommodation for individuals...For phdWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to STEM PhD Expert for AI Reasoning & Evaluation. Be the first to apply!
- fulfillment expert San Francisco, CA
- technology expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- math phd San Francisco, CA
- biology phd San Francisco, CA
- phd engineering San Francisco, CA
- phd intern San Francisco, CA
- phd physics San Francisco, CA
- phd student San Francisco, CA





