Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

STEM PhD Expert for AI Reasoning & Evaluation

$50 - $150 per hour
Temporary

Braintrust

  • Rate: $50 – $150/hr
  • Hours: 35 hours / week
  • Experience: 3 - 5 years
  • Location: United States | Canada + 6 more
  • We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge models reason, answer, and improve. You'll review AI-generated content in your field, identify where the model gets things right or wrong, and help raise the quality bar on technical reasoning.

    This is a short-term engagement running through the end of June, with potential to extend depending on project needs.

    Key Responsibilities

    You may contribute your expertise by:

    • Assessing the factuality and relevance of domain-specific text produced by AI models
    • Crafting and answering questions related to Machine Learning and AI
    • Evaluating and ranking domain-specific responses generated by AI models

    What We're Looking For

    • A PhD (completed or in final stages) in one of the following fields: Machine Learning / AI, Computer Science, Engineering, Statistics, or a closely related quantitative subdomain such as Mathematics or Physics
    • Strong analytical and critical-thinking skills, with the ability to spot subtle errors in technical reasoning
    • Fluent written English and the ability to communicate complex ideas clearly

    Nice to Have

    • Research experience (academic or industry)
    • Prior experience with data annotation or AI model evaluation
    • Experience reviewing or publishing research papers

    Compensation

    Up to $150/hr , depending on your area of expertise, depth of experience, and assessment performance.

    Location

    This role is fully remote. We are currently accepting applicants based in:

    United States, Canada, Puerto Rico, Mexico, United Kingdom, Australia, New Zealand, and Argentina.

    Company: Outlier

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the STEM PhD Expert for AI Reasoning & Evaluation in San Francisco, CA vacancy
  • $45 - $70 per hour

     ...Social Science Help a leading AI lab ensure its models...  ...is seeking behavioral health experts to help evaluate and improve how its AI models...  ...LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required....  ..., and to explain the reasoning behind a professional judgment... 
    For phd
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    1 day ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    For phd
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $84 per hour

     ...technical talent with leading AI research labs....  ...Chemistry & Synthesis Expert Type: Contract...  ...Role Responsibilities Evaluate technically complex problems...  ...evaluations, and reasoning frameworks. Identify...  ...Qualifications Must-Have PhD in Inorganic... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $164.5k - $219k

     ...Information Job Title Expert Senior Manager, Data...  ...to work with major AI ecosystem partners through...  ...to prompt design, evaluation and output quality assuranceDevelop...  ..., or PhD in a technical fieldBackground...  ...require a good-faith, reasonable salary range to be included... 
    For phd
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    6 days ago
  • $50 per hour

     ...projects with top AI labs while earning...  ...(e.g., multi-step reasoning, abstraction, symbolic...  ...with rigorous logic.Evaluate AI outputs for...  ...across undergraduate to PhD-level math topics....  ...Assessment: Shortlisted experts complete an...  ...coding, reasoning, STEM, multilinguality, multimodality... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Clinician (MD/DO) - HLS Expert Pool Type: Contract...  ...model response grading. Evaluate clinical dialogues for accuracy...  ...advice. Annotate clinical reasoning by recording case work-throughs... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $50 per hour

     ...projects with top AI labs while earning...  ...rigorous logic. Evaluate AI outputs for accuracy...  ...and quality of reasoning. Collaborate with...  ...across undergraduate to PhD-level chemistry...  ...Assessment: Shortlisted experts complete an...  ...coding, reasoning, STEM, multilinguality, multimodality... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    5 hours ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,...  ...Identify unsafe outputs, hallucinations, reasoning failures, and policy violations. Provide... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  •  ...world’s fastest-growing AI companies accelerating...  ...capabilities in thinking, reasoning, coding, agentic...  ...multimodality, multilinguality, STEM and frontier knowledge;...  ...tuning models or as an evaluation set to benchmark the...  ...& offer discussion) Skills: PhD Maths... 
    For phd
    Contract work
    For contractors
    Work experience placement
    Freelance
    Remote work

    Turing

    San Francisco, CA
    1 day ago
  • $2,000 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract...  ...push AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $60 - $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Machine Learning Engineer — Model Evaluation & Experimentation Type:...  ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science , or a related STEM field. ~1+ years in a... 
    For phd
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $60 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract...  ...training data through rigorous evaluation. Qualifications Must-Have PhD or advanced degree in Medicine... 
    For phd
    Full time
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    2 days ago
  • $235.03k - $352.29k

     ...and profound opportunity for AI to drive positive change in the...  ...will lead the development of evaluation tooling that ensures our technology...  ...Education: BS/MS/Phd in Computer Science, Robotics,...  ...package. For this position, the reasonably expected base pay range is between... 
    For phd
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    a month ago
  • $145 per hour

     ...technical talent with leading AI research labs. Headquartered...  .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications...  ...Role Responsibilities Evaluate the accuracy and depth of AI...  ...content to strengthen reasoning and rigor in model outputs... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    6 days ago
  • $80 per hour

     ...technical talent with leading AI research labs....  ...Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation...  ...in your domain. Evaluate and improve AI model performance...  ...Must-Have PhD or advanced degree (or equivalent... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    6 days ago
  • $60 per hour

    Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    San Francisco, CA
    1 day ago
  • $75 per hour

     ...technical talent with leading AI research labs....  ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics...  ...Responsibilities Evaluate and analyze complex...  ...Develop structured reasoning approaches for quantitative...  ...'s , Master's , or PhD in a STEM field (or... 
    For phd
    Contract work
    Summer work
    Internship
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    21 days ago
  •  ...Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the...  ...train and assess long-horizon enterprise AI agents. The Opportunity You will work...  ...system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped... 
    For phd

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    13 days ago
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...and create prompts for model evaluation. Evaluate model designs using...  ...and GitHub to improve model reasoning. Qualifications Must-...  ...electronics, or mechanical design. PhD or equivalent industry track... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $84 per hour

     ...Chemistry and Materials Synthesis Experts to contribute to advanced AI research initiatives. In this...  ...characterisation to evaluate complex scientific problems,...  ...capable of advanced scientific reasoning. This opportunity is ideal for PhD-level researchers, materials... 
    For phd
    Hourly pay
    Temporary work
    10 hours per week

    Mercor

    San Francisco, CA
    1 day ago
  •  ...Design scientific tasks for AI training in Earth...  ...capabilities in thinking, reasoning, coding, agentic...  ...multimodality, multilinguality, STEM and frontier knowledge;...  ...Earth Sciences experts to develop realistic, terminal...  ...AI training and evaluation initiative. In this... 
    Contract work
    Part time
    For contractors
    Remote work

    Turing

    San Francisco, CA
    1 day ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Science Physicist (PhD) Type: Contract Compensation...  ...week Role Responsibilities Evaluate complex research-level physics...  ...subfield to enhance AI model reasoning . Design and solve problems... 
    For phd
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    15 days ago
  • $84 per hour

     ...technical talent with leading AI research labs....  ...Layer Deposition (ALD) Experts Type: Contract...  ...high-quality training and evaluation data. Review and evaluate...  ...-generated scientific reasoning , catching errors and...  ...An advanced degree ( PhD/MS ) or equivalent hands... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Stability Physicist (PhD) Type: Contract Compensation...  ...week Role Responsibilities Evaluate research-level physics...  ...subfield to enhance AI model reasoning . Design and solve complex... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    20 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $211k - $290.5k

     ...skilled team of Applied AI/ML Scientists specialize...  ...easier to find, easier to evaluate, and easier to buy, and...  ...: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous experience...  ..., equal opportunity and reasonable accommodation for individuals... 
    For phd
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    2 days ago
  • $167.4k - $310.8k

     ...makes us Roche.Advances in AI, data, and...  ...development of our internal reasoning Large Language Models (...  ...training strategies, and evaluation methodologies.Model Capability...  ...closely with domain experts.Scalable Systems &...  ...years of industry or post-PhD experience with a demonstrated... 
    For phd
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    South San Francisco, CA
    2 days ago
  • $90 per hour

     ...technical talent with leading AI research labs....  ...Dorsey . Position: STEM Researcher — Computational...  ...criteria for sound scientific reasoning versus superficial reasoning. Evaluate models by reviewing attempts...  ...Must-Have ~ MSc or PhD in a STEM field or equivalent... 
    For phd
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $70 - $100 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Astrophysics & Cosmology Expert Type: Contract Compensation...  ...computational problems to evaluate AI capabilities in...  ...level training in a relevant STEM field ( MS, PhD, or equivalent ). Proven... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  • $211k - $290.5k

     ...skilled team of Applied AI/ML Scientists specialize...  ...recommended: Master's or PhD in Computer Science, Statistics, or related STEM fields.Previous...  ...building and validating LLM evaluation pipelines, including prompt...  ..., equal opportunity and reasonable accommodation for individuals... 
    For phd
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to STEM PhD Expert for AI Reasoning & Evaluation. Be the first to apply!