AI Research Evaluator (STEM PhD/MS)

$30 - $90 per hour

Temporary

Braintrust

Rate: $30 – $90/hr
Hours: 15 hours / week
Experience: 10+ years
Location: United States | Canada + 23 more

About the Role
We're looking for detail-oriented reviewers with strong STEM backgrounds to support quality control on AI reasoning datasets. This role requires professional fluency in English, as you'll be reviewing and validating English-language technical content.

What You'll Do

Review and validate AI-generated responses in English for accuracy and reasoning quality
Identify errors, inconsistencies, and areas for improvement in STEM-related datasets
Provide detailed feedback to improve model performance
Collaborate with the team in English for project coordination

Requirements

Master's or PhD in a STEM field (Science, Technology, Engineering, or Mathematics)
Professional fluency in English (reading and writing required)
Strong English communication skills
Strong analytical and critical thinking abilities
Attention to detail

Nice to Have

Experience with AI/ML evaluation or data annotation
Background in AI, NLP, or related technical fields

Details

Hours: 10-15 hours per week (flexible schedule)
Duration: 6-month contract
Location: Remote
Compensation: $30 - $90/hr USD (rate depends on location, experience, and educatioanl background).

Company: Leading AI Lab

Apply

Vacancy posted 13 days ago

Similar jobs that could be interesting for youBased on the AI Research Evaluator (STEM PhD/MS) in San Francisco, CA vacancy

PhD in Quantitative Finance, Remote AI Research Evaluator
$50 - $150 per hour
...United States | Canada + 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative... ...communicate complex ideas clearly Nice to Have Research experience (academic or industry, including...
For phd
Contract work
Temporary work
Remote work
Flexible hours
Braintrust
San Francisco, CA
13 days ago
AI Research Engineer
$100k - $300k
...AI Research EngineerCogent Research is the applied AI lab at the heart of Cogent's mission. As an AI Research Engineer, you will work... ...in Computer Science or a closely related technical field (BS, MS, or PhD)Independence: A highly self-directed, proactive, and self-starting...
For phd
Cogent Security, Inc.
San Francisco, CA
5 days ago
Research Engineer
...market — now building a Physical AI team to bring these models to... ...and economy use cases. As a Research Engineer on our Physical AI team... ...and generate training and evaluation datasets from simulation, including... ...reasoning is a plus BS/MS/PhD in Computer Science, Machine Learning...
For phd
Work at office
HEDRA INC
San Francisco, CA
4 days ago
Staff Applied AI/ML Scientist
$246.5k - $339k
...and big box stores. Our highly skilled team of Applied AI/ML Scientists specialize in developing algorithmic... ...team.Great to Haves:Highly recommended: Master's or PhD in Computer Science, Statistics, or related STEM fields.Experience as a tech lead manager or people manager...
For phd
Work experience placement
Work at office
Local area
Remote work
Monday to Friday
Flexible hours
3 days per week
Faire
San Francisco, CA
4 days ago
Staff Data Scientist, Forecasting
$164.7k - $339.08k
...best work. Creating a career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful partner that augments our... ...modeling and applied statistics/econometrics; advanced degree (MS or PhD) preferred.Expertise in at least one scripting language (ideally...
For phd
Work at office
Local area
Relocation
Relocation package
Pinterest
San Francisco, CA
4 days ago
Staff Business Data Scientist - Slack
$172.5k - $260.1k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...Economics, Physics); an advanced degree (MS, PhD) is a strong plus.Advanced proficiency in... ...tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout...
For phd
Full time
Salesforce
San Francisco, CA
6 days ago
Staff Data Scientist
$212k - $265k
...vision, build the scientific frameworks the org uses to evaluate product and business performance, and use AI tooling to accelerate the speed and reach of... ...or blockchain data is a strong plus.Advanced degree (MS, PhD) in a quantitative field preferred.Exceptional communication...
For phd
Full time
Work at office
Local area
Ripple
San Francisco, CA
6 days ago
Sr. Manager, Machine Learning Engineering-Applied Research
$227.87k
...career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful... ...lead and develop a team of machine learning researchers and engineers within the Applied Science... ...technical fields.Academic Credentials: MS/PhD in Computer Science, ML, NLP, Statistics,...
For phd
Temporary work
Work at office
Local area
Immediate start
Remote work
Relocation
Relocation package
Pinterest
San Francisco, CA
7 days ago
Staff Software Engineer - AI Research Infrastructure
$190k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with... ...how Databricks AI Research train, evaluate, and ship models to customers.Serve as... ...infra, and AI systems.What We Look forBS/MS or PhD in Computer Science or related field5+...
For phd
Local area
Worldwide
DataBricks
San Francisco, CA
6 days ago
Staff Machine Learning Engineer (Research Scientist) - DFAI
$249.12k - $367.92k
...are the Data Foundation & AI team within Plaid’s Data... ...to production serving, evaluation, and monitoring. As part... ...that translate research into production impact.... ...and ship.Qualifications:MS: 7-12+ years of industry... ...and production delivery.PhD: 5-9+ years of industry...
For phd
Work experience placement
Work at office
Local area
Immediate start
Plaid Financial
San Francisco, CA
7 days ago
Staff / Principal Product Data Scientist - Slack
$172.5k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ....Perform evidence-based evaluations of the most important drivers... ...Partner closely with Product Researchers to align roadmaps and collaborate... ...); an advanced degree (MS, PhD) is a strong plus.Unleash Your...
For phd
Full time
Salesforce
San Francisco, CA
3 days ago
Applied Scientist, AI
$180k - $260k
...looking for an Applied Scientist, AI to turn messy, high-stakes... ...sits at the intersection of research, product, engineering, and... ...strong baselines, design honest evaluations, run careful error analysis,... ...gives you an edgeYou have an MS or PhD in computer science, statistics...
For phd
Temporary work
Work at office
Monday to Friday
Monday to Thursday
Sprinter Health
San Francisco, CA
7 days ago
Research Engineer
$100k - $300k
Company Overview At Skild AI, we are building the world's first general purpose robotic... .... Position Overview We are hiring Research Engineers to develop scalable robotic systems... ...systems. Preferred Qualifications BS, MS or PhD degree in Computer Science, Robotics, Engineering...
For phd
Full time
Skild AI
San Francisco, CA
4 days ago
Staff Data Scientist, Algorithm, Financial Markets
$200k - $250k
...into real products, and you “get stuff done” end-to-end. You use AI to work smarter and solve problems faster. Here, you’ll tackle... ...qualifications:7+ years industry experience and an advanced degree (PhD or MS) in a quantitative field (e.g. Statistics, Engineering, Sciences...
For phd
Temporary work
Local area
Worldwide
Airwallex
San Francisco, CA
3 days ago
AI Research Scientist - PhD
$55 - $80 per hour
...technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: STEM PhDs and Technical Domain... ...problems in your domain. Evaluate and improve AI model training... ...performance . Qualifications PhD or advanced degree in Medicine...
For phd
Contract work
Summer work
Remote work
mercor
San Francisco, CA
4 days ago
Biostatistician - Clinical Data Specialist
$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...required; 10-25 years preferred. ~ MS in biostatistics or statistics required... ...market (Phases 1-3) trials. Preferred PhD in biostatistics or statistics....
For phd
Hourly pay
Contract work
For contractors
Summer work
Mercor
San Francisco, CA
23 days ago
STEM Research Scientist - Fully Remote | Upto $90/hr
$90 per hour
...technical talent with leading AI research labs. Headquartered in San Francisco... ...Jack Dorsey . Position: STEM Researcher — Computational... ...superficial reasoning. Evaluate models by reviewing attempts and... ...Qualifications Must-Have ~ MSc or PhD in a STEM field or...
For phd
Remote job
Contract work
Summer work
Immediate start
Mercor
San Francisco, CA
7 days ago
Mathematics Researcher - AI Collaborator
$80 - $110 per hour
...technical talent with leading AI research labs. Headquartered in San Francisco... ...Review and evaluate research papers in mathematics... ...in mathematics or a related STEM field. A competitive fellowship... ...an active research role as a PhD candidate , postdoctoral researcher...
For phd
Contract work
Part time
Summer work
Immediate start
Remote work
Mercor
San Francisco, CA
5 days ago
AI Researcher
...Employment Type Full time Department Engineering AI Researcher Job Description At AGI Inc., we’re not... ...Our founder, Div Garg, is a Stanford AI PhD dropout and previously founded MultiOn, a... ...innovation. Qualifications Education: MS or PhD in Computer Science, Machine...
For phd
Full time
Work at office
Maven Ventures
San Francisco, CA
22 hours ago
STEM Specialist - Quantitative Analyst
$75 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics... ...AI model training and evaluation. Develop structured... ...Bachelor's , Master's , or PhD in a STEM field (or currently...
For phd
Contract work
Summer work
Internship
Remote work
Mercor
San Francisco, CA
24 days ago
Staff Research Engineer - Frontier AI, RL & Evaluation
...systems to enhance frontier AI capabilities. About... ...is the world’s leading research accelerator for frontier... ...in coding, reasoning, STEM, multilinguality, multimodality... .... Our environments evaluate and improve AI models on... ...We’re Looking For PhD or Master’s degree in Artificial...
For phd
Contract work
Part time
For contractors
Turing
San Francisco, CA
1 day ago
AI Research Scientist - PhD
$55 - $80 per hour
...technical talent with leading AI research labs. Headquartered in San Francisco... ...Jack Dorsey . Position: STEM PhDs and Technical Domain... ...challenging problems in your domain. Evaluate and improve AI model... ...Must-Have PhD or advanced degree in Medicine...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
9 days ago
Physics Researcher - AI Collaborator
$80 - $110 per hour
...technical talent with leading AI research labs. Headquartered in San Francisco... ...Review and evaluate research papers in Physics for... ...especially mistakes a working PhD physicist would catch. Collaborate... ...institution in Physics or a related STEM field. A competitive...
For phd
Hourly pay
Contract work
Part time
For contractors
Summer work
Remote work
Mercor
San Francisco, CA
5 days ago
Founding AI Research Engineer - Robot Learning
...Origin is building Physical AI for the built world - starting... ...deployment on Jetson AGX Orin. Every research project will have a deployment... ...detection. Design offline evaluation metrics that predict real-... ...constraints. Requirements BS/MS/PhD in CS, Robotics, ML, or...
For phd
Origin
San Francisco, CA
2 days ago
AI Research Scientist
...Back to Careers Selected Role AI Research Scientist Position LevelSenior Level Employment TypeFull-Time LocationSan Francisco... ...AI features. Required Technical Skills & Qualifications PhD or Masters in CS, AI, or related field. Strong publication...
For phd
Remote work
Codiora Tech
San Francisco, CA
3 days ago
Research Engineer - Causal AI
$200k - $225k
...customers to leverage advanced analyticsDocument research and implementation decisions for... ...varied audiencesDomain & Advanced SkillsMS or PhD with significant applied research... ...wayCutting-edge technology: Work with advanced AI/ML algorithms, composite AI solutions, private...
For phd
Alembic
San Francisco, CA
3 days ago
AI Research Engineer
...Build research and develop AI systems that enhance human agency. Focus on ethical AI, user privacy, and meaningful human-AI collaboration. What... ...and responsible AI development Requirements PhD or equivalent in Computer Science, AI, or related field Strong...
For phd
Home office
Flexible hours
Akolades, Inc.
San Francisco, CA
3 days ago
ML Research Engineer — Inference & GPU Kernels
...We're building a research cohort of senior domain experts in ML inference and GPU kernel... ...deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world... ...AI Experience: 6–10 years Education: PhD/Doctorate, or Master's with a strong research...
For phd
Temporary work
AfterQuery
San Francisco, CA
1 day ago
AI Research Scientist
$100k - $300k
...About Cogent Cogent is an Applied AI Lab building the next generation of AI agents... ...stay at the cutting edge, we blend frontier research with real-world execution. Alongside our... ...generation problems Education: An MSc or PhD/DPhil in Computer Science or a closely...
For phd
Cogent Security
San Francisco, CA
2 days ago
AI Research Engineer
$200k - $400k
...Do you have experience in AI research across LLMs, agents, evaluations, benchmarking, AI safety, alignment, agent understanding, RL environments or post-training... ...improve model reasoning and agent performance. Fresh PhD graduates can be considered. Salary on offer is $200,00...
For phd
Internship
TTN Talent
San Francisco, CA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Research Evaluator (STEM PhD/MS). Be the first to apply!