Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week

Role Responsibilities

Source original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.
Write scientific prompts based on sourced input to challenge frontier models.
Build grading criteria that define correct answers for scientific tasks.
Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

PhD in mathematics , applied mathematics , computational mathematics , or a closely related field.
Demonstrated depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
Working proficiency in Python or R for scientific computing.
Comfortable with Git/GitHub and running code in Docker .

Preferred

Publications in peer-reviewed journals.
Prior scientific software or research engineering experience.

Start Date

Immediate

Interview Process

Upload your resume and application form.
A 25-minute conversational interview covering your background, experience, and motivations.
Follow up within a few days with next steps and onboarding.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 11 days ago

Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy

Mathematics Expert
$50 per hour
...Remote contract for PhDs in Mathematics, Statistics, or related... ...edge projects with top AI labs while earning $50+... ...rigorous logic. Evaluate AI outputs for accuracy... ...undergraduate to PhD-level math topics. Requirements... ...: Shortlisted experts complete an evaluation...
For phd
Contract work
Remote work
Flexible hours
Turing
San Francisco, CA
5 days ago
Remote Chemistry Expert — AI Training & Evaluation
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...
Suggested
Remote job
Hourly pay
Flexible hours
Prolific
San Francisco, CA
2 days ago
Remote Math & AI Benchmark Designer (PhD)
$50 per hour
A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates...
For phd
Remote job
Hourly pay
Flexible hours
Turing
San Francisco, CA
3 days ago
Research Scientist, Dynamical Systems & AI
...building Developmental Intelligence: AI for predicting how organisms... ...Your responsibility is to rigorously evaluate whether this primitive works, where... ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine...
For phd
Becoming
San Francisco, CA
a month ago
Mathematics Expert - Remote
...Description Job Description Mathematics Expert Job Type: Contractor... ...Mathematics Experts to support an AI-focused project involving... ...You will create, review, and evaluate mathematical content with a strong... ...BSc, MSc, or PhD in Mathematics, Applied Mathematics...
For phd
Remote job
For contractors
YO AI Labs
San Francisco, CA
13 days ago
AI Vulnerability Expert - Fully Remote | Upto $90/hr
$90 per hour
...technical talent with leading AI research labs. Headquartered in... ...with researchers and fellow experts to continually improve the benchmark... ...Must-Have ~ MSc or PhD in a STEM field or equivalent... ...-engineering, security, or AI-evaluation roles. ~ Ability to identify...
For phd
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
14 days ago
Mathematics Expert - Fully Remote | Upto $110/hr Part-time
$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time... ...Review and evaluate research papers in mathematics... ...an active research role as a PhD candidate , postdoctoral researcher...
For phd
Remote job
Contract work
Part time
Summer work
Immediate start
Mercor
San Francisco, CA
20 days ago
AI Consulting Expert - Remote
...Job Description Job Title: AI Consulting Domain Remote Job... ...experienced AI Consulting Domain Experts to contribute their... ...systems. In this role, you will evaluate, review, and refine AI-generated... ...degree (Master's, MBA, JD, or PhD) is a plus. ~ Candidates with...
For phd
Remote job
Part time
For contractors
YO AI Labs
San Francisco, CA
24 days ago
Bilingual Finnish STEM Expert (PhD), AI Safety
$61 - $65 per hour
...About the role We're hiring PhD-level scientists who are proficient... ...Finnish) to help make advanced AI models safer. You'll apply your scientific expertise to evaluate and strengthen how these models... ...workflow. What you'll do Write expert-level prompts in Finnish across...
For phd
Part time
Immediate start
Mercor
San Francisco, CA
27 days ago
AI Research Expert - Fully Remote | Upto $145/hr
$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...
For phd
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
22 days ago
Child Psychiatry Expert - AI Safety
$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...and refine clinician-informed evaluation rubrics for AI chatbot... ...generated conversations and provide expert judgment to calibrate automated... ...Must-Have MD , DO , PhD , PsyD , or equivalent qualification...
For phd
Contract work
Traineeship
Summer work
Remote work
Mercor
San Francisco, CA
14 days ago
Computational STEM Researcher - AI Expert
$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ..., hypothesis testing , and evaluation . Author solutions in... ...Collaborate with researchers and experts to maintain consistent and accurate... ...Must-Have ~ MSc or PhD in a STEM field or computational...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
12 days ago
AI Researcher
Smart Bricks is a frontier AI lab building autonomous reasoning systems that allow capital to discover, evaluate, and transact assets end-to-end. We sit at the... ...stakeholders Nice To Have PhD in Computer Science, Mathematics, Statistics, or a related field First...
For phd
Live in
Smart Bricks
San Francisco, CA
5 days ago
Expert Data Scientist - Transmission Right of Way (ROW) Risk Analytics
$133k - $238k
...emerging risk hotspots Evaluate tradeoffs across... ...closely with subject matter experts in transmission... ...Science, Statistics, Applied Mathematics, Engineering, Computer... ...Desired: Master’s or PhD in a quantitative... ...models Explainable AI / interpretable models...
For phd
Full time
Work at office
Remote work
2 days per week
Pacific Gas And Electric Company
Oakland, CA
1 day ago
AI Software Engineer Expert - Remote
...Job Description Job Title: AI Software Engineering Domain Remote... ...Software Engineering Domain Experts to contribute their technical... ...systems. In this role, you will evaluate, review, and refine AI-... ...degree (Master's, MBA, JD, or PhD) or equivalent professional experience...
For phd
Remote job
Part time
For contractors
YO AI Labs
San Francisco, CA
21 days ago
2027 Summer Intern, MS/PhD, Machine Learning Engineer - Simulator Realism Evaluation
$70 per hour
...and prototyping to build state-of-the-art evaluation tools. Write code within Waymo’s simulator... ...in a graduate program (Master's or PhD) in Computer Science, Computer Engineering... ...driving, simulation, evaluation, and physical AI. We prefer: Knowledge/prior...
For phd
Hourly pay
Full time
Internship
Summer internship
Waymo
San Francisco, CA
3 days ago
Agent Evaluation Infrastructure Engineer
...Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the... ...train and assess long-horizon enterprise AI agents. The Opportunity You will work... ...system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped...
For phd
MaxIT Consulting - Max Corporate Group
San Francisco, CA
29 days ago
Physics PhD - Expert Trainer
$75 - $100 per hour
...Join to apply for the Physics PhD - Expert Trainer role at Handshake Continue with Google... ...and graduates in Physics to join our AI research community. This program brings... ...the test with real-world expertise and evaluate where they excel or fail Get paid for...
For phd
Contract work
Freelance
Internship
H1b
Remote work
Visa sponsorship
10 hours per week
Flexible hours
Handshake
San Francisco, CA
5 days ago
AI Research Scientist
...should apply for this role! About P-1 AI: At P-1 AI, we are building an AI engineer... ...pipeline from data generation to evaluation to product integration. Contribute to both... ...knowledge consolidation. About you: A PhD (or equivalent experience) in Computer...
For phd
Relocation package
P-1 AI
San Francisco, CA
1 day ago
Research Scientist, AI
$150k - $275k
...Research Scientist, AI Substrate is addressing one of the most... ...scientists, engineers, and technical experts building technology for the... ...Preferred Qualifications PhD in Physics, Materials Science, Computer Science, Applied Mathematics, or related field...
For phd
Local area
Substrate Inc
San Francisco, CA
5 days ago
User Research Expert - Evaluator - AI Trainer
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
17 days ago
Frontend Code Evaluator - Expert - AI Trainer
$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...
Contract work
Summer work
Local area
Remote work
Mercor
San Francisco, CA
17 days ago
STEM Specialist - Quantitative Analyst
$75 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics, Biology) Type: Contract... ...Role Responsibilities Evaluate and analyze complex problems... ...Bachelor's , Master's , or PhD in a STEM field (or...
For phd
Contract work
Summer work
Internship
Remote work
Flexible hours
Mercor
San Francisco, CA
7 days ago
Mathematics PhD - AI Researcher
$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Mathematics PhD Researchers Type: Contract... ...AI model training and innovation. Evaluate the accuracy and depth of AI-generated...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
24 days ago
Finance Expert - AI Evaluation
$50 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation:... ...~ An advanced degree (MBA, MS, or PhD ) in finance or a related field and/or...
For phd
Contract work
Summer work
Mercor
San Francisco, CA
20 days ago
Staff Data Scientist
$238k - $302k
...5+ U.S. states. Rigorous behavioral evaluation of the Waymo Driver is a critical part... ...inference, etc. Become an expert in Waymo's evaluation ecosystem for... ...quantitative field (e.g. Statistics, Mathematics, Physics) Either a PhD in a quantitative field and 5+ years...
For phd
Full time
Remote work
Waymo
San Francisco, CA
4 days ago
ML Engineer - Model Evaluation Expert
$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science...
For phd
Hourly pay
Weekly pay
Contract work
For contractors
Summer work
Remote work
Mercor
San Francisco, CA
20 days ago
Software Engineering Evaluator - Expert
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
9 days ago
Technical Lead Manager, Autonomy Evaluation and Intelligence
$235.03k - $352.29k
...most immediate and profound opportunity for AI to drive positive change in the physical... ...this role, you will lead the development of evaluation tooling that ensures our technology scales... ...Qualifications Education: BS/MS/Phd in Computer Science, Robotics, Statistics,...
For phd
Immediate start
Flexible hours
Nuro
San Francisco, CA
22 days ago
Bilingual German Generalist Expert, AI Safety
...speakers (English & German) to help make advanced AI models safer. You'll apply your language fluency and cultural judgment to evaluate and strengthen how these models handle... ...train you on the workflow. What you'll do Write expert-level prompts in German across a range of...
Part time
Immediate start
Mercor
San Francisco, CA
20 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!