Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week

Role Responsibilities

Source material from published papers, Kaggle datasets , open-source repositories, or self-designed scenarios.
Write scientific prompts based on sourced inputs.
Build grading criteria to define correct answers.
Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
Working proficiency in Python for scientific computing.
Comfortable with Git/GitHub and running code in Docker .

Preferred

Publications in peer-reviewed journals.
Prior scientific software or research engineering experience.

Start Date

Immediate

Interview Process

Upload your resume and application form.
A 25-minute conversational interview covering your background, experience, and motivations.
Follow up within a few days with next steps and onboarding.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 7 days ago

Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy

Mathematics Expert
$50 per hour
...Remote contract for PhDs in Mathematics, Statistics, or related... ...edge projects with top AI labs while earning $50+... ...rigorous logic. Evaluate AI outputs for accuracy... ...undergraduate to PhD-level math topics. Requirements... ...: Shortlisted experts complete an evaluation...
For phd
Contract work
Remote work
Flexible hours
Turing
San Francisco, CA
4 days ago
Mathematics Expert - Remote
...Description Job Description Mathematics Expert Job Type: Contractor... ...Mathematics Experts to support an AI-focused project involving... ...You will create, review, and evaluate mathematical content with a strong... ...BSc, MSc, or PhD in Mathematics, Applied Mathematics...
For phd
Remote job
For contractors
YO AI Labs
San Francisco, CA
12 days ago
AI Vulnerability Expert - Fully Remote | Upto $90/hr
$90 per hour
...technical talent with leading AI research labs. Headquartered in... ...with researchers and fellow experts to continually improve the benchmark... ...Must-Have ~ MSc or PhD in a STEM field or equivalent... ...-engineering, security, or AI-evaluation roles. ~ Ability to identify...
For phd
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
13 days ago
Mathematics Expert - Fully Remote | Upto $110/hr Part-time
$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time... ...Review and evaluate research papers in mathematics... ...an active research role as a PhD candidate , postdoctoral researcher...
For phd
Remote job
Contract work
Part time
Summer work
Immediate start
Mercor
San Francisco, CA
19 days ago
Bilingual Portuguese STEM Expert (PhD), AI Safety
$50 - $54 per hour
...About the role We're hiring PhD-level scientists who are proficient... ...) to help make advanced AI models safer. You'll apply your scientific expertise to evaluate and strengthen how these models... ...workflow. What you'll do Write expert-level prompts in Portuguese across...
For phd
Part time
Immediate start
Mercor
San Francisco, CA
26 days ago
AI Consulting Expert - Remote
...Job Description Job Title: AI Consulting Domain Remote Job... ...experienced AI Consulting Domain Experts to contribute their... ...systems. In this role, you will evaluate, review, and refine AI-generated... ...degree (Master's, MBA, JD, or PhD) is a plus. ~ Candidates with...
For phd
Remote job
Part time
For contractors
YO AI Labs
San Francisco, CA
23 days ago
AI Research Expert - Fully Remote | Upto $145/hr
$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...
For phd
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
21 days ago
Agent Evaluation Infrastructure Engineer
...Primarily On-site We are seeking an Agent Evaluation Infrastructure Engineer to build the... ...train and assess long-horizon enterprise AI agents. The Opportunity You will work... ...system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped...
For phd
MaxIT Consulting - Max Corporate Group
San Francisco, CA
28 days ago
Child Psychiatry Expert - AI Safety
$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...and refine clinician-informed evaluation rubrics for AI chatbot... ...generated conversations and provide expert judgment to calibrate automated... ...Must-Have MD , DO , PhD , PsyD , or equivalent qualification...
For phd
Contract work
Traineeship
Summer work
Remote work
Mercor
San Francisco, CA
13 days ago
Computational STEM Researcher - AI Expert
$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ..., hypothesis testing , and evaluation . Author solutions in... ...Collaborate with researchers and experts to maintain consistent and accurate... ...Must-Have ~ MSc or PhD in a STEM field or computational...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
11 days ago
Data Scientist
$200k - $260k
...- two of our co-founders were PhD data scientists at Robinhood. Since... ...graduate studies in physics, mathematics, bioengineering, economics,... ...FluencyRapidly learn and adopt emerging AI tools and workflows to accelerate analysisCritically evaluate AI-generated outputs for...
For phd
Flexible hours
Parafin Inc
San Francisco, CA
3 days ago
Scala Expert - AI Evaluation
$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Expert Software Engineer – Scala / COBOL / ABAP... ...Role Responsibilities Evaluate complex technical tasks using deep language...
Hourly pay
Weekly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
San Francisco, CA
more than 2 months ago
Expert Data Scientist - Transmission Right of Way (ROW) Risk Analytics
$133k - $238k
...emerging risk hotspots Evaluate tradeoffs across... ...closely with subject matter experts in transmission... ...Science, Statistics, Applied Mathematics, Engineering, Computer... ...Desired: Master’s or PhD in a quantitative... ...models Explainable AI / interpretable models...
For phd
Full time
Work at office
Remote work
2 days per week
Pacific Gas And Electric Company
Oakland, CA
1 day ago
AI Software Engineer Expert - Remote
...Job Description Job Title: AI Software Engineering Domain Remote... ...Software Engineering Domain Experts to contribute their technical... ...systems. In this role, you will evaluate, review, and refine AI-... ...degree (Master's, MBA, JD, or PhD) or equivalent professional experience...
For phd
Remote job
Part time
For contractors
YO AI Labs
San Francisco, CA
20 days ago
Remote Chemistry Expert (PhD)
$50 per hour
...cutting-edge projects with top AI labs while earning up to $50+/... ...with rigorous logic. Evaluate AI outputs for accuracy and quality... ...benchmarks across undergraduate to PhD-level chemistry topics.... .... Assessment: Shortlisted experts complete an evaluation before...
For phd
Contract work
Remote work
Flexible hours
Turing Inc
San Francisco, CA
4 days ago
Research Scientist, Dynamical Systems & AI
...building Developmental Intelligence: AI for predicting how organisms... ...Your responsibility is to rigorously evaluate whether this primitive works, where... ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine...
For phd
Becoming
San Francisco, CA
a month ago
AI Research Scientist
...should apply for this role! About P-1 AI: At P-1 AI, we are building an AI engineer... ...pipeline from data generation to evaluation to product integration. Contribute to both... ...knowledge consolidation. About you: A PhD (or equivalent experience) in Computer...
For phd
Relocation package
P-1 AI
San Francisco, CA
19 hours ago
Physics PhD - Expert Trainer
$75 - $100 per hour
...Join to apply for the Physics PhD - Expert Trainer role at Handshake Continue with Google... ...and graduates in Physics to join our AI research community. This program brings... ...the test with real-world expertise and evaluate where they excel or fail Get paid for...
For phd
Contract work
Freelance
Internship
H1b
Remote work
Visa sponsorship
10 hours per week
Flexible hours
Handshake
San Francisco, CA
4 days ago
Research Scientist, AI
$150k - $275k
...Research Scientist, AI Substrate is addressing one of the most... ...scientists, engineers, and technical experts building technology for the... ...Preferred Qualifications PhD in Physics, Materials Science, Computer Science, Applied Mathematics, or related field...
For phd
Local area
Substrate Inc
San Francisco, CA
4 days ago
User Research Expert - Evaluator - AI Trainer
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
16 days ago
Frontend Code Evaluator - Expert - AI Trainer
$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...
Contract work
Summer work
Local area
Remote work
Mercor
San Francisco, CA
16 days ago
STEM Specialist - Quantitative Analyst
$75 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics, Biology) Type: Contract... ...Role Responsibilities Evaluate and analyze complex problems... ...Bachelor's , Master's , or PhD in a STEM field (or...
For phd
Contract work
Summer work
Internship
Remote work
Flexible hours
Mercor
San Francisco, CA
6 days ago
Finance Expert - AI Evaluation
$50 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation:... ...~ An advanced degree (MBA, MS, or PhD ) in finance or a related field and/or...
For phd
Contract work
Summer work
Mercor
San Francisco, CA
19 days ago
Mathematics PhD - AI Researcher
$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Mathematics PhD Researchers Type: Contract... ...AI model training and innovation. Evaluate the accuracy and depth of AI-generated...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
23 days ago
ML Engineer - Model Evaluation Expert
$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science...
For phd
Hourly pay
Weekly pay
Contract work
For contractors
Summer work
Remote work
Mercor
San Francisco, CA
19 days ago
Software Engineering Evaluator - Expert
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...
Contract work
Summer work
Work at office
Remote work
Mercor
San Francisco, CA
8 days ago
Technical Lead Manager, Autonomy Evaluation and Intelligence
$235.03k - $352.29k
...most immediate and profound opportunity for AI to drive positive change in the physical... ...this role, you will lead the development of evaluation tooling that ensures our technology scales... ...Qualifications Education: BS/MS/Phd in Computer Science, Robotics, Statistics,...
For phd
Immediate start
Flexible hours
Nuro
San Francisco, CA
21 days ago
Software Engineer, Perception Scaling Evaluation
$170k - $216k
...high-scale, mission-critical automation and evaluation frameworks that establish the "ultimate... ...experience ~2+ years of experience in industrial AI applications involving the creation,... ...efficient code We Prefer MS or PhD in Computer Science, Robotics, similar technical...
For phd
Full time
Remote work
Waymo
San Francisco, CA
more than 2 months ago
Software Engineer - AI Evaluation
$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Science, and Systems Design Experts Type: Contract... ...Role Responsibilities Evaluate LLM-generated responses to coding... ...Must-Have BS, MS, or PhD in Computer Science or a closely...
For phd
Full time
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
more than 2 months ago
Machine Learning Engineer, Simulation Evaluation
$213k - $263k
...and state-of-the-art Generative AI to create a training ground... ...the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you mathematically prove that a virtual world is... ...Bachelor's, Master's, or PhD in computer science, machine learning...
For phd
Full time
Remote work
Waymo
San Francisco, CA
more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!