Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week

Role Responsibilities

Source original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.
Write scientific prompts based on sourced input to challenge frontier models.
Build grading criteria that define correct answers for scientific tasks.
Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

PhD in mathematics , applied mathematics , computational mathematics , or a closely related field.
Demonstrated depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
Working proficiency in Python or R for scientific computing.
Comfortable with Git/GitHub and running code in Docker .

Preferred

Publications in peer-reviewed journals.
Prior scientific software or research engineering experience.

Start Date

Immediate

Interview Process

Upload your resume and application form.
A 25-minute conversational interview covering your background, experience, and motivations.
Follow up within a few days with next steps and onboarding.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 24 days ago

Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy

STEM PhD Expert for AI Reasoning & Evaluation
$50 - $150 per hour
...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where... ...a closely related quantitative subdomain such as Mathematics or Physics Strong analytical and critical-thinking...
For phd
Contract work
Temporary work
Remote work
Flexible hours
Braintrust
San Francisco, CA
a month ago
Behavioral Health Expert, AI Safety and Model Evaluation
$45 - $70 per hour
..., and Social Science Help a leading AI lab ensure its models respond to people... ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle... ...example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required. ~...
For phd
Contract work
Part time
Weekday work
Mercor
San Francisco, CA
a month ago
Senior Science & Clinical Experts - AI Benchmarking
$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable... ...behind your assessment. Requirements A completed PhD in a relevant scientific field, or an MD with a clinical specialization...
For phd
Braintrust
San Francisco, CA
3 days ago
Mathematics Expert
$50 per hour
...Remote contract for PhDs in Mathematics, Statistics, or related... ...edge projects with top AI labs while earning $50+... ...rigorous logic. Evaluate AI outputs for accuracy... ...undergraduate to PhD-level math topics. Requirements... ...: Shortlisted experts complete an evaluation...
For phd
Contract work
Remote work
Flexible hours
Turing
San Francisco, CA
3 days ago
Senior Domain Expert — Multi-Discipline AI Research Program
...building a research cohort of senior domain experts across seven specialist tracks —... ...design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world... ...) Experience: 10+ years Education: PhD/Doctorate required ML Research Engineer...
For phd
Temporary work
AfterQuery
San Francisco, CA
29 days ago
QuickBooks Accounting Expert - AI Evaluation
$24 per hour
...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part...
Part time
Freelance
Remote work
Braintrust
San Francisco, CA
1 day ago
ML Research Engineer - PyTorch Expert
$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Machine Learning Expert Type: Contract Compensation... .... Focus on inference, evaluation, and systems work rather than... ...or evaluation questions. PhD in ML , CS , or physics...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
20 days ago
2027 Summer Intern, MS/PhD, Machine Learning Engineer - Simulator Realism Evaluation
$70 per hour
...and prototyping to build state-of-the-art evaluation tools. Write code within Waymo’s simulator... ...in a graduate program (Master's or PhD) in Computer Science, Computer Engineering... ...driving, simulation, evaluation, and physical AI. We prefer: Knowledge/prior...
For phd
Hourly pay
Full time
Internship
Summer internship
Waymo
San Francisco, CA
1 day ago
Research Scientist - Applied AI
$160k - $250k
...What Granica does Granica is an AI research and systems company building... ...new model architectures, evaluate on live datasets, and publish results... ...efficient learning. What you’ll bring PhD in Machine Learning, Statistics, Applied Mathematics, or a related field with...
For phd
Flexible hours
Granica
San Francisco, CA
1 day ago
Remote Math & AI Benchmark Designer (PhD)
$50 per hour
A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates...
For phd
Remote job
Hourly pay
Flexible hours
Turing
San Francisco, CA
1 day ago
Mathematics Domain Expert
$90 - $140 per hour
...Help define how frontier AI models reason about mathematics. 1\. Overview We are... .... Key Responsibilities Expert review: Assess mathematical... ...research-level problems and evaluation sets in your area of... ...Qualifications Education: PhD in mathematics, applied mathematics...
For phd
Hourly pay
Contract work
Remote work
Mercor
San Francisco, CA
14 days ago
Biology PhD Expert - AI Annotation
$40 - $90 per hour
...States | Canada + 7 more We are looking for PhD-qualified biology experts to contribute their scientific expertise... ...annotation project supporting a leading AI lab. Expert annotation helps AI researchers develop and evaluate how models handle specialized scientific...
For phd
Hourly pay
Contract work
Temporary work
For contractors
10 hours per week
Braintrust
San Francisco, CA
8 days ago
Scientific Computing Research Expert
$300 per month
...Author research-grade AI evaluation tasks from your own computational work. Open to PhD-level and PhD-pursuing researchers across... ..., geosciences, ocean), Mathematical sciences (applied mathematics,... ...you can resubmit. All accepted experts undergo standard background and...
For phd
Contract work
For contractors
Flexible hours
AfterQuery
San Francisco, CA
a month ago
Computational Statistics Expert - PhD
$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:... ...packages. Familiarity with benchmark or evaluation design. Background in scientific...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
27 days ago
Mathematics Expert - Fully Remote | Upto $110/hr Part-time
$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time... ...Review and evaluate research papers in mathematics... ...an active research role as a PhD candidate , postdoctoral researcher...
For phd
Remote job
Contract work
Part time
Summer work
Immediate start
Mercor
San Francisco, CA
3 days ago
Mathematics Expert
...solve challenging physics problems for AI model evaluation. About Turing Turing is one of the... ...your deep analytical skills and mathematics expertise. The ideal candidate possesses... ...engineering entrance levels through graduate and PhD-level concepts—and the ability to break...
For phd
Part time
For contractors
Remote work
Turing
San Francisco, CA
8 days ago
AI Research Expert - Fully Remote | Upto $145/hr
$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...
For phd
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
5 days ago
Finance Expert - AI Evaluation
$50 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation:... ...~ An advanced degree (MBA, MS, or PhD ) in finance or a related field and/or...
For phd
Contract work
Summer work
Mercor
San Francisco, CA
16 days ago
Mathematics Expert
$75 - $125 per hour
...for mathematicians to help train and evaluate AI models on advanced mathematical reasoning. You will write problems... ...Review problems written by other experts for correctness, clarity and originality... ...Qualifications Master’s or PhD in mathematics, or a Bachelor’s plus...
For phd
Hourly pay
Contract work
For contractors
Remote work
RemoExperts
San Francisco, CA
a month ago
Mathematics Expert
$125 per hour
...Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up MATHEMATICS EXPERT Sign up now Up to $125/hr... ...or applied mathematics to evaluate AI-generated content and provide... ...three of the following: Degree — PhD in Mathematics (pure or...
For phd
Contract work
Part time
Remote work
Flexible hours
Handshake
San Francisco, CA
a month ago
Math Expert
$75 per hour
...Job seekers Career centers AI Skills Studio Handshake AI... ...Research Log in Sign up MATH EXPERT Sign up now Up to $75/hr... .... You’ll use your advanced mathematical training to evaluate AI-generated content and provide... ...currently enrolled in a PhD program or in postdoctoral...
For phd
Hourly pay
Full time
Contract work
Part time
Remote work
Flexible hours
Handshake
San Francisco, CA
a month ago
Mathematics Expert (MSc./PhD)
$60 - $120 per hour
...Required Skills Mathematics Python Programming... ...a data lab that helps AI labs & Enterprises train... ...agents. We provide frontier evaluations and reinforcement... ...sources and vets domain experts for our data platform that... ...Mathematics Expert (MSc. or PhD) Pay: $80–$120/hour...
For phd
Part time
For contractors
Immediate start
Remote work
Flexible hours
micro1
San Francisco, CA
21 days ago
ML Engineer - Model Evaluation Expert
$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science...
For phd
Hourly pay
Weekly pay
Contract work
For contractors
Summer work
Remote work
Mercor
San Francisco, CA
6 days ago
Radiologist / Radiation Sciences Expert (AI Safety)
$150 per hour
...looking for radiology and radiation sciences experts to help make AI models safer in their domain. You'll author and review evaluation tasks that test whether a model can tell a... ...Master's degree or higher (MD, DO, MSc, or PhD) in radiology, medical physics, radiation science...
For phd
Contract work
Remote work
Flexible hours
AfterQuery
San Francisco, CA
8 days ago
Staff Research Data Scientist
$207k - $300k
...machine learning for security, AI-powered security operations,... ...telemetry; establish benchmarks and evaluation pipelines for robust model... ...in Statistics, Data Science, Mathematics, Physics, Economics, Operations... ....Preferred qualifications:PhD in Computer Science, Data Science...
For phd
Shift work
Google
San Francisco, CA
3 days ago
Inorganic Chemistry PhD - Synthesis Expert - AI Trainer
$84 per hour
...technical talent with leading AI research labs. Headquartered in... ...Chemistry & Synthesis Expert Type: Contract Compensation... ...week Role Responsibilities Evaluate technically complex problems... ...Qualifications Must-Have PhD in Inorganic Chemistry ,...
For phd
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
3 days ago
Mathematics Expert (Master’s/Ph.D.)
...solve advanced math problems to evaluate language models. About... ...research accelerator for frontier AI labs and a trusted partner for... ...models by applying advanced mathematical reasoning, problem-solving, computational... ...exams, as well as graduate or PhD-level programs. You...
For phd
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
a month ago
Game Developer (Godot Expert)
...game development projects. A relevant master's degree or PhD in Computer Science, Game Development, or a related field.... ...Previous Human Data experience, such as data annotation, RLHF, or AI model evaluation. Experience with multiplayer games, game physics, or UI/UX...
For phd
Part time
micro1
San Francisco, CA
2 days ago
Board Game Reasoning Expert (AI Training & Evaluation)
...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the... ...We are seeking Board Game Reasoning Experts to help train and evaluate next-generation... ...'s degree in Computer Science, Mathematics, Cognitive Science, Game Design,...
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
a month ago
Remote Chemistry Expert (PhD)
$50 per hour
...cutting-edge projects with top AI labs while earning up to $50+/... ...with rigorous logic. Evaluate AI outputs for accuracy and quality... ...benchmarks across undergraduate to PhD-level chemistry topics.... .... Assessment: Shortlisted experts complete an evaluation before...
For phd
Contract work
Remote work
Flexible hours
Turing Inc
San Francisco, CA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!