Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week

Role Responsibilities

  • Source material from published papers, Kaggle datasets , open-source repositories, or self-designed scenarios.
  • Write scientific prompts based on sourced inputs.
  • Build grading criteria to define correct answers.
  • Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
  • Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
  • Working proficiency in Python for scientific computing.
  • Comfortable with Git/GitHub and running code in Docker .

Preferred

  • Publications in peer-reviewed journals.
  • Prior scientific software or research engineering experience.

Start Date

  • Immediate

Interview Process

  • Upload your resume and application form.
  • A 25-minute conversational interview covering your background, experience, and motivations.
  • Follow up within a few days with next steps and onboarding.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy
  • $50 per hour

     ...Remote contract for PhDs in Mathematics, Statistics, or related...  ...edge projects with top AI labs while earning $50+...  ...rigorous logic. Evaluate AI outputs for accuracy...  ...undergraduate to PhD-level math topics. Requirements...  ...: Shortlisted experts complete an evaluation... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  • $1,350 per month

     ...United States | Canada + 23 more Help evaluate how AI systems approach scientific and clinical...  .... Requirements A completed PhD in a relevant scientific field, or an MD...  .... Company: Senior Science & Clinical Experts - AI Benchmarking Location: Any time... 
    For phd
    Temporary work

    Braintrust

    San Francisco, CA
    8 days ago
  •  ...building a research cohort of senior domain experts across seven specialist tracks —...  ...design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world...  ...) Experience: 10+ years Education: PhD/Doctorate required ML Research Engineer... 
    For phd
    Temporary work

    AfterQuery

    San Francisco, CA
    a month ago
  • $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type...  ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $24 per hour

     ...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part... 
    Suggested
    Part time
    Freelance
    Remote work

    Braintrust

    San Francisco, CA
    1 day ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Machine Learning Expert Type: Contract Compensation...  .... Focus on inference, evaluation, and systems work rather than...  ...or evaluation questions. PhD in ML , CS , or physics... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time...  ...Review and evaluate research papers in mathematics...  ...an active research role as a PhD candidate , postdoctoral researcher... 
    For phd
    Remote job
    Contract work
    Part time
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    8 days ago
  • $70 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:...  ...packages. Familiarity with benchmark or evaluation design. Background in scientific... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $84 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Chemistry & Synthesis Expert Type: Contract Compensation...  ...week Role Responsibilities Evaluate technically complex problems...  ...Qualifications Must-Have PhD in Inorganic Chemistry ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $40 - $75 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Evaluation Rubric Reviewer Type: Contract Compensation: $40–$75/... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the...  ...technology stacks based on system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped environment or... 
    For phd

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    10 days ago
  • $90 - $140 per hour

     ...Help define how frontier AI models reason about mathematics. 1\. Overview We are...  .... Key Responsibilities Expert review: Assess mathematical...  ...research-level problems and evaluation sets in your area of...  ...Qualifications Education: PhD in mathematics, applied mathematics... 
    For phd
    Hourly pay
    Contract work
    Remote work

    Mercor

    San Francisco, CA
    19 days ago
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...with researchers and fellow experts to continually improve the benchmark...  ...Must-Have ~ MSc or PhD in a STEM field or...  ...-engineering, security, or AI-evaluation roles. ~ Ability to identify... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    2 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $80 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...and refine clinician-informed evaluation rubrics for AI chatbot...  ...generated conversations and provide expert judgment to calibrate automated...  ...Must-Have MD , DO , PhD , PsyD , or equivalent qualification... 
    For phd
    Contract work
    Traineeship
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $50 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .... Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation:...  ...~ An advanced degree (MBA, MS, or PhD ) in finance or a related field and/or... 
    For phd
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    21 days ago
  •  ...building Developmental Intelligence: AI for predicting how organisms...  ...Your responsibility is to rigorously evaluate whether this primitive works, where...  ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine... 
    For phd

    Becoming

    San Francisco, CA
    15 days ago
  • $60 - $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ..., hypothesis testing , and evaluation . Author solutions in...  ...Collaborate with researchers and experts to maintain consistent and...  ...Must-Have ~ MSc or PhD in a STEM field or computational... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $60 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract...  ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science... 
    For phd
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $150 per hour

     ...looking for radiology and radiation sciences experts to help make AI models safer in their domain. You'll author and review evaluation tasks that test whether a model can tell a...  ...Master's degree or higher (MD, DO, MSc, or PhD) in radiology, medical physics, radiation science... 
    For phd
    Contract work
    Remote work
    Flexible hours

    AfterQuery

    San Francisco, CA
    14 days ago
  • $75 per hour

     ...technical talent with leading AI research labs....  ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics, Biology) Type: Contract...  ...Role Responsibilities Evaluate and analyze complex problems...  ...Bachelor's , Master's , or PhD in a STEM field (or... 
    For phd
    Contract work
    Summer work
    Internship
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    25 days ago
  • $207k - $300k

     ...machine learning for security, AI-powered security operations,...  ...telemetry; establish benchmarks and evaluation pipelines for robust model...  ...in Statistics, Data Science, Mathematics, Physics, Economics, Operations...  ....Preferred qualifications:PhD in Computer Science, Data Science... 
    For phd
    Shift work

    Google

    San Francisco, CA
    3 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  • $60 - $85 per hour

     ...Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether...  ...into how those models are trained and evaluated. It is about 10 hours a week fully remote...  ...at a glance Openings: 12 legal experts. Time commitment: Approximately 10 hours... 
    Hourly pay
    Full time
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Wintermeyer Ventures

    San Francisco, CA
    1 day ago
  • $250k - $400k

     ...Post-Training, Agents, Evals Fundamental AI Research Institute San Francisco Bay...  ...infrastructure, building RL environments , evaluation harnesses and post-training platforms...  ...in top conferences Requirements: ~ PhD in Comp Sci / ML / Maths preferred ~ Strong... 
    For phd
    Relocation package

    Storm3

    San Francisco, CA
    2 days ago
  • $50 per hour

     ...cutting-edge projects with top AI labs while earning up to $50+/...  ...with rigorous logic. Evaluate AI outputs for accuracy and quality...  ...benchmarks across undergraduate to PhD-level chemistry topics....  .... Assessment: Shortlisted experts complete an evaluation before... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing Inc

    San Francisco, CA
    3 days ago
  • $250k - $350k

     ...Glean:   Glean is the Work AI platform that helps everyone...  ...As the Tech Lead Manager of AI Evaluations, you will lead a team of applied...  ...evaluation sets from expert-curated examples, appropriately...  ...roadmaps across teams. ~ MS/PhD in Computer Science, AI or a related... 
    For phd
    Work at office
    Home office
    Flexible hours

    Glean Work

    San Francisco, CA
    9 days ago
  • $80 - $95 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Electromagnetic Engineering Expert Type: Contract Compensation...  ...to real-world scenarios. Evaluate design trade-offs, performance...  ...'s , Master's , or PhD in Electrical Engineering ,... 
    For phd
    Contract work
    Temporary work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!