App
Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor

San Francisco, CA

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week

Role Responsibilities

  • Source material from published papers, Kaggle datasets , open-source repositories, or self-designed scenarios.
  • Write scientific prompts based on sourced inputs.
  • Build grading criteria to define correct answers.
  • Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
  • Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
  • Working proficiency in Python for scientific computing.
  • Comfortable with Git/GitHub and running code in Docker .

Preferred

  • Publications in peer-reviewed journals.
  • Prior scientific software or research engineering experience.

Start Date

  • Immediate

Interview Process

  • Upload your resume and application form.
  • A 25-minute conversational interview covering your background, experience, and motivations.
  • Follow up within a few days with next steps and onboarding.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply
Vacancy posted 28 days ago
Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy
  • STEM PhD Expert for AI Reasoning & Evaluation

    $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where...  ...a closely related quantitative subdomain such as Mathematics or Physics Strong analytical and critical-thinking... 
    For phd
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    6 days ago
  • Behavioral Health Expert, AI Safety and Model Evaluation

    $45 - $70 per hour

     ..., and Social Science Help a leading AI lab ensure its models respond to people...  ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle...  ...example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required. ~... 
    For phd
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    6 days ago
  • Mathematics Expert

    $50 per hour

     ...OverviewRemote contract for PhDs in Mathematics, Statistics, or related...  ...edge projects with top AI labs while earning $50+...  ...with rigorous logic.Evaluate AI outputs for accuracy...  ...undergraduate to PhD-level math topics....  ...Assessment: Shortlisted experts complete an evaluation... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    16 hours ago
  • Adolescent Mental Health AI Safety Expert
    Mercor is partnering with a leading AI research organisation to develop a clinician-informed benchmark for evaluating how AI companion chatbots respond to adolescents with mental...  ...rubrics for AI conversations. We seek MD/DO/PhD/PsyD or equivalent with child/adolescent... 
    For phd

    Mercor

    San Francisco, CA
    16 hours ago
  • Database Systems Evaluation Expert

    $2,200 per month

     ...world tasks that test how well AI agents handle database...  ...regressions where relevant. Evaluate performance measures such as latency...  ...experience, or a database-systems PhD. Deep experience with...  ...task after selection Selected experts will complete one task, with... 
    For phd
    Temporary work
    Immediate start

    Mercor

    San Francisco, CA
    6 days ago
  • Mathematics Expert - Fully Remote | Upto $110/hr Part-time

    $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time...  ...Review and evaluate research papers in mathematics...  ...an active research role as a PhD candidate , postdoctoral researcher... 
    For phd
    Remote job
    Contract work
    Part time
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    10 days ago
  • AI Consulting Expert - Remote
     ...Job Description Job Title: AI Consulting Domain Remote Job...  ...experienced AI Consulting Domain Experts to contribute their...  ...systems. In this role, you will evaluate, review, and refine AI-generated...  ...degree (Master's, MBA, JD, or PhD) is a plus. ~ Candidates with... 
    For phd
    Remote job
    Part time
    For contractors

    YO AI Labs

    San Francisco, CA
    7 days ago
  • Computational Statistics Expert - PhD

    $70 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:...  ...packages. Familiarity with benchmark or evaluation design. Background in scientific... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  • Scientific Computing Research Expert

    $300 per month

     ...Author research-grade AI evaluation tasks from your own computational work. Open to PhD-level and PhD-pursuing researchers across...  ..., geosciences, ocean), Mathematical sciences (applied mathematics,...  ...you can resubmit. All accepted experts undergo standard background and... 
    For phd
    Contract work
    Temporary work
    For contractors
    Flexible hours

    AfterQuery

    San Francisco, CA
    6 days ago
  • Scientific Computing Expert — Mathematics PHD - $300/Approved Task

    $300 per month

     ...Design and build computational mathematics tasks for AI evaluation. About Turing Turing is one of the world...  ...the Role We are seeking Mathematics experts to develop realistic, terminal-based...  ...implement, test, and validate computational algorithms. Skills: PhD Maths... 
    For phd
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    6 days ago
  • AI Research Expert - Fully Remote | Upto $145/hr

    $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type...  ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    12 days ago
  • Mathematics Expert
     ...and solve advanced physics problems for AI model evaluation. About Turing Turing is one of...  ...leveraging your deep analytical skills and mathematics expertise. The ideal candidate...  ...engineering entrance levels through graduate and PhD-level concepts—and the ability to break... 
    For phd
    Part time
    For contractors
    Remote work

    Turing

    San Francisco, CA
    6 days ago
  • Mathematics Expert

    $75 - $125 per hour

     ...for mathematicians to help train and evaluate AI models on advanced mathematical reasoning. You will write problems...  ...Review problems written by other experts for correctness, clarity and originality...  ...Qualifications Master’s or PhD in mathematics, or a Bachelor’s plus... 
    For phd
    Hourly pay
    Temporary work
    For contractors
    Remote work

    RemoExperts

    San Francisco, CA
    6 days ago
  • Inorganic Chemistry PhD - Synthesis Expert - AI Trainer

    $84 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Chemistry & Synthesis Expert Type: Contract Compensation...  ...week Role Responsibilities Evaluate technically complex problems...  ...Qualifications Must-Have PhD in Inorganic Chemistry ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • Expert Senior Manager, Data Sciences, Software and Data Services, Coro

    $164.5k - $219k

     ...Information Job Title Expert Senior Manager, Data...  ...to work with major AI ecosystem partners through...  ...to prompt design, evaluation and output quality assuranceDevelop...  ...to explain and discuss mathematical and machine learning...  ..., or PhD in a technical fieldBackground... 
    For phd
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    2 days ago
  • Board Game Reasoning Expert (AI Training & Evaluation)
     ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the...  ...We are seeking Board Game Reasoning Experts to help train and evaluate next-generation...  ...'s degree in Computer Science, Mathematics, Cognitive Science, Game Design,... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    6 days ago
  • Clinical Mental Health Expert — AI Conversation Evaluation
     ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can... 
    Temporary work
    Part time
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • Remote Chemistry Expert — AI Training & Evaluation

    $60 per hour

    Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    San Francisco, CA
    2 days ago
  • Remote German Music Audio Expert for AI Evaluation
    Mercor is seeking a Music Audio Expert - German for remote engagement with an up-to-6-month duration. Immediate start and 10+ hours per week are available. You will evaluate AI-generated lyrics and voice outputs across music categories and score training data quality to... 
    Remote job
    Immediate start
    10 hours per week

    mercor

    San Francisco, CA
    16 hours ago
  • Remote Music & Lyrics Expert for AI Evaluation
    Mercor connects elite creative and technical talent with leading AI research labs, and seeks a Music & Lyrics Expert to evaluate AI-generated content remotely. You will assess music quality, compare lyrics to published songs, and rate for creativity, prompt adherence, and... 
    Remote job
    Contract work

    mercor

    San Francisco, CA
    4 days ago
  • Remote Greek Lyrics Expert for AI Evaluation
    Mercor is seeking a Music & Lyrics Expert (Greek) for a remote, contract role up to 6 months. The candidate will compare AI-generated lyrics with published songs, rate quality...  ...listening gear to support critical listening and model evaluation. #J-18808-Ljbffr mercor
    Remote job
    Contract work

    mercor

    San Francisco, CA
    4 days ago
  • Intelligence Expert (Bachelor's, Master's and PhDs) - AI Trainer
     ...Reject All Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up INTELLIGENCE EXPERT (BACHELOR'S, MASTER'S AND PHDS) - AI TRAINER...  ...community. Your role will be to simulate and evaluate how malicious actors might leverage large language... 
    For phd
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    6 days ago
  • Remote Physics Expert for AI Model Evaluation (Contract)
     ...connects elite creative and technical talent with leading AI research labs. The Physics Expert contract role involves writing physics problems with...  ...detailed systems and reference answers for model grading, and evaluating model-derived solutions for accuracy and scaling.You... 
    Remote job
    Contract work

    Mercor Inc

    San Francisco, CA
    16 hours ago
  • Clinical Expert - AI System Evaluator

    $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  • Remote Math Researcher - AI Benchmark & Problem Design

    $50 per hour

    A leading AI research firm is seeking PhDs in Mathematics or related fields for a fully remote contract role. The successful candidate will design advanced math problems to test AI performance and evaluate outputs for accuracy. Strong mathematical reasoning, problem-solving... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • Remote Math & AI Benchmark Designer (PhD)

    $50 per hour

    A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates... 
    For phd
    Remote job
    Hourly pay
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  • Advanced Physics Expert for AI Data Challenges
    Obsidian is seeking Physics PhD’s specializing in Advanced Quantum Mechanics, Advanced Electrodynamics, or Advanced Classical Mechanics for a premier project with a top AI lab. In this role, you will contribute expertise to an AI project, creating high-quality data. You... 
    For phd

    Obsidian

    San Francisco, CA
    16 hours ago
  • Research Scientist, Dynamical Systems & AI
     ...building Developmental Intelligence: AI for predicting how organisms...  ...Your responsibility is to rigorously evaluate whether this primitive works, where...  ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine... 
    For phd

    Becoming

    San Francisco, CA
    17 days ago
  • AI Evaluation Engineer - Reinforcement Learning & Agents
     ...Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the...  ...technology stacks based on system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped environment or... 
    For phd

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    12 days ago
  • AI Safety Practitioner - Expert Evaluator

    $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!

Related searches