Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Mathematics PhD - AI Evaluation Expert

$70 per hour

Mercor Inc

Job DescriptionJob DescriptionAbout the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/weekRole ResponsibilitiesSource original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.Write scientific prompts based on sourced input to challenge frontier models.Build grading criteria that define correct answers for scientific tasks.Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.Work independently and asynchronously to meet deadlines while improving AI model performance.QualificationsMust-HavePhD in mathematics, applied mathematics, computational mathematics, or a closely related field.Demonstrated depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.Working proficiency in Python or R for scientific computing.Comfortable with Git/GitHub and running code in Docker.PreferredPublications in peer-reviewed journals.Prior scientific software or research engineering experience.Start DateImmediateInterview ProcessUpload your resume and application form.A 25-minute conversational interview covering your background, experience, and motivations.Follow up within a few days with next steps and onboarding.Application Process (Takes 20–30 mins to complete)Upload resumeAI interview based on your resumeSubmit formResources & SupportFor details about the interview process and platform information, please check: any help or support, reach out to: View email address on click.appcast.io: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy
  • $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where...  ...a closely related quantitative subdomain such as Mathematics or Physics Strong analytical and critical-thinking... 
    For phd
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    a month ago
  • $45 - $70 per hour

     ..., and Social Science Help a leading AI lab ensure its models respond to people...  ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle...  ...example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required. ~... 
    For phd
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    a month ago
  • $40 - $90 per hour

     ...We are looking for PhD-qualified biology experts to contribute their scientific expertise to a short-term annotation project supporting a leading AI lab. Expert annotation helps AI researchers develop and evaluate how models handle specialized scientific information.... 
    For phd
    Hourly pay
    Temporary work
    For contractors
    10 hours per week

    Braintrust

    San Francisco, CA
    20 hours ago
  • $1,350 per unit

     ...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable...  ...behind your assessment. Requirements A completed PhD in a relevant scientific field, or an MD with a clinical specialization... 
    For phd

    Braintrust

    San Francisco, CA
    15 hours ago
  • $75 - $100 per hour

     ...Join to apply for the Math PhD - Expert Trainer role at Handshake...  ...graduates in Math to join our AI research community. This program...  ...real-world expertise and evaluate where they excel or fail Get...  ...2x Get notified about new Mathematics Specialist jobs in San... 
    For phd
    Contract work
    Part time
    Summer work
    Freelance
    H1b
    Remote work
    Visa sponsorship
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    20 hours ago
  • $50 per hour

     ...Remote contract for PhDs in Mathematics, Statistics, or related...  ...edge projects with top AI labs while earning $50+...  ...with rigorous logic. Evaluate AI outputs for accuracy...  ...undergraduate to PhD-level math topics. Requirements...  ...: Shortlisted experts complete an evaluation... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Machine Learning Expert Type: Contract Compensation...  .... Focus on inference, evaluation, and systems work over heavy...  ...benchmarks or evaluation questions. PhD in ML , CS , or physics... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor Inc

    San Francisco, CA
    1 day ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time...  ...Review and evaluate research papers in mathematics...  ...an active research role as a PhD candidate , postdoctoral researcher... 
    For phd
    Remote job
    Contract work
    Part time
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    a month ago
  • $70 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:...  ...packages. Familiarity with benchmark or evaluation design. Background in scientific... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    24 days ago
  • $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type...  ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated... 
    For phd
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Mercor is hiring a Healthcare Expert (contract, remote) to evaluate AI-generated medical responses and improve model reasoning. You will assess input data, compare outputs, and articulate reasons for superiority, focusing on clinical accuracy, safety, and sound medical... 
    Contract work
    Immediate start
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  •  ...building a research cohort of senior domain experts across seven specialist tracks —...  ...design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world...  ...) Experience: 10+ years Education: PhD/Doctorate required ML Research Engineer... 
    For phd
    Temporary work

    AfterQuery

    San Francisco, CA
    26 days ago
  • $84 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Chemistry & Synthesis Expert Type: Contract Compensation...  ...week Role Responsibilities Evaluate technically complex problems...  ...Qualifications Must-Have PhD in Inorganic Chemistry ,... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $60 per hour

    Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    San Francisco, CA
    2 days ago
  • $70 per hour

     ...and prototyping to build state-of-the-art evaluation tools. Write code within Waymo’s simulator...  ...in a graduate program (Master's or PhD) in Computer Science, Computer Engineering...  ...driving, simulation, evaluation, and physical AI. We prefer: Knowledge/prior... 
    For phd
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    San Francisco, CA
    3 days ago
  •  ...Mercor is seeking an ML Research PhD Expert for a remote contract role. You will evaluate AI-generated content, review complex ML research, and provide structured feedback to AI research teams to improve model outputs and data quality. Applicants should have a PhD in ML... 
    For phd
    Contract work
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $164.5k - $219k

     ...Information Job Title Expert Senior Manager, Data...  ...to work with major AI ecosystem partners through...  ...to prompt design, evaluation and output quality assuranceDevelop...  ...to explain and discuss mathematical and machine learning...  ..., or PhD in a technical fieldBackground... 
    For phd
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    2 days ago
  •  ...Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the...  ...stacks based on system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped environment or... 
    For phd

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    1 day ago
  •  ...Applied AI Lab Building End-To-End Software AgentsWe are an applied...  ...improvements in coding, mathematics, and long-horizon reasoning through...  ...Data Research: Develop and evaluate synthetic data pipelines that...  ...capability than credentials. A PhD is one signal among many.Resources... 
    For phd

    Cognition AI

    San Francisco, CA
    20 hours ago
  •  ...AI-Powered Drug Discovery EngineerIn this role you...  ..., signals, and evaluation criteriaDesign evaluation...  ...collaborate with domain experts to establish benchmarks...  ...Computer Science, Statistics, Mathematics, Physics, or related...  ...years of experience, or PhD with 0-2 years... 
    For phd
    Worldwide

    American Statistical Association - ASA

    San Francisco, CA
    4 days ago
  • $50 per hour

    A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates... 
    For phd
    Remote job
    Hourly pay
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $60 - $120 per hour

     ...ML Engineer (MSc. or PhD) (Remote | $60–$120/hr) Position:...  ...Learning Engineers to contribute to AI training projects involving...  ...components, data pipelines, evaluation systems, and numerical methods...  ...Machine Learning, AI, Applied Mathematics, Statistics, Engineering, or a... 
    For phd
    Part time
    For contractors
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Synthires

    San Francisco, CA
    1 day ago
  •  ...Sciforium is an AI infrastructure company developing next-generation...  ...heterogeneous corpora. Implement and evaluate new model architectures, training...  ..., Artificial Intelligence, Mathematics, or a related field. Nice-to-Haves PhD in Computer Science, Machine Learning... 
    For phd
    Flexible hours

    Sciforium

    San Francisco, CA
    4 days ago
  • $90 - $140 per hour

     ...Help define how frontier AI models reason about mathematics. 1\. Overview We are...  .... Key Responsibilities Expert review: Assess mathematical...  ...research-level problems and evaluation sets in your area of...  ...Qualifications Education: PhD in mathematics, applied mathematics... 
    For phd
    Hourly pay
    Contract work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  •  ...building Developmental Intelligence: AI for predicting how organisms...  ...Your responsibility is to rigorously evaluate whether this primitive works, where...  ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine... 
    For phd

    Becoming

    San Francisco, CA
    7 days ago
  • $160k - $250k

     ...What Granica does Granica is an AI research and systems company building...  ...new model architectures, evaluate on live datasets, and publish results...  ...efficient learning. What you’ll bring PhD in Machine Learning, Statistics, Applied Mathematics, or a related field with... 
    For phd
    Flexible hours

    Granica

    San Francisco, CA
    4 days ago
  • $300 per month

     ...Author research-grade AI evaluation tasks from your own computational work. Open to PhD-level and PhD-pursuing researchers across...  ..., geosciences, ocean), Mathematical sciences (applied mathematics,...  ...you can resubmit. All accepted experts undergo standard background and... 
    For phd
    Contract work
    For contractors
    Flexible hours

    AfterQuery

    San Francisco, CA
    a month ago
  •  ...solve challenging physics problems for AI model evaluation. About Turing Turing is one of the...  ...your deep analytical skills and mathematics expertise. The ideal candidate possesses...  ...engineering entrance levels through graduate and PhD-level concepts—and the ability to break... 
    For phd
    Part time
    For contractors
    Remote work

    Turing

    San Francisco, CA
    5 days ago
  • $75 - $125 per hour

     ...for mathematicians to help train and evaluate AI models on advanced mathematical reasoning. You will write problems...  ...Review problems written by other experts for correctness, clarity and originality...  ...Qualifications Master’s or PhD in mathematics, or a Bachelor’s plus... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work

    RemoExperts

    San Francisco, CA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!