Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Mathematics PhD - AI Evaluation Expert

Mercor

Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains - depth required in at least two subdomains (with a coding focus) Mathematics — numerical linear algebra, computational mechanics, computational finance What you'll do Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design Write scientific prompts based on the input Build the grading criteria that define a correct answer Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed Required PhD in mathematics, applied mathematics, computational mathematics, or a closely related field Demonstrated depth in at least two of the following subdomains: numerical linear algebra, computational mechanics, computational finance Working proficiency in Python or R for scientific computing Comfortable with Git/GitHub and running code in Docker — authoring runs through a pull-request workflow with automated quality checks Preferred Publications in peer-reviewed journals Prior scientific software or research engineering experience Engagement Duration: 6 weeks Commitment: part-time, 20+ hours per week Start date: immediate #J-18808-Ljbffr Mercor

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Mathematics PhD - AI Evaluation Expert in San Francisco, CA vacancy
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... 
    For phd
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  • $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where...  ...a closely related quantitative subdomain such as Mathematics or Physics Strong analytical and critical-thinking... 
    For phd
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    20 days ago
  • $45 - $70 per hour

     ..., and Social Science Help a leading AI lab ensure its models respond to people...  ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle...  ...example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required. ~... 
    For phd
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    21 days ago
  • $50 per hour

     ...OverviewRemote contract for PhDs in Mathematics, Statistics, or related...  ...edge projects with top AI labs while earning $50+...  ...with rigorous logic.Evaluate AI outputs for accuracy...  ...undergraduate to PhD-level math topics....  ...Assessment: Shortlisted experts complete an evaluation... 
    For phd
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    2 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code). You will author original, executable research problems that today's frontier models cannot solve. The role emphasizes material sourcing, prompt design, and robust grading criteria against... 
    For phd
    Part time
    Immediate start

    Mercor

    San Francisco, CA
    1 day ago
  • Mercor is partnering with a leading AI research organisation to develop a clinician-informed benchmark for evaluating how AI companion chatbots respond to adolescents with mental...  ...rubrics for AI conversations. We seek MD/DO/PhD/PsyD or equivalent with child/adolescent... 
    For phd

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Description Job Description Mathematics Expert Job Type: Contractor...  ...Mathematics Experts to support an AI-focused project involving...  ...You will create, review, and evaluate mathematical content with a strong...  ...BSc, MSc, or PhD in Mathematics, Applied Mathematics... 
    For phd
    For contractors
    Remote work

    YO AI Labs

    San Francisco, CA
    7 days ago
  • Computational Statistics and Applied Mathematics Expert About the Project We're...  ...to test how well advanced AI systems can solve hard scientific...  ...-level expertise (MS or PhD required; PhD preferred, or MS...  ...Familiarity with benchmark or evaluation design Background in scientific... 
    For phd
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $80 per hour

     ...seeking experienced lecturers to train an AI language model on professional presentation...  ...deck tasks. The role focuses on creating, evaluating, and refining AI-generated slides across...  ...compensation at $80 per hour, requiring a PhD or terminal degree with 4+ years teaching... 
    For phd
    Remote job
    Hourly pay
    Immediate start
    Flexible hours

    Ethos

    San Francisco, CA
    4 days ago
  • $164.5k - $219k

     ...Information Job Title Expert Senior Manager, Data...  ...to work with major AI ecosystem partners through...  ...to prompt design, evaluation and output quality assuranceDevelop...  ...to explain and discuss mathematical and machine learning...  ..., or PhD in a technical fieldBackground... 
    For phd
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    4 days ago
  • $60 per hour

    Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    San Francisco, CA
    4 days ago
  • $50 - $75 per hour

    Logoslabs is seeking a Mid‑Senior Litigation Specialist to help shape the AI tools of tomorrow. You will engage in substantive legal dialogue with an AI model, evaluating its reasoning and identifying failure points to improve performance. The role is contract-based and... 
    Hourly pay
    Contract work
    Remote work

    Logoslabs

    San Francisco, CA
    1 day ago
  • Mercor is seeking a Music Audio Expert - German for remote engagement with an up-to-6-month duration. Immediate start and 10+ hours per week are available. You will evaluate AI-generated lyrics and voice outputs across music categories and score training data quality to... 
    Remote job
    Immediate start
    10 hours per week

    mercor

    San Francisco, CA
    2 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs, and seeks a Music & Lyrics Expert to evaluate AI-generated content remotely. You will assess music quality, compare lyrics to published songs, and rate for creativity, prompt adherence, and... 
    Remote job
    Contract work

    mercor

    San Francisco, CA
    1 day ago
  • Mercor is seeking a Music & Lyrics Expert (Greek) for a remote, contract role up to 6 months. The candidate will compare AI-generated lyrics with published songs, rate quality...  ...listening gear to support critical listening and model evaluation. #J-18808-Ljbffr mercor
    Remote job
    Contract work

    mercor

    San Francisco, CA
    1 day ago
  • Mercor seeks a Music Audio Expert - Punjabi for a remote contract role. You will evaluate AI-generated music outputs, score training data quality, and help refine evaluation standards. Strong Punjabi and English fluency, and a background in music production are essential... 
    Remote job
    Contract work
    10 hours per week

    mercor

    San Francisco, CA
    1 day ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Machine Learning Expert Type: Contract...  ...attempts. Focus on inference evaluation and systems work rather than...  ...or evaluation questions. PhD in ML CS or physics or... 
    For phd
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

    A leading AI consulting firm is searching for a Senior Mathematics Expert to join their remote team. The ideal candidate will possess a PhD in Mathematics and have a rich experience in solving complex...  ...AI models can't solve and evaluating these models. This position offers... 
    For phd
    Remote job

    Aligned Labs

    San Francisco, CA
    1 day ago
  • Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured... 

    Mercor

    San Francisco, CA
    2 days ago
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    12 hours ago
  • $50 per hour

    A leading AI research firm is seeking PhDs in Mathematics or related fields for a fully remote contract role. The successful candidate will design advanced math problems to test AI performance and evaluate outputs for accuracy. Strong mathematical reasoning, problem-solving... 
    For phd
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago
  • $50 per hour

    A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates... 
    For phd
    Remote job
    Hourly pay
    Flexible hours

    Turing

    San Francisco, CA
    23 hours ago
  • $55 - $90 per hour

    Obsidian is seeking STEM PhDs and Technical Domain Experts for a premier project with a leading AI lab in San Francisco. This role offers a competitive pay...  ...data to advance AI innovation. Candidates should have a PhD or advanced degree, high attention to detail, and... 
    For phd

    Obsidian

    San Francisco, CA
    2 days ago
  • Obsidian is seeking Physics PhD’s specializing in Advanced Quantum Mechanics, Advanced Electrodynamics, or Advanced Classical Mechanics for a premier project with a top AI lab. In this role, you will contribute expertise to an AI project, creating high-quality data. You... 
    For phd

    Obsidian

    San Francisco, CA
    2 days ago
  • Mercor is seeking STEM PhDs and technical domain experts for remote, contract roles to contribute to state-of-the-art AI projects. You will develop high-quality data,...  ...accuracy and innovation. Ideal candidates hold a PhD or advanced degree in a relevant field, possess... 
    For phd
    Remote job
    Contract work

    Mercor

    San Francisco, CA
    2 days ago
  • $50 - $63 per hour

     ...Commitment begins at 10+ hours per week, with compensation of $50-$63 per hour. The role requires advanced graduate training in psychology (PhD/PsyD or doctoral candidate) and excellent written English. This is a remote engagement with a flexible schedule. #J-18808-Ljbffr... 
    For phd
    Remote job
    Hourly pay
    Contract work
    10 hours per week
    Flexible hours

    Mercor

    San Francisco, CA
    4 days ago
  •  ...Sciforium is an AI infrastructure company developing next-generation...  ...heterogeneous corpora. Implement and evaluate new model architectures, training...  ..., Artificial Intelligence, Mathematics, or a related field. Nice-to-Haves PhD in Computer Science, Machine Learning... 
    For phd
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  • We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve... 
    Worldwide

    Mercor

    San Francisco, CA
    4 days ago
  • $200k - $260k

     ...- two of our co-founders were PhD data scientists at Robinhood. Since...  ...graduate studies in physics, mathematics, bioengineering, economics,...  ...FluencyRapidly learn and adopt emerging AI tools and workflows to accelerate analysisCritically evaluate AI-generated outputs for... 
    For phd
    Flexible hours

    Parafin

    San Francisco, CA
    4 days ago
  •  ...empowering and governing autonomous AI agents across industries. As...  ...architectures Develop mathematical models describing cross-neuron...  ...complexity and scalability trade-offs Evaluate hardware-aware and distributed...  ...Qualifications Required PhD in Machine Learning, AI, Applied... 
    For phd

    Ephapsys

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!