Mathematics PhD - AI Evaluation Expert
Mercor
Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains - depth required in at least two subdomains (with a coding focus) Mathematics — numerical linear algebra, computational mechanics, computational finance What you'll do Source your own material: a published paper, a Kaggle dataset, an open-source repository, or a scenario you design Write scientific prompts based on the input Build the grading criteria that define a correct answer Calibrate against frontier models — a task ships only when strong models fail it more often than they succeed Required PhD in mathematics, applied mathematics, computational mathematics, or a closely related field Demonstrated depth in at least two of the following subdomains: numerical linear algebra, computational mechanics, computational finance Working proficiency in Python or R for scientific computing Comfortable with Git/GitHub and running code in Docker — authoring runs through a pull-request workflow with automated quality checks Preferred Publications in peer-reviewed journals Prior scientific software or research engineering experience Engagement Duration: 6 weeks Commitment: part-time, 20+ hours per week Start date: immediate #J-18808-Ljbffr Mercor
$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour...For phdContract workSummer workImmediate startRemote work$50 - $150 per hour
...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where... ...a closely related quantitative subdomain such as Mathematics or Physics Strong analytical and critical-thinking...For phdContract workTemporary workRemote workFlexible hours$45 - $70 per hour
..., and Social Science Help a leading AI lab ensure its models respond to people... ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle... ...example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required. ~...For phdContract workPart timeWeekday work$50 per hour
...OverviewRemote contract for PhDs in Mathematics, Statistics, or related... ...edge projects with top AI labs while earning $50+... ...with rigorous logic.Evaluate AI outputs for accuracy... ...undergraduate to PhD-level math topics.... ...Assessment: Shortlisted experts complete an evaluation...For phdContract workRemote workFlexible hours- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code). You will author original, executable research problems that today's frontier models cannot solve. The role emphasizes material sourcing, prompt design, and robust grading criteria against...For phdPart timeImmediate start
- Mercor is partnering with a leading AI research organisation to develop a clinician-informed benchmark for evaluating how AI companion chatbots respond to adolescents with mental... ...rubrics for AI conversations. We seek MD/DO/PhD/PsyD or equivalent with child/adolescent...For phd
- ...Description Job Description Mathematics Expert Job Type: Contractor... ...Mathematics Experts to support an AI-focused project involving... ...You will create, review, and evaluate mathematical content with a strong... ...BSc, MSc, or PhD in Mathematics, Applied Mathematics...For phdFor contractorsRemote work
- Computational Statistics and Applied Mathematics Expert About the Project We're... ...to test how well advanced AI systems can solve hard scientific... ...-level expertise (MS or PhD required; PhD preferred, or MS... ...Familiarity with benchmark or evaluation design Background in scientific...For phdRemote work
$80 per hour
...seeking experienced lecturers to train an AI language model on professional presentation... ...deck tasks. The role focuses on creating, evaluating, and refining AI-generated slides across... ...compensation at $80 per hour, requiring a PhD or terminal degree with 4+ years teaching...For phdRemote jobHourly payImmediate startFlexible hours$164.5k - $219k
...Information Job Title Expert Senior Manager, Data... ...to work with major AI ecosystem partners through... ...to prompt design, evaluation and output quality assuranceDevelop... ...to explain and discuss mathematical and machine learning... ..., or PhD in a technical fieldBackground...For phdPermanent employmentFull timeApprenticeshipLocal areaHome office3 days per week$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach...Remote jobHourly payFlexible hours$50 - $75 per hour
Logoslabs is seeking a Mid‑Senior Litigation Specialist to help shape the AI tools of tomorrow. You will engage in substantive legal dialogue with an AI model, evaluating its reasoning and identifying failure points to improve performance. The role is contract-based and...Hourly payContract workRemote work- Mercor is seeking a Music Audio Expert - German for remote engagement with an up-to-6-month duration. Immediate start and 10+ hours per week are available. You will evaluate AI-generated lyrics and voice outputs across music categories and score training data quality to...Remote jobImmediate start10 hours per week
- Mercor connects elite creative and technical talent with leading AI research labs, and seeks a Music & Lyrics Expert to evaluate AI-generated content remotely. You will assess music quality, compare lyrics to published songs, and rate for creativity, prompt adherence, and...Remote jobContract work
- Mercor is seeking a Music & Lyrics Expert (Greek) for a remote, contract role up to 6 months. The candidate will compare AI-generated lyrics with published songs, rate quality... ...listening gear to support critical listening and model evaluation. #J-18808-Ljbffr mercorRemote jobContract work
- Mercor seeks a Music Audio Expert - Punjabi for a remote contract role. You will evaluate AI-generated music outputs, score training data quality, and help refine evaluation standards. Strong Punjabi and English fluency, and a background in music production are essential...Remote jobContract work10 hours per week
$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Machine Learning Expert Type: Contract... ...attempts. Focus on inference evaluation and systems work rather than... ...or evaluation questions. PhD in ML CS or physics or...For phdFull timeContract workSummer workRemote work$80 - $120 per hour
A leading AI consulting firm is searching for a Senior Mathematics Expert to join their remote team. The ideal candidate will possess a PhD in Mathematics and have a rich experience in solving complex... ...AI models can't solve and evaluating these models. This position offers...For phdRemote job- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured...
- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...Remote jobHourly payWork at office
$50 per hour
A leading AI research firm is seeking PhDs in Mathematics or related fields for a fully remote contract role. The successful candidate will design advanced math problems to test AI performance and evaluate outputs for accuracy. Strong mathematical reasoning, problem-solving...For phdRemote jobContract workFlexible hours$50 per hour
A leading AI research accelerator is seeking remote PhD candidates in Mathematics or related fields to design math problems and evaluate AI performance. The role involves collaboration with researchers and offers flexible hours at a pay rate of $50+/hour. Ideal candidates...For phdRemote jobHourly payFlexible hours$55 - $90 per hour
Obsidian is seeking STEM PhDs and Technical Domain Experts for a premier project with a leading AI lab in San Francisco. This role offers a competitive pay... ...data to advance AI innovation. Candidates should have a PhD or advanced degree, high attention to detail, and...For phd- Obsidian is seeking Physics PhD’s specializing in Advanced Quantum Mechanics, Advanced Electrodynamics, or Advanced Classical Mechanics for a premier project with a top AI lab. In this role, you will contribute expertise to an AI project, creating high-quality data. You...For phd
- Mercor is seeking STEM PhDs and technical domain experts for remote, contract roles to contribute to state-of-the-art AI projects. You will develop high-quality data,... ...accuracy and innovation. Ideal candidates hold a PhD or advanced degree in a relevant field, possess...For phdRemote jobContract work
$50 - $63 per hour
...Commitment begins at 10+ hours per week, with compensation of $50-$63 per hour. The role requires advanced graduate training in psychology (PhD/PsyD or doctoral candidate) and excellent written English. This is a remote engagement with a flexible schedule. #J-18808-Ljbffr...For phdRemote jobHourly payContract work10 hours per weekFlexible hours- ...Sciforium is an AI infrastructure company developing next-generation... ...heterogeneous corpora. Implement and evaluate new model architectures, training... ..., Artificial Intelligence, Mathematics, or a related field. Nice-to-Haves PhD in Computer Science, Machine Learning...For phdFlexible hours
- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve...Worldwide
$200k - $260k
...- two of our co-founders were PhD data scientists at Robinhood. Since... ...graduate studies in physics, mathematics, bioengineering, economics,... ...FluencyRapidly learn and adopt emerging AI tools and workflows to accelerate analysisCritically evaluate AI-generated outputs for...For phdFlexible hours- ...empowering and governing autonomous AI agents across industries. As... ...architectures Develop mathematical models describing cross-neuron... ...complexity and scalability trade-offs Evaluate hardware-aware and distributed... ...Qualifications Required PhD in Machine Learning, AI, Applied...For phd
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- sql expert San Francisco, CA
- phd student San Francisco, CA
- phd intern San Francisco, CA
- phd science San Francisco, CA
- phd San Francisco, CA
- phd engineering San Francisco, CA






