Mathematics PhD - AI Evaluation Expert
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week
Role Responsibilities
- Source material from published papers, Kaggle datasets , open-source repositories, or self-designed scenarios.
- Write scientific prompts based on sourced inputs.
- Build grading criteria to define correct answers.
- Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
- Depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
- Working proficiency in Python for scientific computing.
- Comfortable with Git/GitHub and running code in Docker .
Preferred
- Publications in peer-reviewed journals.
- Prior scientific software or research engineering experience.
Start Date
- Immediate
Interview Process
- Upload your resume and application form.
- A 25-minute conversational interview covering your background, experience, and motivations.
- Follow up within a few days with next steps and onboarding.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$50 per hour
...Remote contract for PhDs in Mathematics, Statistics, or related... ...edge projects with top AI labs while earning $50+... ...rigorous logic. Evaluate AI outputs for accuracy... ...undergraduate to PhD-level math topics. Requirements... ...: Shortlisted experts complete an evaluation...For phdContract workRemote workFlexible hours$1,350 per month
...United States | Canada + 23 more Help evaluate how AI systems approach scientific and clinical... .... Requirements A completed PhD in a relevant scientific field, or an MD... .... Company: Senior Science & Clinical Experts - AI Benchmarking Location: Any time...For phdTemporary work- ...building a research cohort of senior domain experts across seven specialist tracks —... ...design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world... ...) Experience: 10+ years Education: PhD/Doctorate required ML Research Engineer...For phdTemporary work
$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...For phdContract workSummer workRemote work$24 per hour
...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part...SuggestedPart timeFreelanceRemote work$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Machine Learning Expert Type: Contract Compensation... .... Focus on inference, evaluation, and systems work rather than... ...or evaluation questions. PhD in ML , CS , or physics...For phdContract workSummer workRemote work$110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Mathematics Research Collaborator (Part-time... ...Review and evaluate research papers in mathematics... ...an active research role as a PhD candidate , postdoctoral researcher...For phdRemote jobContract workPart timeSummer workImmediate start$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:... ...packages. Familiarity with benchmark or evaluation design. Background in scientific...For phdContract workSummer workRemote work$84 per hour
...technical talent with leading AI research labs. Headquartered in... ...Chemistry & Synthesis Expert Type: Contract Compensation... ...week Role Responsibilities Evaluate technically complex problems... ...Qualifications Must-Have PhD in Inorganic Chemistry ,...For phdContract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation... ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety...Contract workSummer workRemote work$40 - $75 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Evaluation Rubric Reviewer Type: Contract Compensation: $40–$75/...Contract workSummer workRemote work- ...Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the... ...technology stacks based on system requirements. Candidate Profile A PhD is not required. Strong engineering and shipped environment or...For phd
$90 - $140 per hour
...Help define how frontier AI models reason about mathematics. 1\. Overview We are... .... Key Responsibilities Expert review: Assess mathematical... ...research-level problems and evaluation sets in your area of... ...Qualifications Education: PhD in mathematics, applied mathematics...For phdHourly payContract workRemote work$90 per hour
...technical talent with leading AI research labs. Headquartered in... ...with researchers and fellow experts to continually improve the benchmark... ...Must-Have ~ MSc or PhD in a STEM field or... ...-engineering, security, or AI-evaluation roles. ~ Ability to identify...For phdRemote jobContract workSummer work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...and refine clinician-informed evaluation rubrics for AI chatbot... ...generated conversations and provide expert judgment to calibrate automated... ...Must-Have MD , DO , PhD , PsyD , or equivalent qualification...For phdContract workTraineeshipSummer workRemote work$50 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation:... ...~ An advanced degree (MBA, MS, or PhD ) in finance or a related field and/or...For phdContract workSummer work- ...building Developmental Intelligence: AI for predicting how organisms... ...Your responsibility is to rigorously evaluate whether this primitive works, where... ...Requirements Required PhD or equivalent experience in applied mathematics, physics, computer science, machine...For phd
$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ..., hypothesis testing , and evaluation . Author solutions in... ...Collaborate with researchers and experts to maintain consistent and... ...Must-Have ~ MSc or PhD in a STEM field or computational...For phdContract workSummer workRemote work$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract... ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science...For phdHourly payWeekly payContract workFor contractorsSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$150 per hour
...looking for radiology and radiation sciences experts to help make AI models safer in their domain. You'll author and review evaluation tasks that test whether a model can tell a... ...Master's degree or higher (MD, DO, MSc, or PhD) in radiology, medical physics, radiation science...For phdContract workRemote workFlexible hours$75 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics, Biology) Type: Contract... ...Role Responsibilities Evaluate and analyze complex problems... ...Bachelor's , Master's , or PhD in a STEM field (or...For phdContract workSummer workInternshipRemote workFlexible hours$207k - $300k
...machine learning for security, AI-powered security operations,... ...telemetry; establish benchmarks and evaluation pipelines for robust model... ...in Statistics, Data Science, Mathematics, Physics, Economics, Operations... ....Preferred qualifications:PhD in Computer Science, Data Science...For phdShift work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Contract workSummer workWork at officeRemote work$60 - $85 per hour
...Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether... ...into how those models are trained and evaluated. It is about 10 hours a week fully remote... ...at a glance Openings: 12 legal experts. Time commitment: Approximately 10 hours...Hourly payFull timeContract workRemote work10 hours per weekFlexible hours$250k - $400k
...Post-Training, Agents, Evals Fundamental AI Research Institute San Francisco Bay... ...infrastructure, building RL environments , evaluation harnesses and post-training platforms... ...in top conferences Requirements: ~ PhD in Comp Sci / ML / Maths preferred ~ Strong...For phdRelocation package$50 per hour
...cutting-edge projects with top AI labs while earning up to $50+/... ...with rigorous logic. Evaluate AI outputs for accuracy and quality... ...benchmarks across undergraduate to PhD-level chemistry topics.... .... Assessment: Shortlisted experts complete an evaluation before...For phdContract workRemote workFlexible hours$250k - $350k
...Glean: Glean is the Work AI platform that helps everyone... ...As the Tech Lead Manager of AI Evaluations, you will lead a team of applied... ...evaluation sets from expert-curated examples, appropriately... ...roadmaps across teams. ~ MS/PhD in Computer Science, AI or a related...For phdWork at officeHome officeFlexible hours$80 - $95 per hour
...technical talent with leading AI research labs. Headquartered in... ...Electromagnetic Engineering Expert Type: Contract Compensation... ...to real-world scenarios. Evaluate design trade-offs, performance... ...'s , Master's , or PhD in Electrical Engineering ,...For phdContract workTemporary workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- subject matter expert San Francisco, CA
- math phd San Francisco, CA
- research phd San Francisco, CA
- phd physics part time San Francisco, CA
- phd student San Francisco, CA
- phd intern San Francisco, CA
- phd physics San Francisco, CA







