Mathematics Expert for AI Model Evaluation

Role Overview

Apply advanced mathematical reasoning, problem-solving, computational thinking, and clear written communication to improve and evaluate large language models. This remote contract role combines challenging mathematics, model evaluation, Python-based computational work, and formal proof tasks in Lean.

Key Responsibilities

• Create original, challenging mathematics problems that test large language model reasoning, including multi-step, abstract, and proof-based problems.
• Solve problems independently and produce detailed, logically structured solutions with clear justifications.
• Review model-generated solutions, identify mathematical errors and missing arguments, and provide precise feedback, annotations, and corrections.
• Help define evaluation benchmarks covering mathematics curricula from early undergraduate through Ph.D.-level topics.
• Design precise, closed-ended prompts for computational projects, write reliable Python code, verify numerical answers, and provide clear rationales.
• Develop and validate Python solutions for computational tasks using approved scientific libraries.
• Complete Lean theorem-prover tasks, including translating mathematical problems and proofs into formal language and confirming that formal proofs compile correctly.

Qualifications

• Strong mathematical foundation at engineering entrance-exam, graduate, or Ph.D. level.
• Research and analytical skills, with the ability to solve complex mathematics problems through a structured, logical approach.
• Ability to explain complex mathematical concepts clearly using simple language, visuals, and examples.
• Ability to provide constructive feedback and detailed annotations.
• Creative and lateral thinking skills.
• Excellent structured communication and collaboration skills in a remote environment.
• Self-motivated, independent work style.
• A desktop or laptop and reliable internet connection.

Eligibility

Candidates pursuing a Master’s, Ph.D., or postdoctoral degree in Mathematics, Applied Mathematics, Statistics, or a related field are eligible and encouraged to apply.

Work Terms

• Fully remote contractor assignment.
• Choose a commitment of 20, 30, or 40 hours per week.
• Commit at least 4 hours per day and maintain 4 hours of overlap with Pacific Time.
• This independent contractor engagement does not include medical benefits or paid leave.