Mathematician for AI Model Evaluation

Role Overview:

In this role, you will engage in projects focused on enhancing and evaluating large language models through advanced mathematical reasoning, problem-solving, computational thinking, and effective written communication. You will have the opportunity to break down complex mathematical concepts into clear explanations and work on computational tasks that include designing precise prompts, writing reliable Python code, and verifying numerical answers.

Key Responsibilities:

• Design original and challenging mathematics problems that test the reasoning limits of large language models, particularly in multi-step, abstract, and proof-based contexts.
• Solve problems independently and produce detailed, logically structured solutions with clear justifications.
• Review model-generated solutions, identify mathematical errors or missing arguments, and provide precise feedback, annotations, and corrections.
• Contribute to defining new evaluation benchmarks based on Mathematics curricula from early undergraduate to PhD-level topics.
• Develop and validate Python-based solutions for computational tasks using approved scientific libraries.
• Work on theorem-prover tasks using Lean, including translating mathematical problems and proofs into formal language and verifying that formal proofs compile correctly.

Qualifications:

• Strong analytical and research skills.
• Ability to provide constructive feedback and detailed annotations.
• Creative and lateral thinking abilities.
• Excellent structured communication and collaboration skills in a remote environment.
• Self-motivated and capable of working independently.
• Access to a desktop or laptop with a reliable internet connection.

Preferred Qualifications:

• Pursuing a Master’s, Ph.D., or Postdoctoral degree in Mathematics, Applied Mathematics, Statistics, or a related field.
• Ability to analyze and solve complex math problems with a structured and logical approach.
• Ability to explain math concepts clearly using simple language, visuals, and examples.

Work Terms:

• Contract position with remote work flexibility.

Compensation:

• Competitive compensation based on experience and project requirements.

Perks of Freelancing:

• Fully remote work environment.
• Opportunity to collaborate on cutting-edge AI projects with leading companies.
• Potential for contract extension based on performance and project needs.