Chemist for AI Benchmark Development

Role Overview

Develop and validate rigorous academic chemistry assessments that support an AI research initiative. This fully remote role focuses on creating gold-standard multiple-choice benchmarks, evaluating solution quality, and ensuring each question tests deep conceptual understanding rather than surface-level recall.

Key Responsibilities

• Complete either question-authoring or question-verification assignments.
• For authoring assignments, create original, challenging multiple-choice questions within your chemistry specialty, assign a difficulty rating, and submit them for review.
• For verification assignments, assess pre-written questions for accuracy, clarity, rigor, completeness, precision, and solvability; make necessary edits and document the rationale for changes.
• Ensure every question is self-contained, unambiguous, and precisely defined, with all required information included in the prompt.
• Classify questions as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible but subtly incorrect answer options designed to challenge expert-level solvers.
• Write clear, concise, step-by-step reasoning with intermediate steps in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

Chemistry Domains

Assignments may cover materials, polymer and electronic chemistry; industrial and process chemistry; energy storage and environmental chemistry; pharmaceutical and agrochemical chemistry; and consumer, food, and specialty chemicals.

Qualifications

• PhD or current doctoral candidacy in chemistry, biochemistry, chemical engineering, or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific chemistry subdomain.
• Strong knowledge of graduate-level chemistry concepts, reaction mechanisms, and quantitative analysis.
• Experience designing rigorous academic problems or writing chemistry olympiad questions is strongly preferred.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Fully remote, asynchronous hourly engagement.
• Expected commitment of at least 10 hours per week.

Compensation

$61 to $77 per hour.