Applied Psychology Benchmark Specialist

Role Overview

Develop and review rigorous academic assessment content that supports an AI research initiative. This role focuses on creating gold-standard psychology benchmarks, including challenging multiple-choice questions and validated solutions across specialized psychology domains.

Psychology Domains

• Neuromorphic Engineering
• Human Factors and Engineering Psychology
• Consumer and Market Psychology
• Psychometrics
• Digital Health
• Psychedelic-assisted Therapy

Key Responsibilities

• Complete question-authoring assignments by creating original, challenging multiple-choice questions within your psychology specialty, rating their difficulty, and submitting them for review.
• Complete question-verification assignments by reviewing existing questions for accuracy, clarity, rigor, completeness, precision, and solvability; make necessary edits, assign a difficulty rating, and document the rationale for changes.
• Write questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is unambiguous, self-contained, precisely defined, and includes all information needed to solve it.
• Classify question difficulty as Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives designed to challenge expert-level solvers.
• Prepare clear, concise, step-by-step reasoning solutions in markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals and university repositories.

Qualifications

• PhD, PsyD, or doctoral candidacy in Psychology or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level psychological theory, research methodology, and empirical literature.
• Clinical licensure or psychology research publications are strongly valued.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Fully remote, asynchronous hourly engagement.
• Expected commitment of at least 10 hours per week.

Compensation

$50 to $63 per hour.