Psychiatrist for AI Model Evaluation

Join a pioneering initiative to enhance AIs understanding of mental health care by leveraging your expertise in Psychiatry. This role involves designing clinical scenarios, evaluating AI model outputs, and contributing to the development of advanced healthcare reasoning models.

Key Responsibilities

Design clinically realistic prompts and scenarios based on your Psychiatry practice, including diagnostic formulation, medication management, risk assessment, psychotherapy fidelity, and capacity evaluation.
Write high-quality reference responses that meet attending-level standards.
Assess AI-generated responses using structured rubrics.
Provide constructive feedback to the research team to refine model behavior.
Engage in onboarding office hours and specialty calibration sessions.
Qualifications

Attending physicians must be board certified with a current, active, unrestricted medical license.
Resident physicians must be in their final year of residency (recent graduates must be board-eligible).
Fellows must be board-certified or board-eligible in their primary specialty and hold a current active, unrestricted medical license.
Work Terms

Remote position, fully asynchronous.
Default commitment of 20 hours per week, with the possibility to increase after onboarding based on demand.
Weekly payment schedule.
Start date is rolling, following onboarding sign-off.
Ongoing engagement, with monthly reviews.
Compensation

Hourly rates range from $150 to $350, determined by seniority tier (early-career to senior attending), with specific rates confirmed in your offer.
Before Your First Task

Upon acceptance, you will receive an onboarding document and a calendar invite for Onboarding Office Hours.