Licensed Physician for AI Model Evaluation

Provide clinical expertise to research teams designing and evaluating medical AI, focusing on how these systems perform clinical reasoning and decision making. You will create realistic clinical evaluations that reveal gaps in AI medical knowledge and drive improvements in model behavior. This is a remote, contract role with flexible scheduling to accommodate active clinical practice.

• Design systematic evaluation frameworks to measure medical AI performance on clinically relevant tasks
• Create clinical scenarios and case vignettes that test model reasoning and decision making
• Develop assessment methods that reflect the nuance of real-world clinical practice
• Identify specific gaps in AI medical knowledge and reasoning that require remediation
• Work closely with AI researchers to translate clinical assessments into model improvements

• Licensed physician in active clinical practice, any specialty
• Demonstrated experience with clinical decision making and evidence based medicine
• Genuine interest in how AI can support clinical practice and patient care
• Strong analytical skills and clear written and verbal communication

• Location: remote work; the hiring organization is based in San Francisco, California
• Engagement type: contract
• Time commitment: flexible engagement, up to 30 hours per week
• Duration: initial 1 month term, with potential extensions based on performance and fit
• Schedule: flexible hours to accommodate clinical commitments