Healthcare Professional for AI Model Evaluation

Join a leading AI research lab as a Healthcare Expert, where you will play a pivotal role in training frontier models on high-quality clinical and biomedical reasoning. Your expertise will be crucial in evaluating and comparing model outputs on complex medical problems, influencing how AI approaches diagnosis, treatment, and patient care.

• Compare two AI-generated responses to the same prompt and determine which is superior.
• Review provided input files and analyze each model''s reasoning to inform your evaluation.
• Clearly articulate the reasons for your judgment, focusing on clinical accuracy, safety, and the quality of medical reasoning.
• Provide written feedback to the research team to enhance model performance.
• Engage in onboarding and specialty calibration sessions.

• Possess an MD, DO, PharmD, PhD, or an advanced clinical/biomedical degree, or equivalent professional experience.
• Have at least 2 years of professional experience in clinical practice, medical research, or a biomedical specialty.
• Be comfortable applying current clinical guidelines and evidence-based medicine.
• Exhibit excellent written communication skills with a strong attention to detail.

Flexible workload of 10, 20 hours per week.

Hourly rate of $150.

Role starts immediately; applications will be reviewed on a rolling basis.