Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physician Reviewer (MD/DO) - Medical AI Evaluation

$50 per hour
Part-time

Mindrift

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.

Project Highlights

  • Earnings per approved task: a fixed rate for each task, set in advance
  • Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
  • Remote: open to US-licensed physicians based in eligible US states
  • No patient contact, no malpractice exposure: you review written clinical cases
  • All contributors are license-verified physicians
  • $50 one-time onboarding reward, paid once your first task on the project is approved

What this project involves

We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.

Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

What we look for

This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
  • Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

How it works

Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks

Flexibility

You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.

Earnings

Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.

  • $50 one-time onboarding reward, paid once your first task on the project is approved.
  • Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Physician Reviewer (MD/DO) - Medical AI Evaluation in Colorado Springs, CO vacancy
  • $2,880 per day

     ...Springs, Colorado Provider Type: Physician (MD/DO) Specialty: Vascular Surgery...  ...of Blunt and Other Vascular Trauma Evaluate and Manage Vascular Surgery Patients...  ...Surgery - Required Active Colorado Medical License or Active IMLC Letter of Qualification... 
    Medical
    Full time
    Temporary work
    Locum
    Immediate start
    Shift work
    Weekend work
    Day shift
    Weekday work

    WhiteCoat Locums

    Colorado Springs, CO
    1 day ago
  • $5,355 per month

     ...Springs, Colorado Provider Type: Physician (MD/DO) Specialty: Neurological Surgery...  ...Inpatient Neurosurgical Coverage Evaluate and Manage Emergency and Urgent Neurosurgical...  ...of Vasoactive and Sedating Medications Lumbar Puncture Lumbar Drain... 
    Medical
    Weekly pay
    Full time
    Locum
    Local area
    Immediate start
    Shift work
    Night shift
    Weekend work
    Day shift

    WhiteCoat Locums

    Colorado Springs, CO
    1 day ago
  • $100 per hour

     ...specialists with project-based AI opportunities for...  ..., focused on testing, evaluating, and improving AI...  ..., actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program....  ...content or exam-question review, or medical annotation... 
    Medical
    Hourly pay
    Permanent employment
    Part time
    Freelance
    10 hours per week

    Mindrift

    Colorado Springs, CO
    2 days ago
  • $400k

     ...candidate will have completed a fellowship in vitreoretinal surgery or medical retina and be board certified in ophthalmology, with strong...  ...and continuing education as applicable Qualifications: MD or DO from an accredited medical institution Board Certified in... 
    Medical
    Weekly pay
    Full time
    Immediate start
    Shift work

    Lancesoft Inc

    Colorado Springs, CO
    1 day ago
  •  ...Physician - Clinical Trials - MD/DOAt Headlands Research, we are dedicated to enhancing clinical trial delivery...  .... We're committed to advancing medical science by promoting diversity in every...  ...unencumbered license to practice as an MD or DO within the state of Colorado required... 
    Medical
    Full time
    Part time
    Local area
    Flexible hours

    Headlands Research

    Colorado Springs, CO
    1 day ago
  • $300k

     ...exceptional Psychiatrists (MD or DO) across the United...  ..., e-Prescribe, and AI tools....  ...mental-health history, medical history, diagnostic evaluation, and risk analysis....  ...consultations and case reviews. Use technology and...  ...recognized psychiatrists, physician executives,... 
    Medical
    Remote job
    Weekly pay
    Full time
    Part time
    For contractors
    Private practice
    Immediate start
    Work from home

    Legion Health

    Colorado Springs, CO
    1 day ago
  •  ...About the Position Gynecology Oncology Physician – Colorado Springs, CO Looking to...  ...impact in a supportive, well-established medical environment? Join a high-volume Gynecology...  ...What You Need Required: MD or DO degree with valid medical license in Colorado... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Immediate start
    Flexible hours
    Shift work
    Weekend work

    VieMed Healthcare Staffing

    Colorado Springs, CO
    1 day ago
  •  ...this role, you will play a crucial part in providing temporary medical services to our clients in Colorado Springs. Your expertise will...  ...success of our healthcare staffing solutions. As a Locum MD or DO in Neurosurgery, you will have the opportunity to showcase your... 
    Medical
    Temporary work
    Locum

    77 consultants

    Colorado Springs, CO
    4 days ago
  •  ...for an associate-level physician looking to provide...  ...care within a dynamic medical practice setting. In this role, you will evaluate, diagnose, and surgically...  ...multidisciplinary case reviews and clinical...  ...Valid, unrestricted MD or DO medical license eligible... 
    Medical
    Contract work
    Locum

    77 consultants

    Colorado Springs, CO
    26 days ago
  •  ...patient-centered environment. As an on-site medical professional, you will work closely with...  ...Conduct comprehensive evaluations of patients with vascular conditions...  ...improvement projects Requirements MD or DO degree from an accredited medical institution... 
    Medical
    Contract work
    Locum

    77 consultants

    Colorado Springs, CO
    more than 2 months ago
  •  ...for an Associate-level physician looking to provide high-...  ...Conduct comprehensive evaluations of patients with vascular...  ...accurate, timely,and complete medical records in compliance...  ...Doctor of Medicine (MD) or Doctor of Osteopathic Medicine (DO) with specialization in... 
    Medical
    Contract work
    Locum

    77 consultants

    Colorado Springs, CO
    more than 2 months ago
  • $325k - $375k

     ...costs ~ Technology package provided What we're looking for: Board-certified or board-eligible psychiatrists (MD/DO) Active, unrestricted medical license (multi-state licensing support available) Interest in outpatient, 100% telepsychiatry-based care... 
    Medical
    Remote job
    Full time
    Part time
    Private practice
    Flexible hours

    Talkiatry

    Colorado Springs, CO
    1 day ago
  •  ...Date: ASAP About the Position Summary: Job Id: A-MD-67746 Profession: Physician Specialty: Otolaryngology Job Type: Full-time...  ...Otolaryngology – [REQUIRED] Current or Willing to obtain Colorado Medical License – [REQUIRED] Interest in practicing General ENT... 
    Medical
    Weekly pay
    Full time
    Locum
    H1b
    Immediate start
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work
    Weekend work

    Adelphi Locums

    Colorado Springs, CO
    1 day ago
  •  ...Competitive weekly pay (inquire for details) Start Date: ASAP About the Position JOB OVERVIEW Job Id: A-MD-71825 Profession: Physician Specialty: Neurosurgery Job Type: Locum Tenens Location: Colorado Springs, CO Service Setting: Inpatient... 
    Weekly pay
    Full time
    Locum
    Shift work
    Weekend work

    Adelphi Locums

    Colorado Springs, CO
    1 day ago
  •  ...ASAP About the Position Summary: Profession: Physician Specialty: Otolaryngology Job Type: Full-time Location...  ...~403(b) with employer matching; 457(b) voluntary option ~ Medical, vision, dental, life insurance, disability coverage ~ Wellness... 
    Medical
    Weekly pay
    Full time
    Locum
    Immediate start
    Relocation package
    Flexible hours
    Shift work

    Adelphi Locums

    Colorado Springs, CO
    1 day ago
  •  ...week • Call Schedule: TBD; Shared Call • Call Ratio: Minimal • Physician in Practice: 12• Support Staff: - 8 APPs, Robust multidisciplinary...  ...option (if eligible)• Comprehensive health benefits including medical, dental, vision, disability, and life insurance (including... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Locum
    Immediate start
    Relocation package
    Flexible hours
    Shift work

    Adelphi Locums

    Colorado Springs, CO
    1 day ago
  •  ...Job Title: Physician – Sleep Medicine Location...  ...of Medicine (MD) or Doctor of Osteopathy (DO) degree. Experience...  ...Provide comprehensive evaluation, diagnosis, and...  .... Interpret and review polysomnographic studies...  ...CPAP/PAP devices, medications, and behavioral... 
    Medical
    Monday to Friday
    Shift work

    Le CYR Consulting

    Colorado Springs, CO
    2 days ago
  •  ...board-certified Family Medicine Physician to join our team devoted to...  ..., preventive health, acute medical conditions, and mental health...  ...dedication.Perform physical evaluations, analyze diagnostic testing,...  ....Education RequirementsMD or DO from an accredited medical institution... 
    Medical
    Local area

    MLee Healthcare Staffing and Recruiting, Inc

    Colorado Springs, CO
    2 days ago
  • $20 - $30 per hour

     ...language coverage Start: Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is...  ...nobody has looked at yet and judge it step by step. • Review — Take an existing annotation, written by our AI tooling... 
    Hourly pay
    Full time
    Contract work
    Immediate start
    Remote work

    Bespoke Labs

    Colorado Springs, CO
    1 day ago
  •  ...Family Medicine Physician Opportunity in Colorado Springs Imagine stepping into a role...  ...care. In this role, you will merge modern medical practices with heartfelt patient...  ...needs. Education Requirements: MD or DO from a recognized medical institution.... 
    Medical
    Local area
    Relocation package

    MLee Healthcare Staffing and Recruiting, Inc

    Colorado Springs, CO
    19 hours ago
  • $250k - $400k

     ...Non-Operative Physician We are seeking an experienced Non-Operative...  ...for physicians who enjoy evaluating and treating patients with...  ...Educate patients regarding medication management and alternative pain...  ...Required MD or DO Board Certified in: Internal... 
    Medical
    Full time
    Work at office
    Relocation package
    Weekday work

    Synectics

    Colorado Springs, CO
    3 days ago
  • $260.07k - $364.44k

     ...Responsibilities As our Primary Care Physician, you will help individuals and families...  ...Required Doctorate Degree in Medicine (MD or DO) Current and unrestricted Physician...  ...board acceptable to hospital Obtain medical staff privileges within the health system... 
    Medical

    CommonSpirit Health

    Colorado Springs, CO
    19 hours ago
  • $300k

     ...Part-Time Internal Medicine Physician Position in Colorado Springs, CO with National Wound Physician Group Clinical satisfaction...  ...Training Requirements: Active unrestricted medical license (MD/DO) in the state you wish to practice Minimum commitment... 
    Medical
    Full time
    Contract work
    Part time
    Visa sponsorship
    Work visa
    Monday to Friday
    3 days per week
    Weekday work

    VOHRA Wound Physicians

    Colorado Springs, CO
    1 day ago
  • $300k

     ...Part-Time Wound Care Physician Position in Colorado Springs, CO with National Wound Physician Group Clinical satisfaction,...  ...Paid Training Requirements: Active unrestricted medical license (MD/DO) in the state you wish to practice Minimum commitment of... 
    Medical
    Full time
    Contract work
    Part time
    Visa sponsorship
    Work visa
    Monday to Friday
    3 days per week
    Weekday work

    Vohra Physicians

    Colorado Springs, CO
    19 hours ago
  • $50k - $120k

     ...redefining senior care. Our physicians play a pivotal role in delivering...  ...seniors takes more than just medical expertise—it takes support,...  ....Data-driven tools & AI solutions to better understand...  ...supportQualificationsMedical Degree (MD or DO) from an accredited... 
    Medical
    Temporary work
    Work experience placement
    Immediate start

    AllyAlign Health

    Colorado Springs, CO
    8 hours ago
  • $222.71k - $251.85k

     ...compassionate and experienced Physician who wants to make a...  ...by Care Synergy Medical Group, the provider group...  ...REWARDING WORK YOU WILL DO The Physician...  ...symptom management. Reviews clinical information and...  ...planning, developing and evaluating hospice and palliative... 
    Medical
    Full time
    Work at office
    Local area
    Monday to Friday
    Shift work

    Care Synergy Network

    Colorado Springs, CO
    8 hours ago
  •  ...States, and we are looking for physicians who have deep knowledge and...  ...weight-loss and thyroid medications is a plus, as we have expanded...  ...with an internet connection Review labs and create personalized...  ...What We’re Looking For MD or DO with an active license (... 
    Remote job

    Hone Health Medical Roles

    Colorado Springs, CO
    1 day ago
  •  ...Telemedicine Physician - Women's Hormone Expert - Remote (MD/DO only) Work from any location, determine your own schedule...  ...women’s healthcare. Please review and respond to the three applicant...  ...treatment plans. Titrate medications based on patient outcomes. Prescribe... 
    Remote job
    Extra income
    Full time
    Part time

    Hone Health Medical Roles

    Colorado Springs, CO
    1 day ago
  • $300k

     ...Part-Time Hospitalist Physician Position in Colorado Springs, CO with National Wound Physician Group Clinical satisfaction...  ...Paid Training Requirements: Active unrestricted medical license (MD/DO) in the state you wish to practice Minimum commitment... 
    Medical
    Full time
    Contract work
    Part time
    Visa sponsorship
    Work visa
    Monday to Friday
    3 days per week
    Weekday work

    VOHRA Wound Physicians

    Colorado Springs, CO
    3 days ago
  •  ...comprehensive neurological evaluations including detailed patient history...  ...needs, which may include medication management, lifestyle...  ...team including primary care physicians, neurosurgeons, radiologists...  ...Required ~ Doctorate In MD or DO ~(Requires specific number... 
    Medical

    CommonSpirit Health

    Colorado Springs, CO
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physician Reviewer (MD/DO) - Medical AI Evaluation. Be the first to apply!