Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physician (MD/DO) - Medical AI Evaluation

$50 per hour
Part-time

Mindrift

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.

Project Highlights

  • Earnings per approved task: a fixed rate for each task, set in advance
  • Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
  • Remote: open to US-licensed physicians based in eligible US states
  • No patient contact, no malpractice exposure: you review written clinical cases
  • All contributors are license-verified physicians
  • $50 one-time onboarding reward, paid once your first task on the project is approved

What this project involves

We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.

Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

What we look for

This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
  • Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

How it works

Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks

Flexibility

You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.

Earnings

Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.

  • $50 one-time onboarding reward, paid once your first task on the project is approved.
  • Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Physician (MD/DO) - Medical AI Evaluation in Idaho vacancy
  • $52k

     ...reviewers are license-verified physicians $50 one-time onboarding...  ...with project-based AI opportunities for...  ...companies, focused on testing, evaluating, and improving AI...  ...practicing physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical... 
    Medical
    Price work
    Part time
    Freelance
    10 hours per week
    Flexible hours

    Mindrift

    Idaho
    3 days ago
  • $100 per hour

     ...specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation...  ...US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General... 
    Medical
    Hourly pay
    Permanent employment
    Part time
    Freelance
    10 hours per week

    Mindrift

    Idaho
    1 day ago
  •  ...Location: Boise, Idaho Provider Type: Physician (MD/DO) Specialty: Interventional...  ...Interventional Radiology Consultations Evaluate Patients Before and After Procedures...  ...Certification - Required Active Idaho Medical License or Active IMLC Letter of... 
    Medical
    Weekly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work
    Night shift
    Weekend work

    WhiteCoat Locums

    Boise, ID
    1 day ago
  • $4,050 per day

     ...seeking a Locums General Orthopedic Surgery Physician to provide coverage at a Level III...  ...team. The Orthopedic Surgeon will evaluate and manage patients with acute musculoskeletal...  ...Trauma preferred Eligible for Idaho medical licensure Strong clinical judgment... 
    Medical
    Hourly pay
    Weekly pay
    Full time
    Locum
    Immediate start
    Shift work

    AAS Locum Tenens

    Twin Falls, ID
    1 day ago
  •  ...call coverage. Client is looking for one physician per week starting in early January 2027,...  ...APPs Practice Setting Inpatient medical setting Interventional Radiology...  ...likely ongoing Requirements Must be an MD or DO Idaho license required, will wait for... 
    Medical
    Hourly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work
    Night shift
    Weekend work
    Afternoon shift
    Weekday work

    Curative

    Boise, ID
    12 hours ago
  • $110 - $120 per hour

     ...ID paying $110/hour - $120/hour. Job Details: Position: Physician Assistant Specialty: Surgery Trauma Start Date: 11-30-26...  ...specialty. General Job Responsibilities: Provide comprehensive medical care to patients under the supervision of a licensed physician.... 
    Medical
    Hourly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Boise, ID
    1 day ago
  •  ...and 3 US Solid in-house referral base with more than 200 employed providers and 30+ specialties Opportunity to work with medical students and residents if desired Recruitment Package: Generous base salary + incentives Sign-On bonus and Relocation... 
    Medical
    Weekly pay
    Full time
    Immediate start
    Relocation package
    Flexible hours

    ARR Healthcare

    Idaho
    1 day ago
  • $110 - $120 per hour

     ...comprehensive patient assessments to diagnose and treat a variety of medical conditions. Develop and implement individualized treatment...  ...by state regulations and NP specialty. Collaborate with physicians and other healthcare providers to ensure coordinated care.... 
    Medical
    Hourly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Boise, ID
    1 day ago
  •  ...practice that currently enjoys a premier referral status in the Boise community 50% Dermpath (150+ dermpath slides a week) - 50% Medical Dermatology Dermatopathology cases will increase to 100% Dermatopathology over time This practice is NOT owned by a... 
    Medical
    Weekly pay
    Full time
    Immediate start
    Relocation package

    ARR Healthcare

    Idaho
    1 day ago
  •  ...In use at facility • Specialty Backup: Dedicated Rheumatology physician support • Support Staff: Experienced nursing staff and on-site...  ...: 160 hours of paid time off • Health & Retirement Benefits: • Medical, Dental, Vision coverage • Retirement plan options • Life and Disability... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Locum
    Local area
    Immediate start
    Relocation package
    Monday to Friday

    Adelphi Locums

    Blackfoot, ID
    1 day ago
  •  ...SCOPE • Patient Demographics: Adults and Geriatrics • Average Daily Volume / Census: Steady referral stream from a multi-specialty medical group and regional primary care network • Consults & Follow-Ups: Coordinated care with internal medicine, orthopedics, pain management... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Locum
    Local area
    Immediate start
    Relocation package
    Flexible hours

    Adelphi Locums

    Blackfoot, ID
    1 day ago
  •  ...the Position We are currently scheduling interviews with a physician-owned practice in the Lewiston, Idaho, area that is adding a Dermatologist...  ...insurance Physicians providing full-spectrum surgical, medical, and cosmetic dermatology services The practice offers a... 
    Medical
    Weekly pay
    Full time
    Work at office
    Local area
    Immediate start
    Relocation
    Relocation package
    Flexible hours
    2 days per week
    3 days per week

    ARR Healthcare

    Idaho
    1 day ago
  • $350k

     ...year Start Date: ASAP About the Position Dermatology Physician Opportunity in Boise, ID Join an established Dermatology...  ...long-term career. Practice Overview: Practice general medical dermatology with the option to incorporate procedural dermatology... 
    Medical
    Full time
    Live in
    Immediate start
    Relocation package
    Flexible hours
    3 days per week

    Curative

    Boise, ID
    1 day ago
  •  ...Opportunity North Idaho Dermatology is a physician-owned organization with four clinics...  ...and Moscow. We are seeking a Dermatologist MD/DO with knowledge in all areas of general dermatology...  ...balance ~ Family-friendly benefits ~ Medical & surgical dermatology with optional... 
    Medical
    Relocation package

    North Idaho Dermatology

    Post Falls, ID
    3 days ago
  • $325k - $375k

     ...costs ~ Technology package provided What we're looking for: Board-certified or board-eligible psychiatrists (MD/DO) Active, unrestricted medical license (multi-state licensing support available) Interest in outpatient, 100% telepsychiatry-based care... 
    Medical
    Remote job
    Full time
    Part time
    Private practice
    Flexible hours

    Talkiatry

    Boise, ID
    1 day ago
  •  ...Family Medicine Physician (MD/DO) - Educational Faculty - Nampa South Nampa South Family Medicine - Nampa, ID 83686; Nampa North - Nampa...  ...inpatient work with adults, OB and newborn care and a passion for medical education. Call is approximately 1 in 7. We have a unique... 
    Medical
    Full time
    Contract work
    Part time
    Shift work
    Night shift
    Weekend work
    2 days per week

    Full Circle Health

    Nampa, ID
    4 days ago
  • $40k

     ...Position JOB OVERVIEW • Job Title: Physician – Endocrinology (Diabetes Center Director...  ...CAH)• Coverage Type: Clinical Only + Medical Directorship • Coverage Period: ASAP – Ongoing...  ...management • Osteoporosis/metabolic evaluations JOB REQUIREMENTS • Licenses: ID license... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Temporary work
    Locum
    Work at office
    Immediate start
    Relocation package
    Shift work

    Adelphi Locums

    Blackfoot, ID
    1 day ago
  • $3,115 per day

     ...details) Start Date: ASAP About the Position Medical Oncology Physician Assignment Details Location: Boise, Idaho...  ...Provide Inpatient Medical Oncology Coverage Evaluate and Manage Hospitalized Oncology Patients Provide... 
    Medical
    Hourly pay
    Weekly pay
    Daily paid
    Full time
    Locum
    Immediate start
    Shift work

    WhiteCoat Locums

    Boise, ID
    1 day ago
  • $400k

     ...Position We are seeking a Fellowship-Trained Colorectal Surgery Physician to join our high-performing surgical team in Post Falls, Idaho....  ...excellent quality of life. Requirements: Current Idaho medical licensure (or eligibility). Board Certified or Board... 
    Medical
    Weekly pay
    Locum
    Immediate start

    AAS Locum Tenens

    Post Falls, ID
    1 day ago
  •  ...About the Position Are you an Interventional Radiologist physician searching for your next locum tenens opportunity? This...  ...years of experience optimizing continuity of care for hospitals, medical practices and government agencies across the US. A leading provider... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    Temporary work
    Locum
    Monday to Friday
    Night shift
    Weekend work

    VISTA Staffing

    Boise, ID
    1 day ago
  •  ...ARR Healthcare Pay: Competitive weekly pay (inquire for details) Start Date: ASAP About the Position Enterprise Medical Recruiting is assisting a Multispecialty practice in Coeur d'Alene to recruit a new Gastroenterologist. This is a hospital-employed... 
    Medical
    Weekly pay
    Full time
    Immediate start

    ARR Healthcare

    Idaho
    1 day ago
  •  ...DETAILS - Neurology (Neuro) ~ Take over practice from retiring physician and room to grow ~ Highly Collegial practice setting;...  ...Small Places for Business and Careers ~ University city with Medical School/Residency ~ Great Parks and Lots of Family Activities... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    For contractors
    Locum
    Live in
    Immediate start
    Relocation package

    Delta Locum Tenens

    Idaho
    1 day ago
  •  ...Board Eligible in Gastroenterology ERCP experience preferred; EUS training welcomed but not required Ability to obtain Idaho medical licensure This opportunity is ideal for a Gastroenterologist seeking strong earning potential, meaningful procedural volume, and... 
    Medical
    Full time
    Immediate start
    Relocation package
    Flexible hours
    1 day per week

    Curative

    Twin Falls, ID
    1 day ago
  •  ...population growth in that regional service area, they are in need of a full-time endocrinologist to enhance expanding multispecialty medical group, which includes over 300 providers across 30+ specialties. Position Highlights: Outpatient full-spectrum... 
    Medical
    Weekly pay
    Full time
    Local area
    Immediate start

    ARR Healthcare

    Idaho
    1 day ago
  • $4,446 per week

     ...Date: ASAP About the Position Radiology Interventional Physician – Boise, Idaho Are you a skilled interventional radiologist...  ...Competitive pay packages with weekly direct deposit ~ Comprehensive medical benefits (W-2) ~ Robust referral bonus program ~ Paid sick... 
    Medical
    Hourly pay
    Weekly pay
    Full time
    Temporary work
    Locum
    Immediate start
    Monday to Friday
    Flexible hours
    Shift work
    Weekend work
    Day shift
    Afternoon shift
    Weekday work

    VieMed Healthcare Staffing

    Boise, ID
    1 day ago
  • $70 per hour

     ...Com" Best Small Places for Business and Careers University city with Medical School/Residency Great Parks and Lots of Family Activities REFERENCE NUMBER: 230741 ABOUT DELTA PHYSICIAN PLACEMENT Delta Physician Placement (DPP), the permanent staffing... 
    Medical
    Weekly pay
    Permanent employment
    Full time
    For contractors
    Locum
    Live in
    Immediate start
    Relocation package

    Delta Locum Tenens

    Idaho
    1 day ago
  •  ...Start Date: ASAP About the Position Medical Oncology in Southern Idaho Join an...  ...Idaho. This opportunity is designed for physicians who want to focus on patient care, with no...  ...Practice Model: No procedures, ambient AI scribe technology, limited administrative... 
    Medical
    Full time
    Local area
    Immediate start
    Relocation package

    Curative

    Twin Falls, ID
    1 day ago
  • $119 per hour

     ...through telemedicine. Assess, screen, diagnose, and prescribe medication when clinically appropriate. Develop individualized...  ...experience as a licensed Psychiatrist. An active medical license (MD/DO) in good standing. Experience prescribing medication when clinically... 
    Medical
    Remote job
    Hourly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    BetterHelp

    Idaho
    6 hours ago
  • $250k - $300k

     ...SUMMARY: The Primary Care Physician is responsible for providing...  ...services within a medical home model.  Location: Stewart...  ...Conduct thorough medical evaluations, physical examinations, and...  ...Qualifications: Medical degree (MD or DO) from an accredited institution... 
    Medical
    Full time
    Local area
    Immediate start

    CoreCivic

    Preston, ID
    1 day ago
  •  ...Portneuf Medical Center Pocatello, Idaho About Core Clinical...  ...by doing things better. As a physician-founded, owned, and led physician...  ...Responsibilities Evaluate and manage hospitalized adult...  ...care Qualifications MD or DO Board Certified or Board... 
    Medical
    Local area
    Relocation package

    Core Clinical Partners

    Pocatello, ID
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!