Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Licensed Physician (MD/DO) - Freelance AI Trainer

$70 per hour
Part-time

Mindrift (Toloka)

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for  

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations 

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. 

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Licensed Physician (MD/DO) - Freelance AI Trainer in Holland, MI vacancy
  •  ...connects specialists with project-based AI opportunities for leading tech companies,...  ...We're looking for US-based, practicing physicians to contribute to health-focused AI training...  ..., psychologists, dietitians, and similar licensed professionals. If you're a practicing... 
    Freelance
    Hourly pay
    Permanent employment
    Part time
    10 hours per week

    Mindrift (Toloka)

    Holland, MI
    4 days ago
  • $69 per hour

     ...About the role  Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run...  ...different earning levels based on their requirements. Why this freelance opportunity might be a great fit for you?  Work fully remote... 
    Freelance
    Hourly pay
    Part time
    Remote work
    10 hours per week

    Mindrift (Toloka)

    Holland, MI
    4 days ago
  • $60 - $70 per hour

     ...growing network, you are/have: National certification as a registered dietitian (RD) or registered dietitian/nutritionist (RDN) with license to practice in Michigan Ability to commit for a minimum of 10 patient-facing hours per week A minimum of 3 years of... 
    Suggested
    Contract work
    For contractors
    10 hours per week

    Pomelo Care

    Holland, MI
    17 hours ago
  • $30 per hour

     ...power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists...  ...and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection... 
    Freelance
    Part time
    Remote work

    Mindrift (Toloka)

    Holland, MI
    3 days ago
  • $35 per hour

     ...general telehealth services. Our commitment to innovation and physician support has made us a trusted name in virtual medicine. Physicians...  ...We're seeking dedicated, patient-focused physicians licensed in at least five U.S. states to join our team. Whether your... 
    Suggested
    For contractors
    Work at office

    QuickMD

    Holland, MI
    1 day ago
  • $35 per hour

     ...general telehealth services. Our commitment to innovation and physician support has made us a trusted name in virtual medicine. Physicians...  ...We're seeking dedicated, patient-focused physicians licensed in at least five U.S. states to join our team. Whether your... 
    For contractors
    Work at office

    QuickMD

    Zeeland, MI
    1 day ago
  •  ...with Helen DeVos Children’s Hospital helps physicians provide specialized infant care, if needed....  ...acceptedQualificationsRequired Bachelor's DegreeLIC-Physician (MD) - STATE_MI State of Michigan Upon Hire required OrLIC-Osteopathic Physician (DO) - STATE_MI State of Michigan Upon Hire... 
    Full time
    H1b
    Work at office

    Corewell Health

    Holland, MI
    2 days ago
  • $35 per hour

     ...general telehealth services. Our commitment to innovation and physician support has made us a trusted name in virtual medicine. Physicians...  ...We're seeking dedicated, patient-focused physicians licensed in at least five U.S. states to join our team. Whether your... 
    For contractors
    Work at office

    QuickMD

    Zeeland, MI
    17 hours ago
  •  ...reach their communication goals and thrive both inside and outside the classroom. Desired Qualifications: Active and current SLP license Previous experience working in a school-based setting preferred Comfort and skill in servicing students in grades K–12... 
    Contract work
    Flexible hours

    Soliant

    Holland, MI
    2 days ago
  • $83k

     ...security, role-based access controls, and regulatory compliance. Ability to manage multiple initiatives and collaborate effectively in an Agile environment. Experience with AI-enabled data solutions and preparing data for machine-learning workloads is a plus.... 

    Community Choice Credit Union

    Holland, MI
    25 days ago
  •  ...Reports To: Special Education Director Beginning: October 19, 2026 Qualifications: Must be certified and licensed in the state of Michigan. Early childhood experience preferred. Knowledge of IDEA and Michigan Guidelines. Job Responsibilities... 
    Immediate start

    West Ottawa Public Schools

    Holland, MI
    1 day ago
  • $2,274 per week

     ...progress, operate relevant medical equipment, and collaborate with physicians and the broader care team to help deliver quality patient...  ...guidance, fast and straightforward onboarding, complimentary licensing support, and benefits that start on Day 1. Job Details... 
    Contract work
    Relocation
    Shift work
    Day shift

    Life Care Centers Michigan City

    Holland, MI
    1 day ago
  • Compensation $100/hour, up to $2,400 for the full study. Simple and transparent Participation is voluntary and covered by a signed consent form that explains exactly what’s involved. You can ask questions at any point and stop whenever you like. How to apply...
    Freelance
    Temporary work
    Part time

    Mindrift (Toloka)

    Holland, MI
    4 days ago
  •  ...Quality Bonus opportunities PTO package with 5 additional CME days + 6 holidays off Reimbursement for boards, credentialing, and licensing fees Paid malpractice insurance Teaching and Academic Appointment opportunity through affiliation with Michigan State... 
    Relocation package

    Pine Rest Christian Mental Health Services

    Holland, MI
    5 days ago
  • Job Description Job Description Benefits: ~ Earned Wage Access ~401(k) matching ~ Competitive salary ~ Dental insurance ~ Employee discounts ~ Flexible schedule ~ Health insurance ~ Opportunity for advancement ~ Training & development ~ Vision insurance...
    Full time
    Part time
    Second job
    Seasonal work
    Relocation package
    Flexible hours
    Shift work

    Jackson Hewitt - FXS

    Holland, MI
    18 days ago
  • $25 per hour

    Job description We are urgently looking for people interested in taking online surveys for Fortune 500 brands. If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up to $25 per survey. Share your opinion and help influence...
    Extra income
    Full time
    Temporary work
    Part time
    Second job
    Remote work
    Work from home
    Flexible hours

    Earn Haus

    Holland, MI
    26 days ago
  • $25.05 - $26.25 per hour

     ...degree is a plus Strong mechanical and electrical background required Must be at least 21 years of age, have a valid driver's license, a good driving record and ability to obtain a passport. Experience and ability to travel extensively, up to 75% during season,... 
    Hourly pay
    Full time
    Second job
    Local area
    Worldwide
    Flexible hours
    Shift work
    Night shift

    Duravant

    Holland, MI
    3 days ago
  • $100 per hour

     ...English. ~ Available for 3 consecutive days (Mon–Wed or Thu–Sat), starting October 16 on Friday. ~ Not currently employed by a tech or AI company. Great fit for international students, people new to NYC, and anyone between jobs or with a flexible schedule.... 
    Freelance
    Part time
    Flexible hours

    Mindrift (Toloka)

    Holland, MI
    5 days ago
  •  ...Description Step into a vital role where you can support student achievement and help young learners thrive. This contract position for a licensed Speech-Language Pathologist allows you to work with a diverse range of students across elementary, middle, and high school levels.... 
    Contract work

    Soliant

    Hudsonville, MI
    2 days ago
  • $88k - $128k

     ...manufacturing or industrial settings. Knowledge of industrial cameras, sensors, and lighting systems. Experience in deploying AI models to edge devices or cloud platforms. Familiarity with 3D CAD tools and simulation software is advantageous. Leadership experience... 
    Full time
    Local area
    Relocation

    1007 Clarios, LLC

    Holland, MI
    4 days ago
  • $150k - $175k

     ...is the nation’s premier comprehensive lower-extremity focused Physician Practice. We provide leading podiatrists, orthopedic surgeons,...  ...clean DMV report. Education and Experience: Current active license as a Podiatrist in the State of Michigan. Doctoral degree in... 

    Foot & Ankle Specialists of West Michigan

    Holland, MI
    3 days ago
  • Here at Chow Hound our mission is quite simple - to offer the best pet products possible, to help pet parents with any questions they may have, and to give back to the communities we serve. We hope that you can be a part of that goal as a member of our team! As a sales...
    Full time
    Second job
    Flexible hours
    Shift work

    Chowhound

    Holland, MI
    1 day ago
  • $1,000 per month

    Join Our Team as a Website Tester at Little Wheel Little Wheel is a gambling technology company focused on researching and building products that put players first. We are currently hiring Website Testers across Michigan, New Jersey, Pennsylvania, and West Virginia...
    Extra income
    Temporary work
    Second job
    Currently hiring
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Little Wheel

    Holland, MI
    1 day ago
  • $50 - $65 per hour

     ...Description Job Description Part Time Nurse Practitioner or Physician Assistant (Advanced Practice Provider) in Holt, MI. Are...  ...- $65 per hour Our Requirements are: Michigan NP or PA License in good standing. We require previous Family Medicine or Urgent... 
    Hourly pay
    Part time
    Work at office
    Monday to Friday
    3 days per week

    Nirvana Healthcare

    Holland, MI
    10 days ago
  •  ...dental education program accredited by the American Dental Association Commission on Dental Accreditation (ADA CODA) Current state license to practice dentistry Documentation of Hepatitis B vaccination When you join 42 North Dental, you will be part of a team that... 
    Part time
    Work at office
    Local area

    42North Dental

    Douglas, MI
    2 days ago
  • $40 per hour

    Job Description Job Description Speech Language Pathologist New Management! Competitive Sign on Bonus OR loan assistance (new grads) for FT H1B Visa transfers considered Join Our Team at The Orchards at Douglas Cove, a premier healthcare organization in ...
    Hourly pay
    Full time
    H1b
    Relocation package

    The Orchards at Douglas Cove

    Douglas, MI
    1 day ago
  •  ...institute therapy or referrals of patients to the appropriate health care facilities, agencies, and other resources of the community or physician Institute emergency measures and emergency treatment or appropriate stabilization measures in situations such as cardiac arrest... 
    Flexible hours

    American Family Care Holland

    Holland, MI
    13 days ago
  • $400k

    Job Description Job Description A well established, newly renovated private Pediatric dental practice in Hudsonville, MI (suburb of Grand Rapids) is currently searching for a full time Pediatric dentist. This practice is fully digital, has multiple lasers and digital...
    Full time
    Private practice
    Relocation package

    the dentist agent

    Hudsonville, MI
    a month ago
  •  ...flexible three-day-per-week schedule in a collaborative and student-focused educational environment. Key Qualifications: Active SLP license and Certificate of Clinical Competence in Speech-Language Pathology (CCC-SLP) Experience working in school settings or providing... 
    Contract work
    Part time
    Flexible hours
    3 days per week

    ProCare Therapy

    Hudsonville, MI
    2 days ago
  • Job Description Job Description Experience adventure and professional growth as you take your expertise on the road in a rewarding travel position for a skilled SLP. Enjoy the flexibility, financial security, and unique benefits that come with traveling assignments...
    Local area

    Soliant

    Holland, MI
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!