Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Licensed Physician (MD/DO) - Freelance AI Trainer

$100 per hour
Part-time

Mindrift

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $100/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Licensed Physician (MD/DO) - Freelance AI Trainer in Philadelphia, PA vacancy
  • $300k

     ...-volume practice within a collaborative, physician-driven environment. Position Overview...  ...CME allowance Paid time off Licensing fees covered (New Jersey medical license, CDS, DEA) Requirements: MD or DO from an accredited medical institution... 
    Suggested
    Weekly pay
    Full time
    Locum
    Private practice
    Immediate start

    AAS Locum Tenens

    Cherry Hill, NJ
    1 day ago
  •  ...day. Job Details: Position: Physician Specialty: Surgery Trauma...  ...Requirements:   Doctor of Medicine (MD) degree or Doctor of Osteopathic Medicine (DO) degree from an accredited...  ...Osteopathic Association (AOA). License & Certifications:   Board certification... 
    Suggested
    Weekly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Philadelphia, PA
    1 day ago
  • $350k

     ...Interventional Physical Medicine & Rehabilitation Physician to join its growing team. This position...  ...with experience Requirements: MD or DO from an accredited medical school...  ...residency Active New Jersey medical license or eligibility for licensure Strong... 
    Suggested
    Weekly pay
    Full time
    Locum
    Work at office
    Immediate start
    Monday to Friday
    Night shift
    Weekend work

    AAS Locum Tenens

    Cherry Hill, NJ
    1 day ago
  •  ...day. Job Details: Position: Physician Specialty: Surgery Orthopedic...  ...Requirements:   Doctor of Medicine (MD) degree or Doctor of Osteopathic Medicine (DO) degree from an accredited...  ...Osteopathic Association (AOA). License & Certifications:   Board certification... 
    Suggested
    Weekly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Philadelphia, PA
    1 day ago
  •  ...are seeking a dedicated and experienced Urgent Care Physician to join our team in Philadelphia, PA. The ideal candidate...  ...with employer match. Requirements: ~ MD or DO with active, unrestricted medical license in Pennsylvania ~4 years post-residency experience... 
    Suggested
    Weekly pay
    Full time
    Locum
    Weekend work

    AAS Locum Tenens

    Philadelphia, PA
    1 day ago
  • $350k

     ...Board Certified or Board Eligible Neurology Physician with a strong interest or expertise in...  ...on experience Requirements: MD or DO from an accredited medical school Board...  ...residency Active New Jersey medical license or eligibility Demonstrated... 
    Weekly pay
    Full time
    Part time
    Locum
    Work at office
    Immediate start
    Monday to Friday
    Night shift
    Weekend work
    Weekday work

    AAS Locum Tenens

    Cherry Hill, NJ
    1 day ago
  •  ...Start Date: ASAP About the Position Pennsylvania Physicians — Lead the Future of Outpatient Care Clinic Medical Director...  ...Candidate Requirements Active & unrestricted Pennsylvania medical license + DEA Board Certified or Eligible (ABMS or AOA)... 
    Weekly pay
    Permanent employment
    Full time
    Contract work
    Local area
    Relocation
    Relocation package
    Monday to Friday
    Weekend work

    Rhino Medical

    Philadelphia, PA
    1 day ago
  • $135 - $145 per hour

     ...PA paying $135/hour - $145/hour. Job Details: Position: Physician Specialty: Occupational Medicine Start Date: 12-07-26...  ...application and assignment support. In-house credentialing and licensing teams. Travel and lodging coverage. Easy timekeeping and... 
    Hourly pay
    Full time
    Contract work
    Locum
    Immediate start
    Shift work

    Aya Locums

    Philadelphia, PA
    1 day ago
  • $214k - $382k

     ...patient Communicate effectively with referrals sources, i.e., physicians, schools, higher levels of care, etc., when working with...  ...Qualifications: Have a clear, active and unrestricted Physician license (MD/DO) in Pennsylvania Board certified in psychiatry by the... 
    Minimum wage
    Full time
    Work experience placement
    Local area
    Remote work
    Relocation package
    Flexible hours

    Optum

    Upper Darby, PA
    2 days ago
  • $80 per hour

     ...PA area is seeking Urgent Care, Emergency, or Family Medicine Physicians to join our team as we expand coverage. Key Details:...  ...Medicine, or Family Medicine Active Massachusetts medical license or ability to obtain one Strong interpersonal and clinical... 
    Hourly pay
    Weekly pay
    Full time
    Locum
    Flexible hours
    Weekend work

    AAS Locum Tenens

    Philadelphia, PA
    1 day ago
  •  ...Position This Job at a Glance Job Reference Id: ORD-226003-MD-PA Title: MD Dates Needed: ASAP - Ongoing Shift Type:...  ...Love Park. About the Clinician's Workday The Internal Medicine physician will provide clinic-based primary care services in a... 
    Weekly pay
    Full time
    Locum
    Immediate start
    Shift work
    Weekend work
    Day shift

    LocumTenens.com

    Philadelphia, PA
    1 day ago
  • $110 - $125 per hour

     ...PA paying $110/hour - $125/hour. Job Details: Position: Physician Assistant Specialty: Critical Care Start Date: 01-18-27...  ...comprehensive medical care to patients under the supervision of a licensed physician. Conduct patient histories and physical... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Wynnewood, PA
    1 day ago
  • $110 - $125 per hour

     ...permitted by state regulations and NP specialty. Collaborate with physicians and other healthcare providers to ensure coordinated care....  ...(e.g., family practice, adult-gerontology, pediatrics). License & Certifications: Active and unencumbered advanced practice... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Wynnewood, PA
    1 day ago
  • $180k - $300k

     ...Description Job Description Attending Physician – Skilled Nursing Facility (Lafayette...  ...MDS PC) is hiring an Attending Physician (MD/DO) to care for residents at a skilled nursing...  ...What you'll need: Active NYS medical license (MD or DO) Current DEA registration in... 
    Full time
    Local area

    Medical Director Services PC

    Lafayette Hill, PA
    22 days ago
  •  ...weekly pay (inquire for details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Primary Care Physician (MD or DO) Location: Pennsylvania Position Overview Outpatient primary care and acute care in a corporate health center... 
    Weekly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Shift work

    All Medical Personnel

    Philadelphia, PA
    1 day ago
  •  ...lives. We are launching a new clinical pilot that integrates physicians, care navigators, and community support teams to create a more...  ...and human approach to care. We are seeking a Pennsylvania-licensed physician to serve as a consulting clinician for an early-... 
    Work at office
    Local area

    Wider Circle

    Philadelphia, PA
    5 days ago
  • Doctor of Medicine | Internal Medicine - General/Other Location: Philadelphia, PA Employer: Weatherby Healthcare Pay: Competitive weekly pay (inquire for details) Shift Information: 4 days x 10 hours Start Date: ASAP About the Position Interested...
    Weekly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work

    Weatherby Healthcare

    Philadelphia, PA
    1 day ago
  • Doctor of Medicine | Internal Medicine - General/Other Location: Philadelphia, PA Employer: Weatherby Healthcare Pay: Competitive weekly pay (inquire for details) Shift Information: 4 days x 10 hours Start Date: ASAP About the Position If...
    Weekly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work

    Weatherby Healthcare

    Philadelphia, PA
    1 day ago
  • $235k

     ...Location: Philadelphia, PA Employer: Curative Pay: $235,000 per year Start Date: ASAP About the Position OB/GYN Physician - Philadelphia, Pennsylvania Join a well established nonprofit healthcare organization serving the Greater Philadelphia... 
    Full time
    Part time
    Work at office
    Immediate start

    Curative

    Philadelphia, PA
    1 day ago
  •  ...Weeks Start Date: ASAP About the Position Primary Care Physician, Nurse Practitioner or Physician Assistant Location: PA...  ...Required Qualifications Active and unrestricted NP or PA license in the state of practice National certification for NP or PA... 
    Weekly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Weekend work
    2 days per week
    Weekday work

    All Medical Personnel

    Philadelphia, PA
    1 day ago
  • $150 per hour

     ...Contract Duration: 2 Weeks Start Date: ASAP About the Position Requirements: Active Pennsylvania License & DEA Position: Primary Care Physician Primary Care Physician - Needed for an ongoing outpatient assignment in Pennsylvania. The clinician will be... 
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Weekend work

    Alumni Healthcare Staffing

    Philadelphia, PA
    1 day ago
  •  ...weekly pay (inquire for details) Start Date: ASAP About the Position This Job at a Glance Job Reference Id: ORD-224412-MD-PA Title: MD Dates Needed: ASAP - Ongoing Shift Type: Day Shift Assignment Type: Clinic Call Required: No Board... 
    Weekly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work
    Day shift

    LocumTenens.com

    Philadelphia, PA
    1 day ago
  • $75 - $90 per hour

     ...permitted by state regulations and NP specialty. Collaborate with physicians and other healthcare providers to ensure coordinated care....  ...(e.g., family practice, adult-gerontology, pediatrics). License & Certifications: Active and unencumbered advanced practice... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Locum
    Immediate start
    Flexible hours
    Shift work

    Aya Locums

    Philadelphia, PA
    1 day ago
  • $130 - $145 per hour

     ...PA paying $130/hour - $145/hour. Job Details: Position: Physician Specialty: Primary Care Start Date: 12-04-26 Length: 1...  ...application and assignment support. In-house credentialing and licensing teams. Travel and lodging coverage. Easy timekeeping and... 
    Hourly pay
    Full time
    Contract work
    Locum
    Immediate start
    Shift work

    Aya Locums

    Philadelphia, PA
    1 day ago
  • $150 per hour

     ...details) Contract Duration: 2 Weeks Start Date: ASAP About the Position Requirements: Active New Jersey License & DEA Position: Physician/Medical Director Physician/Medical Director needed for an ongoing outpatient assignment in New Jersey. The... 
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Shift work

    Alumni Healthcare Staffing

    Camden, NJ
    1 day ago
  •  ...weekly pay (inquire for details) Start Date: ASAP About the Position This Job at a Glance Job Reference Id: ORD-201206-MD-PA Title: MD Dates Needed: July 2026 - Ongoing Shift Type: Day Shift Assignment Type: Inpatient Call Required: No... 
    Weekly pay
    Full time
    Locum
    Immediate start
    Monday to Friday
    Shift work
    Day shift

    LocumTenens.com

    Philadelphia, PA
    1 day ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating...  ...opportunity on the Outlier.ai platform. You will join Outlier as a freelancer/independent contractor, not an employee. Because this is a... 
    Freelance
    Hourly pay
    Full time
    Contract work
    For contractors
    Work experience placement
    Internship
    Remote work
    Flexible hours
    Night shift

    Outlier AI

    Philadelphia, PA
    16 hours ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating...  ...opportunity on the Outlier.ai platform. You will join Outlier as a freelancer/independent contractor, not an employee. Because this is a... 
    Freelance
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Work experience placement
    Internship
    Remote work
    Night shift

    Outlier AI

    Philadelphia, PA
    16 hours ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating...  ...opportunity on the Outlier.ai platform. You will join Outlier as a freelancer/independent contractor, not an employee. Because this is a... 
    Freelance
    Hourly pay
    Full time
    Contract work
    For contractors
    Work experience placement
    Internship
    Remote work
    Night shift

    Outlier AI

    Philadelphia, PA
    16 hours ago
  •  ...Jefferson Health | Lehigh Valley Physician Group Jefferson Health is seeking a Board Certified/Board Eligible Hospital Medicine Physician...  ...Professional development opportunities Qualifications MD or DO Board Certified or Board Eligible in Internal Medicine or... 
    Freelance
    Relocation package

    Parkland High School

    Philadelphia, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!