Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time)

$70 per hour

Mind Rift

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation isproject-based. What this opportunity involves We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may: Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality; Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales; Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself. What we look for This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have: Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board); Board certification or completed residency training, with recent direct patient care (attending-level preferred); Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine); Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines; Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus); Strong written English (C1+). This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles. Project time expectations For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. Compensation Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks - up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate. #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time) in New York, NY vacancy
  • $100 per hour

     ...specialists with project-based AI opportunities for leading...  ...companies, focused on testing, evaluating, and improving AI systems....  ...clinical EHR vignettes for a medical AI evaluation program. General...  ...US-based physicians open to part-time, non-permanent projects. Ideally... 
    Part time
    Remote work
    Medical
    Hourly pay
    Permanent employment
    10 hours per week

    Mindrift

    Remote
    3 days ago
  • $70 per hour

    Mindrift invites US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Participation is part-time and project-based, with tasks centered on diagnosing and treating multiple systems and scoring reasoning quality across blind reads.... 
    Part time
    Medical
    Hourly pay

    Mindrift

    New York, NY
    5 days ago
  • $80 - $125 per hour

     ...the cutting edge of medical AI, on your own...  ...AI is trained and evaluated with input from practicing...  .... You can do this remotely alongside your...  ...this is worth your time Get paid the...  ...years or more of hospitalist experience, with current...  ...with paid, part-time AI training work... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    3 days ago
  • $70 - $100 per hour

     ...the cutting edge of medical AI, on your own...  ...building them need hospitalist physicians who can...  ...is that work, done remotely around your current...  ...underlying record Evaluate histories of...  ...this is worth your time Get paid $70–$1...  ...different kind of part-time work Fully... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    5 days ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focusing on testing, evaluating, and improving AI systems. We’re seeking US-...  ...general and internal medicine. Projects are part-time, non-permanent, and typically require around... 
    Part time
    Permanent employment
    10 hours per week

    Mindrift (Toloka)

    New York, NY
    4 days ago
  • $80 - $125 per hour

     ...on the cutting edge of medical AI, on your own schedule,...  ...is that work, done remotely around your current practice...  ...this is worth your time Build real AI...  ...practice designation Hospitalist experience totaling at...  ...professionals with paid, part-time AI training work:... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    4 days ago
  • $70 - $115 per hour

     ...on the cutting edge of medical AI, on your own schedule,...  ...building them need hospitalist physicians who can review...  ...is that work, done remotely around your current practice...  ...this is worth your time Get paid $70–$115...  ...professionals with paid, part-time AI training work:... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    4 days ago
  •  ...Turing is seeking a licensed physician to work remotely on medical AI evaluation projects. The role involves designing evaluation frameworks and clinical scenarios to test AI systems against real medical problems, with a flexible engagement of up to 30 hours per week for... 
    Part time
    Remote work
    Medical
    Flexible hours

    Modern MedEd LLC

    United States
    3 days ago
  • $100 - $120 per hour

     ...on the cutting edge of medical AI, on your own schedule,...  ...judgment becomes part of how the next generation...  ...This is that work, done remotely around your current...  ...Why this is worth your time Get paid $100-$120 an...  ...or recent inpatient or hospitalist role Strong grasp of inpatient... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    3 days ago
  • $100 - $150 per hour

     ...the cutting edge of AI documentation...  ...clinical judgment becomes part of how the next...  ...systems handles complex medical records. This is that work, done remotely around your current...  ...this is worth your time Get paid $100–$150...  ...as an attending hospitalist Know inpatient documentation... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    1 day ago
  •  ...is seeking experienced MDs or DOs to evaluate health AI models remotely in the United States. You will...  ...provide structured feedback to ensure medical accuracy and safety. The role requires...  ...residency experience. It is a contractor, part-time engagement offering ~20+ hours per... 
    Part time
    Remote job
    Medical
    For contractors

    Benture

    New York, NY
    3 days ago
  • $170 per hour

     ...Position: Medical Expert Dermatology (USA) Type: Contractor...  ...0 per hour Location: Remote Commitment: Full-time or part-time (20 - 40 hours/week)...  ...a structured online evaluation tool. Assess image...  ...document rationale. Review AI-generated medical text... 
    Part time
    Remote work
    Medical
    Hourly pay
    Full time
    For contractors

    Crossing Hurdles

    United States
    11 hours ago
  • $30 - $60 per hour

    Jobgether SRL in the United States seeks a remote, contract-based role to design realistic medical tasks for evaluating AI in healthcare. This part-time position offers about 20 hours per week and remote work flexibility. You will create tasks involving clinical analysis... 
    Part time
    Remote job
    Medical
    Hourly pay
    Contract work

    Jobgether SRL

    New York, NY
    3 days ago
  • InforCapital, partnership seeks a Licensed Real Estate Agent - AI Quality Evaluator for a part-time remote role based in Seattle, WA. The ideal candidate must...  ...a competitive salary, contractor benefits including medical and 401k, and an equal opportunity work environment.... 
    Part time
    Remote job
    Medical
    For contractors

    InforCapital, partnership

    Seattle, WA
    3 days ago
  •  ...behalf of a healthcare AI partner building...  ..., annotate, and evaluate clinical documentation...  ...usefulness of medical AI systems.This role...  ...clinical notes as part of your regular work...  ...ArrangementRemote, part-time — minimum 10 hours/...  ....This is a fully remote role that can be completed... 
    Part time
    Remote work
    Medical
    Contract work
    For contractors

    Modern MedEd

    Los Angeles, CA
    1 day ago
  •  ...Analyze GitHub issues and evaluate LLM performance on real...  ...’s fastest-growing AI companies accelerating...  ...Work in a fully remote environment. Opportunity...  ...(We have 3 options of time commitment: 20 hrs/week...  ...Contractor assignment (no medical/paid leave) Location... 
    Part time
    Remote work
    Medical
    For contractors
    Freelance

    Turing

    San Francisco, CA
    12 days ago
  •  ...Specialised Part-Time Consulting OpportunityWe are sharing...  ...advanced large language model evaluation, coding benchmark development, and AI-assisted software-...  ...rationalesComfortable collaborating remotely with research and...  ...and project fitNo medical or paid-leave benefits are... 
    Part time
    Remote work
    Medical
    For contractors

    24-MAG LLC

    New York, NY
    5 days ago
  •  ...Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20–40 hours per week with at least 4 hours overlap during PST business hours... 
    Part time
    Remote work
    Medical
    For contractors

    Crossing Hurdles

    New York, NY
    1 day ago
  •  ...Crossing Hurdles is seeking a Medical Expert Dermatology contractor to review dermatology images remotely in the USA. The role requires...  ...residency experience, with full or part-time hours (20–40 per week) and 4...  ...issue tagging, and validating AI-generated medical text. The... 
    Part time
    Remote work
    Medical
    Hourly pay
    Full time
    For contractors

    Crossing Hurdles

    New York, NY
    12 hours ago
  • # Licensed Real Estate Agent - AI Quality Evaluator (Remote - Seattle, WA)Tech Square VenturesReal EstateReal...  ...Agent - AI Quality Evaluator on a part-time , contract basis to support our...  ...eligible engagements) Benefits include: Medical, Dental, Vision, 401k. An Equal Opportunity... 
    Part time
    Remote job
    Medical
    Contract work
    For contractors
    Local area

    InforCapital, partnership

    Seattle, WA
    3 days ago
  • $230k - $250k

     ...drive groundbreaking medical discoveries and...  ...what it means to be part of Mass General...  ...is seeking a full-time, part-time, and per...  ...team. Qualifications Hospitalist - Long-Term Acute...  ...growth. Remote Type OnsiteWork Location...  ...competencies are used to evaluate performance, make... 
    Part time
    Remote work
    Medical
    Daily paid
    Full time
    Freelance
    Relocation package
    Monday to Friday
    Shift work
    Weekend work

    Partners HealthCare

    Cambridge, MA
    5 days ago
  • $75 - $110 per hour

     ...Category: Medical & Clinical AI · Pay: $75–$110 / hr · Location: Remote — US-eligible · Contractor Hospitalist (Locum Tenens) — Remote Clinical AI Review is a remote clinical-review track for evaluating AI outputs that touch hospitalist. Reviewers grade differential... 
    Remote work
    Medical
    Hourly pay
    For contractors
    Locum
    10 hours per week

    AuraOne

    United States
    1 day ago
  • $231k

     ...drive groundbreaking medical discoveries and invite...  ...what it means to be part of Mass General Brigham...  ..., and can request time on the hospitalist procedure service, or...  ...Participate in peer evaluation, practice-based and system...  ...and internal equity. Remote Type Onsite Work... 
    Part time
    Remote work
    Medical
    Full time
    Night shift

    Massachusetts General Hospital

    Boston, MA
    4 days ago
  •  ...About the Role We are seeking experienced Hospitalist Physicians to support the training and evaluation of next-generation AI systems focused on inpatient medicine and clinical documentation. You will review medical records, structured FHIR data, and clinical notes... 
    Medical
    Contract work

    Gramian Consulting Group

    Remote
    15 days ago
  •  ...Information About The Role BJC Medical Group | Missouri Baptist...  ...Medical Group is seeking a Part-Time OB Hospitalist Medical Director to provide...  ...Flexible combination of remote and on-site meetings Opportunity...  ..., assigns work, manages & evaluates performance, conducts... 
    Part time
    Remote work
    Medical
    Full time
    Relief
    Flexible hours
    Shift work

    Missouri Baptist Medical Center

    Saint Louis, MO
    1 day ago
  • A healthcare organization is seeking a part-time Tele-Hospitalist for remote work covering shifts in Kansas, Louisiana, and Texas. This role offers flexibility...  ...per month. The successful applicant must hold an active medical license in Louisiana or be an IMLC member. The position... 
    Part time
    Remote work
    Medical
    Flexible hours
    Shift work

    Beam Healthcare

    United States
    3 days ago
  •  ...technical talent with leading AI research labs. Headquartered...  ...$200/hour Location: Remote Commitment: Flexible part-time hours Role Responsibilities Evaluate AI answers to neurology questions...  ...or DO from an accredited medical school. ~ Board certified... 
    Part time
    Remote work
    Medical
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    New York, NY
    4 days ago
  •  ...physicians on behalf of a healthcare AI partner building advanced...  ...to review, annotate, and evaluate clinical documentation ,...  ..., and clinical usefulness of medical AI systems. Key Responsibilities...  ...Work Arrangement Remote, part-time Flexible scheduling, designed... 
    Part time
    Remote work
    Medical
    Flexible hours

    Mercor Inc

    Houston, TX
    3 days ago
  •  ...AuraOne is hiring for Hospitalist Reviewer—a remote clinical-review track evaluating AI outputs related to hospitalist care. You will grade differential reasoning, dosing logic, and guideline adherence, flag safety issues, and document corrected reasoning for model training... 
    Remote work
    For contractors

    AuraOne

    New York, NY
    5 days ago
  • $150 per hour

     ...Mercor is partnering with healthcare AI to hire pediatricians (MD) to review, annotate, and evaluate clinical documentation. Your pediatric expertise will...  ...of AI-generated clinical summaries. This remote, US-based, part-time contractor role requires an MD with pediatric... 
    Part time
    Remote work
    Medical
    Hourly pay
    For contractors
    10 hours per week
    Flexible hours

    Benture

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time). Be the first to apply!