Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Medical Evaluation Specialist (students, residents, physicians) [Remote]

AuraOne Human Data

Remote
  • Remote job

Medical Evaluation Specialist (students, residents, physicians) is a remote clinical-review track for evaluating AI outputs that touch physician. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

physician AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current physician clinical guidelines and standard of care for Medical Evaluation Specialist (students, residents, physicians) assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in physician or an adjacent specialty for Medical Evaluation Specialist (students, residents, physicians) work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a physician case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • physician
  • Healthcare

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Medical Evaluation Specialist (students, residents, physicians) [Remote] in Remote vacancy
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving next‑generation AI systems. In this contractor role, you will create and validate... 
    Resident
    For students
    Remote job
    For contractors

    YO AI Labs

    Seattle, WA
    2 days ago
  • Job Title: Medical Evaluation Specialist Role Type: Contractor Location: Remote Job Overview We are seeking Medical Evaluation Specialists , including medical students, residents, physicians, and qualified biomedical professionals, to contribute clinical expertise to a... 
    Resident
    For students
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    6 days ago
  • $40 - $90 per hour

     ...next-generation AI systems through rigorous, real-world medical evaluation work. You will create and assess challenging medical...  ...project standards. Qualifications Current medical student, resident, physician, or professional with equivalent biomedical expertise.... 
    Resident
    For students
    Hourly pay
    Contract work
    Remote work

    SaidGig

    United States
    3 days ago
  •  ...include teaching psychiatry residents and medical students through Sanford's...  ...psychiatrists, clinical nurse specialists, doctorate-level psychologists...  ...to the setting ), evaluate, diagnose, and treat patients...  ...) or the Royal College of Physician and Surgeons of Canada. Training... 
    Resident
    For students
    Full time
    Temporary work
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...with basic scientists and to educate medical students and residents• Neurology Residency Program with 3...  ...setting), provide consultative services, evaluate, diagnose, and provide nonsurgical...  ...(AOA) or the Royal College of Physician and Surgeons of Canada in the residency... 
    Resident
    For students
    Full time
    Temporary work
    H1b
    Visa sponsorship
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...as regular interaction with students and residents rotating through the...  ...provide consultative services, evaluate, diagnose, treat, and provide...  ...AOA) or the Royal College of Physician and Surgeons of Canada....  ...board of the American Board of Medical Specialties (ABMS), the... 
    Resident
    For students
    Full time
    Temporary work
    Local area
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...alongside two MS-trained physician assistants and a dedicated...  ...consultations and collaboration with specialists in neuro-ophthalmology,...  ...will also contribute to resident and medical student education through teaching...  ...consultative services, evaluate, diagnose, and provide... 
    Resident
    For students

    Sanford Health

    Fargo, ND
    3 days ago
  •  ...this posting. JOB SUMMARYThe Attending Physician XI Maternal Fetal Medicine (MFM) is...  ....Oversees activities related to resident and medical student’s activity on the Maternal Fetal Medicine...  ...of schedules, and completion of evaluations, as directed.Performs only such procedures... 
    Resident
    For students
    Full time
    Local area

    Cook County Sheriff

    Chicago, IL
    4 days ago
  •  ...applications for Senior Staff Physician, UNLV Student Wellness, Student...  ..., at the Las Vegas Medical District campus....  ...of treatment, evaluation of responses to treatments...  ...to appropriate specialists and higher levels of...  ...of a family medicine residency, a current Nevada M.... 
    Resident
    For students
    Daily paid
    Full time
    Work at office

    University of Nevada Las Vegas

    Las Vegas, NV
    3 days ago
  • $220.36k - $328.41k

     ...Attending Physician IX - Neurology Job Number: 00138959...  ...completed an accredited residency in Neurology, and who is...  ...physician is responsible for the medical care of patients with...  ...a timely manner Complete evaluations of resident and students in a timely manner Maintains... 
    Resident
    For students
    Permanent employment

    Cook County Health

    Chicago, IL
    2 days ago
  • $70 per hour

     ...Powerback? Benefits:  We offer Medical, Dental, and Vision plans to...  ...of CFYs temporary licensees, students and support personnel in...  ...Service first, ensuring that residents and families receive the highest...  .... Screens, examines and evaluates patients, including history,... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    H1b
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    Powerback Rehabilitation

    Massachusetts
    3 hours ago
  • $62 per hour

     ...Benefits : We offer Medical, Dental, and Vision plans...  ...a patient‘s private residence or in a patient‘s room...  ...Language Pathologist to evaluate and treat in the most...  ...temporary licensees, students and support personnel...  ...rehabilitation team and the physician to select the most... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    H1b
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    Powerback Rehabilitation

    Vernon, CT
    3 hours ago
  • $63 per hour

     ...Benefits:  We offer Medical, Dental, and Vision plans...  ...a patient‘s private residence or in a patient‘s room...  ...Language Pathologist to evaluate and treat in the most...  ...temporary licensees, students and support personnel...  ...rehabilitation team and the physician to select the most... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    H1b
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    Powerback Rehabilitation

    Westfield, MA
    3 hours ago
  •  ...care in each of the Medical Centers. This is an...  .../ hospitalist physician for house staff on...  ...internal medicine residents and medical students in all their clinical...  ...including trainee evaluation if applicable. All...  ...with ancillary staff, specialists, and physician extenders... 
    Resident
    For students
    Full time
    Contract work
    Traineeship
    Freelance
    Internship
    Seasonal work
    Work at office
    Local area
    Relocation package
    Night shift
    Rotating shift

    Veterans Affairs, Veterans Health Administration

    Fargo, ND
    1 day ago
  • $276.8k - $344.72k

     ...ATTENDING PHYSICIAN VII, BILINGUAL - PSYCHIATRY Job Posting...  ...of patients with co-morbid medical disease and mental illness...  ...Clinic to ensure safety, evaluate need for further hospitalization...  ...education to patients, students, medical residents, and clinic staff... 
    Resident
    For students
    Traineeship
    Shift work

    Cook County Health

    Chicago, IL
    1 day ago
  • $340k - $400k

     ...Team at the Department of Veterans VA Medical Center in San Francisco, CA as a Nuclear Medicine Physician! The Nuclear Medicine Physician duties...  ...the supervision and education of resident physicians and medical students from the University of California, San... 
    Resident
    For students
    Full time
    Contract work
    Freelance
    Work from home

    Department of Veterans Affairs

    Millbrae, CA
    4 days ago
  •  ...Physician, Student Health Join Our Campus Community! Thank you for...  ...Coverage: Enjoy access to medical, dental, and vision insurance...  ...experience requirements are evaluated on a full-time equivalent (...  ...a charming town of 30,000 residents nestled in the heart of the... 
    Resident
    For students
    Permanent employment
    Full time
    Temporary work
    Part time
    Work visa

    University of Washington (UW)

    Laramie, WY
    6 days ago
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise for evaluating and improving next-generation AI systems. You will create and validate challenging medical questions... 
    Resident
    For students
    Remote job
    For contractors

    YO AI Labs

    Dallas, TX
    1 day ago
  • $320k - $400k

     ...More than 500 full-time salaried physicians and advanced practice clinicians...  ...University and teaching Bassett IM Residents & Columbia-Bassett Medical Students Inpatient & Outpatient Tele-...  ...specialty, training, and fair market evaluation based on industry standards... 
    Resident
    For students
    Full time
    H1b
    Remote work
    Visa sponsorship
    Relocation package

    Endocrine

    Brooklyn, NY
    4 days ago
  •  ...provides health services to Veterans through the San Francisco VA Medical Center (SFVAMC) and seven community-based outpatient clinics...  ...and staff and outstanding trainees at all levels (medical students, residents, and fellows) • Academic environment with commitment to... 
    Resident
    For students
    Traineeship
    Night shift

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  • $250k

    Nuclear Medicine Specialist Opportunities - Northern, CA Hiring...  .../ The Permanente Medical Group The Permanente Medical...  ...nation with over 10,000 physicians, 21 medical centers,...  ...technologists, medical students and non-imaging medical residents (internal medicine, podiatry... 
    Resident
    For students
    Full time
    For contractors
    Traineeship
    Local area
    Remote work
    Work from home
    Home office
    Relocation package
    Flexible hours

    Kaiser Permanente - The Permanente Medical Group, Inc. -Nort...

    Vacaville, CA
    3 days ago
  • $250k - $265k

     ...recruiting Primary Care Physicians to care for our...  ...Actively participates in Medical Center committees and...  ...Plans, implements, and evaluates care based on the specific...  ...sessions for medical students and GME trainees...  ...Completed Internal Medicine Residency Training. ~... 
    Resident
    For students
    Full time
    Part time
    Traineeship
    Work from home
    Monday to Friday

    Department of Veterans Affairs

    Riverside, CA
    1 day ago
  •  ...Pain Medicine Physician The Division of Pain Medicine at Mayo Clinic Arizona in...  ...management of pain patients with complex medical histories via a multi-disciplinary...  ...to educate and supervise fellows, residents, and medical students and to work within care teams... 
    Resident
    For students
    Full time
    Remote work

    Mayo Clinic

    United States
    3 days ago
  •  ...group of over 290 pediatric medical and surgical subspecialists in...  ...an ACGME-accredited pediatric residency program and is also...  ...Residency program as well as medical students from both Tulane and the University...  ...in Louisiana! Interested physicians can submit an online... 
    Resident
    For students

    Pedsccm

    Louisiana, MO
    3 days ago
  •  ...responsible for a wide range of medical duties covering adult neurology...  ...testing and interpretation and evaluation of patients with neuromuscular...  ...providers (nurse practitioners, physician's assistants, medical students, interns, residents, and fellows). Serves as an... 
    Resident
    For students
    Internship
    Work from home

    KurzSolutions

    Andrews Air Force Base, MD
    3 days ago
  • $272.69k - $373.8k

     ...hospital continues a legacy of providing residents of Western Tidewater with high-...  ...Role Summary The Hospitalist Physician provides inpatient medical care to the adult patient population...  ...opportunities through Guild Education ~ Student Debt Pay Down – $10,000 ~ Pet... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    Remote work
    Shift work

    Sentara Health

    Suffolk, VA
    2 days ago
  •  ...operating room, and endoscopy suite• Teaching of surgical residents and medical students through the University of North Dakota School of Medicine...  ...love to call the Fargo area home. Job DescriptionA physician who specializes in invasive procedures in the colon and rectal... 
    Resident
    For students
    Full time
    Contract work
    Temporary work
    Relocation package

    Sanford Health

    Fargo, ND
    1 day ago
  • $272.69k - $373.8k

     ...hospital continues a legacy of providing residents of Western Tidewater with high-...  ...center.Role SummaryThe Hospitalist Physician provides inpatient medical care to the adult patient...  ...opportunities through Guild Education• Student Debt Pay Down - $10,000• Pet Insurance... 
    Resident
    For students
    Full time
    Temporary work
    Remote work
    Shift work

    Sentara Healthcare

    Suffolk, VA
    1 day ago
  • $300k - $400k

     ...California, San Francisco Medical Residency Program, leader in health care...  ...GI fellowship. The GI physician reports to the GI Section Chief...  ..., fellows, medical students, and non- physician clinical...  ...(e.g. Ongoing Professional Evaluations (OPPE), Focused Professional... 
    Resident
    For students
    Full time
    Traineeship
    Locum
    Local area

    University of California, San Francisco

    Fresno, CA
    2 days ago
  • $272.69k - $373.8k

     ...hospital continues a legacy of providing residents of Western Tidewater with high-...  ...center.Role SummaryThe Hospitalist Physician provides inpatient medical care to the adult patient...  ...opportunities through Guild Education• Student Debt Pay Down - $10,000• Pet Insurance... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    Remote work
    Shift work
    Night shift

    Sentara Healthcare

    Suffolk, VA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Medical Evaluation Specialist (students, residents, physicians) [Remote]. Be the first to apply!