Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Medical Evaluation Specialist (students, residents, physicians) [Remote]

AuraOne Human Data

Remote
  • Remote job

Medical Evaluation Specialist (students, residents, physicians) is a remote clinical-review track for evaluating AI outputs that touch physician. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

physician AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current physician clinical guidelines and standard of care for Medical Evaluation Specialist (students, residents, physicians) assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in physician or an adjacent specialty for Medical Evaluation Specialist (students, residents, physicians) work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a physician case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • physician
  • Healthcare

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Medical Evaluation Specialist (students, residents, physicians) [Remote] in Remote vacancy
  •  ...About this role Role Title: Medical Evaluation Specialist (students, residents, physicians) Role Type: Contractor Location: Remote micro1 is engaging Medical Evaluation Specialists (students, residents, physicians) to contribute advanced clinical insights to... 
    Resident
    For students
    Temporary work
    For contractors
    Remote work

    micro1

    Remote
    4 days ago
  • YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving next-generation AI systems. You will create and validate challenging medical questions... 
    Resident
    For students
    Remote job

    YO AI Labs

    Los Angeles, CA
    2 days ago
  • Job Title: Medical Evaluation Specialist Role Type: Contractor Location: Remote Job Overview We are seeking Medical Evaluation Specialists , including medical students, residents, physicians, and qualified biomedical professionals, to contribute clinical expertise to a... 
    Resident
    For students
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    6 days ago
  • $40 - $90 per hour

     ...Apply clinical expertise to help train and evaluate next-generation AI systems through rigorous, real-world medical reasoning. This remote contractor role is suited to medical students, residents, physicians, and candidates with equivalent biomedical expertise who can... 
    Resident
    For students
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    22 days ago
  • $40 - $90 per hour

     ...next-generation AI systems through rigorous, real-world medical evaluation work. You will create and assess challenging medical...  ...project standards. Qualifications Current medical student, resident, physician, or professional with equivalent biomedical expertise.... 
    Resident
    For students
    Hourly pay
    Contract work
    Remote work

    SaidGig

    United States
    1 day ago
  •  ...include teaching psychiatry residents and medical students through Sanford's...  ...psychiatrists, clinical nurse specialists, doctorate-level psychologists...  ...to the setting ), evaluate, diagnose, and treat patients...  ...) or the Royal College of Physician and Surgeons of Canada. Training... 
    Resident
    For students
    Full time
    Temporary work
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...Neurology group in Fargo, ND. The medical center is a Level I Trauma...  ...and to educate medical students and residents• Neurology Residency with 3...  ...consultative services, evaluate, diagnose, and provide nonsurgical...  ...) or the Royal College of Physician and Surgeons of Canada in... 
    Resident
    For students
    Full time
    Temporary work
    H1b
    Visa sponsorship
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...with basic scientists and to educate medical students and residents• Neurology Residency Program with 3...  ...setting), provide consultative services, evaluate, diagnose, and provide nonsurgical...  ...(AOA) or the Royal College of Physician and Surgeons of Canada in the residency... 
    Resident
    For students
    Full time
    Temporary work
    H1b
    Visa sponsorship
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...as regular interaction with students and residents rotating through the...  ...provide consultative services, evaluate, diagnose, treat, and provide...  ...AOA) or the Royal College of Physician and Surgeons of Canada....  ...board of the American Board of Medical Specialties (ABMS), the... 
    Resident
    For students
    Full time
    Temporary work
    Local area
    Relocation package

    Sanford Health

    Fargo, ND
    2 days ago
  •  ...this posting. JOB SUMMARYThe Attending Physician XI Maternal Fetal Medicine (MFM) is...  ....Oversees activities related to resident and medical student’s activity on the Maternal Fetal Medicine...  ...of schedules, and completion of evaluations, as directed.Performs only such procedures... 
    Resident
    For students
    Full time
    Local area

    Cook County Sheriff

    Chicago, IL
    4 days ago
  •  ...Physician, Student Health - Student Health Services Join Our Campus Community...  ...Coverage: Enjoy access to medical, dental, and vision...  ...experience requirements are evaluated on a full-time equivalent (...  ...a charming town of 30,000 residents nestled in the heart of the... 
    Resident
    For students
    Permanent employment
    Full time
    Temporary work
    Part time
    Work visa

    American Academy Of Family Physicians

    Laramie, WY
    4 days ago
  •  ...applications for Senior Staff Physician, UNLV Student Wellness, Student...  ..., at the Las Vegas Medical District campus....  ...of treatment, evaluation of responses to treatments...  ...to appropriate specialists and higher levels of...  ...of a family medicine residency, a current Nevada M.... 
    Resident
    For students
    Daily paid
    Full time
    Work at office

    University of Nevada Las Vegas

    Las Vegas, NV
    3 days ago
  •  ...A offers a comprehensive total rewards package. VHA Physician Total Rewards. EDRP Authorized: Former EDRP participants...  .... The physician may also teach, supervise, and evaluate radiology residents and medical students from affiliated medical schools. Work Schedule:... 
    Resident
    For students
    Full time
    Contract work
    Freelance
    Remote work
    Night shift
    Weekend work

    US Department of Veterans Affairs

    Nashville, TN
    5 days ago
  • $55 - $70 per hour

     ...Powerback? Benefits:  We offer Medical, Dental, and Vision plans to...  ...of CFYs temporary licensees, students and support personnel in...  ...Service first, ensuring that residents and families receive the highest...  .... Screens, examines and evaluates patients, including history,... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    H1b
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    Powerback Rehabilitation

    Delaware State
    1 day ago
  • $42 - $61 per hour

     ...Benefits : We offer Medical, Dental, and Vision plans...  ...a patient's private residence or in a patient's room...  ...Language Pathologist to evaluate and treat in the most...  ...temporary licensees, students and support personnel...  ...rehabilitation team and the physician to select the most... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    H1b
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    Powerback Rehabilitation

    Richmond, VA
    48 minutes ago
  • $320k - $400k

     ...More than 500 full-time salaried physicians and advanced practice clinicians...  ...University and teaching Bassett IM Residents & Columbia-Bassett Medical Students Inpatient & Outpatient Tele-...  ...specialty, training, and fair market evaluation based on industry standards... 
    Resident
    For students
    Full time
    H1b
    Remote work
    Visa sponsorship
    Relocation package

    Society of Critical Care Medicine

    New York, NY
    5 days ago
  • $154.7k

    Primary Care Sports Medicine Physician (ACADEMIC POSITION) UNIVERSITY OF CALIFORNIA, SAN...  ...(HS) Clinical, Clinical X, or In-Residence faculty series.The incumbent will participate...  ...topics to residents as well as medical students. The incumbent will be core faculty for... 
    Resident
    For students

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  •  ...Summary The Clinical Medical Director directly reports the Chief...  ...team members such as fellows, residents, medical students, social work interns/staff, physician assistant and nursing students...  ...Perform outpatient medical evaluations and treatment. Provide or assist... 
    Resident
    For students
    Full time
    Contract work
    Part time
    Freelance
    Seasonal work
    Work at office
    Local area
    Relocation package
    Monday to Friday

    VETERANS HEALTH ADMINISTRATION

    Florence, KY
    10 hours ago
  •  ...provides health services to Veterans through the San Francisco VA Medical Center (SFVAMC) and seven community-based outpatient clinics...  ...and staff and outstanding trainees at all levels (medical students, residents, and fellows) • Academic environment with commitment to... 
    Resident
    For students
    Traineeship
    Night shift

    University of California, San Francisco

    San Francisco, CA
    2 days ago
  •  ...Physician (Hospital Medicine) West Virginia University Medical Corporation d/b/a UniversityHealth Associates seeks multiple Hospital Medicine Physicians....  ...organ system. Provide clinical instruction to students, residents, and fellows and advance initiatives in patient... 
    Resident
    For students
    Local area

    The Chronicle of Higher Education

    Morgantown, WV
    1 day ago
  •  ..., retirement plan, excellent medical and dental plans and much more...  ...health and welfare of its students, faculty, staff, and campus visitors...  ....\n 4. Develops metrics to evaluate the effectiveness of faculty...  ...program for faculty, staff, resident, and student well-being that... 
    Resident
    For students

    Nova Southeastern University

    Davie, FL
    10 days ago
  •  ...responsible for a wide range of medical duties covering adult neurology...  ...testing and interpretation and evaluation of patients with neuromuscular...  ...providers (nurse practitioners, physician's assistants, medical students, interns, residents, and fellows).Serves as an... 
    Resident
    For students
    Internship
    Work from home

    KurzSolutions

    Andrews Air Force Base, MD
    3 days ago
  •  ..., Florida is seeking a Sleep Medicine physician to join its rapidly growing practice and...  ...sleep patients at its Destination Medical Center campus. Clinical responsibilities...  ...fellows, as well as rotating medical residents and students. This position will immediately enjoy... 
    Resident
    For students
    Immediate start
    Flexible hours

    Mayo Clinic

    Jacksonville, FL
    5 days ago
  •  ...group of over 290 pediatric medical and surgical subspecialists in...  ...an ACGME-accredited pediatric residency program and is also...  ...Residency program as well as medical students from both Tulane and the University...  ...in Louisiana! Interested physicians can submit an online... 
    Resident
    For students

    Pedsccm

    Louisiana, MO
    3 days ago
  •  ...operating room, and endoscopy suite• Teaching of surgical residents and medical students through the University of North Dakota School of Medicine...  ...love to call the Fargo area home. Job DescriptionA physician who specializes in invasive procedures in the colon and rectal... 
    Resident
    For students
    Full time
    Contract work
    Temporary work
    Relocation package

    Sanford Health

    Fargo, ND
    1 day ago
  • $272.69k - $373.8k

     ...hospital continues a legacy of providing residents of Western Tidewater with high-...  ...center.Role SummaryThe Hospitalist Physician provides inpatient medical care to the adult patient...  ...opportunities through Guild Education• Student Debt Pay Down - $10,000• Pet Insurance... 
    Resident
    For students
    Full time
    Temporary work
    Remote work
    Shift work

    Sentara Healthcare

    Suffolk, VA
    1 day ago
  • $300k - $400k

     ...California, San Francisco Medical Residency Program, leader in health care...  ...GI fellowship. The GI physician reports to the GI Section Chief...  ..., fellows, medical students, and non- physician clinical...  ...(e.g. Ongoing Professional Evaluations (OPPE), Focused Professional... 
    Resident
    For students
    Full time
    Traineeship
    Locum
    Local area

    University of California, San Francisco

    Fresno, CA
    2 days ago
  • $272.69k - $373.8k

     ...hospital continues a legacy of providing residents of Western Tidewater with high-...  ...center.Role SummaryThe Hospitalist Physician provides inpatient medical care to the adult patient...  ...opportunities through Guild Education• Student Debt Pay Down - $10,000• Pet Insurance... 
    Resident
    For students
    Full time
    Temporary work
    Part time
    Remote work
    Shift work
    Night shift

    Sentara Healthcare

    Suffolk, VA
    1 day ago
  • $18 per hour

     ...acute admissions are rare Strong clinical support from NPs, rotating Internal Medicine residents, and medical students NPs and residents perform initial patient evaluations and prepare documentation for attending review After-hours call is primarily remote... 
    Resident
    For students
    Remote work
    Monday to Friday
    Weekend work
    Weekday work

    Ansible Government Solutions

    Bethesda, MD
    1 day ago
  •  ..., Clinical X, Adjunct, or In-Residence series. Our goal is to provide...  ...apply. Minimum Requirements: Physician candidates must be board-...  ...Candidates must also have a valid US medical license. Applicants must also...  ...trainees (medical students, residents, and fellows) Academic... 
    Resident
    For students
    Traineeship
    Local area

    University of California , San Francisco

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Medical Evaluation Specialist (students, residents, physicians) [Remote]. Be the first to apply!