Applied Health & Medicine Benchmark Specialist [Remote]
$94 - $119 per hourAuraOne Human Data
- Remote job
Applied Health & Medicine Benchmark Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Clinical review AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current clinical review clinical guidelines and standard of care for Applied Health & Medicine Benchmark Specialist assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in clinical review or an adjacent specialty for Applied Health & Medicine Benchmark Specialist work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a clinical review case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Clinical review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$94–$119 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$76k - $199.6k
...colleagues work together to positively impact health for everyone, everywhere. Our colleagues... ...’ lives. An integral part of Internal Medicine, the Cardiology (CARD) Team’s mission is... ...States salary range provided does not apply to any location outside of the United States...SuggestedPermanent employmentFull timeH1bLocal areaRemote workVisa sponsorshipWork visaRelocation package$69.95k
...Programs (CTAP) : This program applies to Federal and/or DOJ... ...in a safety or occupational health fields (safety, occupational... ...industrial hygiene, occupational medicine, toxicology, public health, mathematics... ...team led by a higher graded specialist and is exposed to the...SuggestedHourly payFull timePart timeWork at office- Position: Mental Health Specialist - Full Time (1.0 FTE) 11:00pm-7:30am Location: Mason, OH Job... ...care as identified by the Institute of Medicine. Innovative residential assessment, inpatient... ...exhibiting early behavioral changes. Applies alternatives to physical interventions....SuggestedFull timeTemporary workPart timeWork at officeLocal areaImmediate startFlexible hoursShift workNight shift
$19.71 per hour
...OVERVIEW OF POSITION: The Population Health Specialist supports Colorado Community Health Alliance... ...exceeds Health First Colorado quality benchmarks and value-based contract requirements.... ...to focus on the joy of practicing medicine, and supports the ongoing transition to...SuggestedContract workWork at officeRemote workHome office- Mercor is seeking a contracted Applied Computer Science Benchmark Specialist to develop and evaluate advanced CS questions for AI research labs. Remote engagement requires ~10+ hours per week, with compensation available as an hourly rate. The role emphasizes creating unambiguous...SuggestedRemote jobHourly payContract work10 hours per week
- ...Admin Specialist Senior Health The Office of the Chief of Advance Practice Nursing (APRN) is seeking... ...; serve as liaison with the Michigan Medicine HR Solutions Center to process job... ...Report Act. Pre-employment drug testing applies to all selected candidates, including...Full timeContract workWork at officeImmediate startRemote workFlexible hoursAfternoon shift
- ...Administrative Support Specialist This position provides essential... ...administrative tasks related to health care Intermediate Level:... ...partners throughout Michigan Medicine Strong organizational... ...Pre-employment drug testing applies to all selected candidates, including...Remote workDay shift
- Join to apply for the Senior Physician Specialist - Jail Health 2232 role at San Francisco Department of Public Health 1 month ago Be among the first 25 applicants... ..., full-scope adult primary care practice (Internal Medicine or Family Practice) including acute and chronic...Full timePart timeSecond jobMonday to FridayShift workNight shiftWeekend workAfternoon shift
$21.49 - $26.25 per hour
...cornerstone of recovery. As a Vocational Specialist , you aren't just managing a caseload;... ...will partner with adults facing mental health challenges to help them rediscover their... ...wage range is $21.49 - $26.25. Telecare applies geographic differentials to its pay ranges...Hourly payFull timeLocal areaRelocation packageMonday to FridayShift workNight shiftWeekend work- ...Behavioral Health Specialist As a Behavioral Health Specialist, you will be part of an integrated care team dedicated to providing whole... ...recommendations using American Society for Addiction Medicine (ASAM) criteria. Provides relapse prevention counseling and...Work at officeRemote workFlexible hours
$18.75 - $24.03 per hour
...dedicated staff! With a career at Riveon Mental Health and Recovery, you’ll partner with a... ...to complete all functions of the TBS Specialist position. Provides education, support to... ...professional boundaries with others. Accepts/Applies instructions and supervision. Has /...Hourly payFull timeTemporary workCasual workWork at officeWork from homeFlexible hoursShift work$52.4k - $76.9k
...Description Job Description Description: JOB TITLE: Mental Health Specialist I Family Support Partner Supervisor SUPERVISOR: Clinical... ...city amenities in rural family-oriented communities. Apply Directly at Our mission is to provide dynamic, progressive...Contract workFor contractorsWork experience placementWork at officeImmediate startRemote workWork from homeLong distanceNight shift- Hone Health is seeking physicians for part-time and full-time telemedicine roles nationwide. You will conduct HIPAA‑compliant video consultations... ...while leveraging your expertise across OB/GYN, Internal Medicine, Family Medicine, and hormone replacement therapy. #J-18808-...Remote jobFull timePart time
$150 per hour
...organisation to develop a clinician-informed benchmark for evaluating how AI companion chatbots... ...to adolescents experiencing mental health challenges. As AI companions become increasingly... ...of safe AI systems for adolescents . Apply your clinical expertise to one of the...Remote jobHourly payTraineeship10 hours per week$21 per hour
...is hiring Enrollment Specialists for a 100% remote, full... ...clinic for addiction medicine, recognized for both innovation... ...partners with leading health plans, employers, and... ...starting pay system , benchmarking compensation against... ...references. By applying, you acknowledge and consent...Hourly payFull timeTemporary workCurrently hiringWork at officeRemote workWork visaMonday to FridayShift work$99.1k - $166.2k
...you will play a critical role in ensuring health care vendors deliver exceptional value... ...subject matter expertise, data analysis, benchmarking, cost modeling, proposal development,... ...needs of employees and their families. Apply Lean Principles and continuous improvement...Work experience placementWork at officeImmediate startFlexible hours- ...Health Information Specialist Are you passionate about working in health care? Do you have great attention to detail? If your answer is yes,... ...employees to work, and the Best place for physicians to practice medicine. A Day in the Life of a HIM Specialist Working in...Work at officeMonday to FridayFlexible hours
$60 - $75 per hour
...Applied Biology Benchmark Specialist is a remote review track for evaluating AI outputs across biology reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling...Remote jobFor contractors10 hours per week$60.3k - $133.4k
...variety of functions and is a single source of contact for members, health care personnel and all other entities involved in managing care... ...cases Specialty clinical experience in intensive care medicine, orthopedic, NICU/pediatric, oncology, diabetic member management...Temporary workWork at officeLocal areaImmediate startRemote work- Rutgers University Behavioral Health Care ( UBHC ), established in... ...a Supervising Mental Health Specialist for Addiction Services within... ...take into consideration market benchmarks, if and when appropriate, and... ...and safety policies may apply. Prospective employees should...Daily paidFull timePart timeSeasonal workWork at officeFlexible hoursShift work
- Job Summary The Behavioral Health Specialist works in collaboration with the patient care team to... ...encourage all qualified individuals to apply. Education Bachelor's Degree-Related... ...Plan, Geisinger Commonwealth School of Medicine and two research centers. What you do at...Full timePart timeRemote workShift workAfternoon shift
$66 - $84 per hour
...Applied Computer Science Benchmark Specialist is a remote review track for evaluating AI outputs across applied computer science benchmark specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk...Remote jobFor contractorsWork experience placement10 hours per week$83 - $105 per hour
...Applied Legal Benchmark Specialist is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train...Remote jobFor contractors10 hours per week- LAUKOA seeks a Certified Medical Assistant to support the Defense Health Agency contract across the Virtual Medical Center. You will greet patients, answer phones, verify DEERS eligibility, and enter data into CHCS or Genesis electronic health records. You will schedule...Remote jobContract work
$54.85k - $61.71k
PT Mental Health Specialist Clinical Supervisor... Instituto Familiar de la Raza, Inc. is a multi-service community health and social service agency with an emphasis on serving the Chicano/Latino/Indígena community in San Francisco with a special focus on the diverse needs...Full timePart timeTraineeshipWork experience placementInternshipWork at officeTrial periodFlexible hours- Revelations Counseling & Consulting Llc is seeking a Mental Health Coach in Fredericksburg, VA. This full-time role supports the inTransition program, assisting service members, veterans and families with seamless access to psychological health care providers. The role...Remote jobFull time
- ...Job Description Job Description New England Based Full-time Engagement Specialist(Health Coach/Care Coordinator) Details: Hiring Company: Senscio Systems Position Available: Engagement Specialist; Must be physically located in the New England area; preferably...Full timeWork at officeLocal areaRemote workWork from home
- ...ultrasound imaging and willingness to apply similar approaches to animals.... ...of prior work.Why Join Michigan Medicine?Michigan Medicine is one of the largest health care complexes in the world and... ...SpecialistJob TitleResearch Lab Specialist SeniorWork LocationMichigan...Immediate startRemote work
- Hone Health is expanding its telemedicine team and seeking physicians with expertise in men’s health to provide remote consultations from the comfort of their home. Roles are available part-time and full-time across states where you are licensed, with comprehensive training...Remote jobFull timePart time
- PruittHealth Corporation is hiring a Certified Occupational Therapy Assistant (COTA) for Home Health Services. This role requires licensure in the state and ACOTE-accredited education, with experience in adult healthcare. The employer emphasizes a top-pay per point model...Work from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied Health & Medicine Benchmark Specialist [Remote]. Be the first to apply!
- loss prevention specialist Remote
- total rewards specialist Remote
- inclusion specialist Remote
- accessibility specialist Remote
- health science specialist Remote
- graduation specialist Remote
- behavioral health specialist Remote
- equity specialist Remote
- government relations specialist Remote
- fabrication specialist Remote


