Remote Medical AI Trainer

Clinical Evaluation Of Frontier AI Models

We are currently hiring experienced clinicians to evaluate how frontier AI models handle real clinical work: an assessment and plan from a history and exam, a medication reconciliation with interaction checks, a triage decision, a discharge summary, patient education, or a clinical protocol. You bring the judgment you have built co signing a resident's note only after fixing the plan, catching the interaction the order set missed, and knowing when a presentation does not fit the obvious diagnosis. We bring the model output that judgment is needed to grade.

In this role, you will design challenging, realistic tasks drawn from your own practice, such as a SOAP note and plan for a constructed case, a medication reconciliation with interaction review, a triage decision with rationale, a discharge summary, a patient education handout, or a clinical protocol or standing order set, run them through frontier AI agents, and evaluate what comes back against a professional standard.

You will work with realistic professional files, the kind a practitioner in your field actually handles, which you assemble yourself. Some tasks are compact, built around a handful of files; others are larger scenarios that take several days to build. In every case the goal is the same: a task a competent professional in your field would complete correctly and a frontier model currently gets wrong.

• This is not a traditional clinical role. You will be helping build better AI by putting your knowledge to work in a structured, flexible, fully remote environment. The work is long form and self directed, and clear written reasoning matters as much as technical depth.

Design challenging, realistic clinical tasks drawn from your own day to day practice: the scenario, a prompt phrased the way you would brief a trusted colleague, and the supporting files a clinician would need (constructed or de identified histories, exam findings, labs, imaging reports, medication lists, prior notes), which you author yourself.

Run those tasks through frontier AI models and evaluate the deliverable they produce (the note, plan, reconciliation, summary or protocol) against the standard you would hold a colleague to.

Compare two model outputs on identical prompts and files, decide which performed better, and document where each fell short.

Write detailed grading rubrics that specify what a correct deliverable must contain, such as the right differential considered, the right red flags addressed, the right medication decisions, the right communication for the recipient, and explain in writing why a response passes or fails each one.

Flag concrete failures with evidence: unsupported assessments, missed contraindications or interactions, anchoring on the obvious diagnosis, fabricated or ignored data, unsafe or inappropriate communication, and off brief interpretation of the ask.

Contribute across your setting and adjacent ones, and review and refine tasks built by other clinicians.

2+ years of current or recent hands on clinical practice preferred. In progress Bachelors degree or higher.

Licensed clinician: RN, NP, PA, MD or DO, PharmD, or an allied health license with independent clinical judgment (for example respiratory therapy, physical therapy, midwifery). Licensed candidates may be asked to verify licensure during the assessment.

Depth in at least one setting or specialty: acute care and med surg, emergency, critical care, primary care and family medicine, pediatrics, obstetrics, behavioral health, geriatrics and long term care, perioperative, oncology, pharmacy.

Working understanding of adjacent settings, enough to know what those workflows involve and how they are run, so you can assess work outside your own unit and point out what was done correctly or incorrectly.

Reads and writes clinical documentation at a practitioner level and grounds decisions in current guidelines and the patient context rather than habit.

100% fully remote.

Can be part time or full time. Minimum requirement is 10 hours per week.

This is a Contract position based out of Virginia Beach, VA.

The pay range for this position is $40.00 - $125.00/hr.

Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job-related factors.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: Medical, dental & vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short and long-term disability Health Spending Account (HSA) Transportation benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave)

This is a fully remote position.

Actalent is a global leader in engineering and sciences services and talent solutions. We help visionary companies advance their engineering and science initiatives through access to specialized experts who drive scale, innovation and speed to market. With a network of almost 20,000 consultants and 5,000 clients across the U.S., Canada, Asia and Europe, Actalent serves many of the Fortune 500. We are proud to be an Engineering News-Record (ENR) Top 500 Design Firm for our engineering design services and a ClearlyRated Best of Staffing winner for both client and talent service.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please email View email address on click.appcast.io for other accommodation options.

Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.