Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Healthcare Compliance AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Clinical review AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current clinical review clinical guidelines and standard of care for Healthcare Compliance AI Evaluator assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in clinical review or an adjacent specialty for Healthcare Compliance AI Evaluator work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a clinical review case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Clinical review
  • Legal reasoning
  • Policy review
  • Risk analysis
  • Healthcare
  • Compliance

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Healthcare Compliance AI Evaluator [Remote] in Remote vacancy
  • Obsidian is seeking expert Evaluators in Privacy / regulatory compliance to review AI-generated work products for accuracy and quality. The role is remote and requires 5+ years of relevant experience along with proficiency in Microsoft Office and Google Workspace. As an... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    16 hours ago
  • About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject‑... 
    Suggested
    Hourly pay
    Work at office
    Remote work

    Obsidian

    New York, NY
    3 days ago
  • $20 - $80 per hour

     ...Role Overview Train and evaluate next-generation AI systems by scoring model outputs, annotating real-world content, and delivering clear, actionable...  ...contribute knowledge across fields such as finance, healthcare, STEM engineering, and more, producing the annotations... 
    Suggested
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    22 days ago
  • Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years... 
    Suggested
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Chicago, IL
    13 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    Chicago, IL
    13 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    Chicago, IL
    7 days ago
  • $85 - $95 per hour

     ...clinicians who split their time between neurodevelopmental diagnostic evaluations and ongoing psychotherapy services. This role allows...  ...visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at . How do you know if you have a... 
    Contract work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours
    1 day per week
    Weekday work

    Blackbird Health

    Frederick, MD
    3 days ago
  •  ...Procurement Compliance AI Evaluator is a remote review track for evaluating AI outputs in compliance workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    24 days ago
  •  ...Private Equity and M&A AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade...  ..., narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    20 days ago
  • $80 - $120 per hour

     ...Role Overview Review AI-generated documents, spreadsheets, and slide decks related to financial-services compliance and regulatory response, applying your subject-matter expertise...  ...quality. Key Responsibilities Evaluate AI-generated work products against domain... 
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    5 days ago
  •  ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy...  ...Prior experience reviewing AI-assisted legal-research or compliance tooling. Bilingual experience for cross-jurisdiction matters... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    25 days ago
  • $80 - $120 per hour

     ...Role Overview Assess AI-generated healthcare operations deliverables, including documents, spreadsheets, and slide decks, to ensure accuracy...  ...actionable, structured feedback. Key Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics... 
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    18 hours ago
  •  ...AI Policy Compliance AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    17 days ago
  • $80 - $120 per hour

     ...Role Overview Apply your healthcare and clinical expertise to evaluate AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. You will grade outputs against domain-specific quality rubrics and help improve the clarity and reliability... 
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    18 hours ago
  • $80 - $120 per hour

     ...Role Overview Apply your legal and compliance expertise to assess AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and...  ...and defined quality standards. Key Responsibilities Evaluate AI-generated work products against legal and compliance... 
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    5 days ago
  • Hippocratic AI Inc. is seeking Nurses and Nurse Practitioners with clinical experience to serve as SMEs for evaluating AI-driven clinical agents. You will review agent conversations on acute symptom triage, diabetes management, and travel health, ensuring accuracy, guideline... 
    Remote job
    Contract work
    Part time
    10 hours per week
    Flexible hours

    Hippocratic AI Inc.

    Brooklyn, NY
    3 days ago
  • Mercor is seeking experienced Clinical Law Professors and Clinic Directors to evaluate AI-generated legal reasoning in civil legal services. Experts will blend doctrinal knowledge with practical supervision to assess AI analyses. Applicants should hold a JD with active... 
    Remote job

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    1 day ago
  •  ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This fully remote, flexible contract role values strong critical thinking and quality instincts, with no technical background required beyond... 
    Contract work
    Remote work
    Flexible hours

    Alignerr

    Peru, IL
    5 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    4 days ago
  •  ...Job Description Job Description Company Description Chamberlain With more than 135 years of history in healthcare education and as the largest nursing school in the country, Chamberlain University is committed to delivering a high-value education that prepares... 
    Work at office
    Worldwide
    Flexible hours
    Weekday work

    Chamberlain University

    Lake Charles, LA
    2 days ago
  • $100 per hour

     ...looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as...  ...whether the model thinks like a great engineer. You will assess how AI coding agents behave in real-world scenarios — focusing on:... 
    Contract work
    Immediate start

    G2i Inc.

    Remote
    1 day ago
  •  ...YO AI Labs seeks clinicians specializing in Oncology and Hematology to contribute medical expertise to a healthcare AI project. You will evaluate content, review trial data, and provide expert medical judgment; no prior AI experience required—your clinical expertise and... 
    Remote job
    For contractors

    Jobleads-US

    San Jose, CA
    3 days ago
  •  ...YO AI Labs in the United States is seeking a Hematology Expert to contribute clinical expertise to a healthcare AI project. Remote contractor role evaluating clinical content, reviewing trial data, and providing expert medical judgment. Candidates should hold board... 
    Remote job
    For contractors

    Jobleads-US

    Houston, TX
    3 days ago
  • $65 per hour

    Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience... 
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    5 days ago
  • Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks... 
    Remote job
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    3 days ago
  • $15 per hour

    Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Productive Playhouse

    New York, NY
    3 days ago
  • RWS - TrainAI is seeking a part-time Search Quality Rater to help assess how our clients’ search engines respond to everyday queries. Based in the United States, you will work remotely up to 29 hours per week, maintaining quality standards and meeting SLAs while using your...
    Remote job
    Part time
    Work from home
    Home office

    aitrainer

    New York, NY
    4 days ago
  • A leading AI research collaboration in Atlanta is seeking a specialist to develop advanced physics problems and rigorously evaluate AI-generated solutions. Applicants must have a PhD or be near completion in Applied Physics or a related field, showcasing mastery in core... 
    Remote job
    Flexible hours

    Alignerr

    Atlanta, GA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Healthcare Compliance AI Evaluator [Remote]. Be the first to apply!