Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Healthcare Compliance AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Clinical review AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current clinical review clinical guidelines and standard of care for Healthcare Compliance AI Evaluator assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in clinical review or an adjacent specialty for Healthcare Compliance AI Evaluator work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a clinical review case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Clinical review
  • Legal reasoning
  • Policy review
  • Risk analysis
  • Healthcare
  • Compliance

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Healthcare Compliance AI Evaluator [Remote] in Remote vacancy
  •  ...A healthcare technology firm is seeking a Health Information Specialist to train AI models and evaluate their outputs in diverse healthcare scenarios. This independent contract position can be full-time or part-time and offers remote flexibility. Qualifications include... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    4 days ago
  • $80 - $120 per hour

    Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract... 
    Suggested
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    3 days ago
  • $40 per hour

    A healthcare-focused AI team is looking for medical experts in various fields to train AI models by solving complex healthcare-related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring medical... 
    Suggested
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    10 hours ago
  • $40 per hour

    A medical consultancy is seeking experts to train AI models by giving complex healthcare-related problems and evaluating their outputs. The position allows for flexibility in project choice and schedule, offering pay starting at $40+ per hour, plus bonuses for high-quality... 
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • A healthcare technology company is seeking medical experts to aid in training AI models. This remote position allows flexibility in project selection and scheduling. Responsibilities include evaluating AI outputs for correctness and performance. Candidates must be fluent... 
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Saint Paul, MN
    20 hours ago
  • A leading AI evaluation firm is seeking medical experts to train AI models and evaluate their performance. This remote role allows you to...  ...include assessing AI chatbot outputs related to healthcare, ensuring medical accuracy, and improving model quality. #J-1... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    20 hours ago
  • A healthcare technology company is seeking a Diagnostic Imaging Coordinator to work on training AI models. This remote role requires expertise in various healthcare backgrounds...  ...complex healthcare-related problems to AI and evaluating outputs for accuracy and logic.... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Helena, MT
    3 days ago
  • $50 per hour

    A leading AI healthcare firm is seeking a Diagnostic Imaging Coordinator to enhance AI models by evaluating chatbot outputs and providing complex healthcare-related problems. The position offers flexibility with remote work options and competitive hourly pay starting at... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • A healthcare AI company is seeking medical experts to join their team remotely. The role involves training AI chatbots by evaluating their logic and solving complex healthcare problems. Candidates should possess a current or in-progress medical degree, fluency in English... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Columbia, SC
    20 hours ago
  • A healthcare technology company in the United States is seeking a Diagnostic Imaging Coordinator. This remote position involves training AI models and evaluating their performance on healthcare-related problems. Ideal candidates are experts in healthcare with relevant degrees... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Springfield, IL
    1 day ago
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $50 - $60 per hour

    A professional healthcare organization in Minnesota seeks a Registered Nurse to help improve AI models. In this role, you will evaluate chatbot logic and measure their progress while solving healthcare-related problems. This is an independent contract position with the... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    20 hours ago
  • A healthcare technology company is seeking medical experts to train AI models remotely. The role allows for flexible scheduling and project selection, with hourly...  ...include providing AI chatbots with complex problems, evaluating AI outputs, and ensuring medical accuracy in... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $50 - $60 per hour

    DataAnnotation is seeking an Operating Room Nurse to train AI models by providing diverse healthcare-related problems. This role allows for project...  ...in-progress medical degree. Responsibilities include evaluating AI outputs and ensuring medical accuracy. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Work from home

    DataAnnotation

    Phoenix, AZ
    4 days ago
  • A leading AI training company is seeking medical experts to evaluate AI chatbots by solving diverse healthcare-related problems and ensuring their accuracy. The role offers flexibility, allowing you to choose projects and work at your own schedule. Ideal candidates will... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Sioux Falls, SD
    20 hours ago
  • $30 - $40 per hour

    A healthcare technology company is seeking medical experts to evaluate AI chatbot outputs. This remote position offers flexible project selection with hourly pay starting at $30+ or $40+. Candidates should have fluency in English and a current or in-progress medical degree... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Providence, RI
    20 hours ago
  • $20 per hour

    A healthcare technology company in the United States is seeking a Phlebotomist to train AI models. Responsibilities include providing complex healthcare-related problems to AI chatbots, evaluating their outputs, and ensuring medical accuracy. The position offers flexible... 
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Kansas City, MO
    3 days ago
  • A leading AI training company is seeking medical experts to evaluate AI chatbots' responses to complex healthcare problems in a REMOTE position. Applicants need to hold a medical degree or be in-progress towards one. Responsibilities include ensuring medical accuracy of... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    20 hours ago
  • $20 per hour

    A leading AI development firm in the United States seeks a Phlebotomist to join their...  ...training AI models. The ideal candidate will evaluate AI chatbot outputs for accuracy and...  ...Responsibilities include providing complex healthcare-related problems for AI evaluation and ensuring... 
    Remote job
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Nashville, TN
    4 days ago
  • $30 per hour

    A remote healthcare consulting firm is looking for medical experts to train AI models by evaluating their logic and solving complex healthcare-related problems. The role allows candidates to set their schedule and choose projects to work on, with payments starting at $... 
    Remote job
    Hourly pay

    DataAnnotation

    Santa Fe, NM
    20 hours ago
  • $40 per hour

    A leading AI training company is seeking a Nurse to evaluate and improve AI models in healthcare. The position is open to medical professionals in the United States, offering flexibility in project selection and a competitive pay starting at $40+ per hour. This role focuses... 
    Remote job
    Hourly pay

    DataAnnotation

    Hartford, CT
    20 hours ago
  • $40 per hour

    A healthcare technology firm is seeking medical experts in the United States to evaluate AI models and enhance their performance. Responsibilities include providing complex healthcare-related problems to AI chatbots and ensuring the accuracy of the models. This position... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Honolulu, HI
    1 day ago
  • $40 per hour

    A healthcare technology company is looking for medical experts to train AI models and evaluate their performance. The role is available as a full-time or part-time remote position, ideal for applicants with a current or ongoing medical degree. Responsibilities include... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    20 hours ago
  •  ...is seeking a Pyxis Technician to join their team in the United States. This remote position involves training AI models for healthcare applications, evaluating their logic, and solving complex problems to improve quality. Candidates should have a background in healthcare... 
    Hourly pay
    Remote work

    DataAnnotation

    Bismarck, ND
    20 hours ago
  • $20 per hour

    A healthcare technology company is seeking a Pyxis Technician to join their team and train AI models. In this role, you will provide healthcare-related problems for AI chatbots and evaluate their logic and performance. Fluency in English and a medical or healthcare-related... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    El Paso, TX
    20 hours ago
  • $40 per hour

    A leading technology firm is seeking medical experts to evaluate AI chatbots' performance and ensure their medical accuracy. This remote...  ...or in-progress medical degree. Indicate your expertise in healthcare as your contributions will directly enhance the quality of AI... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    1 day ago
  • $20 per hour

    A healthcare technology firm is seeking a Pyxis Technician to join their team for training AI models and evaluating AI chatbot logic. The role is remote and offers flexible scheduling with project-based payment starting at $20 per hour. Candidates should be fluent in English... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    20 hours ago
  • $40 per hour

    A healthcare data company is seeking medical experts to evaluate AI chatbot performance. As a remote role, you will provide complex healthcare problems to AI models and ensure their output is medically accurate. This position offers flexible project selection and competitive... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Santa Fe, NM
    1 day ago
  • $20 per hour

    A healthcare technology company is seeking a Pyxis Technician to train AI models. The role involves providing complex healthcare-related problems to AI chatbots and evaluating their responses for accuracy and quality. Candidates should have a relevant healthcare expertise... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Providence, RI
    20 hours ago
  • A healthcare technology company is seeking a Pyxis Technician to contribute to training AI models. The role involves solving healthcare-related problems for AI chatbots and evaluating their performance. Candidates must be fluent in English and have a degree in a healthcare... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Healthcare Compliance AI Evaluator [Remote]. Be the first to apply!