Healthcare Compliance AI Evaluator [Remote]
AuraOne Human Data
- Remote job
Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Clinical review AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current clinical review clinical guidelines and standard of care for Healthcare Compliance AI Evaluator assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in clinical review or an adjacent specialty for Healthcare Compliance AI Evaluator work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a clinical review case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Clinical review
- Legal reasoning
- Policy review
- Risk analysis
- Healthcare
- Compliance
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- Obsidian is seeking expert Evaluators in Privacy / regulatory compliance to review AI-generated work products for accuracy and quality. The role is remote and requires 5+ years of relevant experience along with proficiency in Microsoft Office and Google Workspace. As an...SuggestedRemote jobHourly payWork at office
- About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject‑...SuggestedHourly payWork at officeRemote work
$20 - $80 per hour
...Role Overview Train and evaluate next-generation AI systems by scoring model outputs, annotating real-world content, and delivering clear, actionable... ...contribute knowledge across fields such as finance, healthcare, STEM engineering, and more, producing the annotations...SuggestedHourly payFor contractorsRemote work- Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI. You'll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years...SuggestedRemote jobHourly payWork at office
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote workFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote workFlexible hours$85 - $95 per hour
...clinicians who split their time between neurodevelopmental diagnostic evaluations and ongoing psychotherapy services. This role allows... ...visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at . How do you know if you have a...Contract workFor contractorsFor subcontractorWork at officeRemote workFlexible hours1 day per weekWeekday work- ...Procurement Compliance AI Evaluator is a remote review track for evaluating AI outputs in compliance workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on...Remote jobHourly payFor contractors10 hours per week
- ...Private Equity and M&A AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade... ..., narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$80 - $120 per hour
...Role Overview Review AI-generated documents, spreadsheets, and slide decks related to financial-services compliance and regulatory response, applying your subject-matter expertise... ...quality. Key Responsibilities Evaluate AI-generated work products against domain...Hourly payWork at officeRemote work- ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy... ...Prior experience reviewing AI-assisted legal-research or compliance tooling. Bilingual experience for cross-jurisdiction matters...Remote jobHourly payFor contractors10 hours per week
$80 - $120 per hour
...Role Overview Assess AI-generated healthcare operations deliverables, including documents, spreadsheets, and slide decks, to ensure accuracy... ...actionable, structured feedback. Key Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics...Hourly payWork at officeRemote work- ...AI Policy Compliance AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team...Remote jobHourly payFor contractors10 hours per week
$80 - $120 per hour
...Role Overview Apply your healthcare and clinical expertise to evaluate AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. You will grade outputs against domain-specific quality rubrics and help improve the clarity and reliability...Hourly payWork at officeRemote work$80 - $120 per hour
...Role Overview Apply your legal and compliance expertise to assess AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and... ...and defined quality standards. Key Responsibilities Evaluate AI-generated work products against legal and compliance...Hourly payWork at officeRemote work- Hippocratic AI Inc. is seeking Nurses and Nurse Practitioners with clinical experience to serve as SMEs for evaluating AI-driven clinical agents. You will review agent conversations on acute symptom triage, diabetes management, and travel health, ensuring accuracy, guideline...Remote jobContract workPart time10 hours per weekFlexible hours
- Mercor is seeking experienced Clinical Law Professors and Clinic Directors to evaluate AI-generated legal reasoning in civil legal services. Experts will blend doctrinal knowledge with practical supervision to assess AI analyses. Applicants should hold a JD with active...Remote job
- ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and...Full timeContract workRemote workFlexible hours
- ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This fully remote, flexible contract role values strong critical thinking and quality instincts, with no technical background required beyond...Contract workRemote workFlexible hours
$20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hours- ...Job Description Job Description Company Description Chamberlain With more than 135 years of history in healthcare education and as the largest nursing school in the country, Chamberlain University is committed to delivering a high-value education that prepares...Work at officeWorldwideFlexible hoursWeekday work
$100 per hour
...looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as... ...whether the model thinks like a great engineer. You will assess how AI coding agents behave in real-world scenarios — focusing on:...Contract workImmediate start- ...YO AI Labs seeks clinicians specializing in Oncology and Hematology to contribute medical expertise to a healthcare AI project. You will evaluate content, review trial data, and provide expert medical judgment; no prior AI experience required—your clinical expertise and...Remote jobFor contractors
- ...YO AI Labs in the United States is seeking a Hematology Expert to contribute clinical expertise to a healthcare AI project. Remote contractor role evaluating clinical content, reviewing trial data, and providing expert medical judgment. Candidates should hold board...Remote jobFor contractors
$65 per hour
Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience...Hourly paySelf employmentWork from homeFlexible hours- Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks...Remote jobFreelanceFlexible hours
$15 per hour
Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible...Remote jobHourly payFor contractorsFreelanceFlexible hours- RWS - TrainAI is seeking a part-time Search Quality Rater to help assess how our clients’ search engines respond to everyday queries. Based in the United States, you will work remotely up to 29 hours per week, maintaining quality standards and meeting SLAs while using your...Remote jobPart timeWork from homeHome office
- A leading AI research collaboration in Atlanta is seeking a specialist to develop advanced physics problems and rigorously evaluate AI-generated solutions. Applicants must have a PhD or be near completion in Applied Physics or a related field, showcasing mastery in core...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Healthcare Compliance AI Evaluator [Remote]. Be the first to apply!





