Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Pathology Evaluation Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

Pathology Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch pathology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Pathology AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current pathology clinical guidelines and standard of care for Pathology Evaluation Specialist assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in pathology or an adjacent specialty for Pathology Evaluation Specialist work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a pathology case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Pathology

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Pathology Evaluation Specialist [Remote] in Remote vacancy
  • $50 per hour

     ...Role Overview Math Specialists apply advanced mathematical training to evaluate AI-generated mathematics content, design domain-relevant questions, and give detailed feedback that improves AI understanding of mathematical reasoning, proof construction, and technical... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Remote work
    Flexible hours

    SaidGig

    United States
    3 days ago
  • $125 per hour

     ...Role Overview QGIS Specialists apply QGIS and spatial analysis expertise to evaluate AI-generated GIS outputs, test spatial data workflows, and provide detailed feedback that improves how AI handles geographic information system tasks. Key Responsibilities Use hands... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work
    Flexible hours

    SaidGig

    United States
    8 days ago
  • $20 per hour

     ...contractors to help train AI chatbots. This flexible role allows you to work remotely on your own schedule while developing prompts and evaluating model outputs. Ideal candidates are fluent in English and have strong writing and research skills. Compensation starts at $20 per... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Raleigh, NC
    1 day ago
  • Role Description We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. The objective of this project is to autonomously produce high-quality evaluation tasks through simulated interactions... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    Remote
    8 days ago
  • $100k - $115k

     ...Overview LMI is seeking a detail-oriented Program Evaluation Specialist to support program evaluation, implementation science, advanced analytics, and evidence generation across health and civilian programs. In this role, you will lead and support the design, implementation... 
    Suggested
    Contract work
    Remote work

    LMI

    United States
    2 days ago
  • $10k

     .... Position Summary Reporting to the team lead, supports the work of the asthma case manager within the schools. The Program Evaluation Specialist will be expected to provide health education, support and referrals for families of students with asthma. Communicate to OSH... 
    Permanent employment
    Full time
    Work at office
    Work from home
    2 days per week

    NYC Department of Health and Mental Hygiene

    New York, NY
    5 days ago
  • $80 - $110 per hour

     ...reasoning gaps in advanced models. You will author tasks, produce reference solutions and executable tests where applicable, run evaluations against a target model, and analyze failures to pinpoint headroom and patterns of error. Key Responsibilities Design robust... 
    Hourly pay
    Part time
    Freelance
    Remote work

    SaidGig

    United States
    13 days ago
  • $10k

     ...educational materials. - Work on special projects for the Office of School Health and analyze the training needs of the program. - Evaluate the effectiveness of the asthma case management program, develop presentations and materials by utilizing entry and exit... 
    Permanent employment
    Full time
    Work at office
    Work from home
    2 days per week

    City of New York

    Long Island City, NY
    3 days ago
  • $5,540 - $5,780 per month

     ...Reporting to the Director of Graduate Admissions and Program Evaluations (GAPE) in the College of Graduate Studies, this position is responsible...  ...are completed efficiently and on schedule. The Evaluation Specialist is responsible for interpreting and applying complex policies... 
    Permanent employment
    Full time
    Work experience placement
    Internship
    Work at office
    Visa sponsorship

    OPT FOR HEALTHY LIVING

    California, MO
    2 days ago
  •  ...United States Working time Full-time Description & Requirements Maximus is currently hiring a Clinic Assistant to join our Veterans Evaluation Services (VES) team. This is a hybrid position that requires you to work both on-site at any of our Georgia, Alabama, Florida,... 
    Full time
    Contract work
    Currently hiring
    Work at office
    Local area
    Remote work
    Home office
    Shift work
    Weekend work

    MAXIMUS

    Sandy Springs, GA
    2 days ago
  •  ...as needed. Duties Include Experienced Specialist Representative/Consultant of the specialty...  ..., Internist or Medical Subspecialist Evaluates patient signs and symptoms, reviews laboratory...  .... Senior Specialist in Forensic Pathology Performs medicolegal autopsies at the Medical... 
    Permanent employment
    Full time
    Part time
    Work experience placement
    Work at office
    Monday to Friday

    City and County of San Francisco

    San Francisco, CA
    14 hours ago
  • $80 - $120 per hour

    Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should... 
    Remote job
    Hourly pay
    Contract work
    Work at office

    Mercor

    New York, NY
    3 days ago
  •  ...means and mentorship needed to succeed, and your creativity will be rewarded. About the Position The Monitoring and Evaluation (M&E) Specialist will provide technical support to the Office of Monitoring and Evaluation (OME), Division of Global Health Protection (DGHP... 
    Work at office
    Remote work

    Dexis

    Atlanta, GA
    18 days ago
  • Pearson is seeking a Scoring Assistant for School Administrator and Superintendent credential evaluation. The role is remote and part-time, with sessions typically lasting 2-3 days monthly and scheduled between 8:00 a.m. and 4:00 p.m. PST. Training and review are provided... 
    Remote job
    Part time
    Flexible hours

    Itlearn360

    Sacramento, CA
    4 days ago
  • Monitoring, Evaluation, and Learning Specialist Job Category : Program Requisition Number : MONIT002486 Posted : October 25, 2024 Full-Time Locations Showing 1 location Washington, DC 20037, USA Description Who We Are Peace is our commitment. The United States Institute... 
    Full time
    Contract work
    For contractors
    Work experience placement
    Work at office
    Local area
    Work from home
    Worldwide
    Home office
    Night shift

    United States Institute of Peace

    Seattle, WA
    4 days ago
  •  ...Part Time or PRN Dysphagia Management Specialist in Physician's Office/Clinic Settings,...  ...dysphagia skills performing FEES and Speech Pathology Diagnostics, while reaching that work-...  ...Dysphagia Systems Test (DST) evaluates the five systems required for safe swallowing... 
    Full time
    Temporary work
    Part time
    Relief
    Work at office
    Weekend work

    Dysphagia Management Systems

    Grand Rapids, MI
    3 days ago
  • $85k - $110k

     ...Is familiar with the top IDIQs and top IDIQ managers and project managers. May participate in strategic planning that includes evaluating marketing intelligence, identifying customer concerns and key issues, and developing win strategies to thread into strategic pursuits... 
    Daily paid
    Full time
    Work at office
    Local area
    Remote work
    Worldwide
    Relocation package
    Flexible hours

    AECOM

    Kansas City, MO
    1 day ago
  •  .... Part Time or PRN Dysphagia Management Specialist in physician's office/clinic settings, surrounding...  ...skills performing FEES and Speech Pathology Diagnostics, while achieving work-life...  ...Use the Dysphagia Systems Test (DST) to evaluate the five systems required for safe... 
    Full time
    Temporary work
    Part time
    Relief
    Work at office

    Dysphagia Management Systems

    Baltimore, MD
    2 days ago
  • $95.75k - $150k

     ...Agriculture Consumer Service**Job Classification Title**Veterinary Specialist (NS)**Position Number**65042841**Grade**MH22**About Us**The N....  .... Professional service activities involve 100% diagnostic pathology that includes necropsy, histopathology, case coordination and... 

    Ncagr

    Raleigh, NC
    3 days ago
  •  ...surgical cancer intervention, IBD infusions & therapy, nutrition & weight loss services, remote monitoring between visits, pharmacy & pathology services, and the latest therapies, including clinical research, to provide an integrated patient experience . Our mission is to... 
    Work at office
    Remote work

    Gastro Florida

    Clearwater, FL
    5 days ago
  • $50 per hour

     ...Cantonese Audio Evaluation Specialist is a remote evaluation track for reviewing cantonese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  •  ...Repository Navigation Evaluation Specialist is a remote review track for evaluating AI outputs across repository navigation evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $7,353.68 per month

    Job Title Recovery Specialist Agency Texas Division of Emergency Management Department Recovery Ops Team Proposed Minimum Salary...  ...funded grants within Texas. Work involves coordinating, reviewing, evaluating, and reporting of grants at various stages to determine... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    Texas A&M University System

    Austin, TX
    18 hours ago
  • $38 - $43 per hour

     ...Bilingual Italian STEM Evaluation Specialist is a remote review track for evaluating AI outputs across italian stem review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  •  ...are vibrant. LSF is seeking a talented Information Systems Specialist who wants to make an impact in the lives of others....  ...performance expectations and complete the annual performance evaluation jointly. Essential Functions: Responsible for overall operations... 
    Full time
    Work at office
    Local area

    Lutheran Services Florida

    Fort Walton Beach, FL
    10 days ago
  •  ...Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...appraise conditions that could produce accidents or financial loss. # Conducts safety audits/inspections to identify hazards and evaluate loss-producing potential of given system, operation, or process. # Help develop accident-prevention loss control systems or... 
    Full time
    Temporary work
    For contractors
    Monday to Friday
    Flexible hours

    Knife River

    Sioux City, IA
    5 days ago
  • $110.49k - $149.49k

     ...Tracks requirements across regions (FDA/EMA/HC/other NRAs), aligning REMS deliverables with global risk minimization materials and evaluation plans. ~Works with project teams on responses to FDA information requests. ~Provide subject matter expertise to project... 
    Full time
    Work at office
    Flexible hours

    Syneos Health Careers

    Remote
    17 days ago
  •  ...Safety Evaluation Red Team Specialist is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $110.25k - $157.1k

    Cybersecurity Specialist Non-Union PositionSecurity Operations and Identity Access Management; Portland, Oregon (US-OR) Hybrid schedule...  ...compliant with state and federal regulations by identifying, evaluating, prioritizing, monitoring, and reporting on the effectiveness... 
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours
    2 days per week

    NW Natural

    Happy Valley, OR
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Pathology Evaluation Specialist [Remote]. Be the first to apply!