Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Registered Nurse AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Nursing AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current nursing clinical guidelines and standard of care for Registered Nurse AI Evaluator assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in nursing or an adjacent specialty for Registered Nurse AI Evaluator work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a nursing case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Nursing
  • Medicine and healthcare
  • AI evaluation
  • Rubric writing
  • Expert review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Registered Nurse AI Evaluator [Remote] in Remote vacancy
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Suggested
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Suggested
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    21 hours ago
  • $14.5 per hour

     ...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years...  ...we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search... 
    Suggested
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    3 days ago
  • Mercor is hiring expert Evaluators in Healthcare operations to review AI-generated outputs (documents, spreadsheets, and slide decks) for accuracy and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise to grade outputs, identify... 
    Suggested
    Remote job
    Hourly pay

    Mercor

    New York, NY
    4 days ago
  • YO AI Labs is seeking a Child Development Psychologist (PhD) to support an AI training project as a contractor. You will evaluate and annotate data, analyze developmental scenarios, and provide expert guidance to improve AI systems' accuracy, cultural relevance, and psychological... 
    Suggested
    Remote job
    For contractors

    YO AI Labs

    Seattle, WA
    2 days ago
  • Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Telugu and English.... 
    Immediate start
    Remote work
    Flexible hours

    Obsidian

    New York, NY
    3 days ago
  • $20 - $80 per hour

     ...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    a month ago
  •  ...remote, hourly contractor role supporting AI data and language projects on a project-...  ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy...  .... Excellent editorial judgment in register, tone, punctuation, inclusivity, and... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    2 days ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    3 days ago
  •  ...from threats. Job Description The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research...  ...our people are at the center of everything we do. Growth: AI-powered career tool that identifies career steps and learning opportunities... 

    General Dynamics Information Technology

    Maryland, MD
    11 days ago
  •  ...team in the following role. If you are interested in joining our team, apply today! About this Role: Under direction of the Nurse Evaluator III in the Department of Health Care Services' (DHCS) Clinical Assurance Division (CAD), the Nurse Evaluator II (NE II)... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Remote work
    Monday to Friday
    Night shift

    California Correctional Health Care Services

    Sacramento, CA
    1 day ago
  •  ...Special Education AI Evaluator is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    20 days ago
  •  ...Patent Claim AI Evaluator is a remote review track for evaluating AI outputs in patent law workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it. Why... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Spanish Dialect AI Evaluator is a remote evaluation track for reviewing spanish generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    19 days ago
  • $43 - $47 per hour

     ...Role Overview Help improve how advanced AI models respond to sensitive topics in Czech. In this remote, hourly role, you will use Czech language fluency and cultural judgment to evaluate model behavior and support safer, more reliable interactions. Training is provided... 
    Remote job
    Hourly pay
    Immediate start

    SaidGig

    Remote
    2 days ago
  • $18 - $22 per hour

     ...Role Overview Help improve the safety of advanced AI models by applying Thai language fluency and cultural judgment to evaluate how models respond to sensitive topics in Thai. Training is provided, and prior AI or machine learning experience is not required. Key Responsibilities... 
    Remote job
    Hourly pay
    Immediate start

    SaidGig

    Remote
    2 days ago
  •  ...Regulatory Filing AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    19 days ago
  • $30 - $65 per hour

     ...Help improve next-generation AI systems by evaluating Tamil audio for naturalness, fluency, and linguistic authenticity. This remote contractor role relies on your Tamil language expertise to provide high-quality, real-world feedback that strengthens AI understanding... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  • $80 - $120 per hour

     ...Compliance / regulatory response with financial-services AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $14.5 per hour

     ...remote Search Quality Rating team — and help shape the future of AI-powered search.This is your chance to make a real impact on the...  ...every day, all from the comfort of your home.WHAT YOU'LL DO: • Evaluate search results and rate how relevant and useful they are to real... 
    Remote job
    Bi-weekly pay
    Part time

    Welocalize

    Remote
    28 days ago
  • $60 - $65 per hour

     ...Role Overview Help improve next generation AI language systems by evaluating AI generated Indonesian speech. You will use your native level Indonesian expertise to assess fluency, authenticity, and cultural fit, then provide clear feedback that supports model training... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    13 days ago
  • $50 - $75 per hour

     ...Role Overview Apply your consumer and lifestyle expertise to help evaluate and improve advanced AI systems. Your judgment will help establish the standards used to assess AI responses in areas where practical knowledge, cultural context, and real-world constraints matter... 
    Hourly pay
    For contractors
    Local area
    Remote work

    SaidGig

    United States
    2 days ago
  •  ...Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    27 days ago
  • $30 - $65 per hour

     ...Apply your Vietnamese language expertise to help improve next-generation AI systems through detailed audio evaluations and clear linguistic feedback. This remote contractor role focuses on assessing how naturally Vietnamese is spoken and helping strengthen AI language... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  • $30 - $65 per hour

     ...Help improve next-generation AI systems by evaluating Thai-language audio for fluency, authenticity, and linguistic quality. This remote contractor role uses your Thai language expertise to provide detailed, reliable feedback that strengthens AI understanding and generation... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  • $30 - $65 per hour

     ...Role Overview Use your Italian language expertise to help improve next-generation AI systems through detailed evaluation of Italian audio. This remote independent contractor role focuses on providing high-quality linguistic input that helps models better understand and... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  • $30 - $65 per hour

     ...Help improve next-generation AI systems by evaluating Dutch-language audio and providing clear, native-level linguistic feedback. This remote contractor role centers on assessing how naturally AI-generated Dutch sounds, with no previous AI experience required. Key Responsibilities... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  • $140 per hour

     ...Role Overview Apply your subject matter expertise to improve how next-generation AI systems learn, reason, and perform. As an AI Domain Expert you will evaluate AI outputs, create challenging prompts, annotate real-world data, and provide concise, actionable feedback... 
    Hourly pay
    Part time
    For contractors
    Remote work
    Visa sponsorship
    Work visa
    Free visa

    SaidGig

    United States
    14 days ago
  • $12.6 per hour

     ...Help improve a next-generation AI assistant by completing everyday computer tasks through natural Thai voice interactions, then documenting and evaluating the results. This remote, hourly assignment is designed for native Thai speakers who can work independently on a Mac... 
    Hourly pay
    Immediate start
    Remote work

    SaidGig

    United States
    2 days ago
  • $20 per hour

     ...Exclusively for US Citizens) ### About the Role Datatricks AI is actively hiring remote evaluators for **Project Edgehog**, a specialized AI evaluation...  ...get your account set up for Project Edgehog: 1. **Register:** Visit [** and complete your profile registration.... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Datatricksai

    Toccoa, GA
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Registered Nurse AI Evaluator [Remote]. Be the first to apply!