Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Registered Nurse AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Nursing AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current nursing clinical guidelines and standard of care for Registered Nurse AI Evaluator assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in nursing or an adjacent specialty for Registered Nurse AI Evaluator work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a nursing case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Nursing
  • Medicine and healthcare
  • AI evaluation
  • Rubric writing
  • Expert review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Registered Nurse AI Evaluator [Remote] in Remote vacancy
  • Appsierra Group is seeking an experienced Registered Nurse to evaluate and rank AI-generated clinical content for safety and accuracy. This remote, independent contractor role focuses on nursing expertise to ensure education, triage guidance, and clinical documentation... 
    Suggested
    Remote job
    For contractors

    Medcruit Limited

    New York, NY
    18 hours ago
  • $65 per hour

    Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience... 
    Suggested
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    2 days ago
  • Hippocratic AI Inc. is seeking a Registered Nurse with 5+ years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review agent conversations across primary care, chronic disease management, and scheduling, labeling... 
    Suggested
    Remote job

    Hippocratic AI Inc.

    New York, NY
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Suggested
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    United States
    4 days ago
  • $14.5 per hour

     ...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years...  ...performance and provide insights on relevance and quality. Evaluate and rate the effectiveness of search engine results to ensure... 
    Suggested
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Kanz.us

    Dallas, TX
    1 day ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    4 days ago
  •  ...averaging around 15 hours. Compensation is up to $5 per hour, with payments via PayPal or bank transfer. No prior experience is required, making it ideal for freelancers, students, or flexible workers seeking to contribute to AI model improvements. #J-18808-Ljbffr RWS TrainAI
    Remote job
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS TrainAI

    New York, NY
    2 days ago
  • Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations.Applicants must have... 
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    18 hours ago
  • RemoteLeads seeks an experienced contractor to evaluate AI-generated artifacts and provide structured feedback. You will review documents, spreadsheets, and decks for accuracy, identify errors, and apply incident management and SRE best practices to grade outputs. The role... 
    Remote job
    Hourly pay
    Weekly pay
    For contractors
    Work at office
    Flexible hours

    RemoteLeads

    New York, NY
    4 days ago
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks.... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    New York, NY
    2 days ago
  • $13 per hour

    Rate: $13/hr Hours: 20 hours / week Experience: 1 - 3 years Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in... 
    Hourly pay
    For contractors
    Remote work

    Braintrust

    New York, NY
    2 days ago
  • Overview Join a select team of healthcare experts focused on safeguarding and refining AI systems. This role centers on evaluating clinical precision, safety standards, and overall response quality in generative healthcare AI applications. Key responsibilities involve performing... 
    Part time
    For contractors
    Work at office
    Local area
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours

    Vaco by Highspring

    Mountain View, CA
    1 day ago
  • A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years... 
    Remote job
    Full time
    For contractors

    Turing

    New York, NY
    18 hours ago
  • Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The... 
    Remote work

    Feedinkoo: Remote Jobs

    New York, NY
    18 hours ago
  • $20 - $26 per hour

    Prolific is seeking a fluent Punjabi speaker to act as an AI trainer/evaluator. You will listen to audio and compare it with text, rating naturalness and authenticity. The role requires strong linguistic intuition and the ability to provide precise feedback to help models... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    18 hours ago
  • $50 per hour

    Prolific seeks Product Designers and UX Specialists to join our Expert Network for training and evaluating AI models with real design expertise. After a quick test, you may join Prolific as a participant and get paid for AI training tasks. Researchers pay up to $50 per... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    4 days ago
  • RemoteJobsOne is seeking a fully remote contractor based in the United States to join a customer-driven project evaluating AI assistants. You will leverage your everyday digital-life management skills—email, calendars, bookings, and coordination—to train and evaluate AI... 
    Remote job
    For contractors

    RemoteJobsOne

    Chicago, IL
    2 days ago
  • RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates... 
    Remote job
    Work from home

    RWS

    New York, NY
    2 days ago
  • $40 per hour

    DataAnnotation is recruiting contributors to evaluate AI on Slovak translation, localization, and cultural nuance across real projects. You will review frontier models, rate quality, and help train the next generation of AI with your linguistic judgment. You’ll work on... 
    Remote job
    Flexible hours

    DataAnnotation

    Cleveland, OH
    8 hours ago
  • Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale... 
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    Alignerr Corp.

    Miami, FL
    3 days ago
  • AI Trainer Jobs is seeking a Mental Health Clinical AI Evaluator to remotely review AI outputs affecting clinical safety and guideline adherence. You will assess differential reasoning, dosing logic, and flag safety issues, documenting corrected reasoning for model improvement... 
    Remote job
    Hourly pay
    Part time

    AuraOne

    New York, NY
    2 days ago
  • RWS is seeking a part-time, remote Search Quality Rater to help improve AI-driven search results. You will evaluate queries and provide feedback on text, audio, images, and videos to refine data used by leading search engines and platforms. This role offers a flexible schedule... 
    Remote job
    Part time
    Flexible hours

    RWS

    New York, NY
    2 days ago
  • $30 per hour

     ...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems...  ...stakeholders. Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    18 hours ago
  • Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Remote job
    Work at office

    Mercor

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines... 
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $40 per hour

    Prolific is recruiting Materials Science Specialists to join its Expert Network and contribute real-world expertise to train and evaluate cutting-edge AI models. If selected, you’ll be invited to join Prolific as a participant and paid to train and evaluate powerful AI... 
    Remote job
    Hourly pay

    Prolific

    New York, NY
    4 days ago
  • Mercor is seeking a contract Legal / Compliance Evaluator to assess AI-generated artifacts against domain rubrics. This remote role requires strong English fluency and 5+ years in legal/compliance. You will provide structured written feedback and help improve AI model... 
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    Mercor Inc

    San Francisco, CA
    2 days ago
  • Synthires is seeking experienced Nurse Practitioners and advanced practice nursing professionals to join a remote project in the United States. You will evaluate AI-driven clinical content and provide expert feedback to improve accuracy and reliability of patient care materials... 
    Remote job

    Synthires

    New York, NY
    4 days ago
  • RWS TrainAI is seeking a flexible part-time Search Quality Evaluator to join our remote team. You will assess how everyday searches are handled and provide feedback to improve AI-powered results for global users. Ideal for students or freelancers in Poland, with a strong... 
    Remote job
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS TrainAI

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Registered Nurse AI Evaluator [Remote]. Be the first to apply!