Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Registered Nurse AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Nursing AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current nursing clinical guidelines and standard of care for Registered Nurse AI Evaluator assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in nursing or an adjacent specialty for Registered Nurse AI Evaluator work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a nursing case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Nursing
  • Medicine and healthcare
  • AI evaluation
  • Rubric writing
  • Expert review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Registered Nurse AI Evaluator [Remote] in Remote vacancy
  • $50 - $60 per hour

    A professional healthcare organization in Minnesota seeks a Registered Nurse to help improve AI models. In this role, you will evaluate chatbot logic and measure their progress while solving healthcare-related problems. This is an independent contract position with the... 
    Suggested
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    2 days ago
  • $50 - $60 per hour

    DataAnnotation is seeking an Operating Room Nurse to train AI models by providing diverse healthcare-related problems. This role allows for...  ...or in-progress medical degree. Responsibilities include evaluating AI outputs and ensuring medical accuracy. #J-18808-Ljbffr DataAnnotation
    Suggested
    Remote job
    Hourly pay
    Work from home

    DataAnnotation

    Phoenix, AZ
    1 day ago
  • $40 per hour

    A leading AI training company is seeking a Nurse to evaluate and improve AI models in healthcare. The position is open to medical professionals in the United States, offering flexibility in project selection and a competitive pay starting at $40+ per hour. This role focuses... 
    Suggested
    Remote job
    Hourly pay

    DataAnnotation

    Hartford, CT
    2 days ago
  • $40 per hour

    A healthcare technology company is looking for medical experts to train AI models and evaluate their performance. The role is available as a full-time or part-time remote position, ideal for applicants with a current or ongoing medical degree. Responsibilities include... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    2 days ago
  • $40 per hour

    A healthcare technology firm is seeking medical experts in the United States to evaluate AI models and enhance their performance. Responsibilities include providing complex healthcare-related problems to AI chatbots and ensuring the accuracy of the models. This position... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Honolulu, HI
    3 days ago
  • $50 - $60 per hour

     ...DataAnnotation is looking for a Certified Nurse Midwife to assist in training AI models from the comfort of your home. This independent contractor position...  ...and fluency in English. Responsibilities include evaluating AI outputs related to healthcare and ensuring the accuracy... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Oklahoma City, OK
    3 days ago
  • $65 per hour

    Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience... 
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    2 days ago
  • $50 - $60 per hour

     ...DataAnnotation is seeking a Certified Nurse Midwife to assist in training AI models. This remote position allows you to work on your own schedule from...  ...provide expertise in healthcare-related issues while evaluating AI performance. Join us to contribute to innovative healthcare... 
    Hourly pay
    Remote work

    DataAnnotation

    Providence, RI
    3 days ago
  • $40 per hour

    A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Iowa, LA
    2 days ago
  •  ...Blueprint Technologies, LLC. is seeking a detail-oriented Labeler / Annotator to evaluate AI responses in French. This remote role focuses on side-by-side evaluation across real-world scenarios, not translation, requiring strong judgment and attention to detail. You... 
    Remote work

    Blueprint Consulting Services

    Bellevue, WA
    4 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    2 days ago
  • $40 per hour

     ...technology company is seeking a Physics Graduate Assistant to join their team in a remote position. The role involves training AI models by evaluating their outputs and improving their quality through complex physics problems. Candidates should have a strong grasp of... 
    Hourly pay
    Contract work
    Remote work

    DataAnnotation

    Indiana, PA
    2 days ago
  • $40 per hour

     ...We are looking for a Physics Graduate Assistant to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding... 
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work

    DataAnnotation

    Charleston, WV
    2 days ago
  • $40 per hour

    A leading technology firm is seeking medical experts to evaluate AI chatbots' performance and ensure their medical accuracy. This remote role allows you to choose your projects and work on your own schedule, with hourly compensation starting at $40. Candidates should have... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    5 days ago
  • $40 per hour

    A healthcare data company is seeking medical experts to evaluate AI chatbot performance. As a remote role, you will provide complex healthcare problems to AI models and ensure their output is medically accurate. This position offers flexible project selection and competitive... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Santa Fe, NM
    3 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    3 days ago
  • $40 per hour

    A technology company specializing in AI is seeking a Physics Graduate Assistant to enhance AI models. You will evaluate AI chatbot outputs and provide complex physics problems. Ideal candidates will have a strong understanding of classical mechanics, E&M, thermodynamics... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A leading AI technology firm is seeking experienced cybersecurity professionals for a remote position in the United States. You will evaluate AI-generated security content while solving technical problems to strengthen AI models. Ideal candidates have 2+ years in cybersecurity... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    2 days ago
  • $40 per hour

    A cybersecurity company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and enhance AI models' effectiveness. This REMOTE role offers flexibility to choose projects that suit your schedule, with hourly pay starting at $40. Candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    Wausau, WI
    2 days ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical problems for training AI models. The ideal candidates will have over 2 years of relevant cybersecurity experience and strong writing skills. This role... 
    Hourly pay
    Remote work

    DataAnnotation

    Charleston, WV
    2 days ago
  • $40 per hour

     ...We are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Madison, WI
    2 days ago
  • $20 per hour

    A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity... 
    Hourly pay
    Remote work

    DataAnnotation

    Lincoln, NE
    2 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and improve AI systems' reasoning about real-world threats. This is a flexible, remote role available to candidates from the US and other countries, offering competitive... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Topeka, KS
    1 day ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This remote role offers flexibility in project selection and scheduling, with compensation starting at $40+ per hour. Ideal candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    Bismarck, ND
    2 days ago
  • $40 per hour

    A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves critiquing UI/UX visuals, assessing aesthetic quality, and contributing to various design-focused projects. Candidates should have a strong background... 
    Remote work

    DataAnnotation

    Providence, RI
    2 days ago
  •  ...Seeking a PhD-level expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate responses, contributing to the training of advanced AI models in a flexible contract role.... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  • $40 per hour

    A leading AI cybersecurity firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and design technical solutions. You will work remotely and can choose your projects, with pay starting at $40 per hour. The ideal candidate has... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Helena, MT
    3 days ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    1 day ago
  • $20 per hour

    A tech company specializing in AI is looking for a Digital Web Designer to evaluate AI-generated designs and help train models for better aesthetic understanding. This is a remote position open solely to applicants in the United States. The role involves assessing UI/UX... 
    Remote work

    DataAnnotation

    Helena, MT
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Registered Nurse AI Evaluator [Remote]. Be the first to apply!