Registered Nurse AI Evaluator [Remote]
AuraOne Human Data
- Remote job
Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Nursing AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current nursing clinical guidelines and standard of care for Registered Nurse AI Evaluator assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in nursing or an adjacent specialty for Registered Nurse AI Evaluator work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a nursing case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Nursing
- Medicine and healthcare
- AI evaluation
- Rubric writing
- Expert review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- Appsierra Group is seeking an experienced Registered Nurse to evaluate and rank AI-generated clinical content for safety and accuracy. This remote, independent contractor role focuses on nursing expertise to ensure education, triage guidance, and clinical documentation...SuggestedRemote jobFor contractors
$65 per hour
Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience...SuggestedHourly paySelf employmentWork from homeFlexible hours- Hippocratic AI Inc. is seeking a Registered Nurse with 5+ years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review agent conversations across primary care, chronic disease management, and scheduling, labeling...SuggestedRemote job
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
$14.5 per hour
...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years... ...performance and provide insights on relevance and quality. Evaluate and rate the effectiveness of search engine results to ensure...SuggestedHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hours- ...averaging around 15 hours. Compensation is up to $5 per hour, with payments via PayPal or bank transfer. No prior experience is required, making it ideal for freelancers, students, or flexible workers seeking to contribute to AI model improvements. #J-18808-Ljbffr RWS TrainAIRemote jobHourly payPart timeFreelanceWork from homeFlexible hours
- Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations.Applicants must have...Remote jobWork at office
- RemoteLeads seeks an experienced contractor to evaluate AI-generated artifacts and provide structured feedback. You will review documents, spreadsheets, and decks for accuracy, identify errors, and apply incident management and SRE best practices to grade outputs. The role...Remote jobHourly payWeekly payFor contractorsWork at officeFlexible hours
$14.5 per hour
Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
$13 per hour
Rate: $13/hr Hours: 20 hours / week Experience: 1 - 3 years Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in...Hourly payFor contractorsRemote work- Overview Join a select team of healthcare experts focused on safeguarding and refining AI systems. This role centers on evaluating clinical precision, safety standards, and overall response quality in generative healthcare AI applications. Key responsibilities involve performing...Part timeFor contractorsWork at officeLocal areaImmediate startRemote workMonday to FridayFlexible hours
- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The...Remote work
$20 - $26 per hour
Prolific is seeking a fluent Punjabi speaker to act as an AI trainer/evaluator. You will listen to audio and compare it with text, rating naturalness and authenticity. The role requires strong linguistic intuition and the ability to provide precise feedback to help models...Remote jobHourly payWork from homeFlexible hours$50 per hour
Prolific seeks Product Designers and UX Specialists to join our Expert Network for training and evaluating AI models with real design expertise. After a quick test, you may join Prolific as a participant and get paid for AI training tasks. Researchers pay up to $50 per...Remote jobHourly payFlexible hours- RemoteJobsOne is seeking a fully remote contractor based in the United States to join a customer-driven project evaluating AI assistants. You will leverage your everyday digital-life management skills—email, calendars, bookings, and coordination—to train and evaluate AI...Remote jobFor contractors
- RWS Group is seeking a remote evaluator to help improve AI search results by providing detailed feedback on text, audio, images, and videos. You’ll work from home, simulating everyday searches to influence how major search engines respond to real users. Ideal candidates...Remote jobWork from home
$40 per hour
DataAnnotation is recruiting contributors to evaluate AI on Slovak translation, localization, and cultural nuance across real projects. You will review frontier models, rate quality, and help train the next generation of AI with your linguistic judgment. You’ll work on...Remote jobFlexible hours- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...Remote jobHourly payContract workFlexible hours
- AI Trainer Jobs is seeking a Mental Health Clinical AI Evaluator to remotely review AI outputs affecting clinical safety and guideline adherence. You will assess differential reasoning, dosing logic, and flag safety issues, documenting corrected reasoning for model improvement...Remote jobHourly payPart time
- RWS is seeking a part-time, remote Search Quality Rater to help improve AI-driven search results. You will evaluate queries and provide feedback on text, audio, images, and videos to refine data used by leading search engines and platforms. This role offers a flexible schedule...Remote jobPart timeFlexible hours
$30 per hour
...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems... ...stakeholders. Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical...Remote jobHourly payContract work- Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote jobWork at office
- OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines...Remote jobFor contractors
$40 per hour
Prolific is recruiting Materials Science Specialists to join its Expert Network and contribute real-world expertise to train and evaluate cutting-edge AI models. If selected, you’ll be invited to join Prolific as a participant and paid to train and evaluate powerful AI...Remote jobHourly pay- Mercor is seeking a contract Legal / Compliance Evaluator to assess AI-generated artifacts against domain rubrics. This remote role requires strong English fluency and 5+ years in legal/compliance. You will provide structured written feedback and help improve AI model...Remote jobHourly payContract workFlexible hours
- Synthires is seeking experienced Nurse Practitioners and advanced practice nursing professionals to join a remote project in the United States. You will evaluate AI-driven clinical content and provide expert feedback to improve accuracy and reliability of patient care materials...Remote job
- RWS TrainAI is seeking a flexible part-time Search Quality Evaluator to join our remote team. You will assess how everyday searches are handled and provide feedback to improve AI-powered results for global users. Ideal for students or freelancers in Poland, with a strong...Remote jobHourly payPart timeFreelanceWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Registered Nurse AI Evaluator [Remote]. Be the first to apply!

