Registered Nurse AI Evaluator [Remote]
AuraOne Human Data
- Remote job
Registered Nurse AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch nursing. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Nursing AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current nursing clinical guidelines and standard of care for Registered Nurse AI Evaluator assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in nursing or an adjacent specialty for Registered Nurse AI Evaluator work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a nursing case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Nursing
- Medicine and healthcare
- AI evaluation
- Rubric writing
- Expert review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...SuggestedHourly payPart timeRemote workFlexible hours$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...SuggestedBi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours$14.5 per hour
...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years... ...we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search...SuggestedPart timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hours- Mercor is hiring expert Evaluators in Healthcare operations to review AI-generated outputs (documents, spreadsheets, and slide decks) for accuracy and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise to grade outputs, identify...SuggestedRemote jobHourly pay
- YO AI Labs is seeking a Child Development Psychologist (PhD) to support an AI training project as a contractor. You will evaluate and annotate data, analyze developmental scenarios, and provide expert guidance to improve AI systems' accuracy, cultural relevance, and psychological...SuggestedRemote jobFor contractors
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Telugu and English....Immediate startRemote workFlexible hours
$20 - $80 per hour
...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate...Hourly payContract workFor contractorsRemote work- ...remote, hourly contractor role supporting AI data and language projects on a project-... ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy... .... Excellent editorial judgment in register, tone, punctuation, inclusivity, and...Hourly payFor contractorsRemote workFlexible hours
$30 per hour
Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr ProlificRemote jobWork from home- ...from threats. Job Description The Expert-Level Network Evaluator / System Vulnerability Analyst provides advanced technical research... ...our people are at the center of everything we do. Growth: AI-powered career tool that identifies career steps and learning opportunities...
- ...team in the following role. If you are interested in joining our team, apply today! About this Role: Under direction of the Nurse Evaluator III in the Department of Health Care Services' (DHCS) Clinical Assurance Division (CAD), the Nurse Evaluator II (NE II)...Permanent employmentFull timeContract workWork at officeRemote workMonday to FridayNight shift
- ...Special Education AI Evaluator is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- ...Patent Claim AI Evaluator is a remote review track for evaluating AI outputs in patent law workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it. Why...Remote jobHourly payFor contractors10 hours per week
- ...Spanish Dialect AI Evaluator is a remote evaluation track for reviewing spanish generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team...Remote jobHourly payFor contractors10 hours per week
$43 - $47 per hour
...Role Overview Help improve how advanced AI models respond to sensitive topics in Czech. In this remote, hourly role, you will use Czech language fluency and cultural judgment to evaluate model behavior and support safer, more reliable interactions. Training is provided...Remote jobHourly payImmediate start$18 - $22 per hour
...Role Overview Help improve the safety of advanced AI models by applying Thai language fluency and cultural judgment to evaluate how models respond to sensitive topics in Thai. Training is provided, and prior AI or machine learning experience is not required. Key Responsibilities...Remote jobHourly payImmediate start- ...Regulatory Filing AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on...Remote jobHourly payFor contractors10 hours per week
$30 - $65 per hour
...Help improve next-generation AI systems by evaluating Tamil audio for naturalness, fluency, and linguistic authenticity. This remote contractor role relies on your Tamil language expertise to provide high-quality, real-world feedback that strengthens AI understanding...Hourly payFor contractorsRemote work$80 - $120 per hour
...Compliance / regulatory response with financial-services AI Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues...Remote jobFor contractorsWork experience placement10 hours per week$14.5 per hour
...remote Search Quality Rating team — and help shape the future of AI-powered search.This is your chance to make a real impact on the... ...every day, all from the comfort of your home.WHAT YOU'LL DO: • Evaluate search results and rate how relevant and useful they are to real...Remote jobBi-weekly payPart time$60 - $65 per hour
...Role Overview Help improve next generation AI language systems by evaluating AI generated Indonesian speech. You will use your native level Indonesian expertise to assess fluency, authenticity, and cultural fit, then provide clear feedback that supports model training...Hourly payFor contractorsRemote work$50 - $75 per hour
...Role Overview Apply your consumer and lifestyle expertise to help evaluate and improve advanced AI systems. Your judgment will help establish the standards used to assess AI responses in areas where practical knowledge, cultural context, and real-world constraints matter...Hourly payFor contractorsLocal areaRemote work- ...Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling...Remote jobHourly payFor contractors10 hours per week
$30 - $65 per hour
...Apply your Vietnamese language expertise to help improve next-generation AI systems through detailed audio evaluations and clear linguistic feedback. This remote contractor role focuses on assessing how naturally Vietnamese is spoken and helping strengthen AI language...Hourly payFor contractorsRemote work$30 - $65 per hour
...Help improve next-generation AI systems by evaluating Thai-language audio for fluency, authenticity, and linguistic quality. This remote contractor role uses your Thai language expertise to provide detailed, reliable feedback that strengthens AI understanding and generation...Hourly payFor contractorsRemote work$30 - $65 per hour
...Role Overview Use your Italian language expertise to help improve next-generation AI systems through detailed evaluation of Italian audio. This remote independent contractor role focuses on providing high-quality linguistic input that helps models better understand and...Hourly payFor contractorsRemote work$30 - $65 per hour
...Help improve next-generation AI systems by evaluating Dutch-language audio and providing clear, native-level linguistic feedback. This remote contractor role centers on assessing how naturally AI-generated Dutch sounds, with no previous AI experience required. Key Responsibilities...Hourly payFor contractorsRemote work$140 per hour
...Role Overview Apply your subject matter expertise to improve how next-generation AI systems learn, reason, and perform. As an AI Domain Expert you will evaluate AI outputs, create challenging prompts, annotate real-world data, and provide concise, actionable feedback...Hourly payPart timeFor contractorsRemote workVisa sponsorshipWork visaFree visa$12.6 per hour
...Help improve a next-generation AI assistant by completing everyday computer tasks through natural Thai voice interactions, then documenting and evaluating the results. This remote, hourly assignment is designed for native Thai speakers who can work independently on a Mac...Hourly payImmediate startRemote work$20 per hour
...Exclusively for US Citizens) ### About the Role Datatricks AI is actively hiring remote evaluators for **Project Edgehog**, a specialized AI evaluation... ...get your account set up for Project Edgehog: 1. **Register:** Visit [** and complete your profile registration....Hourly payContract workRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Registered Nurse AI Evaluator [Remote]. Be the first to apply!



