Nurse Practitioner - Clinical Evaluator
Mercor
About the Role Mercor is hiring experienced Nurse Practitioners to help evaluate and improve cutting-edge AI systems. In this role, you'll evaluate AI-generated clinical content and workflows, leveraging your real-world expertise in diagnosing, treating, and managing patient care across acute and chronic conditions. Key Responsibilities Evaluate AI-generated clinical assessments, treatment plans, patient education materials, and other healthcare artifacts for quality and accuracy. Compare AI-generated responses head-to-head based on clinical reasoning, guideline adherence, and diagnostic soundness. Review clinical scenarios involving diagnosis, treatment planning, medication decisions, and patient education and provide expert feedback. Required Qualifications 4+ years of experience as a Nurse Practitioner (NP), Advanced Practice Registered Nurse (APRN), Family Nurse Practitioner (FNP), Acute Care Nurse Practitioner (ACNP), Pediatric Nurse Practitioner (PNP), or another closely related advanced practice nursing role. Active RN licensure with specialized graduate education in nursing, and experience diagnosing and treating acute, episodic, or chronic illness. Ability to commit 20+ hours per week . Strong written English communication skills. Additional Information Start date: Immediate Duration: Approximately 4–6 weeks Payment: task-based (payment upon first task approval). Experts who complete their first task within the required timeline will then be qualified to be paid hourly for the remainder of the project. #J-18808-Ljbffr Mercor
$70 - $110 per hour
..., Larry Summers , and Jack Dorsey . Position: Nurse Practitioners Type: Contract Compensation: $70–$110/hour... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated clinical assessments , treatment plans, and patient education...SuggestedHourly payContract workSummer workImmediate startRemote work$120 - $175 per hour
Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...SuggestedContract workSummer workRemote work- Mercor is seeking a contract Legal / Compliance Evaluator to assess AI-generated artifacts against domain rubrics. This remote role requires strong English fluency and 5+ years in legal/compliance. You will provide structured written feedback and help improve AI model performance...SuggestedRemote jobHourly payContract workFlexible hours
- Obsidian is hiring expert Evaluators in Public health communications for a remote position. The role involves reviewing and assessing AI-generated work products for accuracy and domain quality. Candidates must have 5+ years of experience, native or professional fluency...SuggestedRemote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...SuggestedRemote jobHourly payWork at office
- Obsidian is seeking expert Evaluators in Training / onboarding / L&D to assess AI-generated documents and presentations. The role entails applying deep expertise to ensure accuracy and domain quality of outputs. This is a flexible, hourly remote position requiring over...Remote jobHourly payWork at officeFlexible hours
- Mercor is seeking an evaluator for nonprofit/philanthropy programs in a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify factual and presentation errors, and deliver concise feedback. Deep domain expertise will guide grading...Remote jobContract workWork at office
- Obsidian is looking for an AI Evaluator to assess and improve AI-generated responses. This role involves identifying strengths and weaknesses in AI-generated content, ensuring quality and adherence to conversational guidelines. Ideal candidates are native Odia speakers,...Contract work
- Obsidian is seeking experienced Evaluators skilled in Data analysis / quantitative readouts to review AI-generated outputs for quality and accuracy. This role is fully remote and involves providing expert feedback on various formats such as documents and slides. Candidates...Remote jobWork at office
- Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role focuses on evaluating AI-generated artifacts against quality rubrics, identifying errors, and delivering structured feedback to support AI model improvements. Applicants...Remote jobContract workWork at office
- Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations.Applicants must...Remote jobWork at office
- Obsidian is seeking a Bilingual Evaluator to assess AI-generated responses in Urdu and English. Your role involves fact-checking and evaluating the quality of responses, providing essential feedback that will inform future AI development. The ideal candidate will have a...Contract work
$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position & Details Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office- YO AI Labs seeks an AI Evaluation Specialist to assess enterprise AI outputs on a contractual, remote basis across the US, Canada, UK, Ireland, Australia, and New Zealand. You will apply rubrics, identify weaknesses, and provide concrete feedback to improve systems. The...Remote job
$70 per hour
Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workImmediate startRemote work$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$90 per hour
...ML Challenge Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks for training and evaluating models. Assess...Remote jobContract workSummer work$175 per hour
...Contract Compensation: $50–$175/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate JSON-formatted AI model outputs against defined grading rubrics. Read and understand written task descriptions and rubrics....Remote jobContract workSummer workStart working today$90 per hour
...: SWE-Bench Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks . Assess repository-level tasks, reference...Remote jobContract workSummer work$59.1 - $65.5 per hour
...Medical Virtual Medical Team (VMT) is a leading provider of virtual clinical care, providing world-class, convenient, evidence-based... ...certification ~ In the past 5 years, practiced as an Advanced Practitioner for at least: ~2 years in an outpatient primary care setting...Hourly payFull timeTemporary workWork at officeShift workAfternoon shiftWeekday work- Obsidian is seeking expert Evaluators for program management and implementation planning to review AI-generated work for accuracy and quality. This is a remote hourly engagement requiring strong subject matter expertise. The ideal candidate will have over 5 years of experience...Remote jobHourly payWork at office
- Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with...Remote job
$150 per hour
...Location: Remote Role Responsibilities Develop grading criteria by breaking clinical questions into discrete, checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and appropriate escalation...Contract workSummer workRemote work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$100 - $150 per hour
...senior reviewers and iterate quickly on your work. Work independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional B2B sales experience, including quota-carrying roles. ~...Contract workSummer workRemote work$110k - $120k
...Job Description Job Description Job Title: Nurse Practitioner (NP) or Physician Assistant (PA) Location: San Francisco, CA Competitive salary: $110,000-$120,000 (commensurate with experience). Client: MRG Exams Job Description Nurse Practitioner (NP...Full timeMonday to Friday$60 - $70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$148.2k
...with a broad array of patient needs; conducting a mix of acute, chronic, and well visits with support and mentorship of an onsite clinical Preceptor. Treating patients in-office or in testing centers as well as conducting occasional tele-health visits Continuous...Full timeTemporary workWork at office$16 per hour
...Compensation: $16/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards. Score the quality of musical training data . Write music...Contract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Nurse Practitioner - Clinical Evaluator. Be the first to apply!
- nurse practitioner urology San Francisco, CA
- clinical nurse San Francisco, CA
- nurse practitioner San Francisco, CA
- outpatient nurse practitioner San Francisco, CA
- primary care nurse practitioner San Francisco, CA
- orthopedic nurse practitioner San Francisco, CA
- nurse practitioner per diem San Francisco, CA
- permanent nurse practitioner San Francisco, CA
- matron San Francisco, CA
- behavioral health nurse practitioner San Francisco, CA



