Primary Care Physician - AI Evaluator
$170 - $190 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation
Type: Contract
Compensation: $170–$190/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness.
- Evaluate AI-generated notes and summaries against what a practicing PCP would document.
- Annotate outpatient encounter data against detailed guidelines and flag omissions, hallucinations, and clinical inaccuracies.
- Provide structured, written feedback that engineering and product teams can act on to improve AI systems .
- Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.
- Raise clarifying questions where guidance is ambiguous and help refine the guidelines.
Qualifications
Must-Have
- MD , with 2+ years post-residency , currently practicing primary care / family medicine / general internal medicine.
- US-based .
- Direct experience writing clinical notes in an outpatient setting .
- Minimum availability of 10 hours/week for the next 3 months .
Preferred
- 5+ years of experience post-residency.
- Familiarity with Epic .
- Experience with clinical documentation quality review, note auditing, or CDI exposure.
- Prior AI/ML annotation or model evaluation work experience, with strong performance reviews.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$170 - $190 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190...SuggestedContract workWork experience placementSummer workRemote work- Mercor is hiring a Healthcare Expert (contract, remote) to evaluate AI-generated medical responses and improve model reasoning. You will assess input data, compare outputs, and articulate reasons for superiority, focusing on clinical accuracy, safety, and sound medical...SuggestedRemote jobContract workImmediate start
- Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier...SuggestedRemote job
- Turing Enterprises, Inc. in the San Francisco area is seeking a freelance journalist to help evaluate and improve AI using newsroom expertise, editorial judgment, and clear communication. No prior AI experience required. You will design and assess real-world editorial and...SuggestedRemote jobFreelance
- Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with...SuggestedRemote job
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$70 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules, and performance...Hourly payContract workSummer workImmediate startRemote work$250k
...Primary Care Concierge Medicine San Francisco, CA Position Highlights : ~ Warm waitlist of patients starting day 1... ...hospital coordination visits only. Call shared with one other physician ~ Backed by one of the nation's largest concierge medicine...Relocation packageNight shiftWeekend work$76 per hour
...About the opportunity We’re looking for Japanese-English bilingual physicians who are licensed and actively practicing in Japan in Internal Medicine or Primary Care to support a clinical AI evaluation project focused on Type 2 diabetes. You’ll review patient...Hourly payContract workFreelanceImmediate startRemote work- ...California - Concierge Medicine Opportunity Location: San Francisco -Family Medicine or Internal Medicine -Minimum 5 years of primary care experience -Must have interest and willingness to practice concierge medicine (meaning, patient-focused, relationship-driven...Flexible hours
- ...Primary Care Physician Functional Medicine Interest a Plus San Francisco, California - Flexible Schedule Modern Primary Care 4-Day Workweek... ...primary care practice built around modern healthcare, AI-driven technology, and physician flexibility. Position Highlights...Hourly payWork at officeFlexible hoursShift workWeekend work
$104.8k - $320.1k
...students, and trainees. Full-time Concierge / Executive Medicine Physician (1.0 FTE; 8 half-days/week) Faculty appointment within a... ...academic health system with a strong reputation for excellence in primary care and family medicine. Collaborative, patient-centered...Full timeTraineeshipLocal area- ...Concierge Primary Care Physician Opportunity Personalized Adult Medicine We are assisting a growing concierge primary care practice seeking an experienced Internal Medicine or Family Medicine physician to provide exceptional, relationship-focused healthcare for adult...
$350k - $400k
...Medical Center in San Francisco, CA as a Physician - Pain Management! The San Francisco... ...in coordination with Pain Services, primary care, psychiatry/psychology, and other services... ...procedures, case-based teaching, and evaluation of fellow clinical competency. b. Participation...Full timeContract workFreelanceWork from home- ...Description: We are seeking a qualified and compassionate Primary Care Physician to provide high-quality patient care in a modern, patient-... ..., wellness, and long-term health management. Evaluate patients' medical histories, symptoms, and diagnostic results...
- ...Francisco, California Step into a high-impact physician leadership role with a mission-driven... ..., and expand access to integrated care, while maintaining an exceptional work-life... ...and clinical staff. Oversee integrated primary care, behavioral health, dental, and medication...Relocation packageWeekend work2 days per week
$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model...Contract workSummer workRemote work$20 per hour
...Rate: $20/hr Hours: 20 hours / week Experience: 1 - 3 years Help improve leading AI models through research, reasoning and educational evaluation. This remote opportunity is for students and working professionals who already use the Gemini App regularly for...Contract workImmediate startRemote work$70 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workImmediate startRemote work- ...About the role AI assistants are becoming part of everyday life, helping people with everything from writing emails and planning... ...Compare AI responses and select your preferred experience. Evaluate conversational quality, helpfulness, clarity, tone, and overall...Hourly payTemporary workPart timeRemote work
$10 - $30 per hour
...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability... ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...Part timeFor contractorsRemote workShift work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $... ...judgments in two to four specific sentences. Careful reading to notice omissions in responses....Contract workSummer workRemote work$308.7k - $328k
...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible and enjoyable. But this isn’t your average doctor’s office. We’re on a mission to transform healthcare, which means improving the...Full timeTemporary workPart timeWork at officeRemote workRelocation package$211k - $225k
...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible... ...time The Opportunity We are seeking a Primary Care Physician to join our team in a unique remote role. This is a fully virtual...Full timeTemporary workPart timeWork at officeLocal areaRemote workWeekend workAfternoon shift$308.7k - $328k
...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible and enjoyable. But this isn’t your average doctor’s office. We’re on a mission to transform healthcare, which means improving the...Full timeTemporary workPart timeWork at officeRemote workWork from homeRelocation package- ...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible... ...healthcare, and we're looking for dedicated primary care physicians to join us right out of residency. You'll practice in a supportive...Full timePart timeWork at officeRemote workRelocationRelocation package
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$15 per hour
...Rate: $15/hr Hours: 20 hours / week Experience: 1 - 3 years Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses...Full timeContract workPart timeImmediate start$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...model response grading. Evaluate clinical dialogues for accuracy... ...edge cases and standards of care, ensuring annotation consistency... ...of care Background in primary care, internal medicine, emergency...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Primary Care Physician - AI Evaluator. Be the first to apply!
- collaborating physician San Francisco, CA
- doctor of optometry San Francisco, CA
- physician-psychiatry San Francisco, CA
- doctor work from home San Francisco, CA
- internal medicine primary care physician San Francisco, CA
- physician consultant remote San Francisco, CA
- part time physician San Francisco, CA
- allergy physician San Francisco, CA
- remote physician San Francisco, CA
- supervising physician San Francisco, CA





