Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Primary Care Physician - AI Evaluator

$170 - $190 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation
Type: Contract
Compensation: $170–$190/hour
Location: Remote
Commitment: 10+ hours/week

Role Responsibilities

  • Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness.
  • Evaluate AI-generated notes and summaries against what a practicing PCP would document.
  • Annotate outpatient encounter data against detailed guidelines and flag omissions, hallucinations, and clinical inaccuracies.
  • Provide structured, written feedback that engineering and product teams can act on to improve AI systems .
  • Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.
  • Raise clarifying questions where guidance is ambiguous and help refine the guidelines.

Qualifications

Must-Have

  • MD , with 2+ years post-residency , currently practicing primary care / family medicine / general internal medicine.
  • US-based .
  • Direct experience writing clinical notes in an outpatient setting .
  • Minimum availability of 10 hours/week for the next 3 months .

Preferred

  • 5+ years of experience post-residency.
  • Familiarity with Epic .
  • Experience with clinical documentation quality review, note auditing, or CDI exposure.
  • Prior AI/ML annotation or model evaluation work experience, with strong performance reviews.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Primary Care Physician - AI Evaluator in San Francisco, CA vacancy
  • $170 - $190 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190... 
    Suggested
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • Mercor is hiring a Healthcare Expert (contract, remote) to evaluate AI-generated medical responses and improve model reasoning. You will assess input data, compare outputs, and articulate reasons for superiority, focusing on clinical accuracy, safety, and sound medical... 
    Suggested
    Remote job
    Contract work
    Immediate start

    Mercor

    San Francisco, CA
    4 days ago
  • Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier... 
    Suggested
    Remote job

    Planet Pharma

    San Francisco, CA
    2 days ago
  • Turing Enterprises, Inc. in the San Francisco area is seeking a freelance journalist to help evaluate and improve AI using newsroom expertise, editorial judgment, and clear communication. No prior AI experience required. You will design and assess real-world editorial and... 
    Suggested
    Remote job
    Freelance

    Turing

    San Francisco, CA
    4 days ago
  • Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with... 
    Suggested
    Remote job

    Planet Pharma

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $70 - $110 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules, and performance... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $250k

     ...Primary Care Concierge Medicine San Francisco, CA Position Highlights : ~ Warm waitlist of patients starting day 1...  ...hospital coordination visits only. Call shared with one other physician ~ Backed by one of the nation's largest concierge medicine... 
    Relocation package
    Night shift
    Weekend work

    The Medicus Firm

    San Francisco, CA
    12 hours ago
  • $76 per hour

     ...About the opportunity We’re looking for Japanese-English bilingual physicians who are licensed and actively practicing in Japan in Internal Medicine or Primary Care to support a clinical AI evaluation project focused on Type 2 diabetes. You’ll review patient... 
    Hourly pay
    Contract work
    Freelance
    Immediate start
    Remote work

    Braintrust

    San Francisco, CA
    2 days ago
  •  ...California - Concierge Medicine Opportunity Location: San Francisco -Family Medicine or Internal Medicine -Minimum 5 years of primary care experience -Must have interest and willingness to practice concierge medicine (meaning, patient-focused, relationship-driven... 
    Flexible hours

    DOCTORS CHOICE PLACEMENT SERVICES, INC.

    San Francisco, CA
    12 hours ago
  •  ...Primary Care Physician Functional Medicine Interest a Plus San Francisco, California - Flexible Schedule Modern Primary Care 4-Day Workweek...  ...primary care practice built around modern healthcare, AI-driven technology, and physician flexibility. Position Highlights... 
    Hourly pay
    Work at office
    Flexible hours
    Shift work
    Weekend work

    National Health Partners

    San Francisco, CA
    12 hours ago
  • $104.8k - $320.1k

     ...students, and trainees. Full-time Concierge / Executive Medicine Physician (1.0 FTE; 8 half-days/week) Faculty appointment within a...  ...academic health system with a strong reputation for excellence in primary care and family medicine. Collaborative, patient-centered... 
    Full time
    Traineeship
    Local area

    UCSF

    San Francisco, CA
    12 hours ago
  •  ...Concierge Primary Care Physician Opportunity Personalized Adult Medicine We are assisting a growing concierge primary care practice seeking an experienced Internal Medicine or Family Medicine physician to provide exceptional, relationship-focused healthcare for adult... 

    Nortek Medical Staffing

    San Francisco, CA
    12 hours ago
  • $350k - $400k

     ...Medical Center in San Francisco, CA as a Physician - Pain Management! The San Francisco...  ...in coordination with Pain Services, primary care, psychiatry/psychology, and other services...  ...procedures, case-based teaching, and evaluation of fellow clinical competency. b. Participation... 
    Full time
    Contract work
    Freelance
    Work from home

    Veterans Health Administration

    San Francisco, CA
    12 hours ago
  •  ...Description: We are seeking a qualified and compassionate Primary Care Physician to provide high-quality patient care in a modern, patient-...  ..., wellness, and long-term health management. Evaluate patients' medical histories, symptoms, and diagnostic results... 

    ProTouch Staffing

    San Francisco, CA
    12 hours ago
  •  ...Francisco, California Step into a high-impact physician leadership role with a mission-driven...  ..., and expand access to integrated care, while maintaining an exceptional work-life...  ...and clinical staff. Oversee integrated primary care, behavioral health, dental, and medication... 
    Relocation package
    Weekend work
    2 days per week

    Curative

    San Francisco, CA
    12 hours ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $20 per hour

     ...Rate: $20/hr Hours: 20 hours / week Experience: 1 - 3 years Help improve leading AI models through research, reasoning and educational evaluation. This remote opportunity is for students and working professionals who already use the Gemini App regularly for... 
    Contract work
    Immediate start
    Remote work

    Braintrust

    San Francisco, CA
    23 days ago
  • $70 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  •  ...About the role AI assistants are becoming part of everyday life, helping people with everything from writing emails and planning...  ...Compare AI responses and select your preferred experience. Evaluate conversational quality, helpfulness, clarity, tone, and overall... 
    Hourly pay
    Temporary work
    Part time
    Remote work

    micro1

    San Francisco, CA
    7 days ago
  • $10 - $30 per hour

     ...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability...  ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    Part time
    For contractors
    Remote work
    Shift work

    micro1

    San Francisco, CA
    24 days ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $...  ...judgments in two to four specific sentences. Careful reading to notice omissions in responses.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $308.7k - $328k

     ...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible and enjoyable. But this isn’t your average doctor’s office. We’re on a mission to transform healthcare, which means improving the... 
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Relocation package

    One Medical

    San Francisco, CA
    3 days ago
  • $211k - $225k

     ...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible...  ...time The Opportunity We are seeking a Primary Care Physician to join our team in a unique remote role. This is a fully virtual... 
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Remote work
    Weekend work
    Afternoon shift

    One Medical

    San Francisco, CA
    3 days ago
  • $308.7k - $328k

     ...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible and enjoyable. But this isn’t your average doctor’s office. We’re on a mission to transform healthcare, which means improving the... 
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Work from home
    Relocation package

    One Medical

    San Francisco, CA
    3 days ago
  •  ...About Us One Medical is a primary care solution challenging the industry status quo by making quality care more affordable, accessible...  ...healthcare, and we're looking for dedicated primary care physicians to join us right out of residency. You'll practice in a supportive... 
    Full time
    Part time
    Work at office
    Remote work
    Relocation
    Relocation package

    One Medical

    San Francisco, CA
    3 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $15 per hour

     ...Rate: $15/hr Hours: 20 hours / week Experience: 1 - 3 years Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses... 
    Full time
    Contract work
    Part time
    Immediate start

    Braintrust

    San Francisco, CA
    9 days ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...model response grading. Evaluate clinical dialogues for accuracy...  ...edge cases and standards of care, ensuring annotation consistency...  ...of care Background in primary care, internal medicine, emergency... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Primary Care Physician - AI Evaluator. Be the first to apply!