Primary Care Physician - AI Evaluator
$170 - $190 per hourMercor Inc
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness. Evaluate AI-generated notes and summaries against what a practicing PCP would document. Annotate outpatient encounter data against detailed guidelines and flag omissions, hallucinations, and clinical inaccuracies. Provide structured, written feedback that engineering and product teams can act on to improve AI systems . Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions. Raise clarifying questions where guidance is ambiguous and help refine the guidelines. Qualifications Must-Have MD , with 2+ years post-residency , currently practicing primary care / family medicine / general internal medicine. US-based . Direct experience writing clinical notes in an outpatient setting . Minimum availability of 10 hours/week for the next 3 months . Preferred 5+ years of experience post-residency. Familiarity with Epic . Experience with clinical documentation quality review, note auditing, or CDI exposure. Prior AI/ML annotation or model evaluation work experience, with strong performance reviews. #J-18808-Ljbffr
- ...AuraOne is seeking a Primary Care Physician (MD) for a remote Clinical Documentation & AI Evaluation track. Review AI outputs, assess differential diagnosis, dosing logic, and adherence to guidelines, and document corrected clinical reasoning. This contractor role requires...SuggestedFor contractorsRemote work
$70 per hour
...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. Participation... ...US-based, actively practicing physicians (MD/DO) to evaluate clinical... ..., with recent direct patient care (attending-level preferred);...SuggestedHourly payPermanent employmentPart time10 hours per week- Mindrift is seeking US-based physicians to evaluate clinical EHR vignettes for a medical AI evaluation program. You will review vignettes with questions, score reasoning quality, and provide concise rationales. This is a part-time, project-based opportunity focused on...SuggestedPart time
- Mercor in the United States is seeking an experienced hospitalist to support clinical documentation and AI evaluation. This remote, contract role focuses on reviewing inpatient notes and ensuring accuracy against standard hospitalist documentation. You will annotate AI-...SuggestedRemote jobContract work
$70 per hour
Mindrift invites US-based physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation program. Participation is part-time and project-based, with tasks centered on diagnosing and treating multiple systems and scoring reasoning quality across blind reads....SuggestedHourly payPart time- ...Nao Medical is seeking a Primary Care Physician (MD/DO) for its Canarsie clinic in New York. The role blends same-day urgent visits with continuity care across all ages, supported by AI copilots for documentation. Flexible scheduling and leadership development accompany...Flexible hours
$170 per hour
...Category: Medical & Clinical AI · Pay: $170 / hr · Location: Remote — US-eligible · Contractor Primary Care Physician (MD) - Clinical Documentation & AI Evaluation is a remote clinical-review track for evaluating AI outputs that touch physician. Reviewers grade differential...For contractorsRemote work10 hours per week$230k - $250k
...Nao Medical in Jackson Heights, NY is seeking a Primary Care Physician to provide full-scope outpatient care across all ages. You’ll blend well-... ...child visits, chronic disease management, and geriatrics with AI-assisted charting that reduces documentation time. Earn a...Flexible hours- ...Curai Health is hiring a Remote Telemedicine Physician to deliver high-quality, patient-centered primary care via video, chat, and secure messaging to patients across the United States. You will work 36+ patient contact hours weekly in a virtual care setting, with emphasis...Remote work
$130 per hour
Turing is seeking US-based dermatologists to review AI-generated dermatology content for accuracy and safety. You will analyze medical images and case summaries, offering structured feedback to improve AI performance. A strong dermatology background and US licensure are...Hourly payContract workPart time- ...MDVIP is seeking a Successions Sourcer, Physician Recruitment to build and sustain the top-of-funnel... ...recruiters. You will identify, research, and engage primary care physicians for MDVIP affiliation and practice ownership, using AI-assisted searches, multi-touch outreach, and...Remote work
- Job Profile Evaluate AI-generated surgical content for procedural, anatomical, and clinical accuracy. Review pre/post-operative protocols and decision-making, flag patient safety risks, and validate outputs against surgical research and clinical guidelines. Desired Candidate...Freelance
$150 per hour
Mercor is seeking a General Physician for a remote, short-term contract. You will evaluate AI model outputs for clinical validity, provide structured feedback, and flag safety issues while collaborating with AI researchers. The assignment spans 6 weeks at ~20+ hours per...Remote jobHourly payTemporary work- Mercor is seeking experienced MDs or DOs to evaluate health AI models remotely in the United States. You will review outputs across diagnoses, clinical reasoning and care workflows, and provide structured feedback to ensure medical accuracy and safety. The role requires...Remote jobPart timeFor contractors
$18 per hour
...Description Interact with an AI assistant in Malayalam. Translate English prompts into Malayalam and use them to interact with the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality...Hourly payFreelanceImmediate startRemote workFlexible hours$230k - $250k
Nao Medical in Long Island City, NY is seeking a Primary Care Physician (MD/DO) to deliver full-scope care for all ages. Enjoy a base salary of $... ...and up to $45,000 in quarterly performance incentives, with AI-assisted documentation to minimize charting time. Flexible scheduling...Flexible hours$100 - $130 per hour
A leading tech company is seeking a Primary Care Physician to work remotely. This role involves reviewing clinical information and enhancing AI systems for better decision-making in healthcare. Candidates should possess an MD or DO, be board-certified or board-eligible,...Remote job- Mercor Operations Featured Jobs Special Referral Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Remote — United States only Clinical documentation Primary care AI evaluation Special Referral gives your application an enhanced referral route, helping...Contract workFor contractorsWork experience placementRemote work
- ...Mercor is seeking experienced musicians to evaluate generative music AI models, working in Bengali and English. You will assess AI-generated lyrics across genres and rate them against detailed quality standards. Responsibilities include comparing lyrics to published songs...Part timeImmediate startFlexible hours
$18 per hour
...RWS TrainAI is seeking AI Linguistic Evaluators to assess Gujarati language performance for a short collaboration. This remote freelance role requires immediate start and offers flexible scheduling for approximately 10-15 total hours (about 5 hours per day) at a rate...FreelanceImmediate startRemote workFlexible hours- ...RWS Group is seeking a Speech AI Evaluation Specialist to support AI content improvement in Vietnamese (USA). This freelance, part-time role is remote from the USA, with a flexible schedule and immediate start. You will rate AI responses for relevance, accuracy, and clarity...Part timeFreelanceImmediate startRemote workFlexible hours
- ...Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20–40 hours per week with at least 4 hours overlap during PST business...Part timeFor contractorsRemote work
- ...AuraOne is seeking a Multilingual Primary Care Physician (MD) for a Remote Clinical Documentation & AI Evaluation track. Review AI outputs touching physician practice, assess differential reasoning, dosing logic, and guideline adherence, and flag patient-safety issues,...For contractorsRemote work
- ...Obsidian is seeking expert Evaluators in Personal finance / consumer planning to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement designed for seasoned professionals who apply deep domain knowledge...Hourly payRemote work
$125 per hour
...Signify Health, part of CVS Health, is seeking a Part-Time Physician to provide in-home health evaluations, visiting patients in the comfort of their own homes to bridge gaps in care and support personalized health plans. The average weekly hours are about 29.5 with a...Hourly payPart time- ...Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses. - Location: Remote - Type: Independent contractor / Part-time - Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create high-quality...Part timeFor contractorsRemote work
- ...Gramian Consultancy is seeking Thai native-level evaluators to assess Thai audio content for fluency, nativeness and linguistic authenticity... ...You will provide well-reasoned English feedback to help improve AI language understanding and generation. No prior AI experience is...
$18 per hour
...Description Interact with an AI assistant in Bengali. Translate English prompts into Bengali and use them to test the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality, and cultural...Hourly payTemporary workFreelanceImmediate startRemote workFlexible hours- ...Mercor is a remote contractor role focusing on evaluating AI-generated artifacts within real estate, hospitality, and events. You will assess quality against rubrics, spot factual, presentation, and aesthetic errors, and deliver structured feedback to help improve AI models...For contractorsWork at officeRemote work
- ...Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate AI models. After a brief 10–15 minute test, successful candidates may join Prolific as participants and earn money for paid tasks. In this role you will perform AI evaluation...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Primary Care Physician - AI Evaluator. Be the first to apply!
- safety physician New York, NY
- outpatient primary care physician New York, NY
- physician executive New York, NY
- physician-plastic surgery New York, NY
- pm&r physician New York, NY
- doctor on demand New York, NY
- full time post-acute physician New York, NY
- critical care physician New York, NY
- physician recruiter New York, NY
- primary care sports medicine physician New York, NY

