Family Medicine Clinical Expert - AI Evaluation
Gramian Consulting Group
About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About the Role We are seeking Family Medicine Physicians to support the training and evaluation of next-generation AI systems using their primary care expertise. You will review medical records, assess AI-generated clinical content for accuracy and safety, and apply evidence-based medical judgment across preventive, acute, and chronic care. This role offers an opportunity to improve AI performance in real-world healthcare scenarios. Prior AI experience is not required. LOCATION:United States — Remote SENIORITY:Experienced Physician Key Responsibilities - Review inpatient clinical documentation, including histories and physicals (H&Ps), progress notes, and discharge summaries. - Assess documentation for clinical accuracy, completeness, and alignment with the patient encounter. - Adjudicate ambiguous, conflicting, or inconsistent clinical information using sound medical judgment. - Identify and categorize clinically significant errors, omissions, and discrepancies by severity. - Apply structured review rubrics and quality criteria consistently across cases.
- Provide concise, well-reasoned written explanations supporting review decisions. - Contribute to the improvement of documentation review guidelines and quality standards. Requirements - Active MD degree. - Based in the United States and appropriately licensed to practice medicine in the U. S. - Hands-on clinical experience in family medicine or primary care settings. - Broad knowledge of common acute and chronic conditions, preventive care, and patient management across different age groups. - Strong understanding of evidence-based clinical guidelines and standards of care. - Excellent written and verbal communication skills. - Strong attention to detail and the ability to assess clinical information critically and consistently.
- ...needs. About the Role We are seeking Family Medicine Physicians to support the training and evaluation of next-generation AI systems using their primary care expertise.... ...medical records, assess AI-generated clinical content for accuracy and safety, and apply...SuggestedContract workRemote work
- ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative evaluating realism of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for licensed professionals. Participants will review paired conversations...SuggestedTemporary workRemote work
- ...Group is seeking experienced Licensed Clinical Social Workers to contribute their... ...clinical expertise to the development and evaluation of next-generation AI systems. This remote, contract... ...realistic clinical scenarios, develop expert reference responses, and evaluate AI...SuggestedRemote jobContract work
$65 per hour
...Prolific is seeking Registered Nurses to help train and evaluate AI models. If you have clinical experience, we’ll test your skills and, if successful, invite you to join as a Domain Expert participant, where you’ll be paid to contribute. Researchers may pay up to $65/...SuggestedRemote workWork from homeFlexible hours- ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is... ...Psychotherapy Behavioural Health Marriage and Family Therapy Other closely related clinical...SuggestedTemporary workPart timeRemote work
$100 per hour
Gridnaut Recruiting is hiring a remote Clinical Mental Health Expert — AI Conversation Evaluation contractor (pay $100/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Mercor is seeking Clinical Mental Health Experts to support an AI research...Contract workTemporary workFor contractorsRemote work$100 per hour
...Category: Medical & Clinical AI · Pay: $100 / hr · Location: Remote — US-eligible · Contractor Clinical Mental Health Expert — AI Conversation Evaluation is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential...Contract workFor contractorsRemote work10 hours per week$150 per hour
...technical talent with leading AI research labs.... ...Clinician (MD/DO) - HLS Expert Pool Type: Contract... ...criteria by breaking clinical questions into discrete... ...model response grading. Evaluate clinical dialogues... ...primary care, internal medicine, emergency medicine, or...Contract workSummer workRemote work- ...Obsidian is seeking a Medical Expert to help train AI models with high-quality healthcare reasoning data. You will design clinical scenarios, evaluate model outputs, and provide essential feedback to improve AI-driven patient care. This remote, asynchronous role defaults...Remote workFlexible hours
- A leading AI research accelerator is seeking an Associate to leverage expertise in internal or emergency medicine. This role involves designing and evaluating clinical scenarios to enhance AI diagnostics. Candidates should have an MD and active practice within the last...Remote work
- 24-MAG LLC is seeking experienced Dermatologists to contribute to AI training and clinical-evaluation projects. This remote, non-clinical role focuses on image interpretation, structured annotation, case reasoning, and AI-output review, with no live patient care. Ideal...Weekly payRemote work
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$150 per hour
...technical talent with leading AI research labs.... ...Position: Healthcare Expert Type: Contract... ...Role Responsibilities Evaluate and compare AI-generated... ...model reasoning to ensure clinical accuracy and evidence-... ...and evidence-based medicine. ~ Excellent written...Contract workSummer workImmediate startRemote workFlexible hours$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative that evaluates the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply...Temporary workRemote work
- ...Join a growing network of industry experts supporting AI research and development. Overview... ...experienced healthcare professionals to help evaluate and improve how AI systems understand... ...topics. You\'ll bring your real-world clinical expertise to review content for...Contract workPart timeRemote work10 hours per weekFlexible hours
$120 per hour
...not just another player in the AI space – we are building the... ...Pharmacists to help train and evaluate cutting‑edge AI models. As AI... ...must be guided by pharmaceutical experts. If you have the necessary experience... ...where applicable. Clinical Expertise: Recent experience in...Self employmentRemote workWork from homeFlexible hours$150 per hour
...Obsidian is partnering with a leading AI lab to recruit Psychiatry experts for designing clinical scenarios and evaluating AI model outputs. You will be responsible for creating clinically realistic prompts, writing high-quality responses, and grading AI-generated outputs...Weekly payRemote workFlexible hours$187.2k
...Researching We're running a paid study on clinical decision-making to help benchmark medical AI systems. This work feeds directly... ...each case, you will provide detailed expert reviews and help develop scoring rubrics for AI evaluation. The workflow involves assessing the...Contract workRemote work$65 per hour
...Prolific is seeking Registered Nurses to train and evaluate AI models as part of our Domain Expert program. You will review AI-generated clinical responses, rate accuracy and safety, and write improved exemplars and rationales to guide model learning. Successful candidates...Hourly payRemote workWork from homeFlexible hours- AuraOne is seeking a Medical Expert (Mandarin Chinese, mainland China) for a remote clinical AI review role as a CONTRACTOR. You will evaluate AI outputs for clinical accuracy, reasoning, dosing logic, and guideline adherence, signing off on outputs after structured review...Remote jobFor contractors
- ...Work You will use clinical judgment to review... ...improve healthcare AI training data. The... ...terminology. Evaluate AI system outputs... ...understanding of general medicine. Experience in an... ...medicine, family medicine, emergency... ...outputs. Clinical experts help make these systems...Part timeFor contractorsRemote work
- Alpheva AI offers remote, project-based clinical-operations expert work evaluating AI-assisted clinical tasks. The role emphasizes balancing timelines, quality, and participant protection, with asynchronous collaboration across our research teams. Experts with 8+ years...Remote jobFlexible hours
- AuraOne is seeking a Medical Expert, Spanish (Spain) for AI Clinical Review. This remote contractor role evaluates AI outputs, grades differential reasoning, dosing logic, and guideline adherence, flags patient-safety issues, and documents corrected clinical reasoning for...Remote jobFor contractors10 hours per week
- ...a biotech and pharma research team on expert human-evaluation work - creating and critiquing rubrics... ...and drug-development programs Interpret clinical trial endpoints and judge whether results... ...Why Participate Help improve expert AI evaluation of drugs and drug-development...Remote work
- ...medical coders on behalf of a healthcare AI partner building advanced clinical documentation tools. In this role... ...expertise to review, annotate, and evaluate clinical documentation and AI-... ...Knowledge Contribution Contribute expert input on annotation guidelines and documentation...Part timeWork experience placementRemote work10 hours per weekFlexible hours
- Alignerr is seeking an Oncology Clinical Researcher to guide AI training for oncology applications in a fully remote, hourly contract role. Your... ...alignment. Review and translate trial concepts into structured evaluations, operate asynchronously, and contribute to how AI models...Remote jobHourly payContract work10 hours per weekFlexible hours
- ...AuraOne, Inc. seeks Medical Doctor - Physician Expert for a remote clinical-review track evaluating AI outputs touching physician practice. You will review differential reasoning, dosing logic, and adherence to guidelines, flag patient-safety issues, and document corrected...For contractorsRemote work
- AuraOne seeks a Medical Expert fluent in Mandarin Chinese for a remote, US-eligible contractor role to evaluate AI outputs in clinical review. Reviewers assess differential diagnosis, dosing logic, and guideline adherence, and document corrected reasoning for model training...Remote jobFor contractors10 hours per week
- ...Prolific is seeking Chemistry Experts and Chemical Engineers to join our Expert Network to help train and evaluate AI models using real-world chemical expertise. After a brief skills test, you may be invited to work as a paid participant. As part of the role you will...Remote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Family Medicine Clinical Expert - AI Evaluation. Be the first to apply!



