Medical Researcher for AI Evaluation
$350kSaidGig
As a Member of Technical Staff in Medical Research, you will play a pivotal role in advancing AI systems that support healthcare, clinical, and biomedical workflows. This position emphasizes the development of rigorous evaluation frameworks to enhance medical reasoning, evidence synthesis, and healthcare decision support capabilities. Key Responsibilities
- Design and own evaluation frameworks for AI systems in healthcare, including benchmarks, scoring methodologies, clinical quality rubrics, and validation protocols.
- Conduct research on medical reasoning, evidence-based decision making, clinical workflows, and healthcare information synthesis.
- Develop benchmark datasets and evaluation environments based on real-world healthcare and biomedical scenarios.
- Collaborate with researchers, clinicians, and engineers to evaluate and improve healthcare-focused AI systems.
- Analyze performance, safety considerations, reasoning quality, and failure patterns in medical use cases.
- Produce research reports, evaluation methodologies, and best-practice guidelines.
- Stay current with advancements in medicine, healthcare delivery, biomedical research, and AI.
- Contribute to the development of industry standards for healthcare AI evaluation and reliability.
- Advanced degree in Medicine, Public Health, Nursing, Pharmacy, Biomedical Sciences, Epidemiology, Health Economics, or a related healthcare field (MD, DO, PhD, MPH, PharmD, etc.).
- Deep expertise in clinical practice, healthcare operations, biomedical research, public health, healthcare analytics, or evidence-based medicine.
- Demonstrated experience conducting medical, clinical, or healthcare research.
- Strong understanding of research design, evidence evaluation, and healthcare decision-making processes.
- Exceptional analytical reasoning and scientific communication skills.
- Experience working in multidisciplinary environments involving research, healthcare, technology, or policy stakeholders.
- Experience with digital health, clinical decision support systems, healthcare analytics, or health technology assessment.
- Familiarity with healthcare quality measurement, clinical guidelines, evidence synthesis, or healthcare benchmarking.
- Published research in medical, clinical, healthcare, or biomedical fields.
- Experience participating in clinical studies, systematic reviews, or healthcare evaluation initiatives.
This is a full-time, remote position.
CompensationThe compensation for this role ranges from $350, 000 to $500, 000 annually.
EligibilityAll employees are eligible for equity compensation and may receive performance-based bonuses, depending on the role and subject to company policies.
micro1 provides a comprehensive benefits package, including up to 100% reimbursement for health insurance premiums and paid time off.
$196k - $230k
...We Are Notion is the collaborative AI workspace where teams and agents think... ...: We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI-powered experiences—... ...pregnancy, childbirth, or related medical conditions), marital status, ancestry...MedicalLocal areaShift work$150k - $250k
...Distyl AI Job Opportunity Distyl is an applied AI technology... ...social organizations. We research and deploy technologies that... ...measured. Researchers design evaluation frameworks that capture reasoning... ...package ~100% covered medical, dental, and vision for employees...MedicalWork at office3 days per week- ...seeking an experienced Oncology Clinical Researcher (AI Training) to leverage expertise in... ...independently. The ideal candidate will evaluate AI outputs, ensuring they align with clinical... ...AI, shaping future tools used by medical professionals. #J-18808-Ljbffr AlignerrMedicalRemote jobFlexible hours
$295k
...robustness, and reliability of AI models towards their deployment... ...universal access to high-quality medical information. We work at the intersection of AI safety research and healthcare applications,... ...teaming, scalable oversight, etc. Evaluate methods using health-related...MedicalWork at officeRelocation package- ...Autonomous Cyber Defense. Powered by AI. At AdversAI , we’re building... ...re looking for an AI Applied Researcher to join our mission and help... ...data. Fine-tuning and evaluation : Experimenting with model adaptation... ...to Full health benefits - Medical, Dental, Vision A...MedicalRemote work
$122.03k - $143.33k
...Reference #: REF8400I Job Code: PDS.1 Post-Dr Research Staff 1 Organization: Engineering... ...(includes testing for use of marijuana) Medical Exam: Not applicable Apply Now Join us... ...Electromagnetics to join the Nondestructive Evaluation (NDE) Group. In this role, you will...MedicalFull timeFor contractors$350k
...will be instrumental in shaping the future of AI-powered legal reasoning as a Member of Technical Staff in the Legal Research Core team. You will work at the intersection... ...workflows, focusing on building rigorous evaluation frameworks that enhance AI performance in complex...Full timeRemote work$250k - $300k
Principal AI Researcher (Agentic Systems & AI Infrastructure) Seattle, WA or McLean, VA or Remote... ...techniques and model behavior shaping evaluation frameworks for autonomous agents This... ..., comprehensive health care including medical, dental, and vision for you and your...MedicalRemote workShift work$126k - $154k
Join AIR as a Senior Researcher, Place Based Evaluation & Learning and use your experience and expertise to help us deliver on our mission: to generate... ...citizenship status, age, physical or mental disability, medical condition (e.g., cancer), sex, gender, gender identity...MedicalFull timeH1bWork at officeLocal area$250k - $325k
...was first-to-market with: An AI agent that lives in MS Word... ...Role: Why, What, and Who Why AI Researchers are the engine of innovation... ...on legal- specific tasks. Evaluate emerging work in agentic systems... ...high-stakes domains (legal, medical, financial). Prior work on hallucination...MedicalContract workWork at officeImmediate startRemote work$138.6k - $235.7k
...the best tools, equipment, and research facilities in the world... ...) Generous vacation, strong medical and other benefits, competitive... ...to help shape the future of AI Credibility at Sandia and across... ...of AI Credibility, including evaluation, uncertainty quantification,...MedicalPart timeRemote workWork from homeWorldwideRelocationRelocation packageFlexible hoursShift work$150k - $210k
...value. About the Position - Embodied AI Researcher We are seeking an exceptional Embodied... ...data generation, experimentation, and evaluation. Compensation Base salary range is between... ...eligible dependents for competitive medical, dental, vision, and prescription benefits...MedicalFull timeTemporary workFor contractorsLocal areaImmediate start- Drata is seeking an Applied AI Engineer in San Francisco, California to drive the effectiveness of AI systems through rigorous research and experimentation. You will optimize retrieval strategies and build evaluation frameworks, ensuring our AI delivers accurate results...Flexible hours
$183k - $278k
Gray Swan is seeking a Machine Learning Researcher to develop new approaches to adversarial testing and model evaluation. Work at the intersection of research and production, contributing to the secure deployment of AI systems. This full-time position offers a remote work...Remote jobFull time$123.05k
Position Postdoctoral Research Staff Member Organization and Term Integrative Multi-Omics... ...and transfer learning. Train, adapt and evaluate self‑supervised and foundation models for... ..., gender identity, disability, medical condition, pregnancy, protected veteran...MedicalRelocation packageFlexible hours$162.7k - $263.18k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...As a Principal Security Researcher, you will work at the... ...build reliable harnesses and evaluation pipelines, analyze large-scale... ..., ancestry, color, family or medical care leave, gender identity or...MedicalFull timeWork at office$40 per hour
A leading cybersecurity AI platform is seeking experienced professionals to evaluate AI-generated content and solve technical security challenges. Candidates should have 2+ years of cybersecurity experience, coding skills, and strong analytical abilities. This role offers...Hourly payRemote work$40 per hour
A leading cybersecurity company is seeking experienced cybersecurity professionals to train AI models. In this remote role, you will evaluate AI-generated content and provide essential feedback to improve the accuracy of cybersecurity tools. Ideal candidates will have 2...Hourly payRemote work$40 per hour
A leading AI-guided cybersecurity firm is looking for experienced cybersecurity professionals to evaluate AI-generated security content and provide feedback to enhance AI systems. This role involves solving technical cybersecurity problems and writing clear technical explanations...Hourly payRemote workFlexible hours- ...leading cybersecurity firm is seeking experienced cybersecurity professionals for a remote position focused on training AI models. Candidates will evaluate AI-generated security content, tackle technical issues, and provide feedback for developing reliable cybersecurity...Hourly payRemote work
$40 per hour
A cybersecurity consultancy is looking for skilled professionals to evaluate AI-generated security content, solve technical problems, and provide feedback for AI model improvements. The role requires at least 2 years of cybersecurity experience and coding ability. You will...Hourly payRemote work$40 per hour
A cybersecurity solutions provider is looking for experienced professionals to join their team and help train AI models. The role involves evaluating AI-generated security content and providing technical problem-solving to enhance AI systems. Candidates should have over...Hourly payRemote workFlexible hours- ...in hospitals through advanced AI-powered reporting and... ...founding member of the clinical AI research team at Pharos. As a Physician... ...curating datasets, developing and evaluating AI models, validating outputs... ...helping translate complex medical knowledge into systems that...MedicalWork at office
$164k - $190k
...’re seeking an experienced User Researcher to deliver insights that improve Notion’s AI-powered experiences. This role will... ...testing, and post-ship evaluation—with clear recommendations that... ...pregnancy, childbirth, or related medical conditions), marital status, ancestry...MedicalLocal area$120k - $135k
...of CliftonStrengths through research that anchors what we build and... ...‑making. Lead generative and evaluative research using a range of qualitative... .... Thoughtfully incorporate AI tools into research workflows... ...package that includes medical, dental, vision, life and other...MedicalWork at office3 days per week£50 per hour
...seeking individuals with a background in Psychology for completing AI training tasks. This role involves analyzing and improving AI... ...attention to detail and reliable internet access. Join Prolific to help shape AI research in psychology and human behavior. #J-18808-Ljbffr...- ...UX Researcher Immediate need for a talented UX Researcher. This is... ...limited to, health insurance (medical, dental, vision), 401(k) plan... ...metrics and conducting evaluations. Mentor and assist the UX... ...UX associates. Integrate AI-driven research tools to streamline...MedicalContract workWork at officeLocal areaImmediate start
$70 - $75 per hour
...experience sector, is seeking a UX Researcher IV to join their team. As a... ..., diary studies, and product evaluations. Partner with cross-... ...Experience with research-related AI tools to enhance data... ...consultants are eligible for: ~ Medical and Prescription Drug Plans...MedicalWeekly payTemporary workRemote workFlexible hours$91.4k - $187k
...Description Senior Human Factors Researcher Location: Austin TX... ...conducting research to inform and/or evaluate the design of electronic... ...includes the following: # Medical, dental, and vision insurance... ...life-saving care. And with AI embedded across our products...MedicalTemporary workLocal areaRemote workFlexible hoursShift work- Summary Senior CX/UX Researcher (AI‑First Innovation for Tax & Accounting) - Hybrid. Join the... ...research and product development. Experience evaluating emerging user interaction patterns and... ...or UserZoom. Benefits Competitive medical, dental, and vision plans. 401(k) retirement...MedicalWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Medical Researcher for AI Evaluation. Be the first to apply!
- online researcher United States
- researcher work from home United States
- title researcher United States
- home based internet researcher United States
- content researcher United States
- human factors researcher United States
- criminal researcher United States
- field researcher United States
- security researcher United States
- legal researcher United States

