Remote Healthcare AI Evaluation Scientist
$400k24-MAG
24-MAG LLC is seeking experienced medical and healthcare researchers to design rigorous evaluation frameworks for trustworthy healthcare-focused AI systems. You will develop benchmark datasets, validation environments, and analyse medical reasoning to improve AI reliability within clinical workflows. This fully remote, full-time engagement offers compensation in the range of $400,000–$800,000 per year, with opportunities for equity and broader health tech impact across disciplines. #J-18808-Ljbffr
- ...is seeking a research-focused professional to advance trustworthy AI for healthcare by designing evaluation frameworks for medical reasoning, evidence synthesis, and decision support. This full-time remote role blends clinical insight with AI benchmarking and standards...Remote workFull time
- ...-MAG LLC is seeking experienced researchers to lead the evaluation of healthcare-focused AI systems. The role focuses on clinical reasoning, evidence... ...synthesis, benchmarking, and reliability analysis, with remote collaboration across clinicians and engineers. Ideal...Remote work
- ...ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models. The role requires clear...Remote workFor contractors
$130 - $180 per hour
...30-$180 per hour Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence.... ...clinical expertise toward training and evaluating next-generation AI models... ...technology. Engagement Details Fully remote with 100% asynchronous work....Remote workHourly payWeekly payContract workFor contractorsFlexible hours$30 - $60 per hour
Jobgether SRL in the United States seeks a remote, contract-based role to design realistic medical tasks for evaluating AI in healthcare. This part-time position offers about 20 hours per week and remote work flexibility. You will create tasks involving clinical analysis...Remote jobHourly payContract workPart time$77.6k - $176k
Applied AI Health ScientistThe Opportunity:To achieve... ...experienced Applied AI Scientist for Health who can... ...ll Work On: Review and evaluate AI/ML technical proposals... ...Have: Experience in healthcare AI or biomedical applicationsExperience... ...on during meetings.Remote: If this position is...Remote workFull timeContract workPart timeWork at officeLocal areaImmediate startFlexible hoursShift work$219k - $246k
...purpose-built to power AI-enabled precision... ...technology, data science, and healthcare, Verily transforms... ...Description As an AI Applied Scientist, you will occupy a... ...Develop automated evaluation pipelines and "LLM-as-... ...from clinical and remote settings, ensuring absolute...Remote workFull time$77.6k - $176k
...Applied AI Health ScientistThe Opportunity:To achieve... ...experiencedApplied AI Scientist for Healthwho... ...WhatYou’llWork On:Review and evaluate AI/ML technical proposals... ...You Have:Experience in healthcare AI or biomedical... ...cameras on during meetings.Remote: If this position is listed...Remote workFull timeContract workPart timeWork at officeLocal areaImmediate startFlexible hoursShift work- ...R1 RCM Inc. is seeking a Research Scientist to advance applied AI in healthcare by developing novel machine learning approaches and bringing research into... ...design experiments on large-scale healthcare data, evaluate cutting-edge models, and work with engineering and product...Remote work
- ...Rex.zone is seeking an AI Research Scientist to lead applied AI research projects for US-based customers... ...into measurable experiments in LLM evaluation and RLHF data design. You will... ..., safety, and usefulness. The role is remote in the United States, with compensation...Remote workHourly payFlexible hours
- ...Planet Pharma seeks experienced scientists and engineers to evaluate frontier AI models on real technical work, including data analysis, design verification... ...emphasizes self-directed, long-form work in a fully remote setting, with explicit focus on writing clear reasoning...Remote work
$112.7k - $193.2k
...level role serves as a senior technical evaluation and AI governance expert within a... ....You'll enjoy the flexibility to work remotely* from anywhere within the U.S. as you... ...clinical AI use cases using real-world healthcare dataPerform hands-on data programming,...Remote workMinimum wageFull timeWork experience placementWork at officeLocal area- Ellipsis Health Inc. is seeking a Senior Data Scientist focused on AI quality and evaluation. You will own data science projects end-to-end, build evaluation... ...to a fast-paced health-tech environment with remote-friendly options in the U.S. #J-18808-Ljbffr Ellipsis...Remote job
- ...seeking a Member of Technical Staff, Medical Research for remote, high-impact work in healthcare AI. The role offers substantial compensation and a... ...hours per week. Responsibilities include designing evaluation frameworks for AI in medicine, advancing medical reasoning...Remote work10 hours per weekFlexible hours
$99.3k - $198.7k
Abbott is a global healthcare leader that helps people live more fully... ...Overview: The Sr. AI Scientist is largely self-driven, working... ...methods and techniques and evaluation criteria for obtaining and interpreting... ...United States of America : Remote ADDITIONAL LOCATIONS:...Remote workFull timeShift workNight shift$30 - $50 per hour
A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing...Remote jobHourly pay- AuraOne, Inc. is seeking a remote evaluator to review Vietnamese generalist evaluation prompts and responses against the company rubric. This contractor role focuses on labeling edge cases, providing structured feedback, and contributing to model retraining efforts. The...Remote workFor contractors
- ...Biz Tech Consultants seeks a radiologist evaluator for AI-driven quality assessments. You will review diagnostic reports, ensure accuracy... ...certification, plus 2+ years post-qualification radiology experience. Remote work from India with strict attention to detail and team...Remote work
- ...SaidGig is seeking physicians to apply clinical judgment to evaluate and improve AI models. This ongoing opportunity involves creating clinical vignettes from your own practice, with attending-level reference answers, while considering real-patient care constraints....Remote work
- ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who...Remote workTemporary work
$100k - $135k
...-to-senior level Data Scientist to support the U.S. Department... ...with applied program evaluation and statistical... ...platforms and mission-ready AI to federal agencies at... ...the defense, space, healthcare, and energy sectors—... ...clearances.Job LocationsUS-VA-Tysons US-Remote...Remote workContract work- ...AuraOne, Inc. seeks an Ophthalmology AI Evaluation Specialist — Clinical Reasoning Review to remotely review prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for model retraining. The...Remote workFor contractors
- ...precision medicine and advancing the healthcare industry?Recent advancements... ...finally made it possible for AI to impact clinical care in a... ...group of AI scientists and engineers focused on developing... ...the position.Additionally, for remote roles open to individuals in...Remote workFull time
- ...management to design Excel-based tasks that test AI's ability to perform real PM work. You bring 3+... .... You will craft tasks, write precise evaluation rubrics, and work as an independent contractor on a fully remote, task-based program with weekly payments. #J-...Remote workWeekly payFor contractors
$130k - $162.5k
...advanced data analytics and AI to cybersecurity, we... ...AI team. We are AI/ML scientists and engineers with... ...the flexibility to work remotely * from anywhere within... ...AI to optimize healthcare and digital experiencesCollaborate... ...for developing and evaluating Agentic AI solutions,...Remote workMinimum wageFull timeWork experience placementWork at officeLocal area- ...micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise...Remote workFor contractors
- ...company, who manages all applications and next steps. Our partner is looking for a Personal Injury Law & AI Evaluation Specialist based in the United States. In this remote contract role, you will combine your legal expertise with emerging artificial intelligence...Remote workContract workFor contractorsFlexible hours
- ...Rise Data Labs is seeking advanced Biology and Life Sciences experts to support the training and evaluation of state-of-the-art AI systems. This role requires deep domain knowledge and rigorous scientific reasoning applied to AI challenges and data interpretation. You...Remote work
- ...Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work lets you apply your domain expertise to shape how models reason, answer, and improve. You will review AI-generated content in your field...Remote workContract workTemporary workFlexible hours
$40 - $125 per hour
...Sovrano AI is hiring for fully remote, project-based work in three tracks: experimental biology, drug discovery, and computational biology. You will design and evaluate tasks from real-world life sciences problems, grade frontier AI responses, and write clear rubrics....Remote workHourly payFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Healthcare AI Evaluation Scientist. Be the first to apply!
- ai data scientist New York, NY
- ai scientist New York, NY
- software engineering manager remote New York, NY
- remote recruitment consultant New York, NY
- remote data manager New York, NY
- business intelligence analyst remote New York, NY
- benefits specialist remote New York, NY
- junior angular developer remote New York, NY
- remote video game New York, NY
- remote typing work New York, NY



