Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Healthcare AI Evaluation Scientist

$400k

24-MAG

24-MAG LLC is seeking experienced medical and healthcare researchers to design rigorous evaluation frameworks for trustworthy healthcare-focused AI systems. You will develop benchmark datasets, validation environments, and analyse medical reasoning to improve AI reliability within clinical workflows. This fully remote, full-time engagement offers compensation in the range of $400,000–$800,000 per year, with opportunities for equity and broader health tech impact across disciplines. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Healthcare AI Evaluation Scientist in New York, NY vacancy
  •  ...is seeking a research-focused professional to advance trustworthy AI for healthcare by designing evaluation frameworks for medical reasoning, evidence synthesis, and decision support. This full-time remote role blends clinical insight with AI benchmarking and standards... 
    Remote work
    Full time

    SaidGig

    New York, NY
    3 days ago
  •  ...-MAG LLC is seeking experienced researchers to lead the evaluation of healthcare-focused AI systems. The role focuses on clinical reasoning, evidence...  ...synthesis, benchmarking, and reliability analysis, with remote collaboration across clinicians and engineers. Ideal... 
    Remote work

    24-MAG LLC

    New York, NY
    2 days ago
  •  ...ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models. The role requires clear... 
    Remote work
    For contractors

    Executive Staff Recruiters / ESR Healthcare

    New York, NY
    6 hours ago
  • $130 - $180 per hour

     ...30-$180 per hour Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence....  ...clinical expertise toward training and evaluating next-generation AI models...  ...technology. Engagement Details Fully remote with 100% asynchronous work.... 
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Flexible hours

    Weekday AI

    New York, NY
    9 hours ago
  • $30 - $60 per hour

    Jobgether SRL in the United States seeks a remote, contract-based role to design realistic medical tasks for evaluating AI in healthcare. This part-time position offers about 20 hours per week and remote work flexibility. You will create tasks involving clinical analysis... 
    Remote job
    Hourly pay
    Contract work
    Part time

    Jobgether SRL

    New York, NY
    2 days ago
  • $77.6k - $176k

    Applied AI Health ScientistThe Opportunity:To achieve...  ...experienced Applied AI Scientist for Health who can...  ...ll Work On: Review and evaluate AI/ML technical proposals...  ...Have: Experience in healthcare AI or biomedical applicationsExperience...  ...on during meetings.Remote: If this position is... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Immediate start
    Flexible hours
    Shift work

    Booz Allen Hamilton

    Washington DC
    7 days ago
  • $219k - $246k

     ...purpose-built to power AI-enabled precision...  ...technology, data science, and healthcare, Verily transforms...  ...Description As an AI Applied Scientist, you will occupy a...  ...Develop automated evaluation pipelines and "LLM-as-...  ...from clinical and remote settings, ensuring absolute... 
    Remote work
    Full time

    Verily Health

    Boston, MA
    3 days ago
  • $77.6k - $176k

     ...Applied AI Health ScientistThe Opportunity:To achieve...  ...experiencedApplied AI Scientist for Healthwho...  ...WhatYou’llWork On:Review and evaluate AI/ML technical proposals...  ...You Have:Experience in healthcare AI or biomedical...  ...cameras on during meetings.Remote: If this position is listed... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Immediate start
    Flexible hours
    Shift work

    Booz Allen Hamilton

    Washington DC
    2 days ago
  •  ...R1 RCM Inc. is seeking a Research Scientist to advance applied AI in healthcare by developing novel machine learning approaches and bringing research into...  ...design experiments on large-scale healthcare data, evaluate cutting-edge models, and work with engineering and product... 
    Remote work

    R1 RCM

    Boise, ID
    5 days ago
  •  ...Rex.zone is seeking an AI Research Scientist to lead applied AI research projects for US-based customers...  ...into measurable experiments in LLM evaluation and RLHF data design. You will...  ..., safety, and usefulness. The role is remote in the United States, with compensation... 
    Remote work
    Hourly pay
    Flexible hours

    AIToolboard

    New York, NY
    4 days ago
  •  ...Planet Pharma seeks experienced scientists and engineers to evaluate frontier AI models on real technical work, including data analysis, design verification...  ...emphasizes self-directed, long-form work in a fully remote setting, with explicit focus on writing clear reasoning... 
    Remote work

    Planet Pharma

    San Francisco, CA
    4 days ago
  • $112.7k - $193.2k

     ...level role serves as a senior technical evaluation and AI governance expert within a...  ....You'll enjoy the flexibility to work remotely* from anywhere within the U.S. as you...  ...clinical AI use cases using real-world healthcare dataPerform hands-on data programming,... 
    Remote work
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    Minnetonka, MN
    7 days ago
  • Ellipsis Health Inc. is seeking a Senior Data Scientist focused on AI quality and evaluation. You will own data science projects end-to-end, build evaluation...  ...to a fast-paced health-tech environment with remote-friendly options in the U.S. #J-18808-Ljbffr Ellipsis... 
    Remote job

    Ellipsis Health Inc.

    San Francisco, CA
    4 days ago
  •  ...seeking a Member of Technical Staff, Medical Research for remote, high-impact work in healthcare AI. The role offers substantial compensation and a...  ...hours per week. Responsibilities include designing evaluation frameworks for AI in medicine, advancing medical reasoning... 
    Remote work
    10 hours per week
    Flexible hours

    Crossing Hurdles

    United States
    5 days ago
  • $99.3k - $198.7k

    Abbott is a global healthcare leader that helps people live more fully...  ...Overview: The Sr. AI Scientist is largely self-driven, working...  ...methods and techniques and evaluation criteria for obtaining and interpreting...  ...United States of America : Remote ADDITIONAL LOCATIONS:... 
    Remote work
    Full time
    Shift work
    Night shift

    Abbott

    Remote
    11 days ago
  • $30 - $50 per hour

    A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing... 
    Remote job
    Hourly pay

    REX

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a remote evaluator to review Vietnamese generalist evaluation prompts and responses against the company rubric. This contractor role focuses on labeling edge cases, providing structured feedback, and contributing to model retraining efforts. The... 
    Remote work
    For contractors

    AuraOne, Inc.

    New York, NY
    5 days ago
  •  ...Biz Tech Consultants seeks a radiologist evaluator for AI-driven quality assessments. You will review diagnostic reports, ensure accuracy...  ...certification, plus 2+ years post-qualification radiology experience. Remote work from India with strict attention to detail and team... 
    Remote work

    Biz Tech Consultants

    New York, NY
    3 days ago
  •  ...SaidGig is seeking physicians to apply clinical judgment to evaluate and improve AI models. This ongoing opportunity involves creating clinical vignettes from your own practice, with attending-level reference answers, while considering real-patient care constraints.... 
    Remote work

    SaidGig

    United States
    3 days ago
  •  ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who... 
    Remote work
    Temporary work

    Mercor Inc

    Houston, TX
    4 days ago
  • $100k - $135k

     ...-to-senior level Data Scientist to support the U.S. Department...  ...with applied program evaluation and statistical...  ...platforms and mission-ready AI to federal agencies at...  ...the defense, space, healthcare, and energy sectors—...  ...clearances.Job LocationsUS-VA-Tysons US-Remote... 
    Remote work
    Contract work

    LMI

    McLean, VA
    5 days ago
  •  ...AuraOne, Inc. seeks an Ophthalmology AI Evaluation Specialist — Clinical Reasoning Review to remotely review prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for model retraining. The... 
    Remote work
    For contractors

    AuraOne, Inc.

    United States
    2 days ago
  •  ...precision medicine and advancing the healthcare industry?Recent advancements...  ...finally made it possible for AI to impact clinical care in a...  ...group of AI scientists and engineers focused on developing...  ...the position.Additionally, for remote roles open to individuals in... 
    Remote work
    Full time

    Tempus

    Chicago, IL
    6 days ago
  •  ...management to design Excel-based tasks that test AI's ability to perform real PM work. You bring 3+...  .... You will craft tasks, write precise evaluation rubrics, and work as an independent contractor on a fully remote, task-based program with weekly payments. #J-... 
    Remote work
    Weekly pay
    For contractors

    Aptura

    United States
    5 days ago
  • $130k - $162.5k

     ...advanced data analytics and AI to cybersecurity, we...  ...AI team. We are AI/ML scientists and engineers with...  ...the flexibility to work remotely * from anywhere within...  ...AI to optimize healthcare and digital experiencesCollaborate...  ...for developing and evaluating Agentic AI solutions,... 
    Remote work
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    Eden Prairie, MN
    4 days ago
  •  ...micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise... 
    Remote work
    For contractors

    micro1

    United States
    2 days ago
  •  ...company, who manages all applications and next steps. Our partner is looking for a Personal Injury Law & AI Evaluation Specialist based in the United States. In this remote contract role, you will combine your legal expertise with emerging artificial intelligence... 
    Remote work
    Contract work
    For contractors
    Flexible hours

    Jobgether

    Remote
    1 day ago
  •  ...Rise Data Labs is seeking advanced Biology and Life Sciences experts to support the training and evaluation of state-of-the-art AI systems. This role requires deep domain knowledge and rigorous scientific reasoning applied to AI challenges and data interpretation. You... 
    Remote work

    Risedatalabs

    United States
    8 hours ago
  •  ...Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work lets you apply your domain expertise to shape how models reason, answer, and improve. You will review AI-generated content in your field... 
    Remote work
    Contract work
    Temporary work
    Flexible hours

    Brain Trust Inc

    United States
    2 days ago
  • $40 - $125 per hour

     ...Sovrano AI is hiring for fully remote, project-based work in three tracks: experimental biology, drug discovery, and computational biology. You will design and evaluate tasks from real-world life sciences problems, grade frontier AI responses, and write clear rubrics.... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    Sovrano AI

    United States
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Healthcare AI Evaluation Scientist. Be the first to apply!