Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Quality & Evaluation Scientist for Clinical LLMs

Bioscope.ai, Inc.

A leading clinical AI company is seeking a Data Scientist responsible for ensuring the quality and reliability of AI outputs. You will design automated evaluation pipelines, develop uncertainty quantification systems, and build comprehensive frameworks that combine automated assessments with clinician validations. The ideal candidate has expertise in deep learning frameworks such as PyTorch, experience with model evaluation metrics, and excellent communication skills. A Master's degree in a related field is preferred. #J-18808-Ljbffr Bioscope.ai, Inc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Quality & Evaluation Scientist for Clinical LLMs in Boston, MA vacancy
  • $137k - $215.27k

     ...patients worldwide. The AI/ML organization at...  ...computational scientists, biologists,...  ...nomination and toward clinical development. The...  ...on delivering high‑quality development candidates...  ...training and evaluation. Stay abreast of...  ...antibody design models (LLMs, diffusion models,... 
    Quality
    Minimum wage
    Temporary work
    Local area
    Worldwide

    Initial Therapeutics, Inc.

    Boston, MA
    5 days ago
  •  ...join their team remotely. The role involves training AI models, measuring their performance, and evaluating their outputs regarding physics-related tasks....  ...is made hourly, starting from $30+ with bonuses for quality work. Only applicants from the United States will be... 
    Quality
    Remote job
    Hourly pay

    DataAnnotation

    Boston, MA
    4 days ago
  • $40 per hour

    A technology company focused on AI model training is seeking an R&D Biologist to evaluate AI chatbots' performance using complex biological queries. The position...  ...offers hourly pay starting at $40 plus potential bonuses for high-quality work. #J-18808-Ljbffr DataAnnotation
    Quality
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Boston, MA
    2 days ago
  • $119.7k - $222.3k

     ...artificial intelligence (AI) enabled strategies to transform clinical pharmacology support of...  ..., analyses and decision quality. Represent the PK Sciences...  ...for Principal Scientist II. 4+ years of experience...  ...drug metabolism and PK/PD evaluation, experience in working in... 
    Quality

    Research

    Cambridge, MA
    10 days ago
  • $149k - $237k

     ...Senior Clinical Scientist (Cambridge, MA) Help shape the future of robotic-assisted interventions...  ...will gather critical clinical insights, evaluate new technologies, and help validate...  ...Systems Engineering, Regulatory Affairs, Quality, and Usability to ensure clinical workflow... 
    Quality
    Full time
    Work at office
    Work visa
    Relocation package
    3 days per week

    Philips

    Cambridge, MA
    4 days ago
  •  ...are seeking a Machine Learning Scientist to join the Enchant team at...  ...you will design and implement clinical fine-tuning of Enchant, our...  ...You will identify, curate, and evaluate datasets that support...  ...frameworks that track model quality across models and tasks Build... 
    Quality
    Flexible hours

    Iambic Therapeutics, Inc

    Boston, MA
    7 days ago
  • $119.7k - $222.3k

     ...artificial intelligence (AI) enabled strategies to transform clinical pharmacology support of...  ..., analysis and decision quality. Represent the PK Sciences...  ...eligible for Principal Scientist II. 4+ years of...  ...drug metabolism and PK/PD evaluation. Experience working in project... 
    Quality

    U175 (FCRS = US175) Novartis Institutes for BioMedical Resea...

    Cambridge, MA
    4 days ago
  •  ...focusing on identifying and evaluating opportunities. Your work will...  ...advanced transcriptomics. Our ML/AI-driven peptide drug discovery...  ...a peptide hit into a non-clinical candidate ready for development...  ...a constant focus on high quality, scientific excellence, speed... 
    Quality
    Contract work
    Work at office
    Immediate start

    Gubra

    Cambridge, MA
    1 day ago
  • $125k - $150k

     ...Clinical Lab Scientist – NGS Curation and Operations Support Shift: Tuesday through Saturday Salary...  ...Development, Customer Support, Quality Assurance, and Clinical Laboratory Operations...  ...cross‑functional teams. Assist with evaluations and investigate in order to optimize... 
    Quality
    Flexible hours
    Shift work

    Delve Bio, Inc.

    Boston, MA
    4 days ago
  • $31 - $44.76 per hour

     ...and problem solving. Prepare, test and evaluate new reagents or controls. Report accurate...  ...timely test results in order to deliver quality patient care. Perform and document preventative...  ...in a Chemical or Biological science, Clinical Laboratory Science or Medical Technology... 
    Quality
    Temporary work
    Casual work
    Internship
    Monday to Friday
    Flexible hours
    Shift work

    LabCorp

    Boston, MA
    4 days ago
  • $31 - $44.76 per hour

     ...and problem solving Prepare, test and evaluate new reagents or controls Report...  ...timely test results in order to deliver quality patient care Perform and document preventative...  ...in a Chemical or Biological science, Clinical Laboratory Science or Medical Technology... 
    Quality
    Temporary work
    Casual work
    Internship
    Relocation package
    Monday to Friday
    Flexible hours
    Shift work

    LabCorp

    Boston, MA
    1 day ago
  • $39 - $48.02 per hour

     ...Clinical Laboratory Team Leader Are you an experienced clinical laboratory professional...  ...problem solving Prepare, test and evaluate new reagents or controls Report accurate...  ...timely test results in order to deliver quality patient care Perform and document... 
    Quality
    Hourly pay
    Part time
    Casual work
    Relief
    Local area
    Monday to Friday
    Flexible hours
    Shift work

    Personal Genome Diagnostics

    Boston, MA
    19 hours ago
  •  ...responsible for the calibration of equipment and evaluating treatment plans. Ideal candidates will have a Master...  ...Radiological Physics, alongside relevant clinical experience. This role also involves managing quality assurance programs and providing training for staff... 
    Quality
    Full time

    Akumin Inc.

    Boston, MA
    19 hours ago
  • $39 - $48.02 per hour

     ...Clinical Laboratory Team Leader Are you an experienced clinical laboratory professional...  ...problem solving Prepare, test and evaluate new reagents or controls Report accurate...  ...timely test results in order to deliver quality patient care Perform and document... 
    Quality
    Hourly pay
    Part time
    Casual work
    Relief
    Local area
    Monday to Friday
    Flexible hours
    Shift work

    Labcorp

    Boston, MA
    1 day ago
  • $50 per hour

     ...technology company in New Hampshire seeks a Clinical Appeals Nurse to enhance AI models in healthcare. This role involves...  ...providing complex problems for AI chatbots, evaluating outputs for accuracy, and ensuring overall quality of responses. Candidates should possess... 
    Quality
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Boston, MA
    4 days ago
  • $70k - $90k

     ...services company powering the acceleration of clinical research to transform patient outcomes....  ...in clinical trials with cutting-edge AI, we empower research teams and study sponsors...  ...the development, maintenance, and quality assurance of administrative clinical trial... 
    Quality
    Contract work
    Work at office

    MD Ally

    Cambridge, MA
    2 days ago
  •  ...Associate Director, Clinical Scientist, Internal Medicine At Regeneron, we use science and...  ...you will contribute to the development, evaluation, planning and execution of Internal Medicine...  ...of regulatory documents; performs quality review and may approve; adjudicate and... 
    Quality
    Worldwide

    Regeneron

    Cambridge, MA
    1 day ago
  • $70k - $90k

     ...Iterative Scopes is seeking a Clinical Research Systems Specialist to enhance clinical trial operations by developing and maintaining...  ...role involves supporting research sites with CTMS, conducting quality reviews of study builds, and collaborating with cross-functional... 
    Quality

    MD Ally

    Cambridge, MA
    2 days ago
  • $122.25k - $176.58k

     ...Title and Location Principal Scientist, Neurology Research – Cambridge...  ...the Role Lead machine learning/AI-based discovery efforts for...  ...plasma and CSF proteomics and clinical outcomes from public and in‑house...  ...experience. Benefits High‑quality health and wellness benefits,... 
    Quality
    Shift work

    Sanofi

    Cambridge, MA
    2 days ago
  • $50.5k - $56.7k

    Dormont Manufacturing Co is seeking a Research Data Specialist in Boston, MA to support its clinical research program. This role involves data collection, evaluation of medical records, and collaborating with research teams on clinical trials. Candidates should possess... 
    Quality

    Dormont Manufacturing Co

    Boston, MA
    3 days ago
  • $145k - $175k

     ...Parabilis Medicines is a clinical-stage...  ...Zolucatetide is being evaluated in the clinic across...  ...learning/generative AI, molecular...  ...talented and passionate scientists to discover drugs....  ...predictive model quality. ~ Demonstrated...  ...Familiarity with use of LLMs and IDEs, such as... 
    Quality
    Shift work

    Parabilis Medicines

    Cambridge, MA
    15 days ago
  • $193.5k - $338.8k

     ...of Eli Lilly, is seeking a Director - Clinical Research Scientist (CRS) to help lead clinical trial...  ...trials with accountability for execution, quality, and timelines. Review and approve...  ...to the molecule. Critically read and evaluate the relevant medical literature; know... 
    Quality
    Full time
    Contract work
    Local area
    Worldwide
    Flexible hours

    Initial Therapeutics, Inc.

    Boston, MA
    3 days ago
  •  ...Clinical Chemist, Clinical ChemistryDepartment of PathologyBeth Israel Deaconess Medical CenterHarvard Medical School, BostonThe Department...  ...diagnosticsContribution to test development, validation, quality management, and diagnostic stewardship across the chemistry service... 
    Quality
    Full time
    Work from home

    Harvard Medical Faculty Physicians

    Boston, MA
    3 days ago
  • $142.4k - $224.1k

     ...Job Description Translational Medicine (TMed) drives early clinical development of novel therapeutics by partnering with Discovery Sciences...  ...requirements, supporting study objectives and delivery of high‑quality data. Maintain appropriate clinical safety assessment and risk... 
    Quality
    For contractors
    Worldwide
    Relocation
    Visa sponsorship
    Flexible hours
    Shift work

    Merck & Co. Inc

    Boston, MA
    3 days ago
  • $228k - $358k

     ...’re building a talent-dense, high-agency AI safety team at Lila that will engage all...  ...collateral including risk‑ and capability‑focused evaluations and safeguards. What You’ll Be Building...  ...s broader safety strategy Broader, high‑quality research efforts— as and when needed —... 
    Quality
    Full time
    Work at office
    Local area
    Flexible hours

    Dormont Manufacturing Co

    Cambridge, MA
    1 day ago
  • $148k - $210k

     ...We are seeking a scientist to join our team at...  ...clean, format, and quality‑control the large-...  ...—developing AI agents that can navigate...  ...about using LLMs as tools to solve...  ...molecular, genomic, clinical, literature) Implement...  ...data standards Evaluate and iterate on agent... 
    Quality
    Remote work
    Flexible hours

    Dormont Manufacturing Co

    Boston, MA
    3 days ago
  • $60k - $85k

     ...Clinical Laboratory Technologist – Cutting‑Edge Diagnostic Startup 25 miles West of Boston | On‑Site (Hybrid 1 day/week) | $60–85K + Bonus...  ...and products. Experience working under SOPs in a regulated or quality‑focused environment. Comfort working with technical systems or... 
    Quality
    Remote work
    Monday to Friday
    Day shift
    1 day per week

    Brine Group

    Boston, MA
    2 days ago
  • $34.15 - $41.75 per hour

     ...and problem solving Prepare, test and evaluate new reagents or controls Report...  ...timely test results in order to deliver quality patient care Perform and document preventative...  ...in a Chemical or Biological science, Clinical Laboratory Science or Medical Technology... 
    Quality
    Temporary work
    Casual work
    Internship
    Monday to Friday
    Flexible hours
    Shift work

    Personal Genome Diagnostics

    Melrose, MA
    19 hours ago
  • $34.15 - $41.75 per hour

     ...and problem solving Prepare, test and evaluate new reagents or controls Report...  ...timely test results in order to deliver quality patient care Perform and document preventative...  ...in a Chemical or Biological science, Clinical Laboratory Science or Medical Technology... 
    Quality
    Temporary work
    Casual work
    Internship
    Relocation package
    Monday to Friday
    Flexible hours
    Shift work

    LabCorp

    Melrose, MA
    1 day ago
  • $30 per hour

     ...A healthcare-focused AI training company is seeking medical experts to train AI models and evaluate their outputs. This role requires expertise in various healthcare fields...  ...at $30+. Collaboration will improve the quality of AI models designed for healthcare applications... 
    Quality
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Quality & Evaluation Scientist for Clinical LLMs. Be the first to apply!