Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Research Scientist, Scientific Evaluations

$176k - $304k

Lila Sciences

Requisition ID: 8813Your Impact at LILALila is building a platform where AI and automation co-evolve to accelerate scientific discovery. Our AI Research team is looking to hire a ML Research Scientist to focus on building scientific problems and environments to evaluate frontier LLMs on.What You'll Be BuildingDesign and prototype new evals and environments for science — creating high-quality evaluations, identifying environment failures, and patching model capability gaps.Invent new types of RL environments — explore creative ways to turn scientific workflows, simulators, and real-world tasks into training signal.Build end-to-end pipelines for synthetic environment generation — transforming raw assets (papers, codebases, lab protocols) into validated, versioned training environments at scale.Prototype and validate environment designs — from initial concept through reward shaping, data collection, and integration with the training loop.What You'll Need to SucceedExperience applying ML or computation to biology, chemistry, or material sciences.A strong track record of creating environments or evaluations for model trainingExperience building large, complex data pipelines for model training or production.Strong prototyping and coding skills — comfortable quickly building and iterating on new ideas in Python.Creativity and research intuition — ability to identify promising directions, design experiments, and navigate ambiguity.Solid software engineering fundamentals — clean code, version control, testing, and ability to integrate experimental work into shared infrastructure.Bonus Points ForDemonstrated experience training large language modelsStrong publication track record at conferences such as NeurIPS, ICML, and ICLR.Strong Python programming skills, including research and production infrastructureFamiliarity with distributed compute (Ray, Modal) or LLM inference systems (vLLM, batching strategies).Experience with async Python, Pydantic, and workflow orchestration frameworks (Flyte, Airflow).CompensationWe offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.Expected Base Salary Range$176,000—$304,000 USDAbout LILALila Sciences is building Scientific Superintelligence to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.LILA combines advanced AI models with proprietary AI Science Factory instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply.We’re All InLila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.A Note to AgenciesLila Sciences does not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to Lila Sciences or its employees is strictly prohibited unless contacted directly by Lila Science’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of Lila Sciences, and Lila Sciences will not owe any referral or other fees with respect thereto.

Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the ML Research Scientist, Scientific Evaluations in Somerville, MA vacancy
  • $176k - $304k

     ...platform where AI and automation co-evolve to accelerate scientific discovery. Our AI Research team is looking to hire a ML Research Scientist to focus on building scientific problems and environments to evaluate frontier LLMs on.What You'll Be BuildingDesign and prototype... 
    Scientific
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    20 hours ago
  • $147k - $210k

    Design, build, and evaluate agentic AI systems for scientific discovery.Bring in domain-specific...  ...at scale.Work with scientists inside and outside Google...  ...discovery.Set and lead a research agenda. Identify new directions...  ...in top Machine Learning (ML) venues, and help shape... 
    Scientific

    Google

    Cambridge, MA
    4 days ago
  • $228k - $304k

     ...AI and automation co-evolve to accelerate scientific discovery. Our AI Research team is looking to hire a ML Research Scientist to focus on synthetic RL environment pipelines...  ...tasks, hierarchical goals, and complex evaluation scenarios.What You'll Need to SucceedPhD (or... 
    Scientific
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    20 hours ago
  • $150k - $250k

     ...probabilistic inference. Our ML team works on the science of...  ...and we are looking for senior research and engineering talent to derive...  ...Implement, visualize, and evaluate new architectures, training algorithms...  ...Experience in scientific Python and at least one deep... 
    Scientific

    Extropic

    Boston, MA
    4 days ago
  •  ...Research ScientistResearch scientists lead Basis' efforts to develop a deeper understanding of the conceptual...  ...Have demonstrated an ability to do scientific research that is of high-quality....  ...use your materials for both hiring evaluation and recruitment-related research and... 
    Scientific
    Full time

    Basis Research

    Cambridge, MA
    3 days ago
  • $147k - $210k

     ...experiments, build interactive research prototypes, and run simulations to evaluate human-agent collaboration, validate...  ...Google DeepMind’s applied scientific impact.Minimum qualifications:PhD...  ...multidisciplinary team of computer scientists, research engineers, social scientists... 
    Scientific

    Google

    Cambridge, MA
    1 day ago
  •  ...We are looking for an AI Research Scientist to help advance the modeling...  ...learning methods for difficult scientific problems, not simply apply existing...  ...closely with our CTO, AI/ML engineers, data engineers,...  ...validation. Develop and evaluate novel deep learning... 
    Scientific
    Remote work
    Flexible hours

    Absentia Labs

    Boston, MA
    1 day ago
  • $136k - $211.75k

     ...has originated over 100 scientific ventures and has...  ...assembling a lean team of scientists and engineers who work...  ...and protocolsBuild and evaluate models that relate our...  ...Python and the modern ML stack, and comfort...  ...working inside an existing research codebaseEnough imaging... 
    Scientific
    Remote work

    Seres Therapeutics

    Somerville, MA
    2 days ago
  • $262.5k - $299.6k

     ...Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows) At Capital One, we...  ...our applications of AI & ML are bringing humanity and...  ...-functional team of data scientists, software engineers, machine...  ...partners, ensuring scientific insights translate to production... 
    Scientific
    Full time
    Part time
    Work at office
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    1 day ago
  • $121.6k - $194.5k

     ...rigorous and highly collaborative Scientist to develop, benchmark, and evaluate computational approaches for personalized...  ...Vaccines and Bioinformatics Research. This scientist will play a...  ..., and engineering partners.Strong scientific communication skills and the ability... 
    Scientific
    Permanent employment
    Full time
    Work from home

    Moderna Therapeutics

    Somerville, MA
    20 hours ago
  • $124.71k - $187.07k

     ...Senior Scientist, AI for Oncology Clinical Development Locations...  ...Impact What if your AI research could help transform not only...  ...solve complex, high-impact scientific problems. What you’ll do...  ...high-stakes AI initiatives. Evaluate and develop advanced AI... 
    Scientific
    Temporary work
    Work at office
    Remote work

    AstraZeneca plc

    Cambridge, MA
    3 days ago
  • $127k - $205.9k

     ...together the greatest scientific minds with entrepreneurial...  ...Machine Learning Scientist, Climate and Hydrology...  ...climate data, and modern ML methods are brought...  ...model development and evaluation.The individual in this...  ...data teams to define research priorities, guide model... 
    Scientific
    Remote work

    Seres Therapeutics

    Somerville, MA
    5 days ago
  • $216k - $297k

     ...accelerate fundamental research and create a portfolio...  ...that unify human scientific expertise, machine intelligence...  ...machine learning scientists innovating on model architectures...  ...into model and evaluation requirements: ensure...  ..., benchmarking, and ML systems.Deep experience... 
    Scientific

    Seres Therapeutics

    Cambridge, MA
    1 day ago
  • $158.6k - $285.5k

     ...RoleModerna is seeking a scientifically rigorous and highly collaborative Principal Scientist to develop next-...  ...Vaccines and Bioinformatics Research. This scientist will...  ....Establish rigorous evaluation strategies that measure...  ...evaluate emerging AI/ML approaches and external... 
    Scientific
    Permanent employment
    Full time
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    20 hours ago
  • $208k - $286k

     ...to accelerate fundamental research and create a portfolio of AI...  ...We are seeking a Principal Scientist (Embedded ML/Computational) to lead AI/ML...  ...-o, systems biology, and scientific literature mining, ensuring...  ...Amazon Bedrock, and building evaluation and feedback-loop... 
    Scientific

    Seres Therapeutics

    Somerville, MA
    1 day ago
  • $145.9k - $234.2k

     ...seeking a computational scientist to develop artificial...  ....This is a hands-on research role centered on translating...  ...and rigorously evaluating new algorithms, and turning...  ...methods into reusable scientific software. The...  ...combines depth in AI/ML and algorithm development... 
    Scientific
    Full time
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    20 hours ago
  • $180k - $258.5k

     ...with Machine Learning (ML) to enable generative...  ...and innovative (Senior) Scientist, Machine Learning to...  ...critical role in developing, evaluating, and applying machine...  ...highly collaborative, scientifically rigorous, comfortable...  ...in a fast-paced research environment.KEY RESPONSIBILITIESDevelop... 
    Scientific

    Seres Therapeutics

    Cambridge, MA
    5 days ago
  • $119.7k - $222.3k

     ...to support strategic, scientific and operational leadership...  ...candidates across Research Development and Commercial...  ...) / Machine Learning (ML) approaches to enable...  ...for Principal Scientist II. 4+ years of experience...  ...metabolism and PK/PD evaluation, experience in working... 
    Scientific
    Full time

    Novartis

    Cambridge, MA
    5 days ago
  •  ...We are seeking a skilled cheminformatic scientist to join Takeda’s cheminformatics team. This...  ...in medicinal chemistry, DMPK, and AI/ML, defining a roadmap for computational tools...  ...human-in-the-loop workflows that integrate scientific reasoning, molecular design, data... 
    Scientific

    Takeda Pharmaceutical

    Boston, MA
    4 days ago
  • $106k - $176.6k

     ...believe the next generation of scientific breakthroughs will be...  ...As a Senior Machine Learning Research Scientist, you will help create the scientific...  ..., extend, and rigorously evaluate advanced AI methods that...  ...Uncertainty-Aware AI, causal ML and Interpretability Create... 
    Scientific
    Permanent employment
    Full time
    H1b
    Local area
    Worldwide
    Visa sponsorship
    Work visa
    Relocation package
    2 days per week

    Pfizer

    Cambridge, MA
    1 day ago
  • $120k - $225k

     ...a specially selected team of scientists, engineers, and software developers...  ...work. For our AI Test & Evaluation (T&E) work, we are seeking a...  ...in a relevant engineering or scientific discipline, or equivalent demonstrated...  ...in R&D, with a focus on AI/ML and Test & Evaluation.Proven... 
    Scientific
    Full time

    MORSE Corp

    Somerville, MA
    2 days ago
  • $177k - $278.08k

     ...director level, to identify, evaluate, and advance external innovation...  ...technical fluency in AI/ML, computational sciences, and...  ...closely with stakeholders across Research, Data, Digital & Technology (...  ...for a leader who combines scientific credibility, strategic insight... 
    Scientific
    Minimum wage
    Work at office
    Local area
    2 days per week
    3 days per week

    Takeda

    Cambridge, MA
    3 days ago
  •  ...motivated contract-to-hire Scientist/Sr. Scientist to help build...  ...successful candidate will be a key scientific contributor who shapes...  ...influence over the direction of the research and development pipeline and...  ...platforms, and help evaluate new tools and technologies to... 
    Scientific
    Contract work

    Beacon Hill Solutions Group

    Somerville, MA
    4 days ago
  •  ...Research Scientist 1RESEARCH SCIENTIST 1, Computer Science and Artificial Intelligence Lab, to...  ...that require independent judgment in evaluating, selecting, and substantially modifying...  ...to give oral presentations and prepare scientific papers; and the flexibility to attend... 
    Scientific
    Weekend work
    Afternoon shift

    MIT

    Cambridge, MA
    1 day ago
  •  ...Job SummarySummary drives research projects scientifically and determines the course of research as evidenced by leadership, obtaining funding,...  ...coding.Overseeing progress across multiple research and evaluation projects.Identifies, assimilates, and synthesizes data needed... 
    Scientific
    Remote work
    Shift work

    Salem Hospital NSMC

    Cambridge, MA
    3 days ago
  •  ...Corporation is an industry-leading dental research and development (R&D) and manufacturing...  ...is seeking an R&D product development scientist with a background in dental, medical, adhesive...  .../research presentations at industry or scientific conferences. Work Environment &... 
    Scientific
    Permanent employment
    Work at office

    Pulpdent Corporation

    Watertown, MA
    2 days ago
  • $60k - $96k

     ...business people, tech experts, researchers, and systems analysts to...  ...undertake and execute a program of scientific study culminating in...  ...and collaborative Research Scientist who will combine scientific...  ...These competencies are used to evaluate performance, make hiring decisions... 
    Scientific
    Full time
    Traineeship
    Remote work
    Shift work

    1200 The General Hospital Corporation

    Cambridge, MA
    1 day ago
  •  ...120-person Machine Learning (ML) and Natural Language Processing...  ...are looking for passionate researchers to help us create state‑of‑...  ...group of experienced Research Scientists and Machine Learning Engineers...  ...). Creating rigorous evaluation benchmarks, spanning domain knowledge... 
    Work at office

    Kensho

    Cambridge, MA
    1 day ago
  •  ...Description Join Takeda as a The Research Senior Scientist, Global Sample Management team plays...  ...role advances that mission by providing scientific and technical leadership in sample...  ...compliant and efficient operations. · Evaluate, test, qualify, and deploy new... 
    Scientific

    Takeda Pharmaceutical

    Boston, MA
    4 days ago
  •  ...member has a direct impact on scientific strategy and company success...  ...seeking a highly motivated scientist to lead the development and...  ...based and immunology assays to evaluate candidate potency,...  ...collaborative, scientifically rigorous research environment. Qualifications... 
    Scientific

    C10 Labs

    Cambridge, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Research Scientist, Scientific Evaluations. Be the first to apply!