Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Manager / Senior Manager, AI Safety Data and Evaluation Program

$180k - $256k

Lila Sciences

Requisition ID: 8759Your Impact at LILAWe're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.), to identify and mitigate risks from scientific superintelligence while retaining the core scientific discovery capabilities of the stack. The initial focus of this team will be to build and implement a bespoke safety strategy for Lila, tailored to its specific goals and deployment strategies. This will involve technical safety strategy development, broader ecosystem engagement, safety-focused evaluations, safety systems to mitigate risks, and a research agenda that explores longer-term needs such as oversight of superintelligent scientific systems.High-quality safety depends on the right expertise, consistent and repeatable workflows and high levels of interpretability. At Lila Sciences, you will turn scientific risk questions into well-run expert-data and evaluation programs to build this evidence-base.You will bring a strong working understanding of AI safety and scientific misuse risks to connect internal risk mapping and threat modeling with expertise across Lila and external specialists. Your primary responsibilities will be program execution and data quality: organizing contributors, running red-teaming and evaluation campaigns, and ensuring their outputs meet agreed standards. You will also be responsible for gathering targeted high-impact feedback from partners in the AI Safety community on our different aspects of our approach to Safety. You will work closely with scientists who frame the research questions and interpret their significance, while creating the operational conditions for their expertise to have an impact. Ultimately, you will play a key role in generating the evidence that informs safety decisions made by senior leadership at Lila.What You'll Be BuildingTranslate agreed scientific briefs into executable plans covering tasks, contributor needs, instructions, milestones, quality standards and delivery expectations.Source and coordinate external experts with scientific colleagues, and organize access to relevant expertise within Lila.Manage contributor onboarding, task assignment, training and support so specialists can contribute effectively and consistently.Run expert-data collection, annotation, red-teaming and evaluation programs, tracking progress and resolving delivery problems.Establish quality controls covering completeness, consistency, provenance and adherence to rubrics; coordinate calibration, review, disagreement resolution and rework with scientific owners.Maintain clear records, versioned guidance and usable datasets, and improve workflows based on quality findings and researcher feedback.Identify questions that require scientific judgment and bring them to the appropriate specialists, ensuring decisions are reflected in program materials and subsequent work.What You'll Need to SucceedExperience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors.A substantial working understanding of AI safety, including how threat models, capability evaluations, red teaming and safeguards inform one another. You should be able to interpret a safety research brief, recognize its assumptions and the consequences of data-quality failures, and identify when a question needs scientific escalation.Evidence of applying this safety understanding in research, evaluation or expert-data work, including how it shaped the scoping, execution or review of a program.Strong operational judgment and the ability to manage dependencies, changing requirements and several parallel workstreams.A track record of setting measurable quality standards, detecting recurring problems and improving the processes that produce data.Clear communication, careful documentation and the ability to build effective relationships with researchers, experts and vendors.Sufficient technical and scientific fluency to understand research briefs, clarify ambiguity and work productively with subject-matter experts.Bonus Points ForExperience contributing to scientific study design, assessing scientific validity or developing evaluation rubrics.Deeper scientific expertise or research experience in biology, chemistry or materials science.Data analysis, scripting, annotation platforms or tools for tracking research workflows and data provenance.CompensationWe offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.Expected Base Salary Range$180,000—$256,000 USDAbout LILALila Sciences is building Scientific Superintelligence to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves.LILA combines advanced AI models with proprietary AI Science Factory instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply.We’re All InLila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy.A Note to AgenciesLila Sciences does not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to Lila Sciences or its employees is strictly prohibited unless contacted directly by Lila Science’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of Lila Sciences, and Lila Sciences will not owe any referral or other fees with respect thereto.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Manager / Senior Manager, AI Safety Data and Evaluation Program in Somerville, MA vacancy
  • $150.5k - $245.5k

     ...diseases. We are seeking a Senior Manager to join our Patient Safety team. The Senior Manager...  ...this to include safety data aggregation, review and analysis...  ...plan Perform signal evaluation for any identified...  ...match, health and wellness programs, fitness centers, insurance... 
    Data
    Senior
    Worldwide

    Regeneron Pharmaceuticals, Inc.

    Cambridge, MA
    2 days ago
  • $102.1k - $202.2k

     ...builds the end-to-end AI stack and is core to...  ...high risk content, manages customer...  ...and appeals, supports data labeling and quality programs, and helps ensure Microsoft...  ...Program Manager - AI Safety Enforcement in Responsible...  ...criteria, and evaluation datasets. Translate... 
    Data
    Ongoing contract
    Full time
    Work at office
    Local area

    Microsoft

    Cambridge, MA
    1 day ago
  • $180k - $256k

     ...across Lila's scientific workflows.As a Senior Technical Program Manager on SSR, you will operate at the...  ...scaleStrong technical fluency with APIs, data models, schemas, and system integrationsExperience...  ...is the most inspiring frontier for AI. Rather than hard-coding expert... 
    Data
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    1 day ago
  • $119.8k - $234.7k

     ...in days, not months. As a Senior Technical Program Manager , you will embed with strategic...  ...crews alongside engineers, data scientists, and designers,...  .... Our work is powered by AI, applying the mindset and...  ...scientists, designers) to evaluate, design, and deliver AI-powered... 
    Data
    Senior
    Ongoing contract
    Full time
    Local area
    Visa sponsorship
    Work visa

    Microsoft

    Cambridge, MA
    8 hours ago
  •  ...About LILT AI is changing how the world communicates...  ...About the Role: As a Senior Technical Program Manager of Applied AI, you will sit...  ...benchmark transformations and data deliverables. Rather than just...  ...tools to assist in the evaluation of applications, including... 
    Data
    Senior
    Work at office
    Local area

    Lilt

    Boston, MA
    1 day ago
  • $132k - $172k

    Department: 107500 Drug Safety & Pharmacovigilance...  ...Position Summary The Senior Manager, Drug Safety & Pharmacovigilance...  ..., and safety data reconciliation. The Senior...  ...requiring further evaluation. Review MedDRA coding...  ...safety. Knowledge of REMS programs and/or REMS program... 
    Data
    Senior
    Temporary work
    Remote work
    Night shift

    Travere Therapeutics

    Boston, MA
    3 days ago
  • This is what you will do: The Senior Manager, Safety Scientist plays a pivotal...  ...Patient Safety to actively evaluate and manage safety risks in close...  ...: Contributing to safety data reviews and analyses for products...  ...Team (SST) Leading program and study level safety surveillance... 
    Data
    Senior
    Hourly pay
    Work at office
    Local area
    Flexible hours

    AstraZeneca plc

    Boston, MA
    1 day ago
  • $195k - $330k

     ...everyone. Our goals are shared, our decisions data-driven and our camaraderie genuine....  ...ll make an impact:Drive end-to-end CMC program management for mid to late-stage programs,...  ...benefits.Actual salary is based on a holistic evaluation of the specific role/level as well as... 
    Data
    Senior

    Kymera Therapeutics

    Watertown, MA
    2 days ago
  • $195k - $330k

     ...everyone. Our goals are shared, our decisions data-driven and our camaraderie genuine....  ....How you’ll make an impact:Provides program management and matrixed leadership to cross functional...  ....Actual salary is based on a holistic evaluation of the specific role/level as well as... 
    Data
    Senior

    Kymera Therapeutics

    Watertown, MA
    4 days ago
  • $201k - $351k

     ...Medical Director, Patient Safety & Risk Management at Relay Therapeutics will...  ...role is responsible for the evaluation, interpretation, and communication...  ...cross functional clinical program teams, including Clinical...  ...Operations, Biostats, Data Management and Regulatory Affairs... 
    Data
    Senior
    Private practice

    Relay Therapeutics

    Cambridge, MA
    2 days ago
  • $148.7k - $201.2k

    Amazon's Frontier AI Assets (FAI) team works...  ...the quality of data used to develop and evaluate AI models. We draw on...  ...supports our AI work. The program requires...  ...effective dependency management, and continuous process...  ...for improvements to senior leaders. You will work... 
    Data
    Senior
    Flexible hours

    Amazon

    Boston, MA
    12 hours ago
  •  ...automate global supply chains with Physical AI. Our robots work alongside warehouse...  ...Pickle is looking for an experienced Senior Technical Program Manager (TPM) to join our Software Engineering...  ...like more information about how your data is processed, please contact us.... 
    Data
    Senior
    Work at office
    3 days per week

    Pickle Robot Company

    Charlestown, MA
    7 days ago
  • $166k - $220k

     ...systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D...  ...THE JOB As a Technical Program Manager working on our Intelligence Surveillance...  ...information. To ensure your safety and help you navigate your job... 
    Data
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Waltham, MA
    1 day ago
  • $93.8k - $177k

     ...around the world. AI at SharkNinja At...  ...looking for a self-motivated Senior Technical Software Project Manager (STPM) to join the Engineering...  ...telemetry, crash data, returns analysis, and hotfix...  ..., employee stock purchase program, life insurance, AD&D, short... 
    Data
    Senior
    Temporary work
    Local area
    Flexible hours

    SharkNinja

    Needham, MA
    3 days ago
  • $92.48k - $160.29k

     ...Senior Technical Program Manager New Business & Underwriting Platform Are you a seasoned Technical Program...  ...of statutory leaves of absence. We use data and analytics technologies, such as artificial intelligence (AI), and automated processing tools, to analyze... 
    Data
    Senior
    Temporary work
    Local area

    Manulife and John Hancock

    Boston, MA
    1 day ago
  • Regeneron seeks a Senior Manager for Global Patient Safety to shape safety strategies for molecules in development and post-marketing. You will aggregate and analyze safety data, support benefit-risk assessment, and lead communications for safety findings. Role is on-site... 
    Data
    Senior

    BioSpace

    Cambridge, MA
    12 hours ago
  • $149k - $223k

     ...seeking a Principal Technical Program Manager to lead a portfolio of...  ...the primary program voice to senior leadership, presenting status...  ...Bill of Materials (BoM), Tech Data Package (TDP) releases, Functional...  ...supply chain with its end-to-end, AI-powered robotic and software... 
    Data
    Senior
    Contract work
    Work experience placement
    Work at office

    Symbotic

    Wilmington, MA
    1 day ago
  • $130.8k - $209.4k

     ...improving global health.As Senior Manager, Program Management within Portfolio...  ...decision-making. Help teams evaluate options, understand trade-offs...  ...opportunities to use generative AI tools to support information...  ...access to technology or data that is subject to U.S. export... 
    Data
    Senior
    Permanent employment
    Full time
    Work at office
    Work from home

    Moderna Therapeutics

    Cambridge, MA
    4 days ago
  • $142k - $190k

    The Senior Data Science Manager, Predictive Analytics & AI - US Commercial will be responsible for developing, implementing...  ...U.S. Commercial function. Evaluate business and analytical needs to...  ...biotechnology industry. Strong programming skills in Python and SQL. Experience... 
    Data
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    3 days per week

    Biogen Idec

    Somerville, MA
    3 days ago
  • $5,000 per month

     ...beneficial transition to advanced AI systems. Our work takes...  ...and accelerating AI safety research through fellowship programs. Our inaugural summer...  ...with our Research Managers, mentors, and program leadership...  ...structured program evaluation frameworks to assess fellow... 
    Full time
    Summer work
    Work at office
    Home office

    cbai

    Cambridge, MA
    6 days ago
  • $5,000 per month

     ...being structured as a Senior Research Manager, and compensation...  ...to advanced AI systems. Our work...  ...and accelerating AI safety research through fellowship programs. Our inaugural...  ...provably safe AI, evaluations, and various topics...  ...scaffolds, and supporting data collection &... 
    Data
    Full time
    Summer work
    H1b
    Work at office
    Remote work
    Home office
    Visa sponsorship
    Flexible hours

    cbai

    Cambridge, MA
    6 days ago
  • $200k - $240k

    Senior Manager, AI Advisory and Open Source Program OfficeHybrid On-Site: Walnut Creek, CA; Austin, TX; Troy, MI; Boston...  ...require the highest levels of security, safety, and reliability. Wind River helps...  ...the world’s first successful 5G data session with Verizon and building... 
    Data
    Senior
    Full time
    Work at office
    Home office
    Flexible hours

    Control Tec

    Boston, MA
    2 days ago
  • $167k - $222k

     ...The Technical Program Manager Mathematical Software...  .... Continuously evaluate and improve project...  ...applied probability and AI/ML technology....  ...To ensure your safety and help you navigate...  ...efforts. Data Privacy To view...  ...security. Required Experience: Senior IC... 
    Data
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril

    Waltham, MA
    6 days ago
  • $169.8k - $233.4k

     ...sustainable agriculture through AI-driven predictive...  ...biologists, data engineers, software engineers...  ....Define how models are evaluated and validated against experimental...  ...-critical modeling programs.Drive the delivery of...  ...and business outcomes.Manage, mentor, and develop a... 
    Data
    Senior
    Full time
    Temporary work
    Part time
    For contractors
    H1b
    Flexible hours

    Inari

    Somerville, MA
    12 hours ago
  • $150k - $200k

     ...integration and alliance management. The Group Vice...  ...end-to-end with Search Evaluation & Intelligence BD and...  ...and input from manager/senior team members for broader...  ...and digest ideas and data to make clear and qualified...  ...employee benefit programs including medical dental... 
    Data
    Senior
    Full time
    Local area
    Flexible hours
    Night shift

    Novo Nordisk

    Cambridge, MA
    5 days ago
  • $229.9k - $262.4k

     ...creating responsible and reliable AI systems, changing banking for...  ...scientists, technical program managers, and product managers to deliver...  ...search, guardrails, model evaluation, experimentation, governance,...  ...collaboration interfaces with Research, Data, and Platform teams to... 
    Data
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    8 hours ago
  • $126.2k - $264.1k

     ...Job Description Manage the development and implementation process...  ...work of systems analysis and program staff, providing technical support...  ...Oracle brings together the data, infrastructure, applications,...  ...to life-saving care. And with AI embedded across our products... 
    Data
    Senior
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    3 days ago
  • $204.3k - $266.73k

     ...Principal Technical Program Manager We are seeking a Principal...  ...governance policies to evaluate, select, and scale open...  ...leadership and teams data-backed recommendations...  ...including 3+ years on ML, AI platform or large-scale...  ...including influencing senior engineers and... 
    Data
    Work at office
    Local area

    Atlassian

    Dorchester, MA
    12 hours ago
  • $124k - $280k

     ...OpportunityAs an Applied AI Health System Engineer...  ...use cases. As a Senior Manager you will guide large,...  ...at PwC, you will apply data, algorithms, and software...  ...cloud-based AI platforms- Evaluating model behavior through...  ...of population health program design and how AI... 
    Data
    Senior
    Full time
    H1b

    PwC

    Boston, MA
    3 days ago
  • $151.9k - $238.7k

     ...happen fast.ZoomInfo's Core Data team builds the person...  ...answers, and where evaluation — not hand-built logic...  ...hiring a Principal Product Manager to own Person Data...  ...to end and to build the AI evaluation discipline the...  ..., body and lifestyle programs designed for overall well... 
    Data

    ZoomInfo

    Waltham, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Manager / Senior Manager, AI Safety Data and Evaluation Program. Be the first to apply!