Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Program Manager - Model Evals and Safety

Reflection

Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all. We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. About The Role Research Program Managers at Reflection are high‑leveraged leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won’t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0‑to‑1 work in its purest form. You bring a first‑responder mentality. When things go sideways, you don’t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You’ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre‑training, mid‑training, and post‑training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in‑house, what to adopt, and where to invest research effort. Establish Reflection’s engagement with the external safety ecosystem, including third‑party assessments, academic partnerships, and industry safety frameworks. Represent the company’s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post‑mortems and continuous learning, turning every safety‑relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red‑teamings, alignment research, and the evolving regulatory and industry safety ecosystem. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety‑critical system architecture. Proven ability to build structures where none exists. You’ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow‑through. Excited to build from zero to one. We are a small, fast‑moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world’s most capable open‑weight AI systems, responsibly. What We Offer We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent‑dense team. You will help define our future as a company, and help define the frontier of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top‑tier compensation: Salary and equity structured to recognize and retain the best talent globally. Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance. Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning. Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time. Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off‑sites and team celebrations. #J-18808-Ljbffr Reflection

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Program Manager - Model Evals and Safety in New York, NY vacancy
  • Reflection is seeking a Research Program Manager to lead the development of model evaluations and safety protocols. This integral role requires an experienced leader to build systems from the ground up, collaborating with teams to ensure AI safety at every stage of development... 
    Suggested

    Reflection

    New York, NY
    3 days ago
  • Reflection AI is seeking a Research Program Manager to embed with research and infrastructure teams and accelerate frontier model development. You will define evaluation...  ...frameworks, build operational safety infrastructure, and connect evals to the model lifecycle. This... 
    Suggested

    Reflection AI

    New York, NY
    3 days ago
  •  ...CERTIFICATIONS Required Portfolio Management Professional (PMP) SKILLS AND...  ...patient or employee safety or security Ability to effectively...  ...and activities for the program. Supports ongoing outreach, pilot...  ...Houston Methodist also includes a research institute; a comprehensive... 
    Suggested
    Shift work

    Dormont Manufacturing Company

    New York, NY
    2 days ago
  • $385k

    About The Role As a Product Manager for Model Behaviors, you will partner with the Alignment Finetuning...  ...improvements, coordinate across Research, Product, and Safeguards teams, and accelerate...  ...more helpful and safe Contribute to evals that measure alignment progress... 
    Suggested
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    1 day ago
  • $290k - $365k

     ...growing group of committed researchers, engineers, policy experts,...  ...organization works across the full model development lifecycle — from...  ..., interpretability, and safety — each operating at the...  ...development. As a Technical Program Manager for Research, you'll define... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Menlo Ventures

    New York, NY
    5 days ago
  • 3M HEALTHCARE's Discovery team is seeking a Technical Program Manager to own compute planning, RL environment health, and vendor pipelines, enabling faster research iterations. Candidates should have ML engineering or research background and strong program leadership,... 

    3M HEALTHCARE

    New York, NY
    1 day ago
  • $84.58k - $109.2k

    Position Summary We have an exciting opportunity to join our team as a Research Program Manager. In this role, the successful candidate will provide a broad range of complex program coordination, develop and promote assigned programs, design, budget, staff, logistics and... 
    Work at office

    NYU Langone Hospitals

    New York, NY
    4 days ago
  • Weill Cornell Medical College on the Upper East Side is seeking a Research & Faculty Awards Program Manager to support the Office of the Research Dean. The role expands industry/foundation funding opportunities and strengthens nomination packages with faculty collaboration... 
    Work at office

    Weill Cornell Medical College

    New York, NY
    5 days ago
  • $93k

    New York University is seeking a Research Program Manager for the ACAD study focusing on older adults of Asian ancestry. The successful candidate will coordinate research operations, engage with stakeholders, and manage data collection. This full-time role requires a U... 
    Full time

    New York University

    New York, NY
    2 days ago
  • $84.58k - $122.69k

     ...improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and...  ...: We have an exciting opportunity to join our team as a Program Manager. In this role, the successful candidate is responsible for managing... 
    Contract work
    For contractors
    Work at office
    Remote work

    NYU Langone Health

    New York, NY
    5 days ago
  • Akumin is seeking a dedicated professional to manage the operational side of the research program, overseeing contract requests and coordinating with site leaders and research sponsors. This individual contributor role directly impacts revenue and offers a clear path for... 
    Contract work

    Akumin

    New York, NY
    3 days ago
  • Thank you for considering a career with the Research Foundation of The City University of New York (RFCUNY)! We are thrilled that you...  ...Unit:NoWe invite applications for a Research Scientist Program Manager (Part-Time, Postdoctoral Level) under the supervision of Dr.... 
    Part time
    Local area
    Remote work

    Research Foundation Cuny

    New York, NY
    3 days ago
  • $90k - $110k

     ...operational and administrative management of a high-volume clinical...  ...cardiovascular and vascular clinical research studies and supervising...  ...research mission through effective program management, staff leadership,...  ..., clinical standards, and safety requirements. Manage time-off... 
    H1b
    Local area
    Work visa

    State University of New York at Buffalo

    New York, NY
    4 days ago
  •  ...Savannah is seeking a passionate and attentive Pool Experience Model for our luxury urban resort pool venue, Bar Bibi. In this role...  ..., and all other pool experience duties Participate in pool safety programs, training, and ensure overall guest safety Qualifications Excellent... 

    Stay Bardo

    New York, NY
    1 day ago
  • $100k - $160k

    A nonprofit applied AI research organization is looking for a Technical Program Manager to drive ambitious research projects in New York. The role involves managing technical project roadmaps, facilitating team meetings, and ensuring project alignment with strategic goals... 
    Full time

    Basis Research Institute

    New York, NY
    4 days ago
  •  ...to all. We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind...  ...Anthropic and beyond. About The Role Research Program Managers at Reflection are high‑leverage leaders... 
    Relocation package

    Reflection

    New York, NY
    1 day ago
  • $159k - $231k

    Senior UX Program Manager, Model Behavior and Quality Applicants in San Francisco: Qualified applications with arrest or conviction records will...  ...UX related projects and UX content strategy, design, user research, or user centered development tools and methodologies.... 

    Google

    New York, NY
    3 days ago
  • Basis-Research-Institute in New York is looking for a Technical Program Manager to lead ambitious research projects. This role requires strong program management skills, along with significant expertise in AI and machine learning concepts. The ideal candidate will possess... 

    Basis-Research-Institute

    New York, NY
    4 days ago
  • $102k - $135k

    Are you a Program Manager (non-technical) ready for a change in your career? This could be a phenomenal opportunity to explore! We are seeking...  ...Business Services (ABS) in a multi‑year strategic Operating Model Transformation. Reporting to the Director of Program... 
    Full time
    Temporary work
    Part time
    Local area

    Aon Corporation

    New York, NY
    1 day ago
  • $114k - $253k

     ...performance, productivity, safety, and quality of...  ...you will serve as the program integrator and execution...  ...establishing program structure, managing milestones, and driving...  ...Quality (WQ) operating model, from issue intake and...  ...results. Lam Research ("Lam" or the "Company"... 
    Interim role
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week
    1 day per week

    Lam Research

    New York, NY
    4 days ago
  •  ...Lead the design and execution of primary and secondary market research initiatives to generate actionable business insights supporting...  ...innovative methodologies to support business decision‑making. Manage external research vendors, including project oversight, deliverables... 
    Work at office

    GForce Life Sciences

    New York, NY
    5 days ago
  • Mount Sinai Health System is seeking a Program Manager to lead the Discovery & Innovation Hub in Harlem. The role involves overseeing day-to-day operations, ensuring a welcoming environment, and coordinating community engagement activities. The ideal candidate should have... 

    Mount Sinai Health System

    New York, NY
    3 days ago
  • $111k - $150.7k

     ...and lives better. As a member of the Network Innovations team, our Network Innovations Program Manager, Primary Care Programs leads and oversees the full lifecycle of innovation models and programs — from inception through sustainment — ensuring deliverables, KPIs, and... 
    Immediate start
    Work from home
    Flexible hours

    Cambia Health Solutions

    New York, NY
    2 days ago
  • Research & Faculty Awards Program Manager Position Summary This role, working with the Associate Dean for Research, provides extensive programmatic and operational support to several nomination committees managed by the Office of the Research Dean. In collaboration with... 
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Weill Cornell Medicine - Qatar

    New York, NY
    1 day ago
  •  ...workflows – Partner with Product and Engineering leaders to integrate privacy, data protection, marketing, operational and platform safety considerations into product design, development, and release processes. Influence how data is collected, used, stored, and governed... 

    DICK'S SPORTING GOODS INC

    New York, NY
    2 days ago
  • $147.68k - $236.28k

     ...society’s most critical safety and justice issues...  ...that provides GPT‑class models, chat assistants, and...  ...and deliver training programs, workshops, demos, and...  ...evangelizing AI capabilities—not managing people. What You’ll Do...  ...don't need to be a researcher, but you need to be a... 
    Work experience placement
    Work at office

    Axon US Corp

    New York, NY
    1 day ago
  • ## Program ManagerApplylocations: Warrendale, PA: Derby, UK Office: Remote - UK: Remote -...  ...create a higher standard for a better world.Manage assigned programs including applying...  ...professional development in industries where safety and quality are shared values.**SAE... 
    Contract work
    For contractors
    Work at office
    Local area
    Remote work

    Fullsight

    New York, NY
    2 days ago
  •  ...Clinical Research Manager Licensed The Clinical Research Manager Licensed has oversight of...  ...Marrow Transplant (BMT)/Cellular Therapy programs. This role will initially focus on the...  .... The role will ensure participant safety, protocol adherence, and regulatory compliance... 
    Work at office
    Shift work

    Mount Sinai Hospital

    New York, NY
    2 days ago
  • $290k - $365k

    Anthropic is looking for a Technical Program Manager for Safeguards Infrastructure and Evals in New York, NY. This role is integral to ensuring the reliability...  ...managing critical incidents, and a passion for AI safety. The compensation range for this role is $290,000 -... 

    Anthropic

    New York, NY
    3 days ago
  •  ...Alliance Group Career Page is seeking a Data Science and Engineering Manager to join the Center for Data Analytics, Innovation, and Rigor (...  ...with clinical project managers to drive large-scale AI research initiatives in mental health. This is a full-time, exempt role... 
    Full time

    Stone Alliance Group Career Page

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!