Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Program Manager - Model Evals and Safety

Visa Hunt

Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. About the Role Research Program Managers at Reflection are high-leverage leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won\'t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0-to-1 work in its purest form. You bring a first-responder mentality. When things go sideways, you don\'t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You\'ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre-training, mid-training, and post-training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in-house, what to adopt, and where to invest research effort. Establish Reflection\'s engagement with the external safety ecosystem, including third-party assessments, academic partnerships, and industry safety frameworks. Represent the company\'s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post-mortems and continuous learning, turning every safety-relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red-teaming, alignment research, and the evolving regulatory and industry safety ecosystem. You don\'t need to be a safety researcher, but you need to understand the space well enough to make sound judgments about what matters and what to prioritize. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety-critical system architecture. You follow the technical thread and you know when something doesn\'t add up. Proven ability to build structures where none exists. You\'ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow-through. Excited to build from zero to one. We are a small, fast-moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world\'s most capable open-weight AI systems, responsibly. What We Offer: We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top-tier compensation: Salary and equity structured to recognize and retain our talent globally. Stock options: Everyone who joins and contributes to Reflection\'s success gets to share in the upside through stock options. Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance. Meals: Lunch and dinner are provided in the office daily. Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys. Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. Team building: We have regular off-sites, happy hours, and team celebrations. Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company\'s ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization. #J-18808-Ljbffr Visa Hunt

Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the Research Program Manager - Model Evals and Safety in New York, NY vacancy
  • $385k

    About The Role As a Product Manager for Model Behaviors, you will partner with the Alignment Finetuning...  ...improvements, coordinate across Research, Product, and Safeguards teams, and accelerate...  ...more helpful and safe Contribute to evals that measure alignment progress... 
    Suggested
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    2 days ago
  • $258k - $348k

     ...collaboration, join us!The Figma Research team is hiring an Director, Research - AI Evals to own how we measure...  ...with automated, model-based approaches —...  ...including 2+ years of management experienceDirect, hands...  ...evaluation — human evaluation programs, rubric and benchmark/... 
    Suggested
    Minimum wage
    Full time
    For contractors
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    20 hours ago
  • Reflection is seeking an experienced Research Program Manager to embed with research and...  ...infrastructure teams, accelerating frontier model development. This 0-to-1 role...  ..., builds the operational safety infrastructure, and links evals to the model lifecycle. You bring... 
    Suggested

    Visa Hunt

    New York, NY
    20 hours ago
  •  ...a talented, highly motivated MPH-level research scientist with a background in intervention...  ...health, and substance use. The Research Manager will be responsible for administrative...  ...IRB-related activities across studies. Programs and formats project data collection tools... 
    Suggested
    Temporary work
    Local area

    Columbia University

    New York, NY
    11 hours ago
  • NYU Langone Health in Manhattan invites applications for a Program Manager, Neuro-Oncology & Oncology Research. You will oversee program operations, ensure regulatory compliance, budgeting, and liaison with leadership to drive development and productivity. You will manage... 
    Suggested

    NYU Langone Health

    New York, NY
    20 hours ago
  • Mount Sinai Health System is seeking a Research Project Manager I to oversee the operational scope of a designated project or department initiatives. You will support leadership, organize conferences and educational activities, and create and monitor timelines and specifications... 

    Mount Sinai Medical Center

    New York, NY
    4 days ago
  • Cardiovascular Associates of America (CVAUSA) is seeking a Research Project Manager to lead complex multisite clinical research initiatives across the CVRS network. Reporting to the Director of Research, you will design plans, coordinate sites, sponsors, and vendors, and... 
    Remote job
    For contractors

    Cardiovascular-Associates-of-America

    New York, NY
    20 hours ago
  • $84.58k - $122.69k

     ...improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and...  ...: We have an exciting opportunity to join our team as a Program Manager. In this role, the successful candidate is responsible for managing... 
    Contract work
    For contractors
    Work at office
    Remote work

    NYU Langone Health

    New York, NY
    1 day ago
  • Thank you for considering a career with the Research Foundation of The City University of New York (RFCUNY)! We are thrilled that you...  ...Unit:NoWe invite applications for a Research Scientist Program Manager (Part-Time, Postdoctoral Level) under the supervision of Dr.... 
    Part time
    Local area
    Remote work

    Research Foundation Cuny

    New York, NY
    4 days ago
  • Akaasa Technologies seeks a senior candidate with 10+ years of experience in Investment Banking or Fintech to lead the New Solutions and New Users (NSU) function. The role focuses on coordinating innovation initiatives, evaluating new tools, and ensuring compliant data ...
    Work at office

    Akaasa Technologies

    New York, NY
    2 days ago
  • $100k - $160k

    A nonprofit applied AI research organization is looking for a Technical Program Manager to drive ambitious research projects in New York. The role involves managing technical project roadmaps, facilitating team meetings, and ensuring project alignment with strategic goals... 
    Full time

    Basis Research Institute

    New York, NY
    20 hours ago
  • $174.8k - $202k

     ...and defense capabilities to help promote mission success and safety for those who serve their nation. Led by our talented teams around...  ...on Cubic.com.Job Details:Job Summary: Responsible for the program management, performance and completion of the multiple high technology... 
    Full time
    Contract work
    For subcontractor
    Work at office

    Cubic Corporation

    New York, NY
    3 days ago
  •  ...OpportunityUnity Technologies is building a premier Environment, Health & Safety (EHS) team. Our mission is to create a safe working...  ...to the wider business.We are now ready to add a Senior EHS Program & Regional Manager. This is a hybrid role that pairs hands-on regional... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide

    Unity Technologies

    New York, NY
    3 days ago
  • $120k - $150k

     ...Join Safran Aerosystems: an international leader in aviation safety, fluid management and fuel systems. Our strength? Innovating to enhance...  ...detailsDomainResearch, design and developmentJob field / Job profilePrograms - Program manager level 3Job titleProgram ManagerEmployment... 
    Permanent employment
    Contract work
    Temporary work
    Local area
    Flexible hours

    Safran Group

    New York, NY
    2 days ago
  • $102k - $135k

    Are you a Program Manager (non-technical) ready for a change in your career? This could be a phenomenal opportunity to explore! We are seeking...  ...Business Services (ABS) in a multi‑year strategic Operating Model Transformation. Reporting to the Director of Program... 
    Full time
    Temporary work
    Part time
    Local area

    Aon Corporation

    New York, NY
    2 days ago
  •  ...University School of Nursing in New York seeks a talented MPH-level research scientist to support intervention implementation studies aimed...  ...diseases, mental health, and substance use. The Research Manager will handle administrative management, data collection, IRB support... 

    Columbia University Irving Medical Center

    New York, NY
    4 days ago
  • $207k - $300k

    Build both human-powered and Large Language Model (LLM)-powered automated evaluation...  ...measure aspects like grounding, coherence, safety, and helpfulness.Utilize platforms and tools...  ...quality, often in collaboration with research, and cross-functional teams.Create tools... 

    Google

    New York, NY
    2 days ago
  • $204k - $259k

    Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location...  ...to improve mobility and safety. The Applied Research team...  ...to a Technical Lead Manager. Responsibilities Conduct...  ...generous company benefits program. #J-18808-Ljbffr SupportFinity... 
    Full time

    SupportFinity™

    New York, NY
    4 days ago
  • Frontier Model Misuse Risk Evaluator is a remote red-team track for stress-testing AI systems...  ...the rubric clause it violated so the safety team can patch the gap. Why this role...  ...experience red-teaming AI systems, security research, or adversarial ML work for Frontier Model... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • Own the end-to-end program roadmap for AI and innovation initiatives across Global Markets...  ...with AI governance, compliance, and model risk teams on risk-based tiering and approval...  ...AI governance frameworks, model risk management, and regulatory considerations Strong analytical... 

    Jobtailor

    New York, NY
    2 days ago
  •  ...Research Engineer (Senior Staff+), Safeguards LabsSan Francisco, CA...  ...chartered to investigate novel safety methods that protect Claude and...  ...prototype new approaches to safe models, usage safeguards, and...  ...models and experience designing evals.Experience with agentic environments... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    20 hours ago
  • $72k - $80k

     ...external partners is essential to advancing research, innovation, and scientific discovery....  ...to ensuring their success. These programs often involve complex partnerships with...  ...Operations, the Research Center Program Manager will provide comprehensive administrative... 
    Temporary work
    Work experience placement
    Local area

    Columbia University

    New York, NY
    1 day ago
  •  ...strong neighborhoods that ensure enduring safety. The Research Innovation Policy team drives the...  ...of the Policy Unit, the Field Research Manager is responsible for leading the design,...  ...eligible for federal loan forgiveness programs and state repayment assistance programs... 
    Work at office
    Flexible hours

    OFFICE OF CRIMINAL JUSTICE

    New York, NY
    4 days ago
  •  ...Icahn School of Medicine at Mount Sinai is seeking a Clinical Research Nurse Manager to lead a growing portfolio of cellular therapy research....  ...malignant and malignant CAR‑T studies, ensuring participant safety and adherence to protocols. The ideal candidate will have 5... 

    Icahn School of Medicine at Mount Sinai

    New York, NY
    3 days ago
  • A leading AI research firm in New York, NY, is looking for a specialist to oversee the red-...  ...adversarial evaluation pipeline for their models. The ideal candidate should possess a...  ...field and have a deep understanding of LLM safety and adversarial techniques. A strong software... 

    Reflection AI

    New York, NY
    3 days ago
  •  ...Alliance Group Career Page is seeking a Data Science and Engineering Manager to join the Center for Data Analytics, Innovation, and Rigor (...  ...with clinical project managers to drive large-scale AI research initiatives in mental health. This is a full-time, exempt role... 
    Full time

    Stone Alliance Group Career Page

    New York, NY
    4 days ago
  • $88.28k - $103.22k

     ...IT Program ManagerThe International Rescue Committee (IRC) responds...  ..., helping to restore health, safety, education, economic...  ...testing, and overall Project Management in an effort to help the organization...  ...team is working in a hybrid model with one day per week in the... 
    Full time
    Part time
    Work at office
    Remote work
    1 day per week

    International Rescue Committee

    New York, NY
    3 days ago
  • $70k - $75k

     ...offering more than 160 integrated programs in: Education & Youth...  ...BIVO is part of the NYC Crisis Management System (CMS). CMS is the city...  ...implement the Cure Violence Model. The Cure Violence model is a...  ...helping organize Brownsville Safety Alliance resource fairs with... 
    Full time
    Contract work
    Work at office
    Local area

    CAMBA

    New York, NY
    4 days ago
  • $130k - $150k

     ...innovateteam.com . Secure Information: We prioritize your data safety. We never request bank information via email or text. Instead...  ...differs from this process, it’s not from Innovate. GIS Program Manager Location: Remote Apply for this Position Position: GIS Program... 
    Full time
    Contract work
    Local area
    Remote work

    Innovate!, Inc.

    New York, NY
    4 days ago
  • $147.68k - $236.28k

    AI/Technology Evangelist - Program Manager (Corporate AI Team) Join Axon...  ...explore society’s most critical safety and justice issues with our...  ...that provides GPT‑class models, chat assistants, and secure...  ...services). You don’t need to be a researcher, but you need to be a... 
    Work at office

    National Society for Black Engineers

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!