Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Program Manager - Model Evals and Safety

Reflection

Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all. We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. About The Role Research Program Managers at Reflection are high‑leveraged leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won’t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0‑to‑1 work in its purest form. You bring a first‑responder mentality. When things go sideways, you don’t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You’ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre‑training, mid‑training, and post‑training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in‑house, what to adopt, and where to invest research effort. Establish Reflection’s engagement with the external safety ecosystem, including third‑party assessments, academic partnerships, and industry safety frameworks. Represent the company’s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post‑mortems and continuous learning, turning every safety‑relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red‑teamings, alignment research, and the evolving regulatory and industry safety ecosystem. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety‑critical system architecture. Proven ability to build structures where none exists. You’ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow‑through. Excited to build from zero to one. We are a small, fast‑moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world’s most capable open‑weight AI systems, responsibly. What We Offer We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent‑dense team. You will help define our future as a company, and help define the frontier of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top‑tier compensation: Salary and equity structured to recognize and retain the best talent globally. Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance. Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning. Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time. Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off‑sites and team celebrations. #J-18808-Ljbffr Reflection

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Program Manager - Model Evals and Safety in New York, NY vacancy
  • Reflection AI Ltd. is seeking a Research Program Manager to embed with research and infrastructure...  ...teams, accelerating frontier model development. This foundational...  ...define evaluation frameworks, build safety operations, and connect evals to the model lifecycle in a fast-... 
    Suggested

    Reflection AI Ltd

    New York, NY
    6 days ago
  • A part of the Trust and Safety Product organization, the Research Data team is focused on enabling the work of independent...  ...-leading transparency and compliance program. We are looking for an experienced Research Data Program Manager to expand our team's work delivering... 
    Suggested

    TikTok

    New York, NY
    4 days ago
  • $365k

     ...Technical Program Manager, Research Anthropic's mission is to create reliable,...  ...organization works across the full model development lifecycle, from...  ..., interpretability, and safety, each operating at the...  ...research areas like compute, evals, RL environments, and emerging... 
    Suggested
    Work at office
    Flexible hours
    Shift work

    anthropic

    New York, NY
    2 days ago
  • $159k - $230k

    Drive and define Model UX operational processes to provide extreme...  ..., organize, and oversee UX programs from initiation through to completion...  ...UX, Engineering and Product Management partners and stakeholders...  ...strategy, design, user research, or user centered development... 
    Suggested

    Google

    New York, NY
    6 days ago
  • $105k - $200k

    Nonprofit accelerating talent into AI safety and policy. Trained 1,200+ people in two years. The Role: Support 250+ SPAR mentors to become excellent research leads. Coach first-time mentors, handle conflict, and advise on research outputs. Who You Are: Substantial research... 
    Suggested
    Remote job
    Flexible hours

    Kairos

    New York, NY
    1 day ago
  • $180k - $240k

     ...use our profits to fund research on the most important problems in AI Safety and Alignment. We partner...  ...interventions for model safety, novel interpretability...  ...questions Experience managing complex technical projects...  ...diversified employee equity program. Compensation Salary... 
    Work at office
    Remote work
    Flexible hours

    AE Studio

    New York, NY
    4 days ago
  • To support safety evaluation and training data initiatives, the full-time Model Safety Contractor will design safety evaluations, produce safety training data, and document...  ...AI lab, safety organization, or academic safety research background (preferred) Experience with... 
    Full time
    Contract work
    For contractors
    Remote work

    Virtual Vocations Inc

    New York, NY
    6 days ago
  • $120k - $150k

     ...Join Safran Aerosystems: an international leader in aviation safety, fluid management and fuel systems. Our strength? Innovating to enhance...  ...detailsDomainResearch, design and developmentJob field / Job profilePrograms - Program manager level 3Job titleProgram ManagerEmployment... 
    Permanent employment
    Contract work
    Temporary work
    Local area
    Flexible hours

    Safran Group

    New York, NY
    6 days ago
  • $98.4k - $140.2k

     ...Category Development & Insights Manager Division: Consumer Products...  ...terms of quality, efficacy, safety, sincerity and responsibility...  ...CMI bespoke Metier and Shopper research.   Assess e-commerce retailer...  ...Paid Vacation, Vacation Buy Program, Volunteer Time, Summer... 
    Permanent employment
    Full time
    Temporary work
    Work experience placement
    Summer work
    Work at office
    Work from home
    Flexible hours
    3 days per week

    Aesop

    New York, NY
    3 days ago
  • $140k

     ...a customer-centric partner providing innovative solutions. The safety, well-being, and career growth of our team members are the benchmarks of our success. POSITION TITLE: Senior Strategic Program Manager CLASSIFICATION: Exempt Position Overview ADB is a Nationwide... 
    Work at office
    Local area

    ADB Companies, LLC

    New York, NY
    2 days ago
  • $45 - $70 per hour

    Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts...  ...Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Behavioral Health Expert, AI Safety... 
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    4 days ago
  • $50 - $70 per hour

     ...panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives you...  ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government nuclear... 
    Remote job
    Temporary work

    Braintrust

    New York, NY
    5 days ago
  •  ...Icahn School of Medicine at Mount Sinai is seeking a Clinical Research Nurse Manager to lead a growing portfolio of cellular therapy research....  ...malignant and malignant CAR‑T studies, ensuring participant safety and adherence to protocols. The ideal candidate will have 5... 

    Icahn School of Medicine at Mount Sinai

    New York, NY
    2 days ago
  • Mercor connects elite creative and technical talent with leading AI research labs. The company is headquartered in San Francisco, with...  ...D'Angelo, Larry Summers, and Jack Dorsey. They are hiring a AI Safety Practitioner for a contract role with remote work options. The... 
    Remote job
    Contract work
    Summer work

    Mercor Inc

    New York, NY
    4 days ago
  •  ...Montefiore Einstein Cancer Center Data and Safety Monitoring Plan (DSMP), and any other...  ...Minimum of 3 years of experience in clinical research. ~ CCRP/CCRC Certification preferred....  ...~ Strong working knowledge of quality management principles, tools, and risk management... 
    Work experience placement
    Work at office

    ViziRecruiter

    New York, NY
    4 days ago
  • $115.49k - $192.33k

     ...Description The Clinical Program Manager provides clinical support and administrative direction within the Tisch Cancer Center's Clinical...  ...treatment modalities, and the process of conducting clinical research. The Candidate will follow a caseload of patients in the... 
    Temporary work
    Traineeship
    Work at office
    Local area

    Mount Sinai Health System

    New York, NY
    7 days ago
  • $151.2k - $189k

    Scale's Red Team and Safety function stress-tests the most capable AI models in the world, and shapes how labs, governments...  .... We are hiring a Technical Program Manager to own day-to-day partnerships...  ...curious, comfortable with researchers, and operationally rigorous. You... 
    Full time

    Scale AI

    New York, NY
    5 days ago
  • $90k - $100k

     ...Training Program Manager Fully Remote • Curtis Bay, HOME Description Position Description Position...  ...accelerated, standardized training model used across Navy, USCG, and commercial maritime...  ..., maintain curriculum quality, ensure safety, and drive readiness across the fleet.... 
    Full time
    Remote work

    BlackSea Technologies

    New York, NY
    3 days ago
  • $84k - $105k

    ## Program Manager Clinical ResearchApplylocations: 111 East 210th Streettime type: Full timeposted...  ...**$84,000.00-$105,000.00The **Clinical Research Program Manager,** under the...  ...Montefiore Einstein Cancer Center Data and Safety Monitoring Plan (DSMP), and any other applicable... 
    Work experience placement
    Work at office
    Shift work

    Montefiore Hudson Valley Collaborative

    New York, NY
    3 days ago
  • $88.28k - $103.22k

     ...humanitarian crises, helping to restore health, safety, education, economic wellbeing, and...  ...you’ll help build and deliver. As IT Program Manager , you’ll manage the digital platforms...  ...Currently the team is working in a hybrid model with one day per week in the office (unless... 
    Full time
    Part time
    Work at office
    Remote work
    3 days per week
    1 day per week

    Remote Worker LTD.

    New York, NY
    2 days ago
  • Zetron, a Codan Company, is seeking a Program Manager to lead a statewide public safety communications program. You will coordinate Zetron teams, subcontractors, and customer stakeholders to ensure contractual obligations, service levels, and financial targets are achieved... 
    Remote job
    For subcontractor

    Zetron

    New York, NY
    5 days ago
  • SpaceXAI is seeking an experienced Safety Integrity Program Manager, Harmful Activity, to lead priorities, measures, and system health across upstream and downstream operations. You will translate policy, legal constraints, and technical requirements into practical workflows... 

    SpaceXAI

    New York, NY
    5 days ago
  • $53 - $54 per hour

     ...Technical Program Manager – AI Research-((6337) San Jose Technical Program Manager – AI Research itD is seeking a Technical Program Manager – AI Research to oversee business-critical projects in the AI Research space, facilitating review and approval processes... 
    For contractors
    3 days per week

    ITD Technology Co.

    New York, NY
    2 days ago
  •  ...product testing and in agroscience Contract Research Organization services. It is one of the...  ...0,000 analytical methods to evaluate the safety, identity, composition, authenticity,...  ...continued business relationship. Project Manager Duties Include but are not Limited to the... 
    Full time
    Contract work

    Eurofins

    New York, NY
    4 days ago
  •  ...The Clinical Program Manager is responsible for the implementation and conduct of clinical...  ...and the process of conducting clinical research. The CPM will follow a caseload of patients...  ...institutional offices and committees (i.e. Data safety monitoring, institutional review board,... 
    Full time
    Traineeship
    Local area

    Mount Sinai Hospital

    New York, NY
    5 days ago
  • Global Environment, Health & Safety Programs Manager - Ardagh Metal Packaging Role Description: The Global EHS Programs Manager supports in the development and execution of EHS strategies for the organization in actionable plans that align with the AMP EHS Vision. The role... 
    Remote work

    Ardagh Group

    New York, NY
    3 days ago
  •  ...Principal Technical Program Manager Airspace Link is a leading aviation technology company enabling the safe integration of drones into...  ...approved provider of LAANC airspace authorization and B4UFLY safety services, Airspace Link powers critical digital infrastructure... 
    Remote work

    Airspace Link

    New York, NY
    2 days ago
  • $105k - $157.49k

    DescriptionThe Research Program Director is responsible for administrative, operational and business oversight of research projects within...  ...identification and response to potential and actual risk management issues.Responsible for human resources, including recruitment... 
    Traineeship
    Local area

    Mount Sinai Health System

    New York, NY
    5 days ago
  • Nominal is seeking a Staff Research Engineer to define how we measure its agents and to build the path from evals to post-trained models for real hardware tasks. You’ll lead eval suites, benchmarks, and the post-training workflow, including RL and distillation, in live... 

    Nominal

    New York, NY
    2 days ago
  •  ...the world's most advanced hardware programs and its most ambitious startups, from...  ...them. The Role: As a Staff Research Engineer supporting agent evals & post-training, you'll define how...  ...the path from evals to post-trained models when hardware needs them. Evals come... 
    Permanent employment

    Nominal

    New York, NY
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!