Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Program Manager - Model Evals and Safety

Reflection

Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all. We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. About The Role Research Program Managers at Reflection are high‑leveraged leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won’t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0‑to‑1 work in its purest form. You bring a first‑responder mentality. When things go sideways, you don’t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You’ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre‑training, mid‑training, and post‑training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in‑house, what to adopt, and where to invest research effort. Establish Reflection’s engagement with the external safety ecosystem, including third‑party assessments, academic partnerships, and industry safety frameworks. Represent the company’s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post‑mortems and continuous learning, turning every safety‑relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red‑teamings, alignment research, and the evolving regulatory and industry safety ecosystem. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety‑critical system architecture. Proven ability to build structures where none exists. You’ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow‑through. Excited to build from zero to one. We are a small, fast‑moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world’s most capable open‑weight AI systems, responsibly. What We Offer We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent‑dense team. You will help define our future as a company, and help define the frontier of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top‑tier compensation: Salary and equity structured to recognize and retain the best talent globally. Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance. Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning. Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time. Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off‑sites and team celebrations. #J-18808-Ljbffr Reflection

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Research Program Manager - Model Evals and Safety in New York, NY vacancy
  • $385k

    About The Role As a Product Manager for Model Behaviors, you will partner with the Alignment Finetuning...  ...improvements, coordinate across Research, Product, and Safeguards teams, and accelerate...  ...more helpful and safe Contribute to evals that measure alignment progress... 
    Suggested
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    1 day ago
  • $258k - $348k

     ...collaboration, join us!The Figma Research team is hiring an Director, Research - AI Evals to own how we measure...  ...with automated, model-based approaches —...  ...including 2+ years of management experienceDirect, hands...  ...evaluation — human evaluation programs, rubric and benchmark/... 
    Suggested
    Minimum wage
    Full time
    For contractors
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    4 days ago
  •  ...We are seeking a hands-on Research Operations Program Manager, Systems & Analytics to strengthen the execution layer behind that work. This role sits at the intersection of research operations, analytics, tooling, and operational change: building the systems that make... 
    Suggested

    PROLIM Corporation

    New York, NY
    2 days ago
  • $93k

    New York University is seeking a Research Program Manager for the ACAD study focusing on older adults of Asian ancestry. The successful candidate will coordinate research operations, engage with stakeholders, and manage data collection. This full-time role requires a U... 
    Suggested
    Full time

    New York University

    New York, NY
    2 days ago
  • Cardiovascular Associates of America (CVAUSA) is seeking a Research Project Manager to lead complex multisite clinical research initiatives across the CVRS network. Reporting to the Director of Research, you will design plans, coordinate sites, sponsors, and vendors, and... 
    Suggested
    Remote job
    For contractors

    Cardiovascular-Associates-of-America

    New York, NY
    4 days ago
  • $84.58k - $109.2k

     ...through medical education, scientific research, and direct patient care. At NYU Langone...  ...opportunity to join our team as a Research Program Manager. The Program Manager-Research is...  ...of 5+ members, including mathematical modelers, research coordinators, data analysts,... 

    NYU Langone Health

    New York, NY
    2 days ago
  •  ...a talented, highly motivated MPH-level research scientist with a background in intervention...  ...health, and substance use. The Research Manager will be responsible for administrative...  ...IRB-related activities across studies. Programs and formats project data collection tools... 
    Temporary work
    Local area

    Columbia University Irving Medical Center

    New York, NY
    2 days ago
  • Mount Sinai Health System is seeking a Research Project Manager I to oversee the operational scope of a designated project or department initiatives. You will support leadership, organize conferences and educational activities, and create and monitor timelines and specifications... 

    Mount Sinai Medical Center

    New York, NY
    3 days ago
  • NYU Langone Health is seeking a Research Program Manager in the Department of Population Health to oversee NIH-funded projects, manage budgets, and lead a diverse research team. You will coordinate regulatory processes, ensure compliance, and drive progress across domestic... 

    NYU Langone Health

    New York, NY
    2 days ago
  • Thank you for considering a career with the Research Foundation of The City University of New York (RFCUNY)! We are thrilled that you...  ...Unit:NoWe invite applications for a Research Scientist Program Manager (Part-Time, Postdoctoral Level) under the supervision of Dr.... 
    Part time
    Local area
    Remote work

    Research Foundation Cuny

    New York, NY
    2 days ago
  • $49.21 - $58.05 per hour

     ...Job Description Job Description Insights Program Manager Overview: We are the world’s largest professional network, built to help members of all backgrounds and experiences achieve more in their careers. Our vision is to create economic opportunity for every... 
    Full time
    Work from home

    Cypress HCM

    New York, NY
    more than 2 months ago
  • $140k

     ...Senior Strategic Program Manager To be a team member at ADB Companies, or as we call it, part of the A-Team, you must be ALL IN to support...  ...customer-centric partner providing innovative solutions. The safety, well-being, and career growth of our team members are the... 
    Work at office
    Local area

    ADB Companies

    New York, NY
    3 days ago
  • $100k - $160k

    A nonprofit applied AI research organization is looking for a Technical Program Manager to drive ambitious research projects in New York. The role involves managing technical project roadmaps, facilitating team meetings, and ensuring project alignment with strategic goals... 
    Full time

    Basis Research Institute

    New York, NY
    4 days ago
  •  ...OpportunityUnity Technologies is building a premier Environment, Health & Safety (EHS) team. Our mission is to create a safe working...  ...to the wider business.We are now ready to add a Senior EHS Program & Regional Manager. This is a hybrid role that pairs hands-on regional... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide

    Unity Technologies

    New York, NY
    1 day ago
  • $102k - $135k

    Are you a Program Manager (non-technical) ready for a change in your career? This could be a phenomenal opportunity to explore! We are seeking...  ...Business Services (ABS) in a multi‑year strategic Operating Model Transformation. Reporting to the Director of Program... 
    Full time
    Temporary work
    Part time
    Local area

    Aon Corporation

    New York, NY
    1 day ago
  • $120k - $150k

     ...Join Safran Aerosystems: an international leader in aviation safety, fluid management and fuel systems. Our strength? Innovating to enhance...  ...detailsDomainResearch, design and developmentJob field / Job profilePrograms - Program manager level 3Job titleProgram ManagerEmployment... 
    Permanent employment
    Contract work
    Temporary work
    Local area
    Flexible hours

    Safran Group

    New York, NY
    1 day ago
  • $174.8k - $202k

     ...and defense capabilities to help promote mission success and safety for those who serve their nation. Led by our talented teams around...  ...on Cubic.com.Job Details:Job Summary: Responsible for the program management, performance and completion of the multiple high technology... 
    Full time
    Contract work
    For subcontractor
    Work at office

    Cubic Corporation

    New York, NY
    2 days ago
  •  ...University School of Nursing in New York seeks a talented MPH-level research scientist to support intervention implementation studies aimed...  ...diseases, mental health, and substance use. The Research Manager will handle administrative management, data collection, IRB support... 

    Columbia University Irving Medical Center

    New York, NY
    2 days ago
  •  ...offending, and build the strong neighborhoods that ensure enduring safety. The Research Innovation Policy team drives the development and effective...  ...Metrics, and as part of the Policy Unit, the Field Research Manager is responsible for leading the design, execution, and... 
    Work at office

    City of New York

    New York, NY
    3 days ago
  • $207k - $301k

    Build both human-powered and Large Language Model (LLM)-powered automated evaluation...  ...measure aspects like grounding, coherence, safety, and helpfulness.Utilize platforms and tools...  ...quality, often in collaboration with research, and cross-functional teams.Create tools... 

    Google

    New York, NY
    1 day ago
  • $204k - $259k

    Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location...  ...to improve mobility and safety. The Applied Research team...  ...to a Technical Lead Manager. Responsibilities Conduct...  ...generous company benefits program. #J-18808-Ljbffr SupportFinity... 
    Full time

    SupportFinity™

    New York, NY
    2 days ago
  • Productive Playhouse seeks AI Evaluators to support evaluating AI chatbots by interacting with models, assessing capabilities, safety, and usefulness. This is a project-based, task-based engagement with flexible hours and batch deliveries. Open to freelancers outside the... 
    Remote job
    Freelance
    Flexible hours

    Triwill Group

    New York, NY
    4 days ago
  • $147.68k - $236.28k

     ...AI/Technology Evangelist – Program Manager (Corporate AI Team) Join Axon...  ...explore society’s most critical safety and justice issues with our...  ...that provides GPT‑class models, chat assistants, and secure...  ...services). You don’t need to be a researcher, but you need to be a... 
    Work at office

    National Society for Black Engineers

    New York, NY
    5 days ago
  • $45 - $50 per hour

     ...Sago is a global leader in market research and data solutions, committed to connecting...  ...matter. We are currently seeking a PROGRAM MANAGER, RESEARCH OPS for a temporary position...  ...operational behaviors in real time and model the standards expected from the team.... 
    Hourly pay
    Full time
    Temporary work
    Shift work

    Sago

    New York, NY
    14 days ago
  • $72k - $80k

     ...external partners is essential to advancing research, innovation, and scientific discovery....  ...to ensuring their success. These programs often involve complex partnerships with...  ...Operations, the Research Center Program Manager will provide comprehensive administrative... 
    Temporary work
    Work experience placement
    Local area

    Columbia University

    New York, NY
    5 days ago
  •  ...Icahn School of Medicine at Mount Sinai is seeking a Clinical Research Nurse Manager to lead a growing portfolio of cellular therapy research....  ...malignant and malignant CAR‑T studies, ensuring participant safety and adherence to protocols. The ideal candidate will have 5... 

    Icahn School of Medicine at Mount Sinai

    New York, NY
    2 days ago
  • A leading AI research firm in New York, NY, is looking for a specialist to oversee the red-...  ...adversarial evaluation pipeline for their models. The ideal candidate should possess a...  ...field and have a deep understanding of LLM safety and adversarial techniques. A strong software... 

    Reflection AI

    New York, NY
    2 days ago
  •  ...Alliance Group Career Page is seeking a Data Science and Engineering Manager to join the Center for Data Analytics, Innovation, and Rigor (...  ...with clinical project managers to drive large-scale AI research initiatives in mental health. This is a full-time, exempt role... 
    Full time

    Stone Alliance Group Career Page

    New York, NY
    3 days ago
  • $84k - $105k

    ## Program Manager Clinical ResearchApplylocations: 111 East 210th Streettime type: Full timeposted...  ...**$84,000.00-$105,000.00The **Clinical Research Program Manager,** under the...  ...Montefiore Einstein Cancer Center Data and Safety Monitoring Plan (DSMP), and any other applicable... 
    Work experience placement
    Work at office
    Shift work

    Montefiore Orthopedics

    New York, NY
    1 day ago
  • $66.5k - $77k

     ...to advancing community safety and racial justice. Since...  ...: # Operating Programs that pilot new ideas and...  ...# Conducting original research to evaluate what works...  ...gun violence prevention model that aims to reduce and...  ...Center is seeking a Program Manager, Community Safety.... 
    Full time
    Temporary work
    Local area
    Work visa
    Flexible hours
    Night shift
    Afternoon shift

    Center for Justice Innovation

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!