Research Program Manager - Model Evals and Safety
Reflection
Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all. We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond. About The Role Research Program Managers at Reflection are high‑leveraged leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won’t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0‑to‑1 work in its purest form. You bring a first‑responder mentality. When things go sideways, you don’t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You’ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre‑training, mid‑training, and post‑training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in‑house, what to adopt, and where to invest research effort. Establish Reflection’s engagement with the external safety ecosystem, including third‑party assessments, academic partnerships, and industry safety frameworks. Represent the company’s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post‑mortems and continuous learning, turning every safety‑relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red‑teamings, alignment research, and the evolving regulatory and industry safety ecosystem. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety‑critical system architecture. Proven ability to build structures where none exists. You’ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow‑through. Excited to build from zero to one. We are a small, fast‑moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world’s most capable open‑weight AI systems, responsibly. What We Offer We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent‑dense team. You will help define our future as a company, and help define the frontier of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top‑tier compensation: Salary and equity structured to recognize and retain the best talent globally. Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance. Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning. Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time. Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off‑sites and team celebrations. #J-18808-Ljbffr Reflection
$385k
About The Role As a Product Manager for Model Behaviors, you will partner with the Alignment Finetuning... ...improvements, coordinate across Research, Product, and Safeguards teams, and accelerate... ...more helpful and safe Contribute to evals that measure alignment progress...SuggestedVisa sponsorshipFlexible hours$258k - $348k
...collaboration, join us!The Figma Research team is hiring an Director, Research - AI Evals to own how we measure... ...with automated, model-based approaches —... ...including 2+ years of management experienceDirect, hands... ...evaluation — human evaluation programs, rubric and benchmark/...SuggestedMinimum wageFull timeFor contractorsLocal areaRemote workFlexible hours- ...We are seeking a hands-on Research Operations Program Manager, Systems & Analytics to strengthen the execution layer behind that work. This role sits at the intersection of research operations, analytics, tooling, and operational change: building the systems that make...Suggested
- Cardiovascular Associates of America (CVAUSA) is seeking a Research Project Manager to lead complex multisite clinical research initiatives across the CVRS network. Reporting to the Director of Research, you will design plans, coordinate sites, sponsors, and vendors, and...SuggestedRemote jobFor contractors
$93k
New York University is seeking a Research Program Manager for the ACAD study focusing on older adults of Asian ancestry. The successful candidate will coordinate research operations, engage with stakeholders, and manage data collection. This full-time role requires a U...SuggestedFull time- ...a talented, highly motivated MPH-level research scientist with a background in intervention... ...health, and substance use. The Research Manager will be responsible for administrative... ...IRB-related activities across studies. Programs and formats project data collection tools...Temporary workLocal area
- Mount Sinai Health System is seeking a Research Project Manager I to oversee the operational scope of a designated project or department initiatives. You will support leadership, organize conferences and educational activities, and create and monitor timelines and specifications...
$84.58k - $109.2k
...through medical education, scientific research, and direct patient care. At NYU Langone... ...opportunity to join our team as a Research Program Manager. The Program Manager-Research is... ...of 5+ members, including mathematical modelers, research coordinators, data analysts,...- NYU Langone Health is seeking a Research Program Manager in the Department of Population Health to oversee NIH-funded projects, manage budgets, and lead a diverse research team. You will coordinate regulatory processes, ensure compliance, and drive progress across domestic...
- Thank you for considering a career with the Research Foundation of The City University of New York (RFCUNY)! We are thrilled that you... ...Unit:NoWe invite applications for a Research Scientist Program Manager (Part-Time, Postdoctoral Level) under the supervision of Dr....Part timeLocal areaRemote work
$49.21 - $58.05 per hour
...Job Description Job Description Insights Program Manager Overview: We are the world’s largest professional network, built to help members of all backgrounds and experiences achieve more in their careers. Our vision is to create economic opportunity for every...Full timeWork from home$140k
...Senior Strategic Program Manager To be a team member at ADB Companies, or as we call it, part of the A-Team, you must be ALL IN to support... ...customer-centric partner providing innovative solutions. The safety, well-being, and career growth of our team members are the...Work at officeLocal area$100k - $160k
A nonprofit applied AI research organization is looking for a Technical Program Manager to drive ambitious research projects in New York. The role involves managing technical project roadmaps, facilitating team meetings, and ensuring project alignment with strategic goals...Full time$120k - $150k
...Join Safran Aerosystems: an international leader in aviation safety, fluid management and fuel systems. Our strength? Innovating to enhance... ...detailsDomainResearch, design and developmentJob field / Job profilePrograms - Program manager level 3Job titleProgram ManagerEmployment...Permanent employmentContract workTemporary workLocal areaFlexible hours$102k - $135k
Are you a Program Manager (non-technical) ready for a change in your career? This could be a phenomenal opportunity to explore! We are seeking... ...Business Services (ABS) in a multi‑year strategic Operating Model Transformation. Reporting to the Director of Program...Full timeTemporary workPart timeLocal area- ...OpportunityUnity Technologies is building a premier Environment, Health & Safety (EHS) team. Our mission is to create a safe working... ...to the wider business.We are now ready to add a Senior EHS Program & Regional Manager. This is a hybrid role that pairs hands-on regional...Full timeTemporary workWork at officeLocal areaRemote workWorldwide
$174.8k - $202k
...and defense capabilities to help promote mission success and safety for those who serve their nation. Led by our talented teams around... ...on Cubic.com.Job Details:Job Summary: Responsible for the program management, performance and completion of the multiple high technology...Full timeContract workFor subcontractorWork at office- ...University School of Nursing in New York seeks a talented MPH-level research scientist to support intervention implementation studies aimed... ...diseases, mental health, and substance use. The Research Manager will handle administrative management, data collection, IRB support...
- ...offending, and build the strong neighborhoods that ensure enduring safety. The Research Innovation Policy team drives the development and effective... ...Metrics, and as part of the Policy Unit, the Field Research Manager is responsible for leading the design, execution, and...Work at office
$207k - $301k
Build both human-powered and Large Language Model (LLM)-powered automated evaluation... ...measure aspects like grounding, coherence, safety, and helpfulness.Utilize platforms and tools... ...quality, often in collaboration with research, and cross-functional teams.Create tools...$204k - $259k
Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location... ...to improve mobility and safety. The Applied Research team... ...to a Technical Lead Manager. Responsibilities Conduct... ...generous company benefits program. #J-18808-Ljbffr SupportFinity...Full time- Productive Playhouse seeks AI Evaluators to support evaluating AI chatbots by interacting with models, assessing capabilities, safety, and usefulness. This is a project-based, task-based engagement with flexible hours and batch deliveries. Open to freelancers outside the...Remote jobFreelanceFlexible hours
$147.68k - $236.28k
...AI/Technology Evangelist – Program Manager (Corporate AI Team) Join Axon... ...explore society’s most critical safety and justice issues with our... ...that provides GPT‑class models, chat assistants, and secure... ...services). You don’t need to be a researcher, but you need to be a...Work at office$45 - $50 per hour
...Sago is a global leader in market research and data solutions, committed to connecting... ...matter. We are currently seeking a PROGRAM MANAGER, RESEARCH OPS for a temporary position... ...operational behaviors in real time and model the standards expected from the team....Hourly payFull timeTemporary workShift work$72k - $80k
...external partners is essential to advancing research, innovation, and scientific discovery.... ...to ensuring their success. These programs often involve complex partnerships with... ...Operations, the Research Center Program Manager will provide comprehensive administrative...Temporary workWork experience placementLocal area- ...Icahn School of Medicine at Mount Sinai is seeking a Clinical Research Nurse Manager to lead a growing portfolio of cellular therapy research.... ...malignant and malignant CAR‑T studies, ensuring participant safety and adherence to protocols. The ideal candidate will have 5...
- A leading AI research firm in New York, NY, is looking for a specialist to oversee the red-... ...adversarial evaluation pipeline for their models. The ideal candidate should possess a... ...field and have a deep understanding of LLM safety and adversarial techniques. A strong software...
- ...Alliance Group Career Page is seeking a Data Science and Engineering Manager to join the Center for Data Analytics, Innovation, and Rigor (... ...with clinical project managers to drive large-scale AI research initiatives in mental health. This is a full-time, exempt role...Full time
- ...offer our associates, please click here. Overview The Clinical Research Program Manager - Monitor, under the supervision of the Director of Quality... ...(SOPs), the Montefiore Einstein Cancer Center Data and Safety Monitoring Plan (DSMP), and any other applicable regulatory...Work experience placementWork at office
$66.5k - $77k
...to advancing community safety and racial justice. Since... ...: # Operating Programs that pilot new ideas and... ...# Conducting original research to evaluate what works... ...gun violence prevention model that aims to reduce and... ...Center is seeking a Program Manager, Community Safety....Full timeTemporary workLocal areaWork visaFlexible hoursNight shiftAfternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!
- director of research New York, NY
- associate director market research New York, NY
- research supervisor New York, NY
- director institutional research New York, NY
- qualitative research director New York, NY
- research project manager New York, NY
- research operations manager New York, NY
- research manager New York, NY
- account manager market research New York, NY
- clinical research manager remote New York, NY


