Research Program Manager - Model Evals and Safety
Visa Hunt
Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. About the Role Research Program Managers at Reflection are high-leverage leaders and operators who embed directly with research and infrastructure teams to accelerate the pace of frontier model development. They are not project trackers. They are force multipliers who bring clarity to ambiguity, drive decisions when the path forward is unclear, and ensure that the work happening across multiple teams connects into a coherent whole. This is a foundational role. Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You won\'t be stepping into an established function with existing processes and tooling. You will be the person who figures out what this function needs to look like, stands it up, and makes it real. That means defining the evaluation frameworks, building the operational infrastructure for model safety, establishing the processes that connect evals to the model development lifecycle, and laying the groundwork for how Reflection interfaces with the broader safety ecosystem. This is 0-to-1 work in its purest form. You bring a first-responder mentality. When things go sideways, you don\'t wait to be asked. You jump in, assess the situation, cut through noise, align the people who need to be aligned, and drive resolution. What You\'ll Do Build the foundational infrastructure for model evals and safety at Reflection. Define the evaluation frameworks, tooling requirements, and operational processes that will underpin how we assess model capabilities, risks, and readiness for release. Stand up model safety operations as a function, including establishing the workflows, review cadences, and decision frameworks that connect safety evaluation to the model development and release lifecycle. Partner with research and engineering leads across pre-training, mid-training, and post-training to embed safety and evaluation checkpoints into the development process in a way that is rigorous without being a bottleneck. Drive the scoping and prioritization of eval science and eval infrastructure investments, working with technical leads to determine what to build in-house, what to adopt, and where to invest research effort. Establish Reflection\'s engagement with the external safety ecosystem, including third-party assessments, academic partnerships, and industry safety frameworks. Represent the company\'s safety posture to external stakeholders with credibility and clarity. Create visibility and reporting structures that give leadership a clear, honest picture of model safety status, evaluation coverage, and open risks, so they can make informed decisions at the pace the business requires. Champion a culture of blameless post-mortems and continuous learning, turning every safety-relevant finding into a concrete improvement to our systems and processes. About You 7+ years of experience in technical program management, research operations, or ML engineering, with demonstrated experience standing up new functions, teams, or programs from scratch. Familiar with the landscape of model evaluation and AI safety, including evaluation methodologies, red-teaming, alignment research, and the evolving regulatory and industry safety ecosystem. You don\'t need to be a safety researcher, but you need to understand the space well enough to make sound judgments about what matters and what to prioritize. Deep enough technically to engage with researchers and engineers on topics like model behavior, evaluation design, data pipelines, and safety-critical system architecture. You follow the technical thread and you know when something doesn\'t add up. Proven ability to build structures where none exists. You\'ve taken ambiguous mandates and turned them into functioning programs with clear ownership, measurable outcomes, and durable processes. Strong stakeholder management skills spanning deeply technical ICs, research leadership, and external partners. You build trust through competence and follow-through. Excited to build from zero to one. We are a small, fast-moving team and this role will help define how model safety and evaluation works at Reflection. Motivated by enabling researchers and engineers to build the world\'s most capable open-weight AI systems, responsibly. What We Offer: We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top-tier compensation: Salary and equity structured to recognize and retain our talent globally. Stock options: Everyone who joins and contributes to Reflection\'s success gets to share in the upside through stock options. Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance. Meals: Lunch and dinner are provided in the office daily. Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys. Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. Team building: We have regular off-sites, happy hours, and team celebrations. Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company\'s ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization. #J-18808-Ljbffr Visa Hunt
$385k
About The Role As a Product Manager for Model Behaviors, you will partner with the Alignment Finetuning... ...improvements, coordinate across Research, Product, and Safeguards teams, and accelerate... ...more helpful and safe Contribute to evals that measure alignment progress...SuggestedVisa sponsorshipFlexible hours$258k - $348k
...collaboration, join us!The Figma Research team is hiring an Director, Research - AI Evals to own how we measure... ...with automated, model-based approaches —... ...including 2+ years of management experienceDirect, hands... ...evaluation — human evaluation programs, rubric and benchmark/...SuggestedMinimum wageFull timeFor contractorsLocal areaRemote workFlexible hours- Reflection is seeking an experienced Research Program Manager to embed with research and... ...infrastructure teams, accelerating frontier model development. This 0-to-1 role... ..., builds the operational safety infrastructure, and links evals to the model lifecycle. You bring...Suggested
- ...a talented, highly motivated MPH-level research scientist with a background in intervention... ...health, and substance use. The Research Manager will be responsible for administrative... ...IRB-related activities across studies. Programs and formats project data collection tools...SuggestedTemporary workLocal area
- NYU Langone Health in Manhattan invites applications for a Program Manager, Neuro-Oncology & Oncology Research. You will oversee program operations, ensure regulatory compliance, budgeting, and liaison with leadership to drive development and productivity. You will manage...Suggested
- Mount Sinai Health System is seeking a Research Project Manager I to oversee the operational scope of a designated project or department initiatives. You will support leadership, organize conferences and educational activities, and create and monitor timelines and specifications...
- Cardiovascular Associates of America (CVAUSA) is seeking a Research Project Manager to lead complex multisite clinical research initiatives across the CVRS network. Reporting to the Director of Research, you will design plans, coordinate sites, sponsors, and vendors, and...Remote jobFor contractors
$84.58k - $122.69k
...improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and... ...: We have an exciting opportunity to join our team as a Program Manager. In this role, the successful candidate is responsible for managing...Contract workFor contractorsWork at officeRemote work- Thank you for considering a career with the Research Foundation of The City University of New York (RFCUNY)! We are thrilled that you... ...Unit:NoWe invite applications for a Research Scientist Program Manager (Part-Time, Postdoctoral Level) under the supervision of Dr....Part timeLocal areaRemote work
- Akaasa Technologies seeks a senior candidate with 10+ years of experience in Investment Banking or Fintech to lead the New Solutions and New Users (NSU) function. The role focuses on coordinating innovation initiatives, evaluating new tools, and ensuring compliant data ...Work at office
$100k - $160k
A nonprofit applied AI research organization is looking for a Technical Program Manager to drive ambitious research projects in New York. The role involves managing technical project roadmaps, facilitating team meetings, and ensuring project alignment with strategic goals...Full time$174.8k - $202k
...and defense capabilities to help promote mission success and safety for those who serve their nation. Led by our talented teams around... ...on Cubic.com.Job Details:Job Summary: Responsible for the program management, performance and completion of the multiple high technology...Full timeContract workFor subcontractorWork at office- ...OpportunityUnity Technologies is building a premier Environment, Health & Safety (EHS) team. Our mission is to create a safe working... ...to the wider business.We are now ready to add a Senior EHS Program & Regional Manager. This is a hybrid role that pairs hands-on regional...Full timeTemporary workWork at officeLocal areaRemote workWorldwide
$120k - $150k
...Join Safran Aerosystems: an international leader in aviation safety, fluid management and fuel systems. Our strength? Innovating to enhance... ...detailsDomainResearch, design and developmentJob field / Job profilePrograms - Program manager level 3Job titleProgram ManagerEmployment...Permanent employmentContract workTemporary workLocal areaFlexible hours$102k - $135k
Are you a Program Manager (non-technical) ready for a change in your career? This could be a phenomenal opportunity to explore! We are seeking... ...Business Services (ABS) in a multi‑year strategic Operating Model Transformation. Reporting to the Director of Program...Full timeTemporary workPart timeLocal area- ...University School of Nursing in New York seeks a talented MPH-level research scientist to support intervention implementation studies aimed... ...diseases, mental health, and substance use. The Research Manager will handle administrative management, data collection, IRB support...
$207k - $300k
Build both human-powered and Large Language Model (LLM)-powered automated evaluation... ...measure aspects like grounding, coherence, safety, and helpfulness.Utilize platforms and tools... ...quality, often in collaboration with research, and cross-functional teams.Create tools...$204k - $259k
Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location... ...to improve mobility and safety. The Applied Research team... ...to a Technical Lead Manager. Responsibilities Conduct... ...generous company benefits program. #J-18808-Ljbffr SupportFinity...Full time- Frontier Model Misuse Risk Evaluator is a remote red-team track for stress-testing AI systems... ...the rubric clause it violated so the safety team can patch the gap. Why this role... ...experience red-teaming AI systems, security research, or adversarial ML work for Frontier Model...Hourly payFor contractorsRemote work10 hours per week
- Own the end-to-end program roadmap for AI and innovation initiatives across Global Markets... ...with AI governance, compliance, and model risk teams on risk-based tiering and approval... ...AI governance frameworks, model risk management, and regulatory considerations Strong analytical...
- ...Research Engineer (Senior Staff+), Safeguards LabsSan Francisco, CA... ...chartered to investigate novel safety methods that protect Claude and... ...prototype new approaches to safe models, usage safeguards, and... ...models and experience designing evals.Experience with agentic environments...Work at officeVisa sponsorshipFlexible hours
$72k - $80k
...external partners is essential to advancing research, innovation, and scientific discovery.... ...to ensuring their success. These programs often involve complex partnerships with... ...Operations, the Research Center Program Manager will provide comprehensive administrative...Temporary workWork experience placementLocal area- ...strong neighborhoods that ensure enduring safety. The Research Innovation Policy team drives the... ...of the Policy Unit, the Field Research Manager is responsible for leading the design,... ...eligible for federal loan forgiveness programs and state repayment assistance programs...Work at officeFlexible hours
- ...Icahn School of Medicine at Mount Sinai is seeking a Clinical Research Nurse Manager to lead a growing portfolio of cellular therapy research.... ...malignant and malignant CAR‑T studies, ensuring participant safety and adherence to protocols. The ideal candidate will have 5...
- A leading AI research firm in New York, NY, is looking for a specialist to oversee the red-... ...adversarial evaluation pipeline for their models. The ideal candidate should possess a... ...field and have a deep understanding of LLM safety and adversarial techniques. A strong software...
- ...Alliance Group Career Page is seeking a Data Science and Engineering Manager to join the Center for Data Analytics, Innovation, and Rigor (... ...with clinical project managers to drive large-scale AI research initiatives in mental health. This is a full-time, exempt role...Full time
$88.28k - $103.22k
...IT Program ManagerThe International Rescue Committee (IRC) responds... ..., helping to restore health, safety, education, economic... ...testing, and overall Project Management in an effort to help the organization... ...team is working in a hybrid model with one day per week in the...Full timePart timeWork at officeRemote work1 day per week$70k - $75k
...offering more than 160 integrated programs in: Education & Youth... ...BIVO is part of the NYC Crisis Management System (CMS). CMS is the city... ...implement the Cure Violence Model. The Cure Violence model is a... ...helping organize Brownsville Safety Alliance resource fairs with...Full timeContract workWork at officeLocal area$130k - $150k
...innovateteam.com . Secure Information: We prioritize your data safety. We never request bank information via email or text. Instead... ...differs from this process, it’s not from Innovate. GIS Program Manager Location: Remote Apply for this Position Position: GIS Program...Full timeContract workLocal areaRemote work$147.68k - $236.28k
AI/Technology Evangelist - Program Manager (Corporate AI Team) Join Axon... ...explore society’s most critical safety and justice issues with our... ...that provides GPT‑class models, chat assistants, and secure... ...services). You don’t need to be a researcher, but you need to be a...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Program Manager - Model Evals and Safety. Be the first to apply!
- research supervisor New York, NY
- director of research New York, NY
- research project manager New York, NY
- research coordinator remote New York, NY
- clinical research manager New York, NY
- research program manager New York, NY
- research finance manager New York, NY
- clinical research manager remote New York, NY
- account manager market research New York, NY
- research coordinator New York, NY

