Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Policy Manager, Agentic Safety

Full-time

OpenAI

About the Team Our [Safety Systems]( team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments. We investigate emerging model failures, define the behavior models should exhibit instead, and develop the data, evaluations, monitoring, and safeguards needed to improve and validate that behavior. Our work connects alignment research with the practical challenges of training and deploying frontier models.

About the Role

In this role, you will shape how OpenAI understands and addresses real-world risks that emerge from model misalignment as models become more autonomous and operate over longer horizons. You will investigate how misaligned behavior emerges across extended trajectories - including when models persist toward the wrong objective, take unsafe shortcuts, lose track of instructions, exploit weaknesses in their environment, or circumvent constraints - and translate these insights into behavioral policies, evaluations, monitoring, and safeguards. This role is ideal for someone who wants to turn alignment and safety concerns into concrete, empirically grounded improvements to frontier AI systems. Your Responsibilities:
  • Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards.
  • Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior.
  • Build frameworks for understanding harmful outcomes arising from model misalignment.
  • Identify the underlying behaviors and system conditions that drive those outcomes.
  • Turn findings into policy frameworks, evaluation criteria, online measurement and safeguards.
  • Develop human data campaigns and gold sets to ground measurement and evaluation of emerging behaviors and risks.
  • Partner with research, engineering, security, and product teams to shape model and system safety, balancing difficult trade-offs between safety, utility, and business risk.
  • Inform deployment decisions, system cards, safeguards reports, and OpenAI’s broader approach to agentic safety.
  • Build monitoring approaches that detect regressions and emerging risks after deployment.
We’re seeking someone who:
  • Brings a strong background in AI agent safety, privacy, security, cybersecurity, or adjacent fields, with the adversarial mindset needed to investigate real-world harmful outcomes.
  • Has demonstrated interest in AI alignment and a strong understanding of the technical drivers of misaligned model behavior.
  • Has enough technical fluency to work directly with evaluation and training data, understand what the data is showing, and identify limitations, patterns, and opportunities for deeper investigation.
  • Is comfortable working hands-on with model data and evaluation results, including inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures.
  • Uses empirical evidence to develop and refine safety policies and safeguards.
  • Can translate complex or ambiguous alignment risks into precise behavioral expectations and measurable evaluation criteria.
  • Works effectively across research, engineering, security, product, and policy.
  • Communicates clearly about complex and uncertain technical risks.
  • Enjoys fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change.
Our relevant publications:
  • [Safety and alignment in an era of long-horizon models](
  • [Accelerating the cyber defense ecosystem that protects us all](
  • [Safety at every step](
  • [OpenAI GPT5.6 System Card](
  • [OpenAI Model Spec](
Workplace & Location This role is based in our San Francisco office. We do encourage you to apply even if you prefer a different work location as factors may change over time. We offer relocation support to new employees, and we use a hybrid model: three days in the office per week with optional work from home on Thursdays and Fridays. Our open-plan offices have height-adjustable desks, conference rooms, phone booths, well-stocked kitchens full of snacks and drinks, three in-house prepared meals daily, a private outdoor space for working in the sun or socializing, nap rooms, private bike storage, and more. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. For additional information, please see [OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement]( Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations. To notify OpenAI that you believe this job posting is non-compliant, please submit a report through [this form]( No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this [link]( [OpenAI Global Applicant Privacy Policy]( At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Model Policy Manager, Agentic Safety in San Francisco, CA vacancy
  •  ...from system-level safeguards and model training to evaluation and red...  ...maintaining our high bar for safety. We lead OpenAI's commitment...  ...red-team misuse Safety Systems manages the complete lifecycle of...  ...Within Safety Systems, the Model Policy team works to ensure that frontier... 
    Suggested
    Work at office
    Relocation package
    Shift work

    Society for AI Security

    San Francisco, CA
    11 hours ago
  •  ...background spans growth strategy, operating model redesign, and digital transformation...  ...programs to successful outcomes. As a Senior Manager, you set direction across multiple...  ...Equal Opportunity and Affirmative Action Policy StatementAccenture is an EEO and Affirmative... 
    Suggested
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    11 hours ago
  • $203.8k - $326.1k

     ...to help lead the growth and execution of Agentic Commerce within the Commercial & Money...  ...opportunities, adjacencies, and business models that can expand Visa's role in agent-enabled...  ...opportunities and support the product management team in the journey from concept to... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Flexible hours
    Shift work

    Visa

    San Francisco, CA
    4 days ago
  • $200k - $240k

     ...As a Trust and Safety Policy Manager, you will be responsible for helping develop and manage policies for our products and services. Safety is...  ...Draft new policies that help govern the responsible use of our models for emerging capabilities and use cases Conduct regular... 
    Suggested
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    anthropic

    San Francisco, CA
    4 days ago
  •  ...OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco, hybrid 3 days in the office. You will drive complex...  ...with engineers, researchers, product managers, and legal and policy teams to translate safety priorities into actionable plans,... 
    Suggested
    Work at office

    Openai

    San Francisco, CA
    1 day ago
  • $207k - $335k

    # Model Policy Manager, National SecurityOpenAISan Francisco (Hybrid)Full-time$207,000 - $335,000 / yearAI tools:GPT6Upload your resume once...  ...on deployment.* Permanent* Hybrid* Relevant experience in AI safety, policy, or risk assessment### Skills and expertiseAI safetyModel... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Relocation package

    Jobleads-US

    San Francisco, CA
    5 days ago
  •  ...Technical Program Manager, AI Safety & Safeguards Safely delivering increasingly capable AI systems...  ..., product, operations, legal, policy, and external partners. Our Technical Program...  ...and measurable outcomes. We work across model development, infrastructure, product, and... 
    Work at office
    Relocation package

    Society for AI Security

    San Francisco, CA
    11 hours ago
  •  ...Head of Model Safety About the Company Forward-thinking AI research lab Industry...  ...reporting to the CEO, involves direct line management of a team of safety researchers and...  ...the lab in public, including a strong policy-facing remit. Applicants for the Head of... 

    Confidential

    San Francisco, CA
    3 days ago
  •  ...Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You will shape the evaluation frameworks, operational infrastructure for safety, and processes linking evals to model development. You bring a first... 

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...OpenAI seeks a Research Program Manager to lead initiatives that test the safety and robustness of its models through creative experimentation and structured evaluation. You will coordinate across research and engineering teams to transform ambiguous risks into concrete... 
    Work at office
    Relocation package

    Jobleads-US

    San Francisco, CA
    5 days ago
  • $164k - $239k

     ...Policy Manager, YouTube Trust and Safety Share Policy Manager, YouTube Trust and Safety corporate_fare YouTube place San Bruno, CA, USA ; Mountain View, CA, USA X Note: By applying to this position you will have an opportunity to share your preferred working... 

    Jobleads-US

    San Bruno, CA
    1 day ago
  •  ...OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco. You will drive cross-functional product, platform, and safety initiatives across ChatGPT, API, enterprise deployments, and related environments. This role blends technical strategy... 

    Society for AI Security

    San Francisco, CA
    11 hours ago
  •  ...General Compute in San Francisco seeks a senior IC to bring up new models on our ASIC. You will own the end-to-end process from reference...  ...to ensure correctness and performance. You will build the agentic bringup loop, verify via diffs and parity checks, and optimize... 

    General Compute

    San Francisco, CA
    5 days ago
  • $116k - $166k

    Define and drive critical initiatives to accelerate Trust and Safety operations, working closely with cross-functional teams and executives...  ...or equivalent practical experience.4 years of experience in a management consulting, operations, business strategy, investment banking,... 
    Temporary work

    Google

    San Bruno, CA
    4 days ago
  •  ...Walmart Inc. is seeking a Group Director of Product Management for Agentic Advertising in San Bruno, CA. The role leads strategy and execution...  ...first principles into a multi‑year roadmap, define business models, and drive measurable outcomes across brands, partners, and... 

    Jobleads-US

    San Bruno, CA
    4 days ago
  •  ...Safety Plus Inc. is seeking a Safety Manager to drive long-term client success by providing leadership and expertise in safety program design and delivery. You will tailor safety strategies to client needs, lead reviews, and monitor performance metrics to ensure continuous... 

    Safety Plus

    San Francisco, CA
    4 days ago
  •  ...of committed researchers, engineers, policy experts, and business leaders...  ...Claude’s capabilities — reasoning, agentic behavior, knowledge, safety properties — and produce visualizations...  ...researchers and leadership use to monitor model health during training, improving... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    2 days ago
  •  ...About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact...  .... Within Safety Systems, the Model Policy team works to ensure that frontier models... 
    Full time
    Work at office
    Work from home
    Relocation package

    OpenAI

    San Francisco, CA
    5 days ago
  • $200k - $280k

     ...broad portfolio of open-weight models, backed by infrastructure...  ...workloads. As Senior Product Manager for Model APIs and Developer Experience...  ...experience for real-time and agentic voice applications. Build...  ...Equal Employment Opportunity policy,we do not discriminate on the... 
    Full time

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $143.4k - $216.9k

     ...Category Real Estate & Facility Management Job Details About...  ...workforce transformation in the agentic era? You’re in the right place...  ...decisions by building scenario models, evaluating P&L impact and calculating...  ...employer and maintains a policy of non-discrimination with... 
    Work at office
    Relocation

    100 Salesforce, Inc.

    San Francisco, CA
    4 days ago
  • $166.6k - $208.3k

     ...About the role Mercury is looking for a Model Risk Manager to help build and operate a practical,...  ...Mercury’s Model Risk Management Policy, standards, procedures, and templates....  ...management and the governance of generative AI, agentic AI, and other analytical systems... 

    Mercury

    San Francisco, CA
    1 day ago
  •  ...backed equipment facility. About the role You’ll take a new model and get it running — correctly — on our ASIC in record time....  ...top of it. The bet of this role is that bring-up should be an agentic loop, not a hand-port. You’ll build the harness of agents that... 
    Live in

    General Compute

    San Francisco, CA
    11 hours ago
  • $119.4k - $155.2k

     ...more precise commercial decisions, and the Manager - Pricing Analytics is where that work...  ..."what if" scenarios and financial modeling of pricing strategies. Reporting to the...  ...AI-partnership mindset: you engage with agentic tools and pricing agents as a critical collaborator... 

    BoF Careers

    San Francisco, CA
    11 hours ago
  •  ...Zai Lab Limited is seeking a Director, Pharmacovigilance/Safety Scientist to lead scientific safety evaluation across Oncology and NSI products, spanning development to post-marketing. You will collaborate with Safety Physicians, drive global safety strategies, and ensure... 

    Zai Lab (US) LLC

    South San Francisco, CA
    4 days ago
  •  ...the trusted #1 AI CRM in the era of the Agentic Enterprise, Salesforce is hyper-focused on...  ...growth. We are seeking an experienced Senior Manager to join the GTM Growth Strategy team and...  ...initiatives that transform our GTM model, unlock revenue, and optimize cost — catalyzing... 

    Leadout Capital

    San Francisco, CA
    3 days ago
  • $150.1k - $227k

     ...leading workforce transformation in the agentic era? You’re in the right place! Agentforce...  ...Salesforce.The ExperienceWe are looking for a Sr. Manager, Pricing Analytics & Strategy to join the...  ...opportunity employer and maintains a policy of non-discrimination with all employees... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $117.4k - $177.6k

     ...workforce transformation in the agentic era? You’re in the right place...  ...REWS Strategic Initiatives Manager will be a key member of the Strategic...  ...Technology and Global Safety & Security across all levels of...  ...opportunity employer and maintains a policy of non-discrimination with all... 
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $172.1k - $275.8k

     ...automation.We are seeking a full-time Senior Manager to lead global process improvement...  ...business pain points into scalable operating models, workflows, governance, product...  ..., workflow automation, generative AI, or agentic AI solutions.Knowledge of Lean, Six Sigma... 
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...About Vercel: Vercel is the agentic infrastructure company. We free people and agents...  ...Role: We are hiring a Strategic Finance Manager, Product (EPD) to partner with Engineering...  ...Margin Forecasting Build driver-based models linking usage, revenue, and... 
    Work from home
    Worldwide
    Flexible hours

    vercel.com

    San Francisco, CA
    11 hours ago
  • $155k - $210k

     ...About this role Your Team The Model Portfolio team within Multi-Asset Strategies & Solutions...  ...Associate to support the ongoing management and evolution of our model portfolio platform...  ...are treated in line with our [privacy policy]( BlackRock will consider for employment... 
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Flexible hours
    1 day per week

    BlackRock

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Policy Manager, Agentic Safety. Be the first to apply!