Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Policy Manager, Agentic Safety

Society for AI Security

Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments. We investigate emerging model failures, define the behavior models should exhibit instead, and develop the data, evaluations, monitoring, and safeguards needed to... Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave safely and reliably in real-world environments. We investigate emerging model failures, define the behavior models should exhibit instead, and develop the data, evaluations, monitoring, and safeguards needed to improve and validate that behavior. Our work connects alignment research with the practical challenges of training and deploying frontier models. About the Role In this role, you will shape how OpenAI understands and addresses real-world risks that emerge from model misalignment as models become more autonomous and operate over longer horizons. You will investigate how misaligned behavior emerges across extended trajectories - including when models persist toward the wrong objective, take unsafe shortcuts, lose track of instructions, exploit weaknesses in their environment, or circumvent constraints - and translate these insights into behavioral policies, evaluations, monitoring, and safeguards. This role is ideal for someone who wants to turn alignment and safety concerns into concrete, empirically grounded improvements to frontier AI systems. This role is based in our San Francisco office. We offer relocation support to new employees, and we use a hybrid model: three days in the office per week with optional work from home on Thursdays and Fridays. Your Responsibilities Identify vulnerabilities that emerge as models interact with tools, data, and external systems, and translate them into model- and system-level safeguards. Develop threat models and empirical frameworks for understanding harmful outcomes from misaligned behavior. Build frameworks for understanding harmful outcomes arising from model misalignment. Identify the underlying behaviors and system conditions that drive those outcomes. Turn findings into policy frameworks, evaluation criteria, online measurement and safeguards. Develop human data campaigns and gold sets to ground measurement and evaluation of emerging behaviors and risks. Partner with research, engineering, security, and product teams to shape model and system safety, balancing difficult trade-offs between safety, utility, and business risk. Inform deployment decisions, system cards, safeguards reports, and OpenAI’s broader approach to agentic safety. Build monitoring approaches that detect regressions and emerging risks after deployment. We’re seeking someone who Brings a strong background in AI agent safety, privacy, security, cybersecurity, or adjacent fields, with the adversarial mindset needed to investigate real-world harmful outcomes. Has demonstrated interest in AI alignment and a strong understanding of the technical drivers of misaligned model behavior. Has enough technical fluency to work directly with evaluation and training data, understand what the data is showing, and identify limitations, patterns, and opportunities for deeper investigation. Is comfortable working hands-on with model data and evaluation results, including inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures. Uses empirical evidence to develop and refine safety policies and safeguards. Can translate complex or ambiguous alignment risks into precise behavioral expectations and measurable evaluation criteria. Works effectively across research, engineering, security, product, and policy. Communicates clearly about complex and uncertain technical risks. Enjoys fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change. Safety and alignment in an era of long-horizon models Accelerating the cyber defense ecosystem that protects us all Safety at every step OpenAI GPT5.6 System Card About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. For additional information, please see OpenAI’s Aff… . Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confi To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form . No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link . #J-18808-Ljbffr Society for AI Security

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Model Policy Manager, Agentic Safety in San Francisco, CA vacancy
  • OpenAI is seeking a Product Manager for the Model Behavior team in San Francisco. In this role, you will define strategic priorities and guide the development of AI model behavior, balancing user needs and technical innovation. Ideal candidates should have over 6 years... 
    Suggested

    kozmetickesluzby.vecnakraska.sk - Jobboard

    San Francisco, CA
    1 day ago
  •  ...background spans growth strategy, operating model redesign, and digital transformation...  ...programs to successful outcomes. As a Senior Manager, you set direction across multiple...  ...Equal Opportunity and Affirmative Action Policy StatementAccenture is an EEO and Affirmative... 
    Suggested
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    2 days ago
  • $203.8k - $326.1k

     ...to help lead the growth and execution of Agentic Commerce within the Commercial & Money...  ...opportunities, adjacencies, and business models that can expand Visa's role in agent-enabled...  ...opportunities and support the product management team in the journey from concept to... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Flexible hours
    Shift work

    Visa

    San Francisco, CA
    1 day ago
  • OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco, hybrid 3 days in the office. You will drive complex...  ...with engineers, researchers, product managers, and legal and policy teams to translate safety priorities into actionable plans,... 
    Suggested
    Work at office

    OpenAI

    San Francisco, CA
    5 hours ago
  • Discord is seeking a Product Manager in San Francisco to lead efforts in keeping users safe from abuse on the platform. You will create...  ...5+ years in product management, with a strong focus on user safety and experience in handling adversarial problems. Discord offers... 
    Suggested

    Discord

    San Francisco, CA
    1 day ago
  • Anthropic is seeking a Product Manager for the Safeguards team to own ideation, design, development and deployment of safety-focused AI features across Claude.ai, API, and cloud...  ...safety improvements. You will partner with policy, enforcement and engineering to balance risk... 

    Anthropic Limited

    San Francisco, CA
    1 day ago
  • $207k - $335k

    # Model Policy Manager, National SecurityOpenAISan Francisco (Hybrid)Full-time$207,000 - $335,000 / yearAI tools:GPT6Upload your resume once...  ...on deployment.* Permanent* Hybrid* Relevant experience in AI safety, policy, or risk assessment### Skills and expertiseAI safetyModel... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Relocation package

    We Love AI Jobs

    San Francisco, CA
    1 day ago
  •  ...engineering, product, operations, legal, policy, and external partners. Our Technical Program Managers lead complex, high-stakes initiatives that turn safety commitments into deployed systems...  ...measurable outcomes. We work across model development, infrastructure, product... 
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    5 days ago
  •  ...Moonlake Moonlake is building the frontier of interactive world models: systems that generate, simulate, and reason over 3D...  ...Technical Staff to lead reinforcement learning infrastructure and agentic model post-training. You will work closely with Qi and the research... 
    Full time

    embedding-vc

    San Francisco, CA
    5 days ago
  •  ...Head of Model Safety About the Company Forward-thinking AI research lab Industry...  ...reporting to the CEO, involves direct line management of a team of safety researchers and...  ...the lab in public, including a strong policy-facing remit. Applicants for the Head of... 

    Confidential

    San Francisco, CA
    16 hours ago
  • OpenAI seeks a Research Program Manager to lead initiatives that test the safety and robustness of its models through creative experimentation and structured evaluation. You will coordinate across research and engineering teams to transform ambiguous risks into concrete... 
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    6 hours ago
  • $250k - $300k

     ...success and expansion on our agentic CDP. This role will require you...  ...What You'll Do Lead the team. Manage a group of senior Strategy...  ...works into repeatable engagement models, pilot structures, demo...  ...accordance with our remote-first policy. We also offer meaningful equity... 
    Remote work

    Hightouch

    San Francisco, CA
    4 days ago
  • United States Digital Space LLC is seeking a Product Manager for the Safeguards team to own the ideation, design, development and deployment of Safeguards systems across cloud platforms. You will work with research and product teams to develop detections, evals, interventions... 

    Anthropic Limited

    San Francisco, CA
    1 day ago
  • Walmart Inc. is seeking a Group Director of Product Management for Agentic Advertising in San Bruno, CA. The role leads strategy and execution...  ...first principles into a multi‑year roadmap, define business models, and drive measurable outcomes across brands, partners, and... 

    Walmart Inc.

    San Bruno, CA
    1 day ago
  •  ...About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact...  .... Within Safety Systems, the Model Policy team works to ensure that frontier models... 
    Remote job
    Full time

    openai

    San Francisco, CA
    5 days ago
  •  ...funded AI company at the forefront of advancing large language models (LLMs) and autonomous AI agents. The company develops sophisticated...  ..., or post-training methodologies. Experience evaluating agentic systems, complex reasoning capabilities, or model performance... 
    Immediate start

    Aperio Talent Solutions

    San Francisco, CA
    4 days ago
  • $250k - $270k

     ...the Role The Senior Product Manager for Trust & Safety will own the strategy,...  ...someone who can evaluate ML model performance, see where AI agents...  ...-generated deepfakes, and agentic attacks—before they scale....  ...alignment on fraud tolerance, policy, and customer experience.... 
    Odd job
    Immediate start
    Flexible hours

    StartX

    San Francisco, CA
    1 day ago
  • $150.7k - $251.2k

     ...learning, generative AI, and agentic systems that learn, reason, and...  ...improve high-performance models, owning delivery through production...  ...a Forward Deployed Engineer Manager, you will serve as a forward-...  ...and recommend changes to policies and procedures. Strong judgment... 
    Full time
    Work experience placement

    EY

    San Francisco, CA
    1 day ago
  •  ...the Team At OpenAI, our User Safety & Risk Operations (USRO) team...  ...operational programs for emerging model safety risks. About the Role...  ...across teams you don’t manage. Nice to Have Experience...  ...Equal Employment Opportunity Policy Statement]( Background checks... 
    Full time

    OpenAI

    San Francisco, CA
    3 days ago
  • $119.4k - $155.2k

     ...more precise commercial decisions, and the Manager - Pricing Analytics is where that work...  ...""what if"" scenarios and financial modeling of pricing strategies. Reporting to the...  ...AI-partnership mindset: you engage with agentic tools and pricing agents as a critical collaborator... 
    Minimum wage

    Gap

    San Francisco, CA
    16 hours ago
  • $150.1k - $227k

     ...leading workforce transformation in the agentic era? You’re in the right place! Agentforce...  ...Salesforce.The ExperienceWe are looking for a Sr. Manager, Pricing Analytics & Strategy to join the...  ...opportunity employer and maintains a policy of non-discrimination with all employees... 
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $172.1k - $275.8k

     ...automation.We are seeking a full-time Senior Manager to lead global process improvement...  ...business pain points into scalable operating models, workflows, governance, product...  ..., workflow automation, generative AI, or agentic AI solutions.Knowledge of Lean, Six Sigma... 
    Full time
    Work experience placement
    Work at office
    Local area

    Visa

    San Francisco, CA
    3 days ago
  • $143.4k - $216.9k

     ...workforce transformation in the agentic era? You’re in the right place...  ...Real Estate Strategy Senior Manager, you will be the finance lead...  ...decisions by building scenario models, evaluating P&L impact and calculating...  ...employer and maintains a policy of non-discrimination with all... 
    Full time
    Work at office
    Relocation

    Salesforce

    San Francisco, CA
    2 days ago
  • $166.6k - $208.3k

    About the role:Mercury is looking for a Model Risk Manager to help build and operate a practical,...  ...improve Mercury’s Model Risk Management Policy, standards, procedures, and templates....  ...management and the governance of generative AI, agentic AI, and other analytical systems... 

    Mercury

    San Francisco, CA
    3 days ago
  • $191.1k - $320.6k

     ...workforce transformation in the agentic era? You’re in the right...  ...to help craft new commercial models, define strategies for new offerings...  ...solving, analytical and time management skills: Develop hypotheses,...  ...employer and maintains a policy of non-discrimination with all... 
    Work experience placement

    Salesforce, Inc.

    San Francisco, CA
    1 day ago
  • $260k - $350k

     ...services operate. By combining frontier agentic AI, an enterprise-grade platform, and...  ...Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible...  ...gateways, traffic routing systems, or policy-based serving infrastructure.... 
    Full time

    harvey

    San Francisco, CA
    5 days ago
  • $210k - $250k

     ..., founded in 2014, is the only complete agentic AI platform for revenue teams. Outreach...  ...packaging decisions, with evolving pricing models for AI-native products Evangelizing The...  ...+ years in strategy consulting, product management or sales strategy in B2B SaaS Ability... 
    Full time
    Work at office
    Flexible hours
    Night shift

    Outreach

    San Francisco, CA
    5 days ago
  • $192k - $278k

     ...years of experience in program management. Experience in technical...  ...with modern LLMs, multimodal models, and agentic systems. Experience with...  ...critical challenges, ensuring safety and ethics are the highest priority...  .... See also Google's EEO Policy and EEO is the Law. If you... 

    Google DeepMind

    San Francisco, CA
    1 day ago
  • $181.7k - $304.7k

     ...leading workforce transformation in the agentic era? You’re in the right place! Agentforce...  ...validate and operationalize the financial deal model during due diligence, and build and own...  ...opportunity employer and maintains a policy of non-discrimination with all employees... 
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  • $180k - $220k

    About Vercel:Vercel is the agentic infrastructure company, freeing people...  ...a Senior Strategic Sourcing Manager, Engineering, you’ll own...  ...rate and unit-cost analyses, TCO models, and pricing models that exposed...  ...our Job Applicant Privacy Policy for more information on how we... 
    Work at office
    Work from home
    Worldwide
    Monday to Friday
    Flexible hours

    Vercel

    San Francisco, CA
    7 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Policy Manager, Agentic Safety. Be the first to apply!