Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Policy Manager, Multimodal Safety

Society for AI Security

Our work spans diverse research and engineering initiatives—from system-level safeguards and model training to evaluation and red-teaming—all aimed at mitigating misuse, misalignment, and maintaining our high bar for safety. We lead OpenAI's commitment to developing and deploying safe Artificial General Intelligence (AGI), fostering a culture of trust, responsibility, and transparency. Our goal is to continuously learn from deployments, distribute AI’s benefits widely, and ensure that powerful tools remain aligned with human values and safety considerations. red-teaming—all ai model training to evaluation and red-team misuse Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact on society. Our work spans diverse research and engineering initiatives—from system-level safeguards and model training to evaluation and red-teaming—all aimed at mitigating misuse, misalignment, and maintaining our high bar for safety. We lead OpenAI's commitment to developing and deploying safe Artificial General Intelligence (AGI), fostering a culture of trust, responsibility, and transparency. Our goal is to continuously learn from deployments, distribute AI’s benefits widely, and ensure that powerful tools remain aligned with human values and safety considerations. Within Safety Systems, the Model Policy team works to ensure that frontier models behave safely and reliably in real-world environments by designing policies that define safe model behavior. Our relevant publications include: Safety at every step OpenAI GPT6 System Card GPT-Live ChatGPT Images 2.5 About the Role We are hiring a Model Policy Manager to focus on the safety of multimodal models. In this role, you will shape how OpenAI identifies, evaluates, and addresses risks in multimodal AI models - such as GPT-Live and ChatGPT Images - as well as multimodal capabilities in frontier AI models. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will Design and maintain model policies for audio, image, video, and omni-modal behavior. Translate theories of harm and threat models into behavioral safety policies, evaluation criteria, grading guidance, and safeguards. Identify and analyze safety regressions and failure patterns to identify gaps in existing policies and inform policy iteration. Develop policy artifacts that support model training, evaluation, and deployment, including behavior instructions, human-data campaigns, golden sets, and evaluations. Partner with AI researchers, domain experts, and product teams to operationalize policy into measurable model behavior. You might thrive in this role if you Have strong judgment about the real-world risks of advanced multimodal AI systems. Possess experience turning ambiguous safety questions into clear data-driven policies, behavioral boundaries, and measurable evaluation criteria. Treat policy as an end-to-end, measurable system by testing whether it produces the intended model behavior and diagnosing gaps across policy, data, graders, and safeguards. Leverage strong technical judgement to design policies around model behavior that can realistically be trained, measured, and supervised at scale. Demonstrate strong technical fluency and uses AI tools to accelerate policy development, evaluate model behavior, analyze failure patterns, and turn findings into actionable improvements. Are comfortable working hands-on with model data and evaluation results, including inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures. Enjoy fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change. Take a pragmatic, evidence-driven approach to reducing risk while preserving beneficial uses of AI. Have hands-on experience driving consensus and action in ambiguous spaces. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. For additional information, please see OpenAI’s Aff... #J-18808-Ljbffr

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Model Policy Manager, Multimodal Safety in San Francisco, CA vacancy
  •  ...About the Team Our [Safety Systems]( team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment...  ...culture of trust and transparency. Within Safety Systems, the Model Policy team works to ensure that increasingly capable models behave... 
    Suggested
    Full time
    Work at office
    Work from home
    Relocation package
    Shift work

    OpenAI

    San Francisco, CA
    5 days ago
  •  ...background spans growth strategy, operating model redesign, and digital transformation...  ...programs to successful outcomes. As a Senior Manager, you set direction across multiple...  ...Equal Opportunity and Affirmative Action Policy StatementAccenture is an EEO and Affirmative... 
    Suggested
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    11 hours ago
  • $200k - $240k

     ...As a Trust and Safety Policy Manager, you will be responsible for helping develop and manage policies for our products and services. Safety is...  ...Draft new policies that help govern the responsible use of our models for emerging capabilities and use cases Conduct regular... 
    Suggested
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    anthropic

    San Francisco, CA
    4 days ago
  •  ...OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco, hybrid 3 days in the office. You will drive complex...  ...with engineers, researchers, product managers, and legal and policy teams to translate safety priorities into actionable plans,... 
    Suggested
    Work at office

    Openai

    San Francisco, CA
    1 day ago
  • $207k - $335k

    # Model Policy Manager, National SecurityOpenAISan Francisco (Hybrid)Full-time$207,000 - $335,000 / yearAI tools:GPT6Upload your resume once...  ...on deployment.* Permanent* Hybrid* Relevant experience in AI safety, policy, or risk assessment### Skills and expertiseAI safetyModel... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Relocation package

    Jobleads-US

    San Francisco, CA
    5 days ago
  •  ...Technical Program Manager, AI Safety & Safeguards Safely delivering increasingly capable AI systems...  ..., product, operations, legal, policy, and external partners. Our Technical Program...  ...and measurable outcomes. We work across model development, infrastructure, product, and... 
    Work at office
    Relocation package

    Society for AI Security

    San Francisco, CA
    11 hours ago
  •  ...Head of Model Safety About the Company Forward-thinking AI research lab Industry...  ...reporting to the CEO, involves direct line management of a team of safety researchers and...  ...the lab in public, including a strong policy-facing remit. Applicants for the Head of... 

    Confidential

    San Francisco, CA
    3 days ago
  •  ...Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You will shape the evaluation frameworks, operational infrastructure for safety, and processes linking evals to model development. You bring a first... 

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...OpenAI seeks a Research Program Manager to lead initiatives that test the safety and robustness of its models through creative experimentation and structured evaluation. You will coordinate across research and engineering teams to transform ambiguous risks into concrete... 
    Work at office
    Relocation package

    Jobleads-US

    San Francisco, CA
    5 days ago
  • $164k - $239k

     ...Policy Manager, YouTube Trust and Safety Share Policy Manager, YouTube Trust and Safety corporate_fare YouTube place San Bruno, CA, USA ; Mountain View, CA, USA X Note: By applying to this position you will have an opportunity to share your preferred working... 

    Jobleads-US

    San Bruno, CA
    1 day ago
  •  ...OpenAI is seeking a Technical Program Manager for AI Safety & Safeguards in San Francisco. You will drive cross-functional product, platform, and safety initiatives across ChatGPT, API, enterprise deployments, and related environments. This role blends technical strategy... 

    Society for AI Security

    San Francisco, CA
    11 hours ago
  • $116k - $166k

    Define and drive critical initiatives to accelerate Trust and Safety operations, working closely with cross-functional teams and executives...  ...or equivalent practical experience.4 years of experience in a management consulting, operations, business strategy, investment banking,... 
    Temporary work

    Google

    San Bruno, CA
    4 days ago
  • $192.2k - $260k

     ...learning and large language models.We leverage advanced...  ...to meet robustness, safety, and performance needs...  ...one: computer vision, multimodal models, imitation...  ...local laws and Company policies. Criminal history may...  ...judgment, effectively manage stress and work safely... 
    Local area
    Worldwide
    Flexible hours

    Amazon

    San Francisco, CA
    2 days ago
  •  ...Safety Plus Inc. is seeking a Safety Manager to drive long-term client success by providing leadership and expertise in safety program design and delivery. You will tailor safety strategies to client needs, lead reviews, and monitor performance metrics to ensure continuous... 

    Safety Plus

    San Francisco, CA
    4 days ago
  • $300k - $333k

     ...experience in product management or a related technical...  ...experience in AI security, model defense, anti-...  ...Top 10), and external safety coalitions. Proven...  ...achieve reasoning and multimodal capabilities, safeguarding...  ...DeepMind. Establish policies and runtime guardrails... 

    DeepMind Technologies Limited

    San Francisco, CA
    11 hours ago
  •  ...committed researchers, engineers, policy experts, and business leaders...  ...agentic behavior, knowledge, safety properties — and produce...  ...and leadership use to monitor model health during training,...  ...Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    2 days ago
  • $245k - $285k

     ...Policy Program Manager, Safeguards Regulatory San Francisco, CA | New York...  ...meet our obligations under AI safety laws and regulations around...  ...understanding of how our models and products are built,...  ...Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI &... 
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact...  .... Within Safety Systems, the Model Policy team works to ensure that frontier models... 
    Full time
    Work at office
    Work from home
    Relocation package

    OpenAI

    San Francisco, CA
    5 days ago
  • $200k - $280k

     ...broad portfolio of open-weight models, backed by infrastructure...  ...workloads. As Senior Product Manager for Model APIs and Developer...  ...and roadmap across chat and multimodal APIs, ecosystem compatibility...  ...Equal Employment Opportunity policy,we do not discriminate on the... 
    Full time

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $265k - $295k

     ...researchers, engineers, policy experts, and business...  ...’s Safeguards (Trust & Safety) work, with a focus on...  ...Effectively plan for and manage crisis communications and...  ...work including new model launches, product features...  ...Interpretability, Multimodal Neurons, Scaling Laws,... 
    For contractors
    Work at office
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    1 day ago
  •  ...backed equipment facility. About the role You’ll take a new model and get it running — correctly — on our ASIC in record time....  ...-to-end. Take a new architecture — a frontier LLM, an MoE, a multimodal model — from reference weights to first correct tokens running... 
    Live in

    General Compute

    San Francisco, CA
    11 hours ago
  •  ...Zai Lab Limited is seeking a Director, Pharmacovigilance/Safety Scientist to lead scientific safety evaluation across Oncology and NSI products, spanning development to post-marketing. You will collaborate with Safety Physicians, drive global safety strategies, and ensure... 

    Zai Lab (US) LLC

    South San Francisco, CA
    4 days ago
  • $365k

     ...researchers, engineers, policy experts, and business...  ...works across the full model development lifecycle,...  ...interpretability, and safety, each operating at the...  ...As a Technical Program Manager for Research, you'll define...  ...Based Interpretability, Multimodal Neurons, Scaling Laws,... 
    For contractors
    Work at office
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work

    Anthropic Limited

    San Francisco, CA
    1 day ago
  •  ...enterprise engagements and enhance vision-language models. The role combines project ownership with...  ...solutions. Ideal candidates have hands-on experience in multimodal AI, strong communication skills, and the ability to manage complex projects. Competitive salary and... 

    Liquid AI

    San Francisco, CA
    11 hours ago
  • $250k - $300k

     ...Software Engineer For The Ai Model Lifecycle TeamCrusoe is on a...  ...in building a comprehensive managed platform for the entire application...  ...g., preference optimization, policy optimization, reward modeling...  ...AI (Large Language Models, Multimodal).Hands-on experience training... 
    Temporary work

    G2 Venture Partners

    San Francisco, CA
    2 days ago
  • $245k - $285k

     ...Policy Program Manager, Safeguards Regulatory San Francisco, CA | New York...  ...meet our obligations under AI safety laws and regulations around...  ...understanding of how our models and products are built,...  ...Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI &... 
    For contractors
    Work at office
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    2 days ago
  • $245k - $285k

     ...Policy Design Manager, Integrity and Authenticity San Francisco, CA | New...  ...as AI capabilities advance. Safety is core to our mission. You...  ...evaluations that measure the model's capability to support social...  ...Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI &... 
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    2 days ago
  • $265k - $295k

     ...researchers, engineers, policy experts, and business...  ...’s Safeguards (Trust & Safety) work, with a focus on...  ...Effectively plan for and manage crisis communications and...  ...work including new model launches, product features...  ...Interpretability, Multimodal Neurons, Scaling Laws,... 
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $155k - $210k

     ...About this role Your Team The Model Portfolio team within Multi-Asset Strategies & Solutions...  ...Associate to support the ongoing management and evolution of our model portfolio platform...  ...are treated in line with our [privacy policy]( BlackRock will consider for employment... 
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Flexible hours
    1 day per week

    BlackRock

    San Francisco, CA
    1 day ago
  •  ...researchers, engineers, policy experts, and business...  ...and go-to-market model. You will be a member...  ...scaled a sales or account management organization,...  ...Based Interpretability, Multimodal Neurons, Scaling Laws,...  ...Concrete Problems in AI Safety, and Learning from Human... 
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Policy Manager, Multimodal Safety. Be the first to apply!