Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Policy

OpenAI

Model Policy Designer

Our Safety Systems team is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

Within Safety Systems, the Model Policy team aligns model behavior with desired human values and norms. We co-design policy with models and for models by driving rapid policy taxonomy iteration based on data and defining evaluation criteria for foundational models' ability to reason about safety.

If you have a specific expertise or speciality related to this work, please note it in your application via your resume, cover letter or application note.

Frontier AI systems are expanding what people can do across domains, creating both enormous opportunities and difficult safety questions: when should a model help, when should it refuse, and how do we make those boundaries clear enough to train, evaluate, and enforce?

In this role, you will help define how OpenAI's models should behave in high-risk or high-ambiguity contexts, such as agentic systems, multimodal systems, user safety, privacy, and other emerging risk domains.

This is an ideal role for someone who can move across unfamiliar topics, reason from first principles, and turn ambiguity into practical model behavior. You will work closely with research, engineering, product, preparedness, and operations teams to build policies that are technically grounded, measurable, and responsive to real-world risk.

In this role, you will:

  • Design and maintain model policies across safety-relevant domains, including dual-use, agentic, and emerging frontier-risk areas.
  • Translate risk and harm models into clear behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
  • Define practical boundaries between beneficial uses of AI and assistance that could materially enable harm, exploitation, misuse, or unsafe outcomes.
  • Build policy artifacts that support model training, evaluation, and deployment. Partner with safety researchers, engineers, product teams, and other stakeholders to operationalize policy into scalable model behavior and measurable safeguards.
  • Use red-teaming results, deployment data, model failures, over-refusals, under-refusals, and ambiguous edge cases to improve policy and evaluation quality over time.
  • Identify emerging capability areas where frontier AI systems could create new safety challenges or lower barriers to harm.
  • Study real-world deployments to identify where model behavior succeeds, fails, or drifts from the intended safety posture.
  • Combine longer-horizon safety research with hands-on launch and deployment work.
  • Contribute to system cards, safety reports, policy documentation, launch reviews, and external communications on OpenAI's approach to model safety and risk mitigation.
  • Design and run human data campaigns, including gold set construction, labeling guidance, calibration, adjudication, and eval coverage analysis, to ensure policies can be reliably measured and improved.

You might thrive in this role if you:

  • Have strong judgment about how advanced AI systems may affect real-world risk, especially in ambiguous, fast-moving, or high-impact areas.
  • Have experience building or applying policies, taxonomies, harm models, threat models, or risk frameworks for complex technical, social, or adversarial systems.
  • Can move across domains without needing to be the deepest subject-matter expert in every area, while knowing when to seek expert input.
  • Can turn fuzzy questions into structured policy frameworks, evaluation criteria, operational guidance, and enforceable model behavior.
  • Are comfortable using empirical evidence, including evaluations, red-teaming results, deployment observations, and model failure modes, to inform policy decisions.
  • Think in systems across policy, data, graders, classifiers, training, deployment safeguards, measurement, monitoring, and escalation workflows.
  • Have technical judgment about what model behavior can realistically be trained, measured, evaluated, and enforced at scale.
  • Work well across research, engineering, product, policy, domain experts, and operational teams.
  • Write clearly about complex tradeoffs where safety, user value, and implementation constraints all matter.
  • Take a pragmatic approach to safety, focused on reducing real-world risk while preserving legitimate, beneficial, and socially valuable uses of AI.
  • Enjoy fast-paced, collaborative research environments where priorities shift as models, evidence, and risks change.
  • Stay grounded in implementation details, empirical results, and what can actually be trained or measured.

Our relevant publications:

  • Accelerating the cyber defense ecosystem that protects us all
  • Trusted Access
  • Safety at every step
  • Safety evaluations hub
  • OpenAI GPT5.5 System Card
  • Improving Model Safety Behavior with Rule-Based Rewards
  • OpenAI Model Spec

Workplace & Location

This role is based in our San Francisco office. We do encourage you to apply even if you prefer a different work location as factors may change over time.

We offer relocation support to new employees, and we use a hybrid model: three days in the office per week with optional work from home on Thursdays and Fridays.

Our open-plan offices have height-adjustable desks, conference rooms, phone booths, well-stocked kitchens full of snacks and drinks, three in-house prepared meals daily, a private outdoor space for working in the sun or socializing, nap rooms, private bike storage, and more.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

OpenAI
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Model Policy in San Francisco, CA vacancy
  • $301.75k - $355k

     ...us at Crusoe. About This Role The Senior Director for the Model LifeCycle team will undertake a pivotal role in establishing both...  ...learning pipelines (e.g., preference optimization, policy optimization, reward modeling). Dataset, model, and experiment... 
    Policy
    Temporary work

    Crusoe Energy Systems LLC

    San Francisco, CA
    6 hours ago
  •  ...Senior Policy Researcher For Biological And Chemical Risks Our Safety Systems team is at the forefront of OpenAI's mission to build...  ...safety and fostering a culture of trust and transparency. The Model Policy team aligns model behavior with desired human values and... 
    Policy
    Work at office
    Work from home
    Relocation package

    OpenAI

    San Francisco, CA
    3 days ago
  •  ...Francisco is seeking a Member of Technical Staff specialized in Model Efficiency. In this role, you will enhance LLM inference systems...  ...a remote-friendly work model, a competitive salary, and extensive benefits including a generous vacation policy. #J-18808-Ljbffr Cohere
    Policy
    Remote work

    Cohere

    San Francisco, CA
    3 days ago
  •  ...companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $...  ...and vision insurance for employees and dependents. Flexible PTO policy including company-wide Winter Break (our offices are closed from... 
    Policy
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...interacts with the world like humans do. We're pioneering the model architectures that will make this possible. Our founding team met...  ...of rapid innovation in R&D environments. More Details In‑office policy: We’re an in‑person team based out of offices in San Francisco,... 
    Policy
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia AI, Inc.

    San Francisco, CA
    14 hours ago
  • $245k - $310k

    Product Manager, Model Behavior San Francisco, CA. About the Team The Model Behavior team is responsible for how OpenAI’s models behave...  ...Partner closely with research, engineering, product design, and policy teams to translate strategic goals into actionable product... 
    Policy
    Work at office
    Relocation package

    kozmetickesluzby.vecnakraska.sk - Jobboard

    San Francisco, CA
    3 days ago
  • $99k - $232k

     ...Requirements: Up to 80% The Opportunity As a Strategy & Business Model Reinvention Manager, you will provide strategic guidance and...  ...through the H-1B lottery, except as set forth within the following policy: For only those qualified applicants that are impacted by the... 
    Policy
    Full time
    H1b

    PwC

    San Francisco, CA
    14 hours ago
  • $71.73 - $85.73 per hour

     ...compliance with HIPAA, data governance, and organizational security policies. Participate in regular team meetings, providing updates on...  ...coordination roles Epic Clarity Certification (Clinical Data Model) Experience with ITSM tools (e.g., ServiceNow) Proven ability... 
    Policy
    Hourly pay
    Local area
    Flexible hours

    Accenture

    San Francisco, CA
    3 days ago
  • $300k - $320k

     ...role: We are seeking a Technical Program Manager to lead our AI model evaluation initiatives across multiple workstreams. This role will...  ...with our Research, Trust & Safety, Frontier Redteaming, and Policy teams, you will drive high-priority evaluation projects to build... 
    Policy
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    Anthropic

    San Francisco, CA
    1 day ago
  • $144k - $187k

     ..., and frameworks that power MSCI's quantitative risk and factor model research. The team develops the systems and environments that enable...  .... MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination... 
    Policy
    Flexible hours

    MSCI

    San Francisco, CA
    4 days ago
  • $305k

     ...is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial...  ...systems. About the Role As a Product Manager on Claude Code's model performance team, you will drive model launches end-to-end, build... 
    Policy
    Visa sponsorship

    Colorwave

    San Francisco, CA
    5 days ago
  •  ...companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $...  ...and vision insurance for employee and dependents Generous PTO policy including company‑wide Winter Break (our offices are closed from... 
    Policy
    Flexible hours

    Baseten

    San Francisco, CA
    2 days ago
  • $315k

     ...team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's production models undergo sophisticated post-training processes to enhance their capabilities... 
    Policy
    Work at office
    Visa sponsorship
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    3 days ago
  • $207k - $285k

     ...vulnerabilities, and collaborating closely with researchers to strengthen model reliability and public trust. About the Role As a Technical...  ...OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement. Background checks for applicants will be... 
    Policy
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    4 days ago
  •  ...Chopping Block, Inc. is seeking an Engineering Manager to lead the Model Library team. The role involves guiding a team through model...  ...meaningful equity and comprehensive health coverage, alongside a flexible PTO policy and parental leave. #J-18808-Ljbffr AI Chopping Block, Inc.
    Policy
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    14 hours ago
  •  ...Data Team. This role focuses on video-language data preparation, model evaluation, and requires strong skills in Python and project...  ...ensuring high-quality data. The position includes benefits like full health coverage and a flexible PTO policy. #J-18808-Ljbffr Twelve-Labs
    Policy
    Flexible hours

    Twelve-Labs

    San Francisco, CA
    1 day ago
  • $405k

     ...is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial...  ...the Claude Code team Architect eval frameworks that measure model capabilities across diverse coding tasks and scale with our research... 
    Policy
    Visa sponsorship

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  •  ...companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing quickly and recently raised our $...  ..., and vision insurance for employee and dependents Generous PTO policy including company‑wide Winter Break (our offices are closed from... 
    Policy
    Flexible hours

    Baseten

    San Francisco, CA
    8 days ago
  • $320k

     ...is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial...  ...Design and build evaluation systems that measure model capabilities across diverse coding tasks Build tooling and infrastructure... 
    Policy
    Work experience placement
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  • $230k - $385k

     ...About the Team We’re hiring software engineers to make OpenAI’s Model Performance teams more productive. These teams work on the systems...  ...OpenAI’s affirmative action and equal employment opportunity policy statement. Background checks for applicants will be administered... 
    Policy
    Full time
    Work at office
    Local area
    Relocation package
    Flexible hours

    Slope

    San Francisco, CA
    4 days ago
  • $117.73k - $138.5k

     ...statistical Treasury Risk and Pre‑provision Net Revenue (PPNR) models. Regularly reviews model monitoring reports. The models may cover...  ...by law Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct... 
    Policy
    Temporary work
    3 days per week

    Us Bank

    San Francisco, CA
    3 days ago
  • $117.73k - $138.5k

     ...statistical Treasury Risk and Pre-provision Net Revenue (PPNR) models. Regularly reviews model monitoring reports. The models may cover...  ...procedures. Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct... 
    Policy
    Temporary work
    Local area
    3 days per week

    Us Bank

    San Francisco, CA
    1 day ago
  • $300 per month

     ...infrastructure. About this role: The Staff Software Engineer for the Model LifeCycle team will play a key role in building a comprehensive...  ...learning pipelines (e.g., preference optimization, policy optimization, reward modeling). Develop and maintain agent execution... 
    Policy
    Temporary work

    Dormont Manufacturing Company

    San Francisco, CA
    4 days ago
  • $231.44k - $282.88k

     ...ISA to SoC / system simulators; from analytical to cycle-based models; from bare-metal environment to virtual machines. 5+ years involved...  ...more information on how we handle your personal information and your privacy rights: Privacy Policy Document. #J-18808-Ljbffr SiFive
    Policy
    Work experience placement

    SiFive

    Berkeley, CA
    3 days ago
  • $60 per hour

     ...companies to collect high-quality voice data that trains frontier AI models. We work with thousands of participants worldwide to capture...  ...different rates. Please review our Terms of Use and Privacy Policy for more details.**The compensation rate referenced in this posting... 
    Policy
    Worldwide

    Babel Audio

    San Francisco, CA
    6 hours ago
  •  ...clinical scenarios, and other duties as assigned. The final salary and offer components are subject to additional approvals based on UC policy. Required Qualifications Bachelor's degree in related area and / or equivalent experience / trainingMinimum 3 years' relevant... 
    Policy

    University of California , San Francisco

    San Francisco, CA
    14 hours ago
  •  ...is seeking a Software Engineer focused on machine learning performance. This role involves implementing advanced techniques for ML model inference and debugging performance issues with frameworks like PyTorch and TensorRT. The ideal candidate will have a relevant degree... 

    Baseten

    San Francisco, CA
    3 days ago
  • About the Role As a Technical Business Development (Model Labs) at fal, you will work directly with our partner companies, particularly Model Labs, focused on driving successful Model Launches, Infrastructure development, and Program Management. You’ll act as the primary... 
    Contract work
    Temporary work

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    14 hours ago
  • $301.75k - $355k

    Crusoe Energy Systems LLC is seeking a Senior Director to lead the Model LifeCycle team. This pivotal role focuses on establishing a comprehensive managed platform for application development in Machine Learning, particularly Large Language Models. Candidates should possess... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $120 per hour

     ...companies to collect high-quality voice data that trains frontier AI models. We work with thousands of participants worldwide to capture...  ..., which may carry different rates. Please review our Terms of Use and Privacy Policy for more details.* #J-18808-Ljbffr Babel Audio
    Policy
    Worldwide

    Babel Audio

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Policy. Be the first to apply!