Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Program Officer, AI Model Safety

$220k - $300k

OpenAI Foundation

About OpenAI Foundation

AI is already changing how people work, learn, and access care. It has the potential to unlock extraordinary benefits—faster medical breakthroughs, accelerated scientific discovery, more personalized services in healthcare and education, new tools for creativity and invention, higher productivity and economic growth, improved public services like transportation systems, and so much more.

But building powerful systems to benefit humanity is only a part of the work of our mission. Advanced AI models will also present new challenges that are already surfacing, and we need to be prepared to identify these challenges and develop solutions to address them.

These are the two dimensions of what we’re building the Foundation to do. We aim to enable the use of AI to find solutions to humanity’s hardest problems, transform what people are capable of, and deliver real benefits in people’s lives—while working hard with partners to be ready for new challenges, and to help make society resilient, as AI advances.

This work is just beginning. Over the next year, as we quickly ramp up, the Foundation expects to invest at least $1 billion across life sciences and curing diseases, jobs and economic impact, AI resilience, and community programs. This includes early investments toward our previously announced $25 billion commitment to curing diseases and AI resilience.

About the team

AI Resilience helps society absorb, adapt to, and benefit from increasingly capable AI systems, with work across biosecurity, model safety, cybersecurity, children and youth, and the future of the economy. The team is small and fast-moving with many workstreams, candidates, advisors, grantees, board touchpoints, and special projects in flight.

Within AI Resilience, the AI Model Safety program works to make AI systems safer by default. By AI model safety we mean the technical work of understanding and improving how models behave (testing and evaluating them independently, red-teaming them, researching how to interpret, align, and control them) so that increasingly capable systems can be trusted with increasingly consequential tasks. The program supports this through funding independent testing and evaluations, new and stronger industry standards, and foundational research that helps avoid safety issues or detect and address them early.

About the role

We are looking for a founding grantmaker for the Foundation's AI Model Safety program: someone with deep technical fluency in how frontier models are evaluated, audited, and made safer, who can turn that into a grant portfolio and a stronger field.

You will help with the program's grantmaking end to end (investigating opportunities across independent evaluations, standards, and foundational safety research) and do the proactive work, such as identifying the organizations that should exist, finding the people to build them, and helping the field scale as fast as the models do. You will develop the program's strategy together with the rest of AI Resilience, and work closely with the AI Resources team, whose AI resources your grantees will increasingly leverage.

This is an early, zero-to-one role with significant independence. You would report to Lennart Heim, Director of AI Resources, for the moment. We are open to mid-career and senior experience levels.

In this role, you will

  • Run the program's grantmaking across its domains (independent testing and evaluations, industry standards, foundational safety research, AI control, and other new ideas) from sourcing through investigation to getting resources into grantees' hands.

  • Run grant investigations and make grant recommendations to the board.

  • Proactively identify the most important projects and organizations that need to exist, and make them happen: scope priority projects, find or develop the right founders, and actively build new initiatives, seeding them if required.

  • Work with the AI Resources team to route AI resources to safety grantees and help them absorb it productively.

  • Develop the program's strategy with the team lead: what we should fund, what others in the ecosystem are doing, and where the gaps are.

  • Build and maintain relationships across the safety ecosystem: independent safety organizations, AI safety institutes, academic groups, other funders (philanthropic and VC alike), and AI companies' safety teams.

You might thrive in this role if you

  • Have at least 3 years of experience in AI safety, ideally including hands-on research in model safety or evaluations, whether in a research role, on a safety or evals team, in grantmaking, or helping start an organization.

  • Have deep, current fluency in AI model safety: evaluations, red-teaming, auditing, interpretability, control, and alignment research.

  • Follow frontier AI capabilities and risks closely enough to have independent judgment about them, with views on the risks that matter most and on what each part of the ecosystem should do.

  • Have a view on where AI is going, which risks it brings, and what to do about them: your own takes on how capabilities will develop, and what that means for the safety work that will be needed.

  • Excel at owning ambitious, loosely scoped projects: you find the right people, convince them to start new work, and support their success.

  • Have a relentless prioritization mindset: you evaluate opportunities on impact, tractability, and neglectedness, and act on the ranking.

  • Write and communicate: compelling, transparent documents that explain your reasoning and appropriately highlight risks, uncertainties, and downsides internally.

  • Are deeply mission-aligned and excited to help ensure AGI benefits all of humanity.

It would be great if you also have

  • Grantmaking, VC, or philanthropic experience, especially seeding organizations or sub-fields.

  • A research track record in evaluations, interpretability, control, or adjacent technical safety areas.

  • Existing relationships across safety organizations, AI safety institutes, and AI company safety teams.

Compensation

The annual base salary range for this role is $220,000 to $300,000 USD.

This range reflects our good-faith estimate of the base salary we reasonably expect to pay for this position upon hire. Actual base salary will be determined based on job-related factors, including the candidate’s relevant experience, skills, expertise, the scope of the role, and work location, as applicable.

This salary range does not include benefits or any other compensation for which the role may be eligible.

Equal Opportunity

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Program Officer, AI Model Safety in San Francisco, CA vacancy
  • Foundation seeks a founding grantmaker for its AI Model Safety program, combining deep technical fluency in frontier model evaluation and a drive to translate safety research into funded initiatives. The role involves sourcing, evaluating, and distributing resources to... 
    Suggested

    Data

    San Francisco, CA
    12 hours ago
  •  ...build on. We build open models that let anyone control...  ...shape the future of AI. Our mission: make intelligence...  ...the Role Research Program Managers at Reflection...  ...model evals and safety from the ground up, and...  ...dinner are provided in the office daily. Life & family... 
    Suggested
    Work at office
    Visa sponsorship

    Sierra Ventures

    San Francisco, CA
    4 days ago
  • $220k - $300k

     ...AI is already changing how people work, learn, and...  ...mission. Advanced AI models will also present new challenges...  ..., and community programs. This includes early...  ...across biosecurity, model safety, cybersecurity,...  ...least two founding Program Officers for AI Resources: generalists... 
    Suggested

    OpenAI Foundation

    San Francisco, CA
    1 day ago
  •  ...OpenAI Foundation in San Francisco, CA, is hiring two founding Program Officers for AI Resources. You will report to Lennart Heim, Director of AI...  ...AI resilience and scaling resources across biosecurity, model safety, cybersecurity, and collaboration with OpenAI PBC, aiming... 
    Suggested

    Jobleads-US

    San Francisco, CA
    12 hours ago
  •  ...for the world's most dynamic AI companies, like Cursor, Notion...  ...frontier of AI to bring cutting-edge models into production. We're growing...  ...to hire our first Technical Program Manager. This is a zero-to-one...  ...wide Winter Break (our offices are closed from Christmas Eve... 
    Suggested
    Flexible hours

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $220k - $300k

     ...operates with a mission to unlock AI’s potential to solve humanity’...  ...AI resilience, and community programs. This commitment includes...  ...About this Role The Program Officer, Catalytic Deployment role is...  ...operates under a hybrid work model requiring three days per week... 
    Work at office
    Worldwide
    3 days per week

    ImpactAlpha Inc.

    San Francisco, CA
    1 day ago
  •  ...Reflection is building model evals and safety from the ground up, and this RPM will be at the center of that effort. You will shape the evaluation frameworks, operational infrastructure for safety, and processes linking evals to model development. You bring a first... 

    Jobleads-US

    San Francisco, CA
    4 days ago
  • $136.44k - $265.11k

     ...are rebuilding biotech for the AI era.When a breakthrough is...  ...structured data, and run AI agents and models directly in their workflows....  ...around collaborating in the office in a fast-paced environment....  ...enjoy a comprehensive benefits program including equity, health,... 
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    1 day ago
  • $266k - $335k

     ...Model Policy Manager, Multimodal Safety | OpenAI Careers Model Policy Manager, Multimodal Safety Model...  ...learn from deployments, distribute AI’s benefits widely, and ensure that powerful...  ...hybrid work model of 3 days in the office per week and offer relocation... 
    Work at office
    Local area
    Relocation package
    Flexible hours
    Shift work

    OpenAI

    San Francisco, CA
    1 day ago
  • $246.8k - $333.9k

    In this role, you will lead the AWS account team for a frontier AI model lab and one of Amazon's largest strategic technology...  ...+ internal AWS teams spanning infrastructure services, partner programs, commercial operations, corporate development, and legal- Surface... 
    Contract work
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    3 days ago
  •  ...headquarters is in San Francisco and has offices in Los Angeles, New York, Atlanta, and Washington...  ...:This position reports to the Program Manager, Early Care and Education Program...  ...scoping of repairs, space planning, health and safety, regulatory compliance, and business... 
    Casual work
    Work at office
    Local area
    Remote work
    Afternoon shift
    2 days per week

    The Low Income Investment Fund

    San Francisco, CA
    3 days ago
  • $239k - $328k

     ...Research Program Manager – Adversarial Model Research Human Data - San Francisco About...  ...risks in advanced AI systems by designing evaluations...  ...initiatives that test the safety and robustness of OpenAI’s...  ...work model of 3 days in the office per week and offer relocation... 
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $201k - $261k

     ...power MSCI's quantitative risk and factor model research. The team develops the systems and...  ...research infrastructure that integrates AI to accelerate model development, validation...  ...for our clients. ~ Global Orientation program to kickstart your journey, followed by access... 
    Flexible hours

    MSCI Inc

    San Francisco, CA
    1 day ago
  • $266k

     ...Software Engineer, Model Runtime Hardware - San...  ...organization develops AI-native silicon and system...  ...Have strong systems programming experience in C++, Rust...  ...that must be created with safety and human needs at its...  ...paid coordinated company office closures throughout the... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI, Inc.

    San Francisco, CA
    1 day ago
  • $220k - $300k

     ...About OpenAI Foundation AI is already changing how people work...  ...of our mission. Advanced AI models will also present new challenges...  ...AI resilience, and community programs. This includes early...  ...About the role The Program Officer is a key role on the Catalytic... 
    Work at office

    OpenAI Foundation

    San Francisco, CA
    1 day ago
  • $220k - $330k

     ...AI is already changing how people work, learn, and access care...  ...work of our mission. Advanced AI models will also present new...  ...AI resilience, and community programs. This includes early investments...  ...We are looking for a Program Officer, High-Burden Diseases to help... 
    Work at office
    Flexible hours

    OpenAI Foundation

    San Francisco, CA
    1 day ago
  •  ...Head of Model Safety About the Company Forward-thinking AI research lab Industry Research Type Privately...  ...forefront of the lab's safety program, which has scaled significantly,...  ...Manager Title Chief Executive Officer (CEO) Functions ~ Engineering... 

    Confidential

    San Francisco, CA
    4 days ago
  • $85k - $95k

     ...actively seeking to hire an experienced Program Officer for an immediate opening. Job Title...  ...improvements, renovations, health and safety, licensing, and business planning. Help...  ...this job, you agree to receive calls, AI-generated calls, text messages, or emails... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Worldwide

    Innova Solutions

    San Francisco, CA
    1 day ago
  • $50 - $70 per hour

     ...panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives...  ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government nuclear... 
    Contract work
    Temporary work
    Remote work

    Braintrust

    San Francisco, CA
    20 days ago
  • $90 per hour

     ...panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives...  ...export control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government nuclear... 
    Contract work

    SuperAnnotate

    San Francisco, CA
    17 days ago
  • $100 per hour

     ...Pay: up to $100/hour ## Description SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify... 
    Permanent employment
    Full time

    SuperAnnotate

    San Francisco, CA
    17 days ago
  • $231k - $340k

     ...services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep...  ...As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design...  ...production services. ~ Strong programming skills in Go, Java, Python, Rust, or C++.... 

    Harvey

    San Francisco, CA
    1 day ago
  • $199.93k - $219.97k

     ...Anthony's is the most comprehensive safety net service center in San...  ...in need. The Chief People Officer (CPO) builds and stewards the...  ...employee assistance, and retirement programs, evaluated on employee value,...  ...from a Chief-dependent model to a team-led operating model,... 
    Local area
    Monday to Friday
    Shift work

    St Anthony Foundation

    San Francisco, CA
    2 days ago
  • $119.6k - $186.85k

     ...highly motivated and adaptable Aviation Safety, Compliance & Operational Readiness Consultant...  ...airport development and activation programs.This role is ideal for a self-starter with...  ...to split their work week between Jacobs offices/projects and remote locations enabling them... 
    Full time
    For contractors
    Remote work

    Jacobs

    San Francisco, CA
    2 days ago
  • $128.2k - $200k

     ...StatesCapabilities: ConstructionOffice Setup: Office/OnsiteSalary: $128,200.00 - $200,000.00...  ...are changing our world.  As a Project Safety Officer you’ll join our collaborative team...  ..., requirements and training for the Program during construction.Reviews the CM Consultant... 
    Full time
    For contractors
    Work at office
    Local area

    Jacobs

    San Francisco, CA
    3 days ago
  •  ...Baseten is hiring a Technical Program Manager to build from the ground up the planning, execution, and governance of our Model Performance programs in San Francisco. You will shape how ambitious initiatives become structured, tracked, and delivered, enabling rapid R&D... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $192.2k - $260k

     ...systems that combine innovative AI, sophisticated control systems...  ...learning and large language models.We leverage advanced robotics,...  ...optimize them to meet robustness, safety, and performance needs. You...  ...experience- Experience programming in Java, C++, Python or related... 
    Local area
    Worldwide
    Flexible hours

    Amazon

    San Francisco, CA
    3 days ago
  • $220k - $320k

     ...trains and hosts specialized language models for companies that need frontier-quality AI at a fraction of the cost. The...  ...we do. Most of us are in the office 4 days a week in SF; hybrid works...  ..., inference optimization, or GPU programming Strong proficiency in Python and... 
    Work at office

    Inference

    San Francisco, CA
    1 day ago
  •  ...Chief Program Officer About the Company Globally-recognized organization dedicated to protecting the night sky & reducing light pollution Industry Non-Profit Organization Management Type Non Profit Founded 1988 Employees 1-10 Specialties... 
    Remote work
    Shift work
    Night shift

    Confidential

    San Francisco, CA
    4 days ago
  •  ...BSA/AML transaction monitoring models/rules and watchlist screening...  ...identify and mitigate riskUse AI tools fluently and stay current...  ...above locations are eligible offices for this role. The locations have...  ...k) match, health and wellness programs, flexible time off policies... 
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Program Officer, AI Model Safety. Be the first to apply!