Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Program Officer, AI Model Safety

$220k - $300k
Full-time

OpenAI Foundation

About OpenAI Foundation

AI is already changing how people work, learn, and access care. It has the potential to unlock extraordinary benefits—faster medical breakthroughs, accelerated scientific discovery, more personalized services in healthcare and education, new tools for creativity and invention, higher productivity and economic growth, improved public services like transportation systems, and so much more.

But building powerful systems to benefit humanity is only a part of the work of our mission. Advanced AI models will also present new challenges that are already surfacing, and we need to be prepared to identify these challenges and develop solutions to address them.

These are the two dimensions of what we’re building the Foundation to do. We aim to enable the use of AI to find solutions to humanity’s hardest problems, transform what people are capable of, and deliver real benefits in people’s lives—while working hard with partners to be ready for new challenges, and to help make society resilient, as AI advances.

This work is just beginning. Over the next year, as we quickly ramp up, the Foundation expects to invest at least $1 billion across life sciences and curing diseases, jobs and economic impact, AI resilience, and community programs. This includes early investments toward our previously announced $25 billion commitment to curing diseases and AI resilience.

About the team

AI Resilience helps society absorb, adapt to, and benefit from increasingly capable AI systems, with work across biosecurity, model safety, cybersecurity, children and youth, and the future of the economy. The team is small and fast-moving with many workstreams, candidates, advisors, grantees, board touchpoints, and special projects in flight.

Within AI Resilience, the AI Model Safety program works to make AI systems safer by default. By AI model safety we mean the technical work of understanding and improving how models behave (testing and evaluating them independently, red-teaming them, researching how to interpret, align, and control them) so that increasingly capable systems can be trusted with increasingly consequential tasks. The program supports this through funding independent testing and evaluations, new and stronger industry standards, and foundational research that helps avoid safety issues or detect and address them early.

About the role

We are looking for a founding grantmaker for the Foundation's AI Model Safety program: someone with deep technical fluency in how frontier models are evaluated, audited, and made safer, who can turn that into a grant portfolio and a stronger field.

You will help with the program's grantmaking end to end (investigating opportunities across independent evaluations, standards, and foundational safety research) and do the proactive work, such as identifying the organizations that should exist, finding the people to build them, and helping the field scale as fast as the models do. You will develop the program's strategy together with the rest of AI Resilience, and work closely with the AI Resources team, whose AI resources your grantees will increasingly leverage.

This is an early, zero-to-one role with significant independence. You would report to Lennart Heim, Director of AI Resources, for the moment. We are open to mid-career and senior experience levels.

In this role, you will

  • Run the program's grantmaking across its domains (independent testing and evaluations, industry standards, foundational safety research, AI control, and other new ideas) from sourcing through investigation to getting resources into grantees' hands.

  • Run grant investigations and make grant recommendations to the board.

  • Proactively identify the most important projects and organizations that need to exist, and make them happen: scope priority projects, find or develop the right founders, and actively build new initiatives, seeding them if required.

  • Work with the AI Resources team to route AI resources to safety grantees and help them absorb it productively.

  • Develop the program's strategy with the team lead: what we should fund, what others in the ecosystem are doing, and where the gaps are.

  • Build and maintain relationships across the safety ecosystem: independent safety organizations, AI safety institutes, academic groups, other funders (philanthropic and VC alike), and AI companies' safety teams.

You might thrive in this role if you

  • Have at least 3 years of experience in AI safety, ideally including hands-on research in model safety or evaluations, whether in a research role, on a safety or evals team, in grantmaking, or helping start an organization.

  • Have deep, current fluency in AI model safety: evaluations, red-teaming, auditing, interpretability, control, and alignment research.

  • Follow frontier AI capabilities and risks closely enough to have independent judgment about them, with views on the risks that matter most and on what each part of the ecosystem should do.

  • Have a view on where AI is going, which risks it brings, and what to do about them: your own takes on how capabilities will develop, and what that means for the safety work that will be needed.

  • Excel at owning ambitious, loosely scoped projects: you find the right people, convince them to start new work, and support their success.

  • Have a relentless prioritization mindset: you evaluate opportunities on impact, tractability, and neglectedness, and act on the ranking.

  • Write and communicate: compelling, transparent documents that explain your reasoning and appropriately highlight risks, uncertainties, and downsides internally.

  • Are deeply mission-aligned and excited to help ensure AGI benefits all of humanity.

It would be great if you also have

  • Grantmaking, VC, or philanthropic experience, especially seeding organizations or sub-fields.

  • A research track record in evaluations, interpretability, control, or adjacent technical safety areas.

  • Existing relationships across safety organizations, AI safety institutes, and AI company safety teams.

Compensation

The annual base salary range for this role is $220,000 to $300,000 USD.

This range reflects our good-faith estimate of the base salary we reasonably expect to pay for this position upon hire. Actual base salary will be determined based on job-related factors, including the candidate’s relevant experience, skills, expertise, the scope of the role, and work location, as applicable.

This salary range does not include benefits or any other compensation for which the role may be eligible.

Equal Opportunity

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Program Officer, AI Model Safety in San Francisco, CA vacancy
  • $218.5k - $288k

     ...headquartered in San Francisco and has offices in Boston, New York, Austin,...  ...in Small Language Models and AI Training, you will lead...  ...world applications.Ensure AI safety, fairness, and alignment principles...  ...or efficient models.Strong programming skills in Python and... 
    Suggested
    Work at office
    Flexible hours
    3 days per week

    Postman

    San Francisco, CA
    a month ago
  • $220k - $300k

     ...About OpenAI Foundation AI is already changing how...  ...mission. Advanced AI models will also present new challenges...  ..., and community programs. This includes early...  ...across biosecurity, model safety, cybersecurity,...  ...least two founding Program Officers for AI Resources: generalists... 
    Suggested
    Full time

    OpenAI Foundation

    San Francisco, CA
    2 days ago
  • $136.44k - $265.11k

     ...are rebuilding biotech for the AI era.When a breakthrough is...  ...structured data, and run AI agents and models directly in their workflows....  ...around collaborating in the office in a fast-paced environment....  ...enjoy a comprehensive benefits program including equity, health,... 
    Suggested
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    1 day ago
  • $246.8k - $333.9k

    In this role, you will lead the AWS account team for a frontier AI model lab and one of Amazon's largest strategic technology...  ...+ internal AWS teams spanning infrastructure services, partner programs, commercial operations, corporate development, and legal- Surface... 
    Suggested
    Contract work
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    3 days ago
  •  ...headquarters is in San Francisco and has offices in Los Angeles, New York, Atlanta, and Washington...  ...:This position reports to the Program Manager, Early Care and Education Program...  ...scoping of repairs, space planning, health and safety, regulatory compliance, and business... 
    Suggested
    Casual work
    Work at office
    Local area
    Remote work
    Afternoon shift
    2 days per week

    The Low Income Investment Fund

    San Francisco, CA
    3 days ago
  • $220k - $320k

     ...trains and hosts specialized language models for companies that need frontier-quality AI at a fraction of the cost. The...  ...we do. Most of us are in the office 4 days a week in SF; hybrid works...  ..., inference optimization, or GPU programming ~ Strong proficiency in Python... 
    Work at office

    Inference

    San Francisco, CA
    1 day ago
  • $266k - $335k

     ...About the Team Safety Systems manages the complete lifecycle of safety...  ...efforts for OpenAI’s frontier models, ensuring our models are...  ...from deployments, distribute AI’s benefits widely, and ensure...  ...hybrid work model of 3 days in the office per week and offer relocation... 
    Full time
    Work at office
    Relocation package
    Shift work

    OpenAI

    San Francisco, CA
    4 days ago
  • $349k - $431k

     ...+ U.S. states. The mission of the Waymo AI Foundations team is to develop machine learning...  ...learning from demonstration, generative modeling, Bayesian inference, hierarchical...  ...participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $190k - $265k

     ...passionate about enabling data and AI teams to solve the world's...  ...from data apps, AI agents, model training, model serving, and Vector...  ...system observabilityStrong programming skills in Scala, Go, or PythonBonus...  ...in San Francisco, with offices around the globe and was founded... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...Head of Model Safety About the Company Forward-thinking AI research lab Industry Research Type Privately...  ...forefront of the lab's safety program, which has scaled significantly,...  ...Manager Title Chief Executive Officer (CEO) Functions ~ Engineering... 

    Confidential

    San Francisco, CA
    4 days ago
  •  ...Senior Program Officer, Policy & AdvocacyBusiness Unit: Sobrato PhilanthropiesStatus: Full-TimeWork...  ...needs, and 3) strengthening the social safety net for our most vulnerable communities....  ...an organization's program and financial models, and organizational capacity.... 

    The Sobrato Organization

    San Francisco, CA
    3 days ago
  • $220k - $300k

     ...About OpenAI Foundation AI is already changing how people work...  ...work of our mission. Advanced AI models will also present new...  ...AI resilience, and community programs. This includes early investments...  ...About the role The Program Officer is a key role on the Catalytic... 
    Full time
    Work at office

    OpenAI Foundation

    San Francisco, CA
    2 days ago
  • $220k - $330k

     ...About OpenAI Foundation AI is already changing how people work...  ...work of our mission. Advanced AI models will also present new...  ...AI resilience, and community programs. This includes early investments...  ...We are looking for a Program Officer, High-Burden Diseases to help... 
    Full time
    Work at office
    Flexible hours

    OpenAI Foundation

    San Francisco, CA
    2 days ago
  • $190k - $265k

     ...passionate about enabling data and AI teams to solve the world's...  ...from data apps, AI agents, model training, model serving, and Vector...  ...observability ~ Strong programming skills in Scala, Go, or Python...  ...Headquartered in San Francisco with 30+ offices around the globe, Databricks... 
    Full time
    Local area
    Worldwide

    Databricks

    San Francisco, CA
    2 days ago
  •  ...innovative utility leader, recognized for excellent results in service, safety, stewardship, and inclusiveness. The San Francisco Public...  ...performance of an environmental sample collection and analysis program. Assists in making technical presentations to regulatory... 
    Full time
    Work experience placement
    Local area

    GovernmentJobs.com

    San Francisco, CA
    3 days ago
  • $235k - $245k

     ...supportive housing, and clinical case management programs through partnerships with developmental...  ...In short, we do good work. We have offices statewide with a staff of passionate...  ...Housing Pool (Flex Pool): A systems-level model that aligns and deploys housing resources... 
    Permanent employment
    Contract work
    Temporary work
    For subcontractor
    Flexible hours

    Brilliant Corners

    San Francisco, CA
    12 hours ago
  • $128.2k - $200k

     ...StatesCapabilities: ConstructionOffice Setup: Office/OnsiteSalary: $128,200.00 - $200,000.00...  ...are changing our world.  As a Project Safety Officer you’ll join our collaborative team...  ..., requirements and training for the Program during construction.Reviews the CM Consultant... 
    Full time
    For contractors
    Work at office
    Local area

    Jacobs

    San Francisco, CA
    3 days ago
  • $119.6k - $186.85k

     ...highly motivated and adaptable Aviation Safety, Compliance & Operational Readiness Consultant...  ...airport development and activation programs.This role is ideal for a self-starter with...  ...to split their work week between Jacobs offices/projects and remote locations enabling them... 
    Full time
    For contractors
    Remote work

    Jacobs

    San Francisco, CA
    1 day ago
  • $86.6k - $108.2k

     ...create new pathways for growth within our programs department. We are currently seeking...  ...are preferred. Of the three new program officer positions, one will be based in the Humboldt...  ...to health care, education, employment and safety. THE PROGRAMS DEPARTMENT The Program Officers... 
    Work at office

    The California Wellness Foundation

    San Francisco, CA
    2 days ago
  • $130k - $150k

     ...Guidance The Joint Test & Evaluation (JT&E) program considers emerging technologies and the...  ...‑making. Apply statistical methods, modeling & simulation techniques, and operations research...  .... We may use artificial intelligence (AI) tools to support parts of the hiring process... 
    Full time

    CGS Federal (Contact Government Services)

    San Francisco, CA
    5 days ago
  • $85k - $95k

     ...actively seeking to hire an experienced Program Officer for an immediate opening. Job Title: Program...  ...improvements, renovations, health and safety, licensing, and business planning. Help...  ...this job, you agree to receive calls, AI-generated calls, text messages, or emails... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Worldwide

    Innova Solutions Inc

    San Francisco, CA
    2 days ago
  • The Program Officer (PO), Capacity Building is a thoughtful and engaged contributor to the Kataly team, focused on the Foundation’s mission to promote social justice and racial equity in communities most impacted by injustice. In summary, the PO works closely with the Director... 

    Kataly Foundation

    San Francisco, CA
    2 days ago
  • $140k - $170k

    Waverley Street Foundation is building out its team of Program Officers to advance work that will bring the foundation’s ambitious climate goals into fruition. The Program Officers will help shape and guide the trajectory of the Foundation’s climate initiatives, specifically... 
    Work at office
    3 days per week

    Waver

    San Francisco, CA
    2 days ago
  • $106k - $112k

     ...PFS provides substantial strategic expertise through a staffing model that enables foundations to each be more efficient and...  ...provide top-level service to our clients. ABOUT THE POSITION The Program Officer serves as a key manager of grantee relationships assigned to multiple... 
    Local area

    Pacific Foundation Services

    San Francisco, CA
    2 days ago
  • $266k - $335k

     ...About the Team Safety Systems manages the complete lifecycle of safety efforts for OpenAI’s frontier models, ensuring our models are deployed responsibly and have a positive impact...  ...learn from deployments, distribute AI’s benefits widely, and ensure that powerful... 
    Full time

    OpenAI

    San Francisco, CA
    4 days ago
  •  ...Assistant Chief Nursing Officer (ACNO) Our client is a 25-bed Critical Access not-for-...  ...lead nursing operations, drive quality and safety initiatives, and shape the strategic...  ...patient safety, and regulatory compliance programs (CMS, Joint Commission/HFAP, Title 22, CA... 
    Relocation
    Relocation package

    Bileddo Associates

    San Francisco, CA
    1 day ago
  •  ...BSA/AML transaction monitoring models/rules and watchlist screening...  ...identify and mitigate riskUse AI tools fluently and stay current...  ...above locations are eligible offices for this role. The locations have...  ...k) match, health and wellness programs, flexible time off policies... 
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    1 day ago
  •  ...Chief Program Officer (CPO) About the Company Globally-recognized organization providing community-based services to youth Industry Non-Profit Organization Management Type Non Profit Founded 1975 Employees 1001-5000 Categories Health Care... 
    Work at office

    Confidential

    San Francisco, CA
    4 days ago
  •  ...Chief Program Officer (CPO) About the Company Leading provider of supportive housing services Industry Non-Profit Organization Management Type Non Profit Founded 2004 Employees 201-500 Categories Consulting Non Profit Real Estate... 

    Confidential

    San Francisco, CA
    5 days ago
  •  ...recognized for excellent results in service, safety, stewardship, and inclusiveness. We...  ...We are proud of our infrastructure and programs, but most importantly, we value our highly...  ...must be submitted directly to the Executive Officer of the Civil Service Commission within... 
    Full time
    Work experience placement
    Local area

    City and County of San Francisco

    San Francisco, CA
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Program Officer, AI Model Safety. Be the first to apply!