Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Agent Infrastructure

Full-time

OpenAI

About the Team

The Agent Infrastructure team at OpenAI designs robust and secure systems that power the training and advanced use cases of next-gen AI models at OpenAI. Our systems are a key component of the infrastructure that makes advanced reasoning models like OpenAI’s o1 models possible, and we work hand-in-hand with researchers to train these advanced models.

More advanced reasoning models have the capacity to solve hard problems, and our team is also building the platform on which AI models are able to interact with the world and perform actions. We develop secure environments that allow AI models to write and execute code in secure environments, empowering the next significant milestone in AGI development: The deployment of advanced AI agents.

About the Role

On the Agent Infrastructure team, you will play a crucial role in designing and maintaining robust and secure systems that facilitate the training of next-gen AI models at a massive scale. You will work closely with researchers to enhance system capabilities and support experimental and production workloads. In addition, you will work directly on the systems that form the operating system for AI agents: building systems that allow models to write and execute code, interact with external systems, and take actions in secure environments. We’re looking for people with deep experience building AI infrastructure and who are used to working closely with researchers to build high-performance systems at massive scale for specialized use cases.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Push massive compute clusters to their limits. You will oversee the development and performance of extremely high-scale Kubernetes clusters, ensuring reliability and high throughput.

  • Use Terraform to stand up and evolve complex infrastructure that powers RL training and advanced model use cases.

  • Collaborate with research teams to stand up and optimize systems for novel AI training runs and experimental applications.

  • Develop and maintain FastAPI and gRPC APIs that serve as the interface for our large-scale AI computing environment, used in both training and inference.

You might thrive in this role if you have:

  • Willingness to leave no stone unturned in pursuit of solving a problem.

  • Experience building backend infrastructure that is easy to maintain.

  • Experience building products that end users interface with.

  • Experience making things go fast (Most things start in Python, but we expect we’ll increasingly move towards Rust for more robust performance).

Nice to have:

  • Are a team player, willing to do a variety of tasks that move the team forward.

  • Have experience working on large-scale Machine Learning infrastructure and distributed systems.

  • Know how to reason about training at scale, identifying bottlenecks and engineering solutions to optimize system performance in training environments.

  • Know your way around cloud platforms and work with infrastructure-as-code tech like Terraform.

  • Have mastered more than multiple programming languages and feel comfortable spinning up new services from scratch.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. 

For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this  link .

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Agent Infrastructure in San Francisco, CA vacancy
  • $320k

     ...growing group of committed researchers, engineers, policy experts, and business leaders...  ...About the Role We're building the infrastructure that enables Claude to act in the world...  ...generation of AI capabilities. The Agent Infrastructure team designs and operates... 
    Suggested
    Full time
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  •  ...uniquely positioned to solve this. We are Stanford engineers and former YC founders who have spent our careers at...  ...The Role We're hiring an engineer to own the infrastructure layer behind our production AI agents. This is not a prompt engineering role. It's not... 
    Suggested
    Full time

    Zed

    San Francisco, CA
    1 day ago
  •  ...Netic is the AI revenue engine for essential services who are the backbone of the American economy. With $43M in funding...  ...and the impact is immediate and tangible. Netic's Software Engineers working on the Agent Platform team build the features that let our AI agents... 
    Suggested
    Full time
    Summer work
    Internship
    Immediate start
    Sleeping nights

    Netic

    San Francisco, CA
    1 day ago
  •  ...customer support requires human agents and AI in perfect balance,...  ...rapid feedback loops. The engineering challenges are significant:...  ...Responsibilities As a Software Engineer on the AI Agents &...  ...performance. Develop LLM Infrastructure: Architect the abstractions... 
    Suggested
    Full time

    Assembled

    San Francisco, CA
    1 day ago
  •  ..., and Google Lens. Before that, Clay led the product and design teams for Google Workspace.  What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building, and maintaining the core systems that make our AI platform... 
    Suggested
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    27 days ago
  •  ...support each other with any deliverables we have to meet. Every engineer on TTH is also a product-led thinker; every PM on TTH is...  ...prototypes; and every strategist on TTH is capable of owning an agent end to end. As a part of this team, you’ll set the standard on... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    3 days ago
  •  ...Benchmarking: How can we craft a simulation platform to test AI agents against every real-world scenario imaginable? (See -Bench)...  ...agents? Agent Development Lifecycle: How do we adapt traditional software development methodologies to accommodate AI agents’ non-... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    27 days ago
  •  ...About the Role We are seeking a Cloud Infrastructure Engineer to help design and evolve the platforms that power OpenAI’s products. In this role, you will be a hands-on technical leader, driving the architecture, scalability, reliability, and security of critical... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...About the Role This role broadly owns infrastructure across the stack. If it’s running in the...  ...opinions on how to properly use coding agents in an infrastructure setting About...  ...-4 to hundreds of millions of users, engineered the foundations of autonomous driving,... 
    Full time

    The Generalist

    San Francisco, CA
    1 day ago
  •  ...into real, working systems and build any software needed for running large-scale frontier...  ...About the Role We are looking for engineers to operate the next generation of compute...  ...systems engineering with hands-on infrastructure work on our largest datacenters. You will... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $209k - $240k

     ...office workdays. About the Product Infrastructure Team: The Product Infrastructure...  ...classes of problems up-front for product engineers. Solve hard technical challenges such...  ...values, and enthusiastic about making software toolmaking ubiquitous, we want to hear... 
    Full time
    Work at office
    Local area

    Notion

    San Francisco, CA
    1 day ago
  •  ...This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running the world’s largest, most reliable, and...  ...to hardware caching  Much more! About the Role As an engineer within Fleet infrastructure, you will design, write, deploy,... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $130k - $175k

     ...goal is to enable and empower Kiddom’s engineering by building a scalable and sustainable...  ...new and existing services. Practicing Infrastructure as Code (IaC) wherever possible, giving...  ...related field ~5+ years professional software engineering experience ~ Experience... 
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work

    Kiddom

    San Francisco, CA
    1 day ago
  •  ...Orb: Orb is redefining what billing software can be, turning one of the most complex...  ...the role: As a senior member of the infrastructure team, you’ll play a key role in maintaining...  ...customer growth Partner with other engineering teams to ensure we build reliable... 
    Full time
    Work at office
    Remote work
    3 days per week

    Orb

    San Francisco, CA
    1 day ago
  • $145.4k - $188.1k

     ...together. About the Machine Learning Infrastructure Team At Thumbtack, our challenges...  ...these experiences. We empower product engineering teams by providing scalable, high-performance...  ...blog . The challenge As a Software Engineer on the ML Infrastructure team,... 
    Full time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    1 day ago
  •  ...the data collection systems, operational capability, exabyte-scale data warehouse, and software toolchain – to help our partners drive the field forward. Infrastructure engineers build the platform that support our ever-increasing scale of data collection. Sample... 
    Full time

    Xdof

    San Francisco, CA
    1 day ago
  •  ...including stablecoins. You’ll help design, deploy and operate the infrastructure that makes this possible. This is a hands-on devops...  ...role sits at the intersection of infrastructure, platform engineering and security. You’ll define how Modern Treasury scales and operates... 
    Full time
    Work at office
    Local area
    Immediate start

    Modern Treasury

    San Francisco, CA
    1 day ago
  •  ...systems fast, reliable, and cost-efficient requires world-class infrastructure. The Caching Infrastructure team is responsible for...  ...diverse range of use cases. We’re looking for an experienced engineer to help design and scale this critical infrastructure. The ideal... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $120k - $170k

     ...Horowitz to Blackrock and Fidelity, and employs a team of 450 engineers and entrepreneurs. Astranis designs, builds, and...  ...,000 sq. ft. headquarters in Northern California, USA. Software Engineer - Infrastructure As a Software Engineer on the Infrastructure team,... 
    Permanent employment
    Full time
    Remote work
    Flexible hours

    Astranis

    San Francisco, CA
    1 day ago
  • $215k - $265k

     ...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of...  ...Build and maintain Apollo's cloud infrastructure . This means IaC, networking,...  ...properly. Create infrastructure for agent tooling . As more of our team builds... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    Apollo Research

    San Francisco, CA
    1 day ago
  •  ...grown 6x over the last decade, software businesses have gone from not worrying...  ...We're building the agentic infrastructure layer at Anrok—the systems that let AI agents reason about tax data, take...  ...builds on. We're looking for an engineer who pairs a strong distributed-... 
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours
    3 days per week

    Anrok, Inc.

    San Francisco, CA
    1 day ago
  •  ...Exa is building a search engine from scratch to serve every AI agent. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to process...  ...of machines Design GPU scheduling software so we max out our cluster utilization Build... 
    Full time
    H1b

    Exa

    San Francisco, CA
    1 day ago
  •  ...schedules of billion-dollar infrastructure projects and improving safety...  ...veterans and world-class engineers to solve physical-world problems...  ...team builds the software foundation Bedrock's autonomous...  ...reporting, integrations, and agent harnessing, making our HIL fleet... 
    Full time
    Work at office
    Flexible hours

    Bedrock Robotics

    San Francisco, CA
    1 day ago
  •  ...AI presents: mass-manufactured social engineering. Countless scams, deepfakes, and other...  ...dark web forums, etc., and leverage AI agents to identify and neutralize digital threats...  ...backend engineer to build out the infrastructure required to rapidly scale up our engineering... 
    Full time
    Work at office
    Flexible hours

    Doppel

    San Francisco, CA
    1 day ago
  •  ...team is a new cross-functional group working across engineering, product, research, and design to build the...  ...About the Role We’re looking for an experienced Software Engineer to help build the core infrastructure behind OpenAI’s monetization and ads systems. In this... 
    Full time
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...Background Specter is creating a software-defined "control plane" for the physical...  ...will ultimately become the perception engine for a company's physical footprint, enabling...  ...Specter is hiring an ML infrastructure engineer to build and scale the machine... 
    Full time

    S.e. Specter

    San Francisco, CA
    1 day ago
  • $196k - $339.9k

     ...including 80% of the Fortune 100, rely on Airtable to transform how work gets done. Airtable’s infrastructure is evolving to meet the needs of our fast growing engineering org. We are looking for backend engineers to join our team to help improve critical product... 
    Remote job
    Full time
    For contractors
    Work at office
    Relocation
    Flexible hours

    Airtable

    San Francisco, CA
    1 day ago
  • $140k - $225k

     .... We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused...  ...their best work. About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in shaping the... 
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    1 day ago
  • $175k - $215k

     ...redefines the future of global mobility. The Waymo Logs Infrastructure powers critical decision making and model development...  ...and clients   You have: ~4+ years of professional software engineering experience ~ Experience working on large-scale distributed... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  •  ...love to have you on our team! Why Join Us The Platform Engineering organization at Rad AI builds the foundations that power all...  ...ship reliably, safely, and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure, platforms, and reliability... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Rad Ai

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Agent Infrastructure. Be the first to apply!