Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, GPU Infrastructure

Full-time

Fluidstack

About Fluidstack

We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.

We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.


We hire people who care deeply about this problem space. If that is you, please apply!

How We Operate

  • Be a barrel. Full autonomy. Own things end to end, take on scope without being asked, no permission required to operate outside your core role.

  • Insane urgency. We drive everything forward as fast as possible.

  • Reason from first principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins.

  • Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward.

  • Build something that actually matters. If you're going to spend your time, spend it on something that matters to the world.

The Production Engineering Team

Examples of key exciting problems the team is working on

  • Build the repair pipeline that keeps pace with a fleet of 10s to 100s of GWs: at our scale, a GPU failure isn't a ticket. It's a throughput problem. We're building the automation that takes a chip from fault detection through triage, RMA, and return to service without human intervention.

  • Qualify every new GPU generation inside a 6-month build window: our platform covers burn-in, performance baselining, and NPI execution. It has to define "production-ready" before a site goes live, not after. New hardware gets certified at speeds unheard of in the industry.

  • Migrate live compute at construction speed: we're converting clusters across production sites simultaneously, bringing new sites online, and making Kubernetes-orchestrated bare metal sustainable at the pace we're building – multiple GW annually.

  • See and own the entire fleet in real time, at any scale: build the observability and orchestration layer that makes hyperscale AI compute actually operable. Debug, tune, and performance-test infrastructure that grows by another site every few months.

     

Role Scope

  • Own compute fleet health end to end. Build the metrics pipelines, alerting, and unified health view that tell you the true state of every GPU in production — across Kubernetes-orchestrated workloads and bare metal, at scale.

  • Turn deployment/repair into a pipeline, not a procedure. Build and own the automation that takes a compute failure from detection through triage, parts management, and return to service. No one-off scripts, no heroics.

  • Design and expand the GPU qualification platform. Burn-in, performance baselining, and NPI execution for every new GPU generation. You define what "good" looks like before hardware goes into production.

  • Own Redfish and BMC tooling. Firmware-level telemetry, log collection at fleet scale, and the low-level access layer that repair automation and health tooling depend on.

  • Own end-to-end reliability, scalability, and operation of the compute fleet at-scale. Fluidstack is building one of the largest GPU fleets in the world and that can only be accomplished with aggressive automation, tooling, and incident discipline.

     

What We're Looking For

The below is a starting point. We always make space for exceptional people, so if you don't fit this role exactly, tell us where you would.

  • You treat toil as a bug. Manual steps in a repair workflow are a backlog item, not a job description.

  • You have an instinct for hardware. You're comfortable reasoning about failure modes at the firmware and silicon level, not just the software stack above it.

  • You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else.

  • You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise.

  • You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on.

  • You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day.

  • You've shipped production automation that other teams depend on, and you're comfortable in any language using AI coding tools.

  • Bonus: Hardware lifecycle management and RMA automation. BMC/Redfish or IPMI tooling. GPU qualification or burn-in frameworks. Workflow and orchestration engines (Temporal, Cadence). Metrics and alerting pipelines (Prometheus, Grafana). Go or Python...

 

Salary & Benefits

  • Competitive total compensation package (salary + equity).

  • Retirement or pension plan, in line with local norms.

  • Health, dental, and vision insurance.

  • Generous PTO policy, in line with local norms.

     

Total compensation may also include equity in the form of restricted stock units.

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email View email address on jobs.jobcopilot.com with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.

Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, GPU Infrastructure in San Francisco, CA vacancy
  • $230k

     ...responsible AI deployment over unchecked growth.About the roleAs a software engineer on the Fleet High Performance Computing (HPC) team, you...  ...maintain the health and efficiency of our supercomputing infrastructure.Our team empowers strong engineers with a high degree of... 
    Suggested
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  •  ...Platform and builds the shared infrastructure that helps DoorDash, Wolt,...  ...DeepSeek) ourselves — real-time GPU serving, high-throughput...  ...model serving and inference engines, fine-tuning and training pipelines...  ...of industry experience in software engineeringDeep backend engineering... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    San Francisco, CA
    4 days ago
  • $230k - $405k

    About the Team:Compute Infrastructure builds the platform that turns enormous...  ...of compute into a reliable engine for frontier AI. We design,...  ...data centers, orchestration software, agent infrastructure, developer...  ...protocols, RDMA, NCCL, GPU hardware behavior, benchmarking... 
    Suggested
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    15 hours ago
  • $293k - $385k

    About the TeamThe GPT Infrastructure team builds systems that turn advances...  ...and runtimes, performance engineering, secure partner integrations...  ...the RoleWe are seeking a software engineer to help build the platform...  ...platforms.Familiarity with GPU or accelerator architecture,... 
    Suggested
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    15 hours ago
  • $230k

    This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running...  ..., most reliable, and frictionless GPU fleet to support OpenAI’s general purpose...  ...hardware caching Much more!About the RoleAs an engineer within Fleet infrastructure, you will... 
    Suggested
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...Software Engineer Voxel's perception system is the technical core of everything we ship. Our...  ...software engineer to own the ML Infrastructure that powers how Voxel trains and ships...  ...Prefect, or similar) Familiarity with GPU performance profiling and optimization... 
    Work at office
    Flexible hours

    Voxel

    San Francisco, CA
    5 days ago
  • $266k

     ...security culture.About the RoleOpenAI is seeking a Security Software Engineer to join the Infrastructure Security (InfraSec) team.InfraSec safeguards the core of OpenAI’s research and production environments—GPU supercomputing clusters, multi-cloud infrastructure,... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $180k - $250k

     ...next generation of AI products. We build the infrastructure, tools, and model access that teams need to...  ...ambitious teams build on. You are a hands-on engineer who builds the software and processes that keep a large fleet of GPU servers healthy and productive. You write... 
    Temporary work
    Local area
    Remote work
    Relocation package

    The Consensus

    San Francisco, CA
    3 days ago
  •  ...Whoever deploys frontier compute infrastructure fastest will decide whether...  ...teams spanning hardware and software. Speed and scale are our key...  ...world. The Production Engineering Team Examples of key...  ...0s of GWs: at our scale, a GPU failure isn't a ticket. It's... 
    Local area

    Fluidstack

    San Francisco, CA
    1 day ago
  •  ...GPU Kernel Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ..., and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies... 
    Flexible hours

    Baseten

    San Francisco, CA
    2 days ago
  • $152k - $221k

     ...internal Specialists, Product, and Engineering teams to package approaches,...  ...of experience automating infrastructure provisioning, Developer...  ...data structures, algorithms, software design, Linux environments and...  ...and inference workloads on GPU/TPU using frameworks such as... 

    Google

    San Francisco, CA
    2 days ago
  • $300k

     ...opportunity?  Join a stealth-mode hyperscale infrastructure startup building a 300MW+ AI compute...  ...under development. The Principal Software Engineer will take ownership of the software...  ...orchestration, workload scheduling, GPU resource management, infrastructure automation... 
    Full time
    Remote work
    Flexible hours
    San Francisco, CA
    more than 2 months ago
  •  ...expertise in model innovation and systems engineering paired with a design-minded product...  ...models, and we are looking for a Software Engineer, Data Infrastructure to own the strategy and execution...  ...serving infrastructure (batching, GPU-aware loading, evaluation pipelines... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia, Inc.

    San Francisco, CA
    1 day ago
  • $250k - $300k

     ...11017Reference26-01619Salary$250,000-$300,000 / yearSoftware Engineer - Growth InfrastructureJob Number: 26-01619Ready for your next career move? We are looking for a Software Engineer - Growth Infrastructure for our client in San Francisco, CA. Our client is dedicated... 
    Full time
    Internship
    Visa sponsorship

    Eclaro International

    San Francisco, CA
    1 day ago
  •  ...IT services to the applications we develop that help us scale seamlessly in the face of incredible growth.As a Senior Software Engineer (Infrastructure), you will be a core technical contributor on the IT Infrastructure team, owning and driving the evolution of our core... 
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $122.4k - $158.4k

    The backbone of any technology org is its infrastructure, come join the team giving that skeleton superhuman abilities. The Infrastructure...  ...strong foundations this team has built.We are looking for an engineer to join our team to help build out the “platform” even... 

    Mercury

    San Francisco, CA
    3 days ago
  • $166k - $225k

     ...and running the world's best data and AI infrastructure platform so our customers can use deep...  ...to improve their business. Founded by engineers — and customer obsessed — we leap at every...  ...we're only getting started.As a Senior Software Engineer on the Infrastructure teams,... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $299k - $334k

     ...’t always the people who can build its software. A support lead knows how tickets should...  ...reliable system often means finding an engineer, provisioning a database, and building an application.We’re building database infrastructure for everyone else. We want everyday... 
    Local area
    Weekend work

    Notion Labs

    San Francisco, CA
    2 days ago
  • $140k - $225k

     ...collaborates.We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused...  ...do their best work.About The RoleAs the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in shaping the... 
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    2 days ago
  • $164k

    About the roleThe Infrastructure Engineering organization comprises three sub-teams: Core Infrastructure (which manages the infrastructure systems that power Chime, including AWS, Networking, Kubernetes, Terraform, and Observability), Infra Platform, and Data Infra (which... 
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    2 days ago
  • $230k - $390k

     ...Starline, and Google Lens. Before that, Clay led the product and design teams for Google Workspace. What you’ll doAs a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building, and maintaining the core systems that make our AI platform... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    1 day ago
  • $180k - $250k

    About the roleThatch is rewiring how health benefits work. We build software that gives employees real control over how they use their benefits.We’re looking for an Infrastructure Engineer to own the reliability, security, and performance of the platform that powers Thatch... 

    Thatch Health

    San Francisco, CA
    4 days ago
  • $196k - $294k

    About Vercel:Vercel is the agentic infrastructure company. We free people and agents to ship...  ...exceptional developer experience.Now, software is entering a new era, and the next generation...  ...starts in v0, in an agent, or in an engineer’s editor, every customer builds — and... 
    Work from home
    Worldwide
    Flexible hours

    Vercel

    San Francisco, CA
    1 day ago
  • $150k - $200k

     ..., we care deeply about giving our customers more time for their life’s work.About the Role:As a Software Engineer on Collections Infra, you’ll help scale the infrastructure behind Notion’s database block. Databases power views, boards, charts, forms, and the workflows... 
    Local area

    Notion Labs

    San Francisco, CA
    15 hours ago
  • $159k - $275k

     ...including stablecoins. You’ll help design, deploy and operate the infrastructure that makes this possible.This is a hands-on devops role with...  ...role sits at the intersection of infrastructure, platform engineering and security. You’ll define how Modern Treasury scales and... 
    Local area
    Immediate start
    Remote work

    Modern Treasury

    San Francisco, CA
    4 days ago
  • $184k - $259.44k

    Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling state of the art models, debugging the latest AI... 
    Full time
    Work at office
    3 days per week
    Early shift

    Scale AI

    San Francisco, CA
    2 days ago
  • Role SummaryWe have an opening for a Senior Software Infrastructure Engineer in our Infrastructure team focused on driving technical strategy, alignment and execution of projects across compute, networking, cloud orchestration, and observability. This is an opportunity... 

    Temporal Technologies

    San Francisco, CA
    4 days ago
  • $230k - $390k

     ...design teams for Google Workspace. What you'll doThe Payments Infrastructure team builds the trust boundary between a live conversation...  ...sees plaintext cardholder data.Make payments something other engineers can use without becoming compliance experts: drive the platform... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    4 days ago
  •  ...economy has grown 6x over the last decade, software businesses have gone from not worrying...  ...Ventures.We're building the agentic infrastructure layer at Anrok—the systems that let AI...  ...product builds on. We're looking for an engineer who pairs a strong distributed-systems... 
    Work at office
    Remote work
    Home office
    Flexible hours
    3 days per week

    Anrok

    San Francisco, CA
    2 days ago
  •  ...Senior Software Engineer At Commure, we're building the AI Operating System for healthcare, the foundation that defines how care is...  ...the Role We're hiring a Senior Software Engineer on the Infrastructure team to own the foundational infrastructure and internal developer... 
    Local area
    Immediate start

    commure

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, GPU Infrastructure. Be the first to apply!