Software Engineer, GPU Infrastructure
Fluidstack
About Fluidstack
We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.
We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.
We hire people who care deeply about this problem space. If that is you, please apply!
How We Operate
Be a barrel. Full autonomy. Own things end to end, take on scope without being asked, no permission required to operate outside your core role.
Insane urgency. We drive everything forward as fast as possible.
Reason from first principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins.
Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward.
Build something that actually matters. If you're going to spend your time, spend it on something that matters to the world.
The Production Engineering Team
Examples of key exciting problems the team is working on
Build the repair pipeline that keeps pace with a fleet of 10s to 100s of GWs: at our scale, a GPU failure isn't a ticket. It's a throughput problem. We're building the automation that takes a chip from fault detection through triage, RMA, and return to service without human intervention.
Qualify every new GPU generation inside a 6-month build window: our platform covers burn-in, performance baselining, and NPI execution. It has to define "production-ready" before a site goes live, not after. New hardware gets certified at speeds unheard of in the industry.
Migrate live compute at construction speed: we're converting clusters across production sites simultaneously, bringing new sites online, and making Kubernetes-orchestrated bare metal sustainable at the pace we're building – multiple GW annually.
See and own the entire fleet in real time, at any scale: build the observability and orchestration layer that makes hyperscale AI compute actually operable. Debug, tune, and performance-test infrastructure that grows by another site every few months.
Role Scope
Own compute fleet health end to end. Build the metrics pipelines, alerting, and unified health view that tell you the true state of every GPU in production — across Kubernetes-orchestrated workloads and bare metal, at scale.
Turn deployment/repair into a pipeline, not a procedure. Build and own the automation that takes a compute failure from detection through triage, parts management, and return to service. No one-off scripts, no heroics.
Design and expand the GPU qualification platform. Burn-in, performance baselining, and NPI execution for every new GPU generation. You define what "good" looks like before hardware goes into production.
Own Redfish and BMC tooling. Firmware-level telemetry, log collection at fleet scale, and the low-level access layer that repair automation and health tooling depend on.
Own end-to-end reliability, scalability, and operation of the compute fleet at-scale. Fluidstack is building one of the largest GPU fleets in the world and that can only be accomplished with aggressive automation, tooling, and incident discipline.
What We're Looking For
The below is a starting point. We always make space for exceptional people, so if you don't fit this role exactly, tell us where you would.
You treat toil as a bug. Manual steps in a repair workflow are a backlog item, not a job description.
You have an instinct for hardware. You're comfortable reasoning about failure modes at the firmware and silicon level, not just the software stack above it.
You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else.
You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise.
You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on.
You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day.
You've shipped production automation that other teams depend on, and you're comfortable in any language using AI coding tools.
Bonus: Hardware lifecycle management and RMA automation. BMC/Redfish or IPMI tooling. GPU qualification or burn-in frameworks. Workflow and orchestration engines (Temporal, Cadence). Metrics and alerting pipelines (Prometheus, Grafana). Go or Python...
Salary & Benefits
Competitive total compensation package (salary + equity).
Retirement or pension plan, in line with local norms.
Health, dental, and vision insurance.
Generous PTO policy, in line with local norms.
Total compensation may also include equity in the form of restricted stock units.
We are committed to pay equity and transparency.
Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.
You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email View email address on jobs.jobcopilot.com with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.
$230k
...responsible AI deployment over unchecked growth.About the roleAs a software engineer on the Fleet High Performance Computing (HPC) team, you... ...maintain the health and efficiency of our supercomputing infrastructure.Our team empowers strong engineers with a high degree of...SuggestedWork at officeLocal areaFlexible hours$240k - $280k
...About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that... ...physical host from discovery, inference bring-up to GPU driver/CUDA stack, health validation, and decommission...SuggestedFull time- ...applied AI research, flexible infrastructure, and seamless developer... ...and help build the platform engineers turn to to ship AI products.... ...foundational engineers to lead our GPU Networking efforts, making RDMA... ...to architect the software fabric that unifies thousands...SuggestedFull timeFlexible hours
$137.1k - $201.6k
...Platform and builds the shared infrastructure that helps DoorDash, Wolt,... ...DeepSeek) ourselves — real-time GPU serving, high-throughput... ...model serving and inference engines, fine-tuning and training pipelines... ...of industry experience in software engineering ~ Deep backend...SuggestedHourly payWork at officeLocal areaRemote workFlexible hours- ...Exa is building a search engine from scratch to serve every AI agent. We build massive-scale infrastructure to crawl the web, train state-of... ...compute, we also own a $5M H200 GPU cluster (and soon 5x'ing that... ...Design GPU scheduling software so we max out our cluster utilization...SuggestedFull timeH1b
$215k - $265k
...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of... ...Build and maintain Apollo's cloud infrastructure . This means IaC, networking,... ...signals for their service. Multi-cloud GPU orchestration: The platform that finds...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours- ...You’ll Do Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling. Ship cloud... ...systems. Nice to Have gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter)....Full timeRemote work
- ...working systems and build any software needed for running large-... ...the Role We are looking for engineers to operate the next generation... ...systems engineering with hands-on infrastructure work on our largest... ...bare-metal Linux environments, GPU hardware, and large-scale networking...Full time
- ...About the Role This role broadly owns infrastructure across the stack. If it’s running in the... ...responsible for: The compute (both CPU and GPU compute) that’s required to cost... ...GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built...Full time
$180k - $250k
...next generation of AI products. We build the infrastructure, tools, and model access that teams need to... ...ambitious teams build on. You are a hands-on engineer who builds the software and processes that keep a large fleet of GPU servers healthy and productive. You write...Full timeLocal areaRelocation package- ...Background Specter is creating a software-defined "control plane" for... ...become the perception engine for a company's physical footprint... ...Specter is hiring an ML infrastructure engineer to build and scale the... ...DDP, DeepSpeed, Ray) and GPU cluster management. Strong...Full time
$230k
This role will support the fleet infrastructure team at OpenAI. The fleet team focuses on running... ..., most reliable, and frictionless GPU fleet to support OpenAI’s general purpose... ...hardware caching Much more!About the RoleAs an engineer within Fleet infrastructure, you will...Work at officeLocal areaRelocation packageFlexible hours$293k - $385k
About the TeamThe GPT Infrastructure team builds systems that turn advances... ...and runtimes, performance engineering, secure partner integrations... ...the RoleWe are seeking a software engineer to help build the platform... ...platforms.Familiarity with GPU or accelerator architecture,...Work at officeLocal areaRemote workFlexible hours$230k - $405k
About the Team:Compute Infrastructure builds the platform that turns enormous... ...of compute into a reliable engine for frontier AI. We design,... ...data centers, orchestration software, agent infrastructure, developer... ...protocols, RDMA, NCCL, GPU hardware behavior, benchmarking...Work at officeLocal areaFlexible hours- ...Platform and builds the shared infrastructure that helps DoorDash, Wolt,... ...DeepSeek) ourselves — real-time GPU serving, high-throughput... ...model serving and inference engines, fine-tuning and training pipelines... ...of industry experience in software engineeringDeep backend engineering...Hourly payWork at officeLocal areaRemote workFlexible hours
- ...Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable... .... Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re seeking a GPU Kernel Engineer to join our team at the cutting...Full timeFlexible hours
- ...well as accelerating research progression via model inference. About the Role We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from low-level kernel performance to high-level...Full time
- ...applied AI research, flexible infrastructure, and seamless developer... ...and help build the platform engineers turn to to ship AI products.... ...Baseten is building its own GPU infrastructure for large-scale... ...not. We are hiring a Lead Software Engineer to build a first-class...Full timeFlexible hours
$230k - $385k
...security culture.About the RoleOpenAI is seeking a Security Software Engineer to join the Infrastructure Security (InfraSec) team.InfraSec safeguards the core of OpenAI’s research and production environments—GPU supercomputing clusters, multi-cloud infrastructure,...Work at officeLocal areaFlexible hours- ...About the job FriendliAI is looking for a Cloud Infrastructure Engineer to own the architecture and evolution of the cluster platform behind our GPU-accelerated AI inference cloud. As a Software Engineer, Cloud Infrastructure, you will design how our clusters are built...Permanent employmentFull timeFlexible hours
$193.93k - $291.15k
...Senior Software Engineer, ML Infrastructure Mountain View, California (HQ) Nuro believes self-driving vehicles are the most immediate and profound... ...-as-code (IaC) pipelines to manage thousands of GPU/CPU nodes across diverse environments. Intelligent Scheduling...Immediate startFlexible hours- ...through the perception team. We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision models.... ...Flyte, Metaflow, Prefect, or similar) Familiarity with GPU performance profiling and optimization (Nsight,...Work at officeFlexible hours
$300k
...opportunity? Join a stealth-mode hyperscale infrastructure startup building a 300MW+ AI compute... ...under development. The Principal Software Engineer will take ownership of the software... ...orchestration, workload scheduling, GPU resource management, infrastructure automation...Full timeRemote workFlexible hours$176k - $220k
...institutions Work together with engineers, scientists, operators, and... ...AI Human data is the core infrastructure to AI advancement. Frontier... ...We’re looking for a Senior Software Engineer to join our ML Infrastructure... ...fine-tuned models, including GPU serving, batching, and...Full timeWork at officeRemote workFlexible hours- ...Whoever deploys frontier compute infrastructure fastest will decide whether... ...teams spanning hardware and software. Speed and scale are our key... ...world. The Production Engineering Team Examples of key... ...platforms, so every new site and GPU generation lands cleanly...Local area
$200k - $250k
...office. The opportunity We're hiring a Senior Cloud Infrastructure Engineer to join the Cloud Infrastructure & Platform (CIN) team at Altruist... .... Architect infrastructure for AI/ML workloads: GPU-enabled compute, SageMaker endpoints, Bedrock integration, vector...Work at officeImmediate start3 days per week$200k - $260k
...are a hardcore and obsessed team of the world's best engineers and operators. If you are obsessed with your craft, enjoy... .... About the Role We are looking for a Senior Software Engineer to join our Infrastructure Team , focused on building secure, reliable, and...Local areaFlexible hours$300 per month
...only vertically integrated AI infrastructure company built from the... ...Data Center Infrastructure Engineering (DCIE) team is fundamental to... ...infrastructure for Crusoe’s fleet GPU’s and data center. The team... ...skilled and motivated Software Engineer to join Crusoe’s Data...Temporary work$210k - $300k
...obsessed team of the world's best engineers and operators. If you are obsessed... ...About the Role We're looking for a Software Engineer to join our ML Infrastructure team. In this role, you'll help... ...scale the systems that turn our GPU clusters into a reliable, high-throughput...Local areaFlexible hours- ...expertise in model innovation and systems engineering paired with a design-minded product... ...models, and we are looking for a TLM, Data Infrastructure to own the strategy and execution for... ...and serving infrastructure (batching, GPU-aware loading, evaluation pipelines)....Work at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, GPU Infrastructure. Be the first to apply!
- software engineer internship San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship no experience San Francisco, CA
- real time software engineer San Francisco, CA
- financial software developer San Francisco, CA
- part time software developer San Francisco, CA
- graduate software developer San Francisco, CA
- software engineer travel San Francisco, CA
- experienced software developer San Francisco, CA
- remote entry level software developer San Francisco, CA




