GPU Infrastructure Engineer
Career Movement
Senior Engineer A profitable, high growth technology company in the Bay Area is expanding the team that powers the compute behind its most important research and products. As a senior engineer, you will write production code that decides how large fleets of accelerators are scheduled, served and repaired. You will become the engineer researchers call when a critical run has to go right, with real ownership and visible impact from day one. What you will do: Build and operate GPU clusters across public cloud, specialty GPU providers and owned data centers Design schedulers and automation that increase utilization and recover from hardware failures without manual intervention Stand up fast model serving and distributed training environments Report on where compute spend goes and where it can be reduced What you bring: 5+ years engineering production distributed systems or ML infrastructure Strong Python plus Go or C++ Deep Kubernetes experience, with exposure to Slurm or similar schedulers Proven experience running large GPU workloads on a modern training or serving stack Willingness to carry the pager for systems that other teams depend on Career Movement
- Senior Hpc & Gpu Infrastructure Engineer Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support...SuggestedFlexible hours
- ...Sciforium is an AI infrastructure company developing next-generation multimodal AI models and... ...from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the... ...own the complete networking stack of our GPU clusters — from the RDMA compute fabric...SuggestedFull timeRemote workFlexible hours
- ...goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands... ...matters to the world. The Production Engineering Team Examples of key exciting... ...of 10s to 100s of GWs: at our scale, a GPU failure isn't a ticket. It's a throughput...SuggestedFull timeLocal area
- ...Attacks Architect We're a team of ex-Google engineers who built some of the largest defensive... ...very best. You'll build and scale the infrastructure that ingests rich data streams from... ...with fresh threat data, to orchestrating GPU workloads across dynamic clusters, to implementing...SuggestedFlexible hours
$170k - $250k
...champions growth and development? Join an early-stage infrastructure company operating in the AI space, backed by a... ...team. This company is looking for an engineer to work directly with the CTO on complex GPU virtualisation challenges. The role offers hands-on...SuggestedFull timeVisa sponsorshipFlexible hours- ...Infrastructure Security EngineerAI needs a new infrastructure layer. We're building it at Modal... ...Suno. They rely on Modal for instant GPU access, sub-second container starts, and... ...olympiad medalists, and experienced engineering and product leaders with decades of experience...
- ...generate revenue and improve customer retention. We're hiring a Infrastructure Engineer to build and run the infrastructure behind those... ...Redis, queues, and background workers. Experience deploying GPU workloads or self-hosted AI inference. Familiarity with infrastructure...Work at officeImmediate startNight shift
$180k - $220k
...Looking For Lightning AI is seeking an experienced Senior Storage Infrastructure Engineer to join our Infrastructure Engineering team. In this role,... ...high-performance data transfer technologies (e.g., RDMA, GPU Direct Storage) Experience supporting GPU-based workloads or...Work at officeRemote workWork from homeFlexible hours- Infrastructure Engineer We're looking for an Infrastructure Engineer to architect and own the systems that power Salient at scale. This is a high... ...modeling team to optimize the serving and performance of GPU-intensive workloads. Drive reliability and performance across...Full timeWork at office
$200k - $300k
...across the United States to help them hire. Forward Deployed Infrastructure Engineer Location - San Francisco, CA - (On-site - 5 Days Per Week)... ...solutions using Terraform and modern deployment tooling Deploy GPU-backed AI infrastructure supporting production machine...H1bRemote workVisa sponsorship$120k - $200k
...Affirm, ElevenLabs, and many more. About the Role As a Senior Infrastructure Engineer at Bland, you'll help us to build the backbone that enables... ...WebRTC.) Background in ML infrastructure, model serving, or GPU computing. Experience with real-time audio/video processing....Work at officeNight shift$225k
...behind large-scale AI compute? Join a market and infrastructure platform dedicated to buying, selling and... ...AI labs and compute providers. The Network Engineer will help define design standards for current and next-generation GPU fabrics across different sites and customers...Full timeWork experience placement- Staff Infrastructure Engineer Shield AI is seeking a Staff Infrastructure Engineer to design, engineer, and support enterprise infrastructure across... ..., and hybrid cloud environments, including virtualization, GPU-accelerated infrastructure, VDI, and specialized engineering...Full timeTemporary workPart time
- Network Engineer Gimlet is building the first multi-silicon neocloud designed for fast, efficient... .... We combine large-scale compute infrastructure with an execution platform that... ...may also have: Experience with AI/HPC, GPU, or large-scale distributed infrastructure...
$170k - $210k
...Are Looking For We are seeking an experienced Senior Network Engineer (InfiniBand / UFM) to design, deploy, automate, and operate next-generation AI Factory networking infrastructure supporting large-scale GPU clusters. This role is responsible for building and...Work at officeRemote workWork from homeFlexible hours- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers.... ...of superintelligence. One person, one GPU. If you'd like to build the world's... ...and on-call rotation for Network Engineering team You Have 10+ years of experience in...Work at officeLocal areaWork from homeFlexible hours
$200k
Infrastructure Engineer We're looking for an infrastructure engineer to own and evolve the security infrastructure that underpins our foundation... ...don't meet all of these: Experience with ML infrastructure, GPU clusters, or large-scale training environments (schedulers,...Immediate startVisa sponsorshipWork visaRelocation package- Senior Network Engineer Houston; New York; San Francisco; Seattle About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve...
$180k - $225k
...Lightning AI is seeking a Senior Network Engineer with hands-on Cumulus Linux expertise to... ...the network backbone behind our AI infrastructure platform. You’ll play a critical role in... ...performance Ethernet fabrics supporting GPU clusters and AI workloads Build and maintain...Work at officeRemote workWork from homeFlexible hours$250k - $300k
.... As the only vertically integrated AI infrastructure company built from the ground up, we own... ...-time position reporting into Network Engineering, with the mandate to set optical strategy... ...chain to align optical capacity with GPU cluster deployments, the backbone roadmap...Full timeTemporary workFlexible hours- ...(***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro... ...seeking a Machine Learning Infrastructure Engineer to help architect the compute, training,... ...large-scale workloads across extensive GPU clusters.Build developer abstractions,...Full timeWork at officeFlexible hours
$200k - $350k
...client. Build and tune the serving and training infrastructure behind specialized language models, from... ...performance or stability gains. - Solid low-level engineering and troubleshooting ability, including familiarity with GPU memory and compute ceilings. - Deep...Full timeWork at office$200k - $300k
...operating cost. Work closely with customers and engineers to shape the direction of the work.... ...machine handles. - Write low-level GPU kernel code for accelerators from several... ...fast career progression. - Backend, infrastructure or systems experience at a leading technology...Full timeInternshipWork at officeImmediate startFlexible hours- ...Sciforium is an AI infrastructure company developing next-generation multimodal AI models and... ...from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the... ...About the Role We are looking for a GPU Cluster Engineer to own the entire software...Full timeFlexible hours
$350k
...growing group of committed researchers, engineers, policy experts, and business leaders working... ...'re looking for an engineer to own the infrastructure behind that research. This is the... ...with machine learning framework internals, GPU or accelerator programming, or inference...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$200k - $250k
...teams across the United States to help them hire. Principal Infrastructure Engineer / Tech Lead Location San Francisco, CA On-site role... ...infrastructure-as-code systems using tools such as Terraform Manage GPU allocation, instance sizing, and cloud resource utilization...Fixed term contractH1bImmediate startRemote workVisa sponsorshipRelocation packageFlexible hours$250k - $350k
...one builds what makes them actually work. We're hiring ML Infrastructure Engineers to tackle a hard, real-world problem, understanding what's happening... ...and inference systems for multimodal / LLM-based models GPU infrastructure and performance optimisation Hybrid...$230k
...deployment over unchecked growth.About the roleAs a software engineer on the Fleet High Performance Computing (HPC) team, you will... ...to maintain the health and efficiency of our supercomputing infrastructure.Our team empowers strong engineers with a high degree of autonomy...Work at officeLocal areaFlexible hours- Principal Network Engineer Houston; New York; San Francisco; Seattle Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior...Flexible hours
$200k - $400k
Infrastructure Engineer We are looking for an Infrastructure Engineer who thrives on the complexity of modern deployment patterns. You will own... ...workloads, specifically high-throughput inference systems or GPU-accelerated computing. Kubernetes Mastery: Strong K8s (EKS/GKE...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Infrastructure Engineer. Be the first to apply!
- entry level infrastructure engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- infrastructure developer San Francisco, CA
- security infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA



