Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Infrastructure Engineer

Career Movement

Senior Engineer A profitable, high growth technology company in the Bay Area is expanding the team that powers the compute behind its most important research and products. As a senior engineer, you will write production code that decides how large fleets of accelerators are scheduled, served and repaired. You will become the engineer researchers call when a critical run has to go right, with real ownership and visible impact from day one. What you will do: Build and operate GPU clusters across public cloud, specialty GPU providers and owned data centers Design schedulers and automation that increase utilization and recover from hardware failures without manual intervention Stand up fast model serving and distributed training environments Report on where compute spend goes and where it can be reduced What you bring: 5+ years engineering production distributed systems or ML infrastructure Strong Python plus Go or C++ Deep Kubernetes experience, with exposure to Slurm or similar schedulers Proven experience running large GPU workloads on a modern training or serving stack Willingness to carry the pager for systems that other teams depend on Career Movement

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GPU Infrastructure Engineer in San Francisco, CA vacancy
  • Senior Hpc & Gpu Infrastructure Engineer Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support... 
    Suggested
    Flexible hours

    Sciforium

    San Francisco, CA
    2 days ago
  •  ...Sciforium is an AI infrastructure company developing next-generation multimodal AI models and...  ...from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the...  ...own the complete networking stack of our GPU clusters — from the RDMA compute fabric... 
    Suggested
    Full time
    Remote work
    Flexible hours

    Sciforium

    San Francisco, CA
    8 days ago
  •  ...goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands...  ...matters to the world. The Production Engineering Team Examples of key exciting...  ...of 10s to 100s of GWs: at our scale, a GPU failure isn't a ticket. It's a throughput... 
    Suggested
    Full time
    Local area

    fluidstack

    San Francisco, CA
    8 days ago
  •  ...Attacks Architect We're a team of ex-Google engineers who built some of the largest defensive...  ...very best. You'll build and scale the infrastructure that ingests rich data streams from...  ...with fresh threat data, to orchestrating GPU workloads across dynamic clusters, to implementing... 
    Suggested
    Flexible hours

    Aegis AI

    San Francisco, CA
    2 days ago
  • $170k - $250k

     ...champions growth and development? Join an early-stage infrastructure company operating in the AI space, backed by a...  ...team. This company is looking for an engineer to work directly with the CTO on complex GPU virtualisation challenges. The role offers hands-on... 
    Suggested
    Full time
    Visa sponsorship
    Flexible hours
    San Francisco, CA
    more than 2 months ago
  •  ...Infrastructure Security EngineerAI needs a new infrastructure layer. We're building it at Modal...  ...Suno. They rely on Modal for instant GPU access, sub-second container starts, and...  ...olympiad medalists, and experienced engineering and product leaders with decades of experience... 

    Modal

    San Francisco, CA
    2 days ago
  •  ...generate revenue and improve customer retention. We're hiring a Infrastructure Engineer to build and run the infrastructure behind those...  ...Redis, queues, and background workers. Experience deploying GPU workloads or self-hosted AI inference. Familiarity with infrastructure... 
    Work at office
    Immediate start
    Night shift

    Simple AI Lab Company

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...Looking For Lightning AI is seeking an experienced Senior Storage Infrastructure Engineer to join our Infrastructure Engineering team. In this role,...  ...high-performance data transfer technologies (e.g., RDMA, GPU Direct Storage) Experience supporting GPU-based workloads or... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    Lightning AI

    San Francisco, CA
    2 days ago
  • Infrastructure Engineer We're looking for an Infrastructure Engineer to architect and own the systems that power Salient at scale. This is a high...  ...modeling team to optimize the serving and performance of GPU-intensive workloads. Drive reliability and performance across... 
    Full time
    Work at office

    Salient

    San Francisco, CA
    2 days ago
  • $200k - $300k

     ...across the United States to help them hire. Forward Deployed Infrastructure Engineer Location - San Francisco, CA - (On-site - 5 Days Per Week)...  ...solutions using Terraform and modern deployment tooling Deploy GPU-backed AI infrastructure supporting production machine... 
    H1b
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  • $120k - $200k

     ...Affirm, ElevenLabs, and many more. About the Role As a Senior Infrastructure Engineer at Bland, you'll help us to build the backbone that enables...  ...WebRTC.) Background in ML infrastructure, model serving, or GPU computing. Experience with real-time audio/video processing.... 
    Work at office
    Night shift

    Bland Company

    San Francisco, CA
    2 days ago
  • $225k

     ...behind large-scale AI compute? Join a market and infrastructure platform dedicated to buying, selling and...  ...AI labs and compute providers. The Network Engineer will help define design standards for current and next-generation GPU fabrics across different sites and customers... 
    Full time
    Work experience placement
    San Francisco, CA
    2 days ago
  • Staff Infrastructure Engineer Shield AI is seeking a Staff Infrastructure Engineer to design, engineer, and support enterprise infrastructure across...  ..., and hybrid cloud environments, including virtualization, GPU-accelerated infrastructure, VDI, and specialized engineering... 
    Full time
    Temporary work
    Part time

    Shield AI

    San Francisco, CA
    2 days ago
  • Network Engineer Gimlet is building the first multi-silicon neocloud designed for fast, efficient...  .... We combine large-scale compute infrastructure with an execution platform that...  ...may also have: Experience with AI/HPC, GPU, or large-scale distributed infrastructure... 

    Gimlet Labs

    San Francisco, CA
    2 days ago
  • $170k - $210k

     ...Are Looking For We are seeking an experienced Senior Network Engineer (InfiniBand / UFM) to design, deploy, automate, and operate next-generation AI Factory networking infrastructure supporting large-scale GPU clusters. This role is responsible for building and... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    Lightning AI

    San Francisco, CA
    2 days ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers....  ...of superintelligence. One person, one GPU. If you'd like to build the world's...  ...and on-call rotation for Network Engineering team You Have 10+ years of experience in... 
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    2 days ago
  • $200k

    Infrastructure Engineer We're looking for an infrastructure engineer to own and evolve the security infrastructure that underpins our foundation...  ...don't meet all of these: Experience with ML infrastructure, GPU clusters, or large-scale training environments (schedulers,... 
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    2 days ago
  • Senior Network Engineer Houston; New York; San Francisco; Seattle About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve... 

    Nscale

    San Francisco, CA
    2 days ago
  • $180k - $225k

     ...Lightning AI is seeking a Senior Network Engineer with hands-on Cumulus Linux expertise to...  ...the network backbone behind our AI infrastructure platform. You’ll play a critical role in...  ...performance Ethernet fabrics supporting GPU clusters and AI workloads Build and maintain... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    Lightning AI

    San Francisco, CA
    2 days ago
  • $250k - $300k

     .... As the only vertically integrated AI infrastructure company built from the ground up, we own...  ...-time position reporting into Network Engineering, with the mandate to set optical strategy...  ...chain to align optical capacity with GPU cluster deployments, the backbone roadmap... 
    Full time
    Temporary work
    Flexible hours

    Crusoe

    San Francisco, CA
    4 days ago
  •  ...(***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro...  ...seeking a Machine Learning Infrastructure Engineer to help architect the compute, training,...  ...large-scale workloads across extensive GPU clusters.Build developer abstractions,... 
    Full time
    Work at office
    Flexible hours

    Objective Paradigm

    San Francisco, CA
    12 hours ago
  • $200k - $350k

     ...client. Build and tune the serving and training infrastructure behind specialized language models, from...  ...performance or stability gains. - Solid low-level engineering and troubleshooting ability, including familiarity with GPU memory and compute ceilings. - Deep... 
    Full time
    Work at office

    Raydar

    San Francisco, CA
    3 days ago
  • $200k - $300k

     ...operating cost. Work closely with customers and engineers to shape the direction of the work....  ...machine handles. - Write low-level GPU kernel code for accelerators from several...  ...fast career progression. - Backend, infrastructure or systems experience at a leading technology... 
    Full time
    Internship
    Work at office
    Immediate start
    Flexible hours

    Raydar

    San Francisco, CA
    3 days ago
  •  ...Sciforium is an AI infrastructure company developing next-generation multimodal AI models and...  ...from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the...  ...About the Role We are looking for a GPU Cluster Engineer to own the entire software... 
    Full time
    Flexible hours

    Sciforium

    San Francisco, CA
    8 days ago
  • $350k

     ...growing group of committed researchers, engineers, policy experts, and business leaders working...  ...'re looking for an engineer to own the infrastructure behind that research. This is the...  ...with machine learning framework internals, GPU or accelerator programming, or inference... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...teams across the United States to help them hire. Principal Infrastructure Engineer / Tech Lead Location San Francisco, CA On-site role...  ...infrastructure-as-code systems using tools such as Terraform Manage GPU allocation, instance sizing, and cloud resource utilization... 
    Fixed term contract
    H1b
    Immediate start
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  • $250k - $350k

     ...one builds what makes them actually work. We're hiring ML Infrastructure Engineers to tackle a hard, real-world problem, understanding what's happening...  ...and inference systems for multimodal / LLM-based models GPU infrastructure and performance optimisation Hybrid... 

    techire ai

    San Francisco, CA
    2 days ago
  • $230k

     ...deployment over unchecked growth.About the roleAs a software engineer on the Fleet High Performance Computing (HPC) team, you will...  ...to maintain the health and efficiency of our supercomputing infrastructure.Our team empowers strong engineers with a high degree of autonomy... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • Principal Network Engineer Houston; New York; San Francisco; Seattle Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior... 
    Flexible hours

    Nscale

    San Francisco, CA
    2 days ago
  • $200k - $400k

    Infrastructure Engineer We are looking for an Infrastructure Engineer who thrives on the complexity of modern deployment patterns. You will own...  ...workloads, specifically high-throughput inference systems or GPU-accelerated computing. Kubernetes Mastery: Strong K8s (EKS/GKE... 
    Flexible hours

    Simile

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Infrastructure Engineer. Be the first to apply!