Senior AI Infra SRE — GPU Clusters & On-Prem Kubernetes
Starlink
SpaceX is seeking a Sr. Site Reliability Engineer (STARSHIELD) to design, operate, and scale on‑premise GPU and AI infrastructure for a national security‑focused constellation. The role emphasizes automation, Kubernetes, and cross‑team collaboration with AI engineers to deliver highly available services. You will mentor junior engineers, lead critical infra initiatives, and work across data centers with stringent security requirements, including Top Secret clearance considerations. #J-18808-Ljbffr Starlink
- SpaceX is seeking a Sr. Software Engineer for AI Infrastructure (Starshield) to design, deploy, and scale on-prem and GPU-enabled AI clusters. You will automate Kubernetes/AI systems, manage core infra, and partner with AI teams to deliver highly available services at scale...Senior
- SpaceX is seeking a Sr. Site Reliability Engineer for AI Infrastructure (Starshield) to design, operate, and... ...security data. You will deploy and manage AI GPU clusters, GPU as a service, and core infra with Kubernetes, databases, and distributed storage. You will mentor...Senior
- ...engineer to lead the compute platform in Palo Alto, focusing on GPU clusters and scalable ML infrastructure. You will own the end-to-end... ...the CTO and shape the engineering direction, implementing Kubernetes-based orchestration, autoscaling, and efficient resource management...Senior
- SpaceX is hiring a Sr. Site Reliability Engineer focused on AI infrastructure for Starshield. You will design, operate, and scale GPU-enabled on-premise and Kubernetes-based AI clusters, and automate deployment and management of core services, databases, and storage. You...Senior
- SpaceX seeks a Sr. Software Engineer, AI Infrastructure (Starshield) to design and operate the software and GPU infrastructure supporting critical national-security... ...on-premise compute resources, automate Kubernetes/AI clusters, and collaborate with AI teams to deliver scalable...Senior
$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will... ..., BeeGFS), scheduling & orchestration (e.g., Slurm, Kubernetes, LSF), high-speed networking (e.g., Infiniband, RoCE...Full time- ..., and deployment of a private AI data center, from hardware procurement... ...planning through secure cluster operation. This is a project-... ...who has built and operated GPU infrastructure. The planned... ...monitoring. Select and configure Kubernetes, Slurm, or an appropriate...SeniorTemporary workFor contractorsRemote work
- NVIDIA is hiring software engineers with Kubernetes expertise to help scale its DGX Cloud GPU infrastructure for AI workloads. You will work on production systems, GPU resource scheduling, and cluster health monitoring. We seek 5+ years in a software engineering role, strong...
- Infrinia.ai, powered by SoftBank, in Silicon Valley seeks a Senior Software Engineer to build foundational AI infrastructure on GPU systems and Kubernetes. You will own major chunks of the infrastructure software, drive automation, and collaborate with engineering leads...Senior
- NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We seek Software Engineers with SRE/Production Engineering experience who have hands-on experience with bare-metal NVIDIA systems and who can develop tooling to move GPU capacity into...Senior
- ...seeking software engineers with SRE or Production Engineering... ...BMaaS/IaaS infrastructure for GPU systems. You will build automation... ...validation, firmware upgrades, and cluster lifecycle, while diagnosing complex issues across Linux, Kubernetes, and hardware. On-call duties...Senior
- Senior Solution Architect - AI / GPU Cloud We are seeking a Senior Solution Architect to... ...models. Architect GPU clusters, storage, networking, and... .... Partner with internal infra, DC ops, and engineering... ...inference architectures, Kubernetes, Slurm, or other cluster/...Senior
- JPMorganChase is seeking a Lead Software Engineer in the AI/ML Data Platforms group to design, build, and operate scalable ML training systems on AWS and Kubernetes. You will drive GPU-based training pipelines, performance optimizations, and governance across environments...Senior
- Blue Signal Search is seeking a GPU Network Engineer to design and operate the... ...performance networking backbone powering large AI training and inference workloads. You will work with experienced infra and compute teams to influence GPU cluster architecture and scalable data center...Senior
$184k - $287.5k
...amazing people. The GPU, our invention, serves... ...We're looking for a Senior SRE to own and scale the Kubernetes platform that... ...schedules do not move. The clusters you run sit... ...spanning multiple on-prem datacenters and multiple... ...vacancy. NVIDIA uses AI tools in its...Senior- A tech company in Palo Alto is actively seeking a Backend Engineer to develop systems that manage GPU clusters for AI workloads. The role demands 5+ years of backend experience, with strong skills in Go or Python. You will design APIs for GPU orchestration and manage resources...Senior
- A tech company focusing on AI infrastructure is seeking a Senior/Staff Backend Engineer to create innovative systems for managing GPU clusters. Ideal candidates will possess extensive experience in backend engineering with distributed systems, proficiency in languages like...SeniorWork at office3 days per week
- ...United StatesJob Title: Senior Kubernetes Platform Engineer /... ...teams, security teams, and SRE teams to deliver a... ...highly available Kubernetes clusters.Develop container... ...workloads.Experience with AI/ML platform deployments... ...environments.Experience with GPU-based Kubernetes...Senior
- ...At Rhoda AI, we’re building the next generation of generalist... ...improve on our cloud and GPU cluster, and create essential... ...Qualifications ~5+ years in DevOps / SRE / platform / infra, with ownership of... ...devices Knowledge with kubernetes and cloud system orchestration...Senior
$170.7k - $300.2k
Apple Inc. is looking for a Senior Software Engineer to join their Applied Machine Learning team in Cupertino, California... ...systems using cloud technologies like AWS and Kubernetes. With 8+ years of experience in SRE/MLOps and strong programming skills in Python/Java, ideal...Senior- ...infrastructure layer for the AI-first world. Our... ...run a multi-tenant GPU cloud for AI... ...platform capability. Senior, Staff Security Engineer... ...architecture for multi-tenant Kubernetes GPU clusters Design tenant... ...with platform, infra, and SRE teams ~ GPU isolation...Senior
- ...SEO paths, and support production systems across pipelines, CDN, and cloud infra. You’ll need strong Kubernetes, AWS, Python scripting, and on-call incident management skills to drive continuous improvements and support AI workloads at scale. #J-18808-Ljbffr DevopsrolesSenior
- Nace AI in Palo Alto, CA is seeking a Senior MLOps Engineer to own the production-grade ML infrastructure that... ...evaluation pipelines across cloud and on-prem environments. You'll lead LLM/SLM... ...and related tooling, manage multi-GPU clusters, and implement observability and...Senior
$152k - $287.5k
...to join their Scheduling team focused on developing advanced GPU compute clusters. Candidates should have a Bachelor’s degree in Computer Science... ...opportunities for equity. Join us to tackle challenges in AI workloads while working with cutting-edge technology. #J-1880...Senior- Rhoda AI is building the next generation of generalist robots, with the full stack from high... ...CD pipelines and the surrounding production infra to accelerate research. You will own build artifact storage, cloud and GPU clusters, and deployment paths for ML models, while...Senior
$152k - $241.5k
...builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering... ...upgrades, repair, and cluster lifecycle management.Develop... ...systems, networking, Linux, and Kubernetes; turn recurring issues into...SeniorPermanent employmentFull time- Kardow in Sunnyvale, CA seeks a senior software engineer to design high-performance AI frameworks for large-scale... ...systems. You will optimize GPU-driven workloads, integrate... ...LLMs, and lead test-automation infra across Kubernetes-based clusters. You are expected to have...Senior
- CoreWeave is Hiring for a senior role in Sunnyvale, CA, focusing on Applied Training and a Kubernetes-native research cluster platform. You will design, build, and own infrastructure that accelerates AI research and training at scale, collaborating closely with customers...SeniorFull time
- ...on Platform Engineer to own the infrastructure for our deploy-anywhere platform. You’ll manage Kubernetes clusters, CI/CD, IaC, and observability, across AWS, GCP, and on-prem environments including air-gapped setups. You’ll contribute to backend services and scale ML/...Remote jobWork at office
- ...At Nace AI, we are redefining how professional... ...Overview: As a Senior MLOps Engineer, you... ...and manage multi-GPU training and inference clusters (scheduling, utilization... ...across cloud and on-prem environments.... ...Strong proficiency with Kubernetes , containerization...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infra SRE — GPU Clusters & On-Prem Kubernetes. Be the first to apply!
- senior living Palo Alto, CA
- senior associate vice president Palo Alto, CA
- senior app developer Palo Alto, CA
- senior manufacturing engineer Palo Alto, CA
- senior ml engineer Palo Alto, CA
- senior application support engineer Palo Alto, CA
- senior recruitment consultant Palo Alto, CA
- senior manager data analytics Palo Alto, CA
- senior devops Palo Alto, CA
- senior supply chain manager Palo Alto, CA


