AI Infrastructure Engineer - GPU as a Service
$180k - $280kDigipowerX
Salary: $180,000 - 280,000 per year Requirements:
- We are looking for at least 4 years of experience shipping production systems, including hands-on work with GPU or ML infrastructure.
- We need strong Python skills plus proficiency in at least one of Go, C++, or Rust.
- We expect practical experience with CUDA, NCCL, or similar NVIDIA GPU technologies in production settings.
- We prefer experience with Kubernetes, Linux, and high-performance networking.
- We value candidates who can thrive in a small team and take ownership of problems from start to finish.
- Bonus experience includes neocloud, GPU cloud, or HPC scheduler environments.
- Additional advantage if you have worked with LLM serving tools such as vLLM, TensorRT-LLM, or Triton.
- Familiarity with multi-tenant isolation, billing metering, or quota systems is a plus.
- We build and operate the control plane for GPU allocation, scheduling, and multi-tenant service delivery.
- We deploy inference and training workloads on our clusters using CUDA, containers, Kubernetes, or comparable tools.
- We own the reliability, utilization, and performance of our GPUaaS platform.
- We collaborate with site operations and customers on cluster bring-up, networking, and capacity planning.
- We develop the APIs and internal tooling that our customers and teams rely on.
- Cloud
- CUDA
- Kubernetes
- LLM
- Linux
- Python
- Rust
- vLLM
- DevOps
More:
We are DigiPower X (NASDAQ: DGXX), a Bay Area-based company offering a full-time role in an on-site or hybrid environment. This production-focused position builds the software behind our GPU-as-a-Service platform, bringing our NVIDIA B300, Vera Rubin, and related GPU systems to customers as a service. The compensation range is $180,000 to $280,000 base salary, depending on scope and experience, plus equity.
last updated 33 week of 2026
$114.6k - $234.6k
Oracle Cloud Infrastructure (OCI) is seeking a Principal Systems Software Engineer to help build and evolve the low-... ...power next-generation GPU infrastructure.This is... ...capabilities spanning BMC/service-processor software,... ...-saving care. And with AI embedded across our products...SuggestedTemporary workFlexible hours$160k - $225k
...Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In... ...and evolution of AIR's managed GPU training platform, ensuring scalable and... ...knowledge of GPU performance and training infrastructure. This position comes with a competitive...Suggested- ...Oracle Cloud Infrastructure (OCI) is seeking a Principal Systems Software Engineer to help build and evolve the low... ...power next-generation GPU infrastructure. This... ...capabilities spanning BMC/service-processor software,... ...-saving care. And with AI embedded across our products...SuggestedFlexible hours
- Crusoe Cloud is revolutionizing high-performance computing with sustainable GPU compute power. As a Cloud Support Engineer, you will be the primary contact for technical support, helping customers leverage Crusoe Cloud to achieve their goals and accelerate research and...SuggestedRemote work
$192.1k - $249.6k
...Senior AI Inference Infrastructure Software EngineerNIO is a pioneer and a leading... ...technologies, Battery as a Service, or BaaS, as well as its proprietary... ...Infrastructure Software Engineer with strong hands-on... ...specific hardware accelerators (GPU, NPU, DSP, etc.), improving...SuggestedFull timeTemporary workImmediate startFlexible hours$142.8k - $274.8k
...EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewThe AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform,... ...that enable teams to develop, deploy, and operate AI services at scale. We create foundational capabilities spanning...Ongoing contractLocal area3 days per week$200k - $322k
...decades. Our invention of the GPU in 1999 sparked the growth of... ...deep learning ignited modern AI — the next era of computing.... ...to join us today.Design-for-X Engineering at NVIDIA works on... ...deployment cycles as part of the AI Infrastructure requirements at an org-wide level...Full time$170.5k - $315.49k
Job Details:Job Description: We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures.In this role, you will dive deep into the inference stack and redefine peak performance...Full timeLocal areaImmediate startShift work$190k - $260k
...artificial intelligence (AI) powered technology... ...world models - depends on infrastructure that turns thousands... .... We are looking for engineers who make model... ...without stalling a single GPU, sharding data and models... ...benefits)MetLife Legal Services, Identity & Fraud...Temporary workWork at officeVisa sponsorship- ...company is seeking a Principal Application Support Engineer to join their AI Networking Infrastructure support team in Santa Clara, CA. The role involves... ...teams to tackle complex customer issues, ensuring serviceability and product quality, and providing training to...
$224k - $356.5k
...NVIDIA's next-generation gaming service powered by GPUs in the cloud,... ...highly skilled and motivated engineers who bring GeForce NOW to life!... ...critical software, tools, CPU/GPU scheduler.Passionate about software... ...existing vacancy. NVIDIA uses AI tools in its recruiting...Full time$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our... ...infrastructure software engineer to join our team. You'll... ...and improve system and service reliability.Skilled in... ...and Visualization. The GPU, our invention, serves...Full timeRemote work$174k - $252k
...hardware, network, or service operations and quality.... ...developing large-scale infrastructure, distributed systems or... ...development.Google's software engineers develop the next-... ...Contribute to projects enabling AI networking and high-... ...fabrics for TPU and GPU workloads.Our Platforms...$152k - $241.5k
...Computing and Visualization. The GPU, our invention, serves as the... ...the heart of our products and services. Our work opens up new... ...highly motivated Senior Software Engineers to work on our GPU Fabric Networking... ...existing vacancy. NVIDIA uses AI tools in its recruiting...Full timeRemote work- ...A leading AI technology firm in California is seeking an experienced Senior Software Engineer to develop and optimize AI infrastructure software using state-of-the-art GPU systems. Candidates should have a Bachelor's degree in a technical field and a minimum of 5 years...
$184k - $287.5k
...unlimited potential of AI to define the next era... ...computing. An era in which our GPU acts as the brains of... ...Senior AI Platform Engineers. They will set the... ...the intersection of ML infrastructure and large-scale systems... ...latency-sensitive backend service from initial architecture...Full time$178k - $321k
...function has an early but working AI-native capability: a multi-... ...and the governed data and AI infrastructure everything else depends on.... ...it. This is a two-person engineering team: you deploy, debug, and... ...Production-grade here means service levels sized for an internal...- ...computing experiences—from AI and data centers, to PCs, gaming... ...a AI Research Scientist - Infrastructure Engineer, Reinforcement Learning, to... ...researcher‑facing APIs across large GPU fleets. You make RL... ...agencies, or fee-based recruitment services. AMD and its subsidiaries...
$184k - $287.5k
...multi-rack, multi-tenant AI/ML datacenters with NVIDIA... ...NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider) Engagements team... ...-services that expose new GPU capabilities.Drive joint... ..., OpenTelemetry), and infrastructure-as-code.Excellent communication...Full timeRemote work$184k - $287.5k
...NVIDIA's Cloud Gaming service, streaming games at the... ...empowers every GeForce NOW engineer to deliver confidently... ...-heals, you build the infrastructure behind it.What You'll... ...engineeringDaily use of AI-assisted tools (Claude... ...infrastructure spanning on-premises GPU clusters and public...Full timeLocal area$272k - $431.25k
...NOW is NVIDIA's Cloud Gaming service, streaming games at the highest... ...experienced Systems Software Engineering Manager to lead a team building... ...achieve business success in the GPU Cloud space, including SW... ...existing vacancy. NVIDIA uses AI tools in its recruiting processes...Full timeLocal area- AMD is seeking a Staff Software Developer to advance AI software on GPUs, focusing on high-performance C++ and low-level kernel work.... ...hardware-software co-design. The role requires deep expertise in GPU programming, LLMs, and AI systems, plus capability to mentor others...
- ...computing experiences—from AI and data centers, to... ...AI / ML Platform Engineers to build the platform... ...This role focuses on the infrastructure and platform systems that... ...management, and GPU cluster utilization.You... ...workflows into reusable services, APIs, dashboards, job...
$224k - $356.5k
...into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of... ...recipes, and model bring-up infrastructure — that lets developers run groundbreaking... ...Computer Science, Computer Engineering, Electrical Engineering, or...Full timeLocal area$165k - $242k
...The Essential Cloud for AI™. Built for pioneers... ...CoreWeave combines superior infrastructure performance with deep... ...the role Senior engineers are area owners who... ...reliability across multiple services. You'll partner with... ...teams to evolve our GPU performance testing...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware... ...stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that designs...
- ...Oracle Cloud Infrastructure seeks a Principal Systems Software Engineer to build and evolve low-level systems software for next‑gen GPU infrastructure. This is a hands-on role spanning software, firmware, hardware and cloud-scale fleet operations. You’ll work across...
$272k - $431.25k
...NVIDIA DGX Cloud is the AI supercomputing-as-a-service substrate designed to power the next generation... .... As a Security Data Engineer within our Infrastructure Security Engineering organization... ...fragmented telemetry from a 250,000+ GPU fleet into a single, queryable, trustworthy...Full timeRemote work- ...Devices, Inc. is seeking an influential software engineer to improve performance profiling for AMD GPUs. You... ...and software, driving profiling capabilities for AI and HPC workloads. The ideal candidate excels in C++, GPU programming, and Linux development, with experience...
- ...computing experiences—from AI and data centers, to... ...for an influential engineer working on software and... ...development of startup/GPU AI hardware, including... ...PREFERRED EXPERIENCE:Deep AI infrastructure experience with open-... ...fee-based recruitment services. AMD and its subsidiaries...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer - GPU as a Service. Be the first to apply!
- ai ml engineer Sunnyvale, CA
- machine learning ai engineer Sunnyvale, CA
- ai developer Sunnyvale, CA
- ai engineer Sunnyvale, CA
- ai prompt engineer Sunnyvale, CA
- senior ai engineer Sunnyvale, CA
- ai engineer remote Sunnyvale, CA
- infrastructure engineering manager Sunnyvale, CA
- data infrastructure engineer Sunnyvale, CA
- senior infrastructure engineer Sunnyvale, CA



