Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer - GPU as a Service

$180k - $280k
Full-time

DigipowerX

Salary: $180,000 - 280,000 per year Requirements:

  • We are looking for at least 4 years of experience shipping production systems, including hands-on work with GPU or ML infrastructure.
  • We need strong Python skills plus proficiency in at least one of Go, C++, or Rust.
  • We expect practical experience with CUDA, NCCL, or similar NVIDIA GPU technologies in production settings.
  • We prefer experience with Kubernetes, Linux, and high-performance networking.
  • We value candidates who can thrive in a small team and take ownership of problems from start to finish.
  • Bonus experience includes neocloud, GPU cloud, or HPC scheduler environments.
  • Additional advantage if you have worked with LLM serving tools such as vLLM, TensorRT-LLM, or Triton.
  • Familiarity with multi-tenant isolation, billing metering, or quota systems is a plus.
Responsibilities:
  • We build and operate the control plane for GPU allocation, scheduling, and multi-tenant service delivery.
  • We deploy inference and training workloads on our clusters using CUDA, containers, Kubernetes, or comparable tools.
  • We own the reliability, utilization, and performance of our GPUaaS platform.
  • We collaborate with site operations and customers on cluster bring-up, networking, and capacity planning.
  • We develop the APIs and internal tooling that our customers and teams rely on.
Technologies:
  • Cloud
  • CUDA
  • Kubernetes
  • LLM
  • Linux
  • Python
  • Rust
  • vLLM
  • DevOps

More:

We are DigiPower X (NASDAQ: DGXX), a Bay Area-based company offering a full-time role in an on-site or hybrid environment. This production-focused position builds the software behind our GPU-as-a-Service platform, bringing our NVIDIA B300, Vera Rubin, and related GPU systems to customers as a service. The compensation range is $180,000 to $280,000 base salary, depending on scope and experience, plus equity.

last updated 33 week of 2026

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer - GPU as a Service in Sunnyvale, CA vacancy
  • $114.6k - $234.6k

    Oracle Cloud Infrastructure (OCI) is seeking a Principal Systems Software Engineer to help build and evolve the low-...  ...power next-generation GPU infrastructure.This is...  ...capabilities spanning BMC/service-processor software,...  ...-saving care. And with AI embedded across our products... 
    Suggested
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    4 days ago
  • $160k - $225k

     ...Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In...  ...and evolution of AIR's managed GPU training platform, ensuring scalable and...  ...knowledge of GPU performance and training infrastructure. This position comes with a competitive... 
    Suggested

    Databricks

    Mountain View, CA
    6 hours ago
  •  ...Oracle Cloud Infrastructure (OCI) is seeking a Principal Systems Software Engineer to help build and evolve the low...  ...power next-generation GPU infrastructure. This...  ...capabilities spanning BMC/service-processor software,...  ...-saving care. And with AI embedded across our products... 
    Suggested
    Flexible hours

    Socket.dev

    Santa Clara, CA
    6 hours ago
  • Crusoe Cloud is revolutionizing high-performance computing with sustainable GPU compute power. As a Cloud Support Engineer, you will be the primary contact for technical support, helping customers leverage Crusoe Cloud to achieve their goals and accelerate research and... 
    Suggested
    Remote work

    Crusoe

    Sunnyvale, CA
    4 days ago
  • $192.1k - $249.6k

     ...Senior AI Inference Infrastructure Software EngineerNIO is a pioneer and a leading...  ...technologies, Battery as a Service, or BaaS, as well as its proprietary...  ...Infrastructure Software Engineer with strong hands-on...  ...specific hardware accelerators (GPU, NPU, DSP, etc.), improving... 
    Suggested
    Full time
    Temporary work
    Immediate start
    Flexible hours

    NIO

    San Jose, CA
    3 days ago
  • $142.8k - $274.8k

     ...EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewThe AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform,...  ...that enable teams to develop, deploy, and operate AI services at scale. We create foundational capabilities spanning... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    2 days ago
  • $200k - $322k

     ...decades. Our invention of the GPU in 1999 sparked the growth of...  ...deep learning ignited modern AI — the next era of computing....  ...to join us today.Design-for-X Engineering at NVIDIA works on...  ...deployment cycles as part of the AI Infrastructure requirements at an org-wide level... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $170.5k - $315.49k

    Job Details:Job Description: We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures.In this role, you will dive deep into the inference stack and redefine peak performance... 
    Full time
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    1 day ago
  • $190k - $260k

     ...artificial intelligence (AI) powered technology...  ...world models - depends on infrastructure that turns thousands...  .... We are looking for engineers who make model...  ...without stalling a single GPU, sharding data and models...  ...benefits)MetLife Legal Services, Identity & Fraud... 
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    2 days ago
  •  ...company is seeking a Principal Application Support Engineer to join their AI Networking Infrastructure support team in Santa Clara, CA. The role involves...  ...teams to tackle complex customer issues, ensuring serviceability and product quality, and providing training to... 

    AMD

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

     ...NVIDIA's next-generation gaming service powered by GPUs in the cloud,...  ...highly skilled and motivated engineers who bring GeForce NOW to life!...  ...critical software, tools, CPU/GPU scheduler.Passionate about software...  ...existing vacancy. NVIDIA uses AI tools in its recruiting... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our...  ...infrastructure software engineer to join our team. You'll...  ...and improve system and service reliability.Skilled in...  ...and Visualization. The GPU, our invention, serves... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $174k - $252k

     ...hardware, network, or service operations and quality....  ...developing large-scale infrastructure, distributed systems or...  ...development.Google's software engineers develop the next-...  ...Contribute to projects enabling AI networking and high-...  ...fabrics for TPU and GPU workloads.Our Platforms... 

    Google

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...Computing and Visualization. The GPU, our invention, serves as the...  ...the heart of our products and services. Our work opens up new...  ...highly motivated Senior Software Engineers to work on our GPU Fabric Networking...  ...existing vacancy. NVIDIA uses AI tools in its recruiting... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...A leading AI technology firm in California is seeking an experienced Senior Software Engineer to develop and optimize AI infrastructure software using state-of-the-art GPU systems. Candidates should have a Bachelor's degree in a technical field and a minimum of 5 years... 

    Intelliswift - An LTTS Company

    Sunnyvale, CA
    6 hours ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the next era...  ...computing. An era in which our GPU acts as the brains of...  ...Senior AI Platform Engineers. They will set the...  ...the intersection of ML infrastructure and large-scale systems...  ...latency-sensitive backend service from initial architecture... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $178k - $321k

     ...function has an early but working AI-native capability: a multi-...  ...and the governed data and AI infrastructure everything else depends on....  ...it. This is a two-person engineering team: you deploy, debug, and...  ...Production-grade here means service levels sized for an internal... 

    OKX

    San Jose, CA
    4 days ago
  •  ...computing experiences—from AI and data centers, to PCs, gaming...  ...a AI Research Scientist - Infrastructure Engineer, Reinforcement Learning, to...  ...researcher‑facing APIs across large GPU fleets. You make RL...  ...agencies, or fee-based recruitment services. AMD and its subsidiaries... 

    AMD

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...multi-rack, multi-tenant AI/ML datacenters with NVIDIA...  ...NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider) Engagements team...  ...-services that expose new GPU capabilities.Drive joint...  ..., OpenTelemetry), and infrastructure-as-code.Excellent communication... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...NVIDIA's Cloud Gaming service, streaming games at the...  ...empowers every GeForce NOW engineer to deliver confidently...  ...-heals, you build the infrastructure behind it.What You'll...  ...engineeringDaily use of AI-assisted tools (Claude...  ...infrastructure spanning on-premises GPU clusters and public... 
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...NOW is NVIDIA's Cloud Gaming service, streaming games at the highest...  ...experienced Systems Software Engineering Manager to lead a team building...  ...achieve business success in the GPU Cloud space, including SW...  ...existing vacancy. NVIDIA uses AI tools in its recruiting processes... 
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    2 days ago
  • AMD is seeking a Staff Software Developer to advance AI software on GPUs, focusing on high-performance C++ and low-level kernel work....  ...hardware-software co-design. The role requires deep expertise in GPU programming, LLMs, and AI systems, plus capability to mentor others... 

    AMD

    Santa Clara, CA
    6 days ago
  •  ...computing experiences—from AI and data centers, to...  ...AI / ML Platform Engineers to build the platform...  ...This role focuses on the infrastructure and platform systems that...  ...management, and GPU cluster utilization.You...  ...workflows into reusable services, APIs, dashboards, job... 

    AMD

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of...  ...recipes, and model bring-up infrastructure — that lets developers run groundbreaking...  ...Computer Science, Computer Engineering, Electrical Engineering, or... 
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    2 days ago
  • $165k - $242k

     ...The Essential Cloud for AI™. Built for pioneers...  ...CoreWeave combines superior infrastructure performance with deep...  ...the role Senior engineers are area owners who...  ...reliability across multiple services. You'll partner with...  ...teams to evolve our GPU performance testing... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    24 days ago
  • NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware...  ...stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that designs... 

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  •  ...Oracle Cloud Infrastructure seeks a Principal Systems Software Engineer to build and evolve low-level systems software for next‑gen GPU infrastructure. This is a hands-on role spanning software, firmware, hardware and cloud-scale fleet operations. You’ll work across... 

    Socket.dev

    Santa Clara, CA
    6 hours ago
  • $272k - $431.25k

     ...NVIDIA DGX Cloud is the AI supercomputing-as-a-service substrate designed to power the next generation...  .... As a Security Data Engineer within our Infrastructure Security Engineering organization...  ...fragmented telemetry from a 250,000+ GPU fleet into a single, queryable, trustworthy... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    6 days ago
  •  ...Devices, Inc. is seeking an influential software engineer to improve performance profiling for AMD GPUs. You...  ...and software, driving profiling capabilities for AI and HPC workloads. The ideal candidate excels in C++, GPU programming, and Linux development, with experience... 

    Advanced Micro Devices, Inc.

    Santa Clara, CA
    4 days ago
  •  ...computing experiences—from AI and data centers, to...  ...for an influential engineer working on software and...  ...development of startup/GPU AI hardware, including...  ...PREFERRED EXPERIENCE:Deep AI infrastructure experience with open-...  ...fee-based recruitment services. AMD and its subsidiaries... 

    AMD

    San Jose, CA
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer - GPU as a Service. Be the first to apply!