AI Cloud Systems Engineer — LLMs, Kubernetes & Triton

Jobleads-US

NVIDIA in Silicon Valley invites a versatile Systems Software Engineer - AI and Cloud to drive cloud-native AI workloads and high-performance inference. You’ll work with cross-functional teams to push NVIDIA’s AI and cloud technologies forward and craft scalable software for production-grade environments.

You will mentor with Triton Inference Server, vLLM, and Kubernetes, develop tutorials and sample code, and contribute to public demos and whitepapers.

#J-18808-Ljbffr Jobleads-US

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the AI Cloud Systems Engineer — LLMs, Kubernetes & Triton in Santa Clara, CA vacancy

Sr. System Engineer/GPU Platforms
$137k - $156k
...solutions for Data Center, Cloud Computing, Enterprise... ..., and committed engineers, technologists, and business... ...an experienced Senior Systems Engineer / GPU Platforms... ...server systems used for AI, HPC, enterprise... ...with Docker, containers, Kubernetes, or related orchestration...
Suggested
Worldwide
Super Micro Computer
San Jose, CA
1 day ago
Senior Software Engineer, Distributed Systems Engineer - DGX Cloud
$152k - $241.5k
NVIDIA is hiring experienced software engineers with kubernetes experience to help scale up its AI Infrastructure. We expect you to have significant... ...be doing:You will be part of an DGX Cloud team responsible for production systems that enable large scalable GPU clusters...
Suggested
Full time
Nvidia
Santa Clara, CA
3 days ago
Senior Software Engineer - Kubernetes Backend and Platform Engineering
$160k - $320k
...SMTS) to join our Nutanix Kubernetes Platform (NKP) team in... ..., enterprise-grade cloud-native solutions at the... ...combine strong backend engineering skills with deep Kubernetes... .... It supports AI/ML workloads, GPU infrastructure... ..., and storage systems. NKP simplifies Kubernetes...
Suggested
Work at office
Local area
Remote work
Relocation package
3 days per week
Nutanix
San Jose, CA
4 days ago
HPC Systems Engineer - AI Workloads
...scientific discovery to powering AI and the technologies people... ...ROLE:We are seeking an AI Systems Engineer to join our AMD IT compute platforms... ...- Distributed ML services, LLMs and AI inferencing, by... ...for AI/HPC domain SLURM and Kubernetes management Managing GPU clusters...
Suggested
AMD
San Jose, CA
22 hours ago
System Engineer IV, Platform (E4
$161k - $221k
...the global leader in materials science and engineering solutions that are at the foundation of... ...create and service is essential to advancing AI and accelerating the commercialization of... ...go. Learn more about our benefits. As a Systems Engineer, you’ll design, integrate, and...
Suggested
Full time
Remote work
Applied Materials
Santa Clara, CA
1 day ago
System Engineer - Platform Integration
...are a fastgrowing, wellfunded silicon, systems, and solutions company pioneering a new... ...infrastructure—from data centers to nextgeneration cloud and AI platforms—by securing systems at the... ...technology takes more than great engineering—it takes a team of exceptional people...
Axiado Corporation
San Jose, CA
1 day ago
Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - Federal
$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...and services within the cloud-native platform, taking... ...operating workloads on Kubernetes.Working experience with... ...skills in Go (or another systems language with a willingness...
Permanent employment
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
2 days per week
ServiceNow
Santa Clara, CA
22 hours ago
Senior Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - Federal
$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...key-value stores — on Kubernetes, and serves as the technical... ...reviews for stateful systems.You will spend significant... ...services (RDS/Aurora, Cloud SQL, MSK, ElastiCache),...
Permanent employment
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
2 days per week
ServiceNow
Santa Clara, CA
22 hours ago
Systems Engineering Manager, AV Platform Software
$189.3k - $290.7k
...congestion. Our teams develop the software, systems and technology that make advanced driver... ...programs.The RoleThe Manager, Systems Engineering, AV Platform Software will lead a team of... ...metrics, automation, and responsible use of AI-enabled tools.Build a high-performing...
Full time
H1b
Local area
Work from home
Relocation
Relocation package
General Motors
Sunnyvale, CA
3 days ago
Senior Hardware Systems Engineer - LPU Platform Pathfinding
$184k - $287.5k
...the boundaries of innovation and engineering? At NVIDIA, we lead the world in accelerated... ...computing—driving progress in AI, graphics, and high‑performance systems.As a Senior Hardware Systems... ...silicon, architecture, data center, cloud, product, and manufacturing teams...
Full time
Nvidia
Santa Clara, CA
1 day ago
Principal Engineer, Cloud Site Reliability Engineering
$272k - $431.25k
NVIDIA is looking for a Cloud Site Reliability Engineering Architect to work in IPP's (... ...and devices with operating systems like Windows, Linux, and... ...speed and cost efficiency of AI development and testing... ...like: OpenStack, Docker, Kubernetes, Chef/Puppet, Hadoop/Ceph/...
Full time
Work experience placement
Worldwide
Nvidia
Santa Clara, CA
4 days ago
Staff Site Reliability Engineer - AI Platform Runtime
$168k - $270.25k
Site Reliability Engineering (SRE) at NVIDIA is an engineering... ...maintain large scale production systems with high efficiency and... ...deployment, open source cloud enabling technologies like Kubernetes and Public Cloud. SRE at... ...NVIDIA’s next-generation AI-driven enterprise...
Full time
Nvidia
Santa Clara, CA
22 hours ago
Engineering Manager, AI Platform
...vertically integrated AI infrastructure... ..., and cloud services.... ...Role: As an Engineering Manager on the... ...Language Models (LLMs). You will be responsible... ...management systems, cost-aware scheduling... ...with Kubernetes, gRPC, and observability... ...Hugging Face, Triton). Personal...
Temporary work
Work at office
Crusoe
Sunnyvale, CA
27 days ago
AI Cloud Senior DevOps Engineer
...technology company for AI and Bitcoin mining... ...offers advanced cloud capabilities to... ...Cloud Senior DevOps Engineer to join our AI... ...infrastructure using Kubernetes (K8s) and Docker.... ...logging, and alerting systems (e.g., Prometheus,... ...(e.g., vLLM, TGI, Triton Inference Server),...
Full time
Local area
Bitdeer Technologies Group
San Jose, CA
a month ago
Senior Systems Engineer, Enterprise AI Platforms
$182k - $242k
...Job Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...2025. Learn more at What You'll Do: IT Engineering at CoreWeave designs, builds, and operates the systems that enable our employees and acquired...
Permanent employment
Full time
Temporary work
Casual work
Work at office
Flexible hours
CoreWeave
Sunnyvale, CA
10 days ago
Senior Software Engineer, Google Cloud Kubernetes Networking
$174k - $252k
...technologies.Triage product or system issues and debug/track/... ...features to enable AI/ML workloads in Google Distributed Cloud (GDC) platforms.... ...VM workloads running on Kubernetes platforms.Design and develop... ...Linux OSs.Google's software engineers develop the next-...
Google
Sunnyvale, CA
13 hours ago
Principal Rust Systems Engineer — AI Platform Bringup Equity
...NVIDIA in Santa Clara, CA is seeking a Principal Software Engineer for LPX System Software to shape the hardware abstraction layers and core libraries that enable a deterministic compute architecture. This role blends OS-level engineering with high-availability runtimes...
Jobleads-US
Santa Clara, CA
5 days ago
Senior AI Cloud Storage Systems Engineer
...NVIDIA Corporation seeks a Production Storage Engineer to design, deploy, and optimize large-scale storage clusters for GPU-accelerated AI/ML workloads in Santa Clara, CA. You will... ...availability across distributed storage systems. You will work with cutting-edge...
Jobleads-US
Santa Clara, CA
5 days ago
Senior Platform AI Engineer — Agentic AI & RAG Systems
...seeks a senior full-stack software engineer to build next-generation AI platforms and products, focusing... ...shape architecture and scale systems with Cloud, AI/ML, and Generative AI teams in... ...knowledge of LLM-powered architectures, Kubernetes deployments, and proficiency in...
Jobleads-US
Santa Clara, CA
1 day ago
Cloud Systems Engineer - Automation & AI Ops
...Google LLC is seeking a highly skilled Operations Engineer for the EDACloud platform in Sunnyvale, CA. The role focuses on maintaining... ...and improving scalable microservices. Strong Linux expertise and cloud design experience are required. The candidate should have 5+...
Jobleads-US
Sunnyvale, CA
1 day ago
Senior Software Engineer, Platform Engineering
$168k - $270.25k
...unlimited potential of AI to define the next... ...- Stack Software Engineer to build the next... ...scaling of our software systems. This role will... ...to collaborate with Cloud, AI/ML & Generative... ...that leverage LLMs for reasoning, planning... ...deploying applications in Kubernetes...
Full time
Immediate start
Nvidia
Santa Clara, CA
1 day ago
Systems Software Engineer - AI and Cloud
$124k - $195.5k
...unlimited potential of AI to define the next... ...in AI and cloud computing. As a versatile System Software Engineer - AI and Cloud, you... ...systems optimized for Kubernetes deployment, using... ...vLLM and NVIDIA Triton Inference Server.A... ...Advanced knowledge of LLMs, modern AI...
Full time
Nvidia
Santa Clara, CA
1 day ago
Senior Kubernetes Platform Engineer
...95035, United StatesJob Title: Senior Kubernetes Platform Engineer / ArchitectLocation: Milpitas, CAExperience... ...Kubernetes, container orchestration, cloud-native technologies, platform... ...engineering and R&D workloads.Experience with AI/ML platform deployments on Kubernetes....
Apptad
Milpitas, CA
1 day ago
Senior Software Engineer - GPU Local AI Platforms
$224k - $356.5k
...unlimited potential of AI to define the next era... ...developers run groundbreaking LLMs out of the box. The... ...Science, Computer Engineering, Electrical Engineering... ...depth in GPU computing, ML systems, or high-performance... ...optimization (CUDA/C++, Triton, or equivalent) — you understand...
Full time
Local area
Nvidia
Santa Clara, CA
1 day ago
SRE Monitoring Platform Software Engineer (Entry Level)
...technology company for AI and Bitcoin mining infrastructure... ...also offers advanced cloud capabilities to... ...Their signals become the system you help build. As... ...entry-level Software Engineer on the SRE / Monitoring... ...standard debugging tools. ~ Kubernetes basics — understand...
Full time
Contract work
Internship
Local area
Bitdeer
San Jose, CA
11 days ago
Platform Hardware and Systems Engineering - Intern, Bachelor's
$91.2k
...advanced semiconductor manufacturing to AI-powered innovations, you'll play a role in... ...global deployment. Whether you're tackling engineering challenges, improving operations,... ...of computing. As a Platform Hardware and Systems Engineering Intern, you'll work on meaningful...
Hourly pay
Summer work
Internship
Local area
Immediate start
Worldwide
Relocation package
Shift work
Intel
Santa Clara, CA
1 day ago
Senior Site Reliability Engineer - Managed Kubernetes
Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure... ...day is currently Tuesday.Engineering at Lambda is responsible for... ...Lambda website, cloud APIs and systems as well as internal... ...DoOperate and maintain bare-metal Kubernetes clusters, scaling up to...
Work at office
Local area
Work from home
Flexible hours
Lambda Labs
San Jose, CA
22 hours ago
Principal Software Engineer, Retail and CPG Platform Architecture
$240k - $379.5k
...Platform and collaborate with engineering to build the platform.... ...of enterprise AI architectures will make... ...commerce Architect and build systems hands-on, using... ...including experience with LLMs, RAG, and agent-based systems... ...libraries (CUDA, Triton, TensorRT). Background...
Full time
Work experience placement
Nvidia
Santa Clara, CA
2 days ago
Cloud AI Systems Engineer - Automation & Scale
...Amazon AWS Hardware Engineering seeks a leader who designs and operates scalable server systems for AI-powered cloud platforms. You will drive architectural decisions, own critical components, and deliver improvements across EC2 and related services. The role requires...
Jobleads-US
Cupertino, CA
1 day ago
Devops Platform Engineer
...discovery to powering AI and the technologies people... ...a hands-on Platform Engineer to build and operate the... ...platform across Kubernetes, observability, AI-enabled... ...comparable observability systems.Experience with IBM LSF... ...engineering, DevOps, SRE, cloud infrastructure, or...
AMD
San Jose, CA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Cloud Systems Engineer — LLMs, Kubernetes & Triton. Be the first to apply!