AI Cloud Systems Engineer LLMs, Kubernetes & Triton
NVIDIA
NVIDIA in Silicon Valley invites a versatile Systems Software Engineer - AI and Cloud to drive cloud-native AI workloads and high-performance inference. You’ll work with cross-functional teams to push NVIDIA’s AI and cloud technologies forward and craft scalable software for production-grade environments. You will mentor with Triton Inference Server, vLLM, and Kubernetes, develop tutorials and sample code, and contribute to public demos and whitepapers. #J-18808-Ljbffr NVIDIA
$184k - $287.5k
...SRE to own and scale the Kubernetes platform that assists NVIDIA... ...and multiple public clouds. When these clusters degrade... ...that actually change the system. Partner with EDA engineering, storage, and network teams... ...existing vacancy. NVIDIA uses AI tools in its recruiting...Suggested$137k - $156k
...solutions for Data Center, Cloud Computing, Enterprise... ..., and committed engineers, technologists, and business... ...an experienced Senior Systems Engineer / GPU Platforms... ...server systems used for AI, HPC, enterprise... ...with Docker, containers, Kubernetes, or related orchestration...SuggestedWorldwide$152k - $241.5k
NVIDIA is hiring experienced software engineers with kubernetes experience to help scale up its AI Infrastructure. We expect you to have significant... ...be doing:You will be part of an DGX Cloud team responsible for production systems that enable large scalable GPU clusters...SuggestedFull time- ...scientific discovery to powering AI and the technologies people... ...ROLE:We are seeking an AI Systems Engineer to join our AMD IT compute platforms... ...- Distributed ML services, LLMs and AI inferencing, by... ...for AI/HPC domain SLURM and Kubernetes management Managing GPU clusters...Suggested
$160k - $320k
...SMTS) to join our Nutanix Kubernetes Platform (NKP) team in... ..., enterprise-grade cloud-native solutions at the... ...combine strong backend engineering skills with deep Kubernetes... .... It supports AI/ML workloads, GPU infrastructure... ..., and storage systems. NKP simplifies Kubernetes...SuggestedWork at officeLocal areaRemote workRelocation package3 days per week- ...are a fastgrowing, wellfunded silicon, systems, and solutions company pioneering a new... ...infrastructure—from data centers to nextgeneration cloud and AI platforms—by securing systems at the... ...technology takes more than great engineering—it takes a team of exceptional people...
$161k - $221k
...the global leader in materials science and engineering solutions that are at the foundation of... ...create and service is essential to advancing AI and accelerating the commercialization of... ...go. Learn more about our benefits. As a Systems Engineer, you’ll design, integrate, and...Full timeRemote work$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...and services within the cloud-native platform, taking... ...operating workloads on Kubernetes.Working experience with... ...skills in Go (or another systems language with a willingness...Permanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...key-value stores — on Kubernetes, and serves as the technical... ...reviews for stateful systems.You will spend significant... ...services (RDS/Aurora, Cloud SQL, MSK, ElastiCache),...Permanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$184k - $287.5k
...the boundaries of innovation and engineering? At NVIDIA, we lead the world in accelerated... ...computing—driving progress in AI, graphics, and high‑performance systems.As a Senior Hardware Systems... ...silicon, architecture, data center, cloud, product, and manufacturing teams...Full time$189.3k - $290.7k
...congestion. Our teams develop the software, systems and technology that make advanced driver... ...programs.The RoleThe Manager, Systems Engineering, AV Platform Software will lead a team of... ...metrics, automation, and responsible use of AI-enabled tools.Build a high-performing...Full timeH1bLocal areaWork from homeRelocationRelocation package$182k - $242k
...CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers CoreWeave delivers a platform of technology... ...2025. Learn more at . What Youll Do: IT Engineering at CoreWeave designs builds and operates the systems that enable our employees and acquired...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$168k - $270.25k
Site Reliability Engineering (SRE) at NVIDIA is an engineering... ...maintain large scale production systems with high efficiency and... ...deployment, open source cloud enabling technologies like Kubernetes and Public Cloud. SRE at... ...NVIDIA’s next-generation AI-driven enterprise...Full time- ...AI u0026 Data Platforms (AiDP) is ISu0026Ts engine for AI-powered innovation. The team brings together... ...large-scale distributed systems that power our GenAI ML... ...technologies in hybrid cloud environments to build... ...processing infrastructure (Kubernetes Spark Flink Ray Trino or...Full time
- ...vertically integrated AI infrastructure... ..., and cloud services.... ...Role: As an Engineering Manager on the... ...Language Models (LLMs). You will be responsible... ...management systems, cost-aware scheduling... ...with Kubernetes, gRPC, and observability... ...Hugging Face, Triton). Personal...Temporary workWork at office
$90k - $180k
...ResponsibilitiesAI Systems & Agentic WorkflowsBuild agentic AI services (planning,... ...productionize models (LLMs, GNNs, embedding... ...design reviews and engineering best practices. Mentor... ...(Python), K8s (Kubernetes) and containerization... ...with vLLM, Triton Inference Server, ONNX...Full timeTemporary workPart time- NVIDIA in Santa Clara, CA seeks a Senior System Software Engineer to build and operate cloud-based scientific computing platform workflows across AI training, inference, and visualization. You will own core cloud infrastructure for physics-informed and data-driven workflows...
$174k - $252k
...technologies.Triage product or system issues and debug/track/... ...features to enable AI/ML workloads in Google Distributed Cloud (GDC) platforms.... ...VM workloads running on Kubernetes platforms.Design and develop... ...Linux OSs.Google's software engineers develop the next-...- ServiceNow is hiring a Senior (DevOps) Machine Learning Engineer in Santa Clara, CA, onsite, to build cloud AI/ML solutions powering intelligent enterprise... ...production-focused environment with strong emphasis on Kubernetes operations, observability, and end-to-end ownership...
- CrowdStrike Inc. is a global cybersecurity leader, protecting people and organizations with an AI-native platform. We design AI-powered systems at scale in Sunnyvale, seeking engineers to build a greenfield product with agentic reasoning and robust distributed architecture....
$124k - $195.5k
...unlimited potential of AI to define the next... ...in AI and cloud computing. As a versatile System Software Engineer - AI and Cloud, you... ...systems optimized for Kubernetes deployment, using... ...vLLM and NVIDIA Triton Inference Server.A... ...Advanced knowledge of LLMs, modern AI...Full time- ...95035, United StatesJob Title: Senior Kubernetes Platform Engineer / ArchitectLocation: Milpitas, CAExperience... ...Kubernetes, container orchestration, cloud-native technologies, platform... ...engineering and R&D workloads.Experience with AI/ML platform deployments on Kubernetes....
- Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure... ...day is currently Tuesday.Engineering at Lambda is responsible for... ...Lambda website, cloud APIs and systems as well as internal... ...DoOperate and maintain bare-metal Kubernetes clusters, scaling up to...Work at officeLocal areaWork from homeFlexible hours
$240k - $379.5k
...Platform and collaborate with engineering to build the platform.... ...of enterprise AI architectures will make... ...commerce Architect and build systems hands-on, using... ...including experience with LLMs, RAG, and agent-based systems... ...libraries (CUDA, Triton, TensorRT). Background...Full timeWork experience placement$185k - $215k
...you will operate as a Lead AI Systems Engineer, setting technical direction... ...modern AI/ML methods (e.g., LLMs/VLMs, time-series anomaly detection... ..., regression testing, and cloud replay pipelines (SiL/HiL/... ...Vector DBs, Apache Airflow, Kubernetes, and AWS/GCP services....Work experience placementLocal areaWorldwide$102.5k - $187.9k
...develop advanced technologies in AI, automation, and data... ...key responsibilities As a Kubernetes DevOps Engineer, you are responsible to design... ...performance on Azure cloud environment. A Kubernetes... ...science, engineering, information systems management, accounting, finance...Summer holidayWork at officeFlexible hours- ...discovery to powering AI and the technologies people... ...a hands-on Platform Engineer to build and operate the... ...platform across Kubernetes, observability, AI-enabled... ...comparable observability systems.Experience with IBM LSF... ...engineering, DevOps, SRE, cloud infrastructure, or...
$225k - $275k
...seeking a Senior Software Engineering Manager to lead the... ...-latency distributed systems that power AI inference. You will... ...distributed systems, cloud infrastructure,... ...Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure...$150k
Senior Software Engineer, Systems PlatformParticipate in the development of network system software... ...management platforms Understanding of Cloud platforms such as Amazon AWS, Google Cloud... ...’s degree in CS/EE/CE or related field AI Use Guidelines for Interviews:Our interviews...Full timeFor subcontractorLocal area- Senior Principal Presales Systems Engineer, Cloud and AI NetworkingThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live...Full timeWork experience placementLocal areaImmediate startRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Cloud Systems Engineer LLMs, Kubernetes & Triton. Be the first to apply!
- senior ai engineer Santa Clara, CA
- ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- big data cloud engineer Santa Clara, CA
- principal cloud engineer Santa Clara, CA
- senior principal cloud computing engineer Santa Clara, CA
- aws cloud security engineer Santa Clara, CA
- cloud engineer Santa Clara, CA





