Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior System Software Engineer — GPU AI Inference (Triton)

NVIDIA Gruppe

NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments. The ideal candidate will have a minimum of 5 years of experience in deep learning software, excellent Rust & C++ skills, and a strong understanding of distributed systems. The position offers a competitive base salary, equity, and benefits, with applications accepted until at least May 1, 2026. #J-18808-Ljbffr NVIDIA Gruppe

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior System Software Engineer — GPU AI Inference (Triton) in Santa Clara, CA vacancy
  • $152k - $241.5k

     ...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server ( . NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic...  ...using GPUs to power a revolution in AI, enabling breakthroughs in problems... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and...  ...work. We are searching for outstanding senior system software engineer to join the NVIDIA's GPU Diagnostics SW team... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots,...  ...world. We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    6 days ago
  • $224k - $356.5k

     ...NVIDIA’s workstation-class AI computer—built on GB30...  ...bundles, DGX BaseOS, GPU drivers, CUDA toolkit,...  ...like NemoClaw, LLM inference via NIM, Hermes agents...  ...a deeply technical systems software engineer who will own AI stack...  ...compiler (TensorRT, NVCC, Triton), and GPU architecture... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...and Visualization. The GPU, our invention, serves...  ...motivated Performance engineer to influence the roadmap...  ...understanding of computer system architecture, HW-SW...  ...principles (aka systems software fundamentals) ~ Implement...  .... NVIDIA uses AI tools in its recruiting... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...leader in physical AI, powering self-...  ...medical devices. Our software platforms are...  ...We are hiring a Senior Systems Software Engineer to join our team...  ...optimizing deep learning inference for autonomous...  ...space models) on GPU and SOC. This...  ...(TVM, MLIR, XLA, Triton) or contributing... 
    Senior
    Immediate start

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and...  ...s best talent. We are now looking for a Senior System Software Engineer! NVIDIA is searching for a world-class... 
    Senior
    Work experience placement
    Local area
    Remote work

    NVIDIA

    Santa Clara, CA
    21 hours ago
  • $184k - $287.5k

     ...NVIDIA is searching for a creative and highly motivated engineer with expertise in system s software to join the GPU Software team. You will design key aspects of our...  ...posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $356.5k

    NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...We are seeking software engineers to work on next-generation graphics and computing...  ...demanding applications a GPU or high-performance computing...  ..., a solid foundation of systems software with emphasis on OS...  ...existing vacancy. NVIDIA uses AI tools in its recruiting processes... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $356.5k

    NVIDIA Corporation is seeking a Senior Deep Learning Software Engineer specializing in Inference to join their growing team in Santa Clara, CA. The role involves optimizing GPU-accelerated software for advanced AI applications, including developing high-performance deep... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...Become a Senior System Software Engineer on NVIDIA's AI Inference Operations Team, focusing on DevOps and Infrastructure Automation...  ...community engagement on projects like Triton Inference Server or ONNX Runtime. Familiarity with GPU software stacks — CUDA, cuDNN,... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...that empower NVIDIA engineers to improve perf...  ...join a multifaceted software team with high...  ...developing tools for AI researchers and SW...  ...running AI workload in GPU cluster. As a...  ...workload and the system, and empower them...  ...training and inference. Knowledge of GPU... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $248.71k - $292.6k

     ...Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses...  .... Build fast. Sr. Staff Software Engineer - High Performance GPU Inference Systems Mission Push...  ...inference systems in production (e.g., Triton, TensorRT, or custom GPU... 
    Senior

    I did my part and supported the Regular Toilet

    Palo Alto, CA
    4 days ago
  • $152k - $241.5k

     ...unlimited potential of AI to define the next...  ...era in which our GPU acts as the brains...  ...a Deep Learning Engineer with strong...  ...vision, and agentic systems. If you’ve spent more...  .... ~ Excellent software engineering fundamentals...  ...handling inference latency, cost-per-... 
    Senior
    Internship

    NVIDIA

    Santa Clara, CA
    8 days ago
  • $224k - $356.5k

     ...generation personal AI supercomputer—a...  ...massive coherent CPU+GPU memory, designed...  ...developers, and AI engineers. As NVIDIA brings...  ...firmware, BMC, and AI software teams, collaborate...  ...both operating systems. What you’ll be...  ...fine-tuning, and inference—and work with the... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

    NVIDIA Gruppe is seeking experienced engineers for its Dynamo platform, focusing on scalable AI systems. You will develop the Kubernetes deployment, optimize GPU resource management, and work on intelligent routing and KV-cache management. Applicants should have 15+ years... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...individual to optimize and benchmark GenAI inference using the latest acceleration technologies....  ...results and architecting distributed inference systems. Required qualifications include a relevant degree and significant software development experience in Python or C++. A... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...about redefining how software is built in the age of Generative AI? Join NVIDIA’s TensorRT...  ...for out-of-framework inference globally. We are moving...  ...scale. If you are a systems-thinking C++ engineer who wants to help...  ...optimization (CPU and/or GPU), including using tooling... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...Senior Staff AI/ML System Software Engineer At d-Matrix, we are focused on unleashing the potential of generative AI to power...  ..., TensorRT,...). Experience with inference servers/model serving frameworks (such as Triton, TFServ, KubeFlow, …). Experience with... 
    Senior
    Work experience placement
    3 days per week

    D-Matrix

    Santa Clara, CA
    3 days ago
  • $384k

     ...NVIDIA is seeking a Senior Director, System Software Engineering, to lead strategy and execution...  ...foundation for NVIDIA's internal AI research clusters. This...  ...software that automates GPU management at scale, drive...  ...large-scale training and inference environments. Experience... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...and help bring AI solutions to our...  ...AI/ML and HPC software solutions at scale...  ...training and inference. Conducting...  ...for both AI and systems performance....  ...Electrical/Computer Engineering, Computer...  ....), compilers (Triton, XLA, etc.), and...  ...experience with GPU systems in general... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers,...  ...searching for a highly motivated, technical engineer to join the Tegra system-on-chip (SoC) software organization. You will work on key... 
    Senior

    NVIDIA

    Santa Clara, CA
    10 days ago
  •  ...experiences-from AI and data...  ...gaming and embedded systems. Grounded in a...  ...instrumental in enhancing GPU kernel...  ...and Multimodal inference at scale across...  ...internal GPU software teams and engage...  ...Skilled engineer with strong technical...  ...in GPGPU C++, Triton, TileLang or DSL... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and...  ...on the world. NVIDIA is looking for Senior System Software Engineers to join our Tegra system software group. The... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...a Vulkan Performance driver engineer, you will have a hand in everything...  ...will be doing: Diagnosing GPU and CPU performance...  ...(or equivalent) in graphics software, system programming, or related field...  ...existing vacancy. NVIDIA uses AI tools in its recruiting processes... 
    Senior
    Work experience placement

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...upon which every new AI‑powered application...  ...built. We are seeking a Senior Software Engineer – AI Inference to advance open‑...  ...on NVIDIA GPUs and systems-and by improving the...  ...work. Improve multi‑GPU inference...  ...vLLM, SGLang, PyTorch, Triton, NCCL, Dynamo or adjacent... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and...  ...the future of technology? As a Tegra Senior System Software Engineer/Architect at NVIDIA, you will play a pivotal... 
    Senior

    NVIDIA

    Santa Clara, CA
    21 hours ago
  • $152k - $241.5k

     ...We are hiring senior engineers to work on the CUDA driver, a core...  ...computation on the GPU. Our team delivers features...  ...across a range of system configurations and hardware...  ...strong system software programming skills, a detailed...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...decades. Our invention of the GPU in 1999 sparked the growth...  ...deep learning ignited modern AI — the next era of computing....  ...outstanding architect for a Senior System Engineer role for system bringup and...  ...exciting computing hardware and software to contribute to the latest... 
    Senior
    Work at office

    NVIDIA

    Santa Clara, CA
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior System Software Engineer — GPU AI Inference (Triton). Be the first to apply!