Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior System Software Engineer - Dynamo-Triton Inference Server

$152k - $241.5k

NVIDIA

We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. We are a fast-paced team building a highly-performant AI inference platform to make design and deployment of new AI models easier and accessible to all users.**What you'll be doing:*** Develop world-class GPU-accelerated AI inference serving software.* Contribute to feature development and drive broad customer adoption.* Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform. This platform will ensure feature parity and effectively serve both Large Language Model (LLM) and non-LLM workloads.* Be an active member of the.* Balance a variety of objectives such as building robust software designed to be deployed in production server or cloud environments, optimizing and balancing prediction throughput and latency, and developing and adopting the next generation of inference technologies.**What we need to see:*** MS or PhD in Computer Science or relevant field (or equivalent experience).* 5+ years of professional experience working on deep learning software.* Excellent Rust & C++ skills, familiarity with Python, and strong programming & software design skills including debugging, performance analysis, and test design.* Experience with high-scale distributed systems and ML systems.* Strong communication skills and ability to work in a fast-paced, agile team environment.**Ways to stand out from the crowd:*** Prior experience with AI frameworks and engines, such as TensorRT, PyTorch, ONNX, OpenVINO, vLLM, or TRT-LLM.* Knowledge of GPU memory management, cache management, or high-performance networking.* Experience with distributed systems programming.* Experience in contributing to a large open source project: use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and .Applications for this job will be accepted at least until February 22, 2026.This posting is for an existing vacancy.NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior System Software Engineer - Dynamo-Triton Inference Server in Santa Clara, CA vacancy
  •  ...NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...Senior System Software Engineer - GPU Server page is loaded## Senior System Software Engineer - GPU Serverlocations: US, CA, Santa Claratime type: Full timeposted on: Posted Todayjob requisition id: JR2001533We are seeking software engineers to work on next-generation... 
    Senior

    NVIDIA

    Santa Clara, CA
    6 hours ago
  • $224k - $356.5k

     ...applications like NemoClaw, LLM inference via NIM, Hermes agents, and...  ...for a deeply technical systems software engineer who will own AI stack...  ...compiler (TensorRT, NVCC, Triton), and GPU architecture teams...  ...TensorRT, NCCL, Triton Inference Server, DCGM, and DOCA/OFED.... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...and medical devices. Our software platforms are central to this...  ...globally! We are hiring a Senior Systems Software Engineer to join our team as a...  ...optimizing deep learning inference for autonomous vehicles and...  ...frameworks (TVM, MLIR, XLA, Triton) or contributing to inference... 
    Senior
    Immediate start

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $320k

     ...NVIDIA Gruppe is seeking a Distinguished Engineer to join the Dynamo engineering team in Santa Clara, California. The successful candidate will provide technical leadership and drive product direction while working on state-of-the-art AI inferencing technologies. With... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...NVIDIA Gruppe is seeking experienced engineers for its Dynamo platform, focusing on scalable AI systems. You will develop the Kubernetes deployment, optimize GPU resource management, and work on intelligent routing and KV-cache management. Applicants should have 15+ years... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  •  ...Senior Technical Product Marketing Manager This...  ...will be pivotal in our inference marketing. You will work closely with engineering to understand the...  ...frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT‑LLM, vLLM,...  ...—background in software development, AI... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  •  ...Senior Staff AI/ML System Software Engineer At d-Matrix, we are focused on unleashing the potential of generative AI to power...  ..., TensorRT,...). Experience with inference servers/model serving frameworks (such as Triton, TFServ, KubeFlow, …). Experience with... 
    Senior
    Work experience placement
    3 days per week

    D-Matrix

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...application is built. We are seeking a Senior Software Engineer – AI Inference to advance open‑source LLM...  ...best‑in‑class on NVIDIA GPUs and systems-and by improving the underlying stack...  ...to vLLM, SGLang, PyTorch, Triton, NCCL, Dynamo or adjacent serving/runtime projects... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $148k - $235.75k

     ...We are looking for a Senior Technical Product...  ...and pivotal in our inference marketing. You will...  ...focused on working with engineering to understand the technical...  ...& optimizations (Dynamo, Triton Inference Server, TensorRT-LLM, vLLM,...  ...– Background in software development, AI infrastructure... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...debugging tools that empower NVIDIA engineers to improve perf and power...  ...to join a multifaceted software team with high standards! This...  ...insight in the workload and the system, and empower them to find...  ...TensorFlow, distributed training and inference. Knowledge of GPU cluster... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...Excellent programming skills in Python and C/C++ Excellent software engineering fundamentals Ability to develop code in Unix/Linux environments...  ...captioning, document understanding) — including handling inference latency, cost-per-call tradeoffs, and degraded-mode... 
    Senior
    Internship

    NVIDIA

    Santa Clara, CA
    6 hours ago
  • $152k - $241.5k

     ...We’re hiring a Deep Learning Engineer with strong experience in generative...  ...computer vision, and agentic systems. If you’ve spent more time...  ...and C/C++. ~ Excellent software engineering fundamentals....  ...understanding) — including handling inference latency, cost-per-call... 
    Senior
    Internship

    NVIDIA

    Santa Clara, CA
    13 days ago
  • $184k - $287.5k

     ...We are looking for a Senior Systems Software Engineer for our Robotics Team working on NVIDIA Isaac ROS ( . Modern robot development for the next...  ...accelerated compute for simulation, training, and edge inference. NVIDIA’s ISAAC platform binds together high-fidelity visual... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...you passionate about redefining how software is built in the age of Generative AI...  ...default entry point for out-of-framework inference globally. We are moving beyond...  ...an unprecedented scale. If you are a systems‑thinking C++ engineer who wants to help scale out an agentic... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $184k - $287.5k

     ...code for multiple operating systems Qualifications BS or MS degree...  ...Science, Electrical Engineering or related field (or equivalent...  ...computing, PyTorch, low‑latency AI inference Understanding of system‑...  ...with Linux, or Windows Systems Software development Compensation... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $152k - $241.5k

     ...Senior Software Engineer, Quantized Inference page is loaded## Senior Software Engineer, Quantized Inferencelocations...  ..., performant code, e.g., writing Triton kernels, inserting quantize/...  ...productivity across the team: CI, build systems, training infrastructure, pipeline... 
    Senior

    NVIDIA

    Santa Clara, CA
    6 hours ago
  • $152k - $287.5k

     ...NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara. In this role, you will be responsible for developing system software solutions and optimizing display features. Ideal candidates should have 5+ years of experience, strong C programming skills,... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  •  ...A leading technology company in California is seeking a Senior System Software Engineer for its software development team. The role involves collaboration on NVIDIA's DRIVE self-driving platform, focusing on camera and graphics solutions. Candidates should have 5+ years... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $128.7k - $261.3k

     ...Model Deployment & Inference Solutions team in GM...  ...platform or infrastructure systems where reliability,...  ...) as part of your engineering workflow. Experience...  ...clean, well-tested software with clear...  ...aware Python, TensorRT, Triton inference server, torch.compile, ONNX... 
    Senior
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  •  ...NVIDIA Gruppe in Santa Clara is seeking experienced Software Engineers to develop high-speed interconnect technologies. This role involves...  ...possess strong troubleshooting abilities, extensive knowledge of systems software, and experience in working closely with hardware.... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $184k - $287.5k

     ...NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize...  ...customers. GPU programming experience (CUDA, OAI TRITON or CUTLASS). Benefits Equity and benefits. Salary... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    5 hours ago
  • $152k - $241.5k

     ...NVIDIA Gruppe in Santa Clara is seeking experienced software engineers to design and debug their next-gen software stack. Candidates should...  ...environment awaits those ready to tackle challenging low-level systems software development. NVIDIA offers competitive salaries... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $184k - $287.5k

     ...NVIDIA Gruppe is seeking a Systems Software Engineer to innovate and solve complex challenges. You will collaborate with design teams, develop automated testing software, and optimize workflows using AI. Ideal candidates possess at least 5 years of C++ experience, a master... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $184k - $356.5k

     ...NVIDIA Gruppe is seeking a Senior System Software Engineer to join the Tegra system software group in Santa Clara. Ideal candidates will possess strong C/C++ skills and experience with operating systems and kernel programming. Your role will involve designing test frameworks... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  • $152k - $241.5k

     ...NVIDIA Corporation is seeking a system software engineer based in Santa Clara, California. The role involves designing and implementing innovative NVLink interconnects and requires collaboration with various teams. The candidate must have a Bachelor's degree and at least... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 hours ago
  • $152k - $241.5k

     ...NVIDIA Gruppe in Santa Clara, CA, seeks a Senior System Software Engineer. In this role, you will work on pioneering AI and imaging solutions, partnering with top-tier teams to develop advanced software for self-driving platforms. The ideal candidate has over 5 years of... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago
  •  ...NVIDIA Gruppe in Santa Clara, California is seeking a Senior System Software Engineer for their Automotive Team to help develop high-performance automotive systems. This role requires expertise in system software development on Real Time OS and strong programming skills... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    5 hours ago
  •  ...NVIDIA Gruppe is looking for a skilled GPU system software engineer in Santa Clara, California. The position requires defining and developing firmware components focused on power and performance while collaborating globally and influencing architectural designs. Applicants... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    6 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior System Software Engineer - Dynamo-Triton Inference Server. Be the first to apply!