Senior System Software Engineer - Dynamo-Triton Inference Server
$152k - $241.5kNVIDIA
We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. We are a fast-paced team building a highly-performant AI inference platform to make design and deployment of new AI models easier and accessible to all users.**What you'll be doing:*** Develop world-class GPU-accelerated AI inference serving software.* Contribute to feature development and drive broad customer adoption.* Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform. This platform will ensure feature parity and effectively serve both Large Language Model (LLM) and non-LLM workloads.* Be an active member of the.* Balance a variety of objectives such as building robust software designed to be deployed in production server or cloud environments, optimizing and balancing prediction throughput and latency, and developing and adopting the next generation of inference technologies.**What we need to see:*** MS or PhD in Computer Science or relevant field (or equivalent experience).* 5+ years of professional experience working on deep learning software.* Excellent Rust & C++ skills, familiarity with Python, and strong programming & software design skills including debugging, performance analysis, and test design.* Experience with high-scale distributed systems and ML systems.* Strong communication skills and ability to work in a fast-paced, agile team environment.**Ways to stand out from the crowd:*** Prior experience with AI frameworks and engines, such as TensorRT, PyTorch, ONNX, OpenVINO, vLLM, or TRT-LLM.* Knowledge of GPU memory management, cache management, or high-performance networking.* Experience with distributed systems programming.* Experience in contributing to a large open source project: use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and .Applications for this job will be accepted at least until February 22, 2026.This posting is for an existing vacancy.NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr
- ...NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments...Senior
- A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach...Senior
$184k - $287.5k
...Senior System Software Engineer - GPU Server page is loaded## Senior System Software Engineer - GPU Serverlocations: US, CA, Santa Claratime type: Full timeposted on: Posted Todayjob requisition id: JR2001533We are seeking software engineers to work on next-generation...Senior$224k - $356.5k
...applications like NemoClaw, LLM inference via NIM, Hermes agents, and... ...for a deeply technical systems software engineer who will own AI stack... ...compiler (TensorRT, NVCC, Triton), and GPU architecture teams... ...TensorRT, NCCL, Triton Inference Server, DCGM, and DOCA/OFED....SeniorLocal area$224k - $356.5k
...and medical devices. Our software platforms are central to this... ...globally! We are hiring a Senior Systems Software Engineer to join our team as a... ...optimizing deep learning inference for autonomous vehicles and... ...frameworks (TVM, MLIR, XLA, Triton) or contributing to inference...SeniorImmediate start$320k
...NVIDIA Gruppe is seeking a Distinguished Engineer to join the Dynamo engineering team in Santa Clara, California. The successful candidate will provide technical leadership and drive product direction while working on state-of-the-art AI inferencing technologies. With...Senior$272k - $431.25k
...NVIDIA Gruppe is seeking experienced engineers for its Dynamo platform, focusing on scalable AI systems. You will develop the Kubernetes deployment, optimize GPU resource management, and work on intelligent routing and KV-cache management. Applicants should have 15+ years...Senior- ...Senior Technical Product Marketing Manager This... ...will be pivotal in our inference marketing. You will work closely with engineering to understand the... ...frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT‑LLM, vLLM,... ...—background in software development, AI...Senior
- ...Senior Staff AI/ML System Software Engineer At d-Matrix, we are focused on unleashing the potential of generative AI to power... ..., TensorRT,...). Experience with inference servers/model serving frameworks (such as Triton, TFServ, KubeFlow, …). Experience with...SeniorWork experience placement3 days per week
$152k - $241.5k
...application is built. We are seeking a Senior Software Engineer – AI Inference to advance open‑source LLM... ...best‑in‑class on NVIDIA GPUs and systems-and by improving the underlying stack... ...to vLLM, SGLang, PyTorch, Triton, NCCL, Dynamo or adjacent serving/runtime projects...Senior$148k - $235.75k
...We are looking for a Senior Technical Product... ...and pivotal in our inference marketing. You will... ...focused on working with engineering to understand the technical... ...& optimizations (Dynamo, Triton Inference Server, TensorRT-LLM, vLLM,... ...– Background in software development, AI infrastructure...Senior$184k - $287.5k
...debugging tools that empower NVIDIA engineers to improve perf and power... ...to join a multifaceted software team with high standards! This... ...insight in the workload and the system, and empower them to find... ...TensorFlow, distributed training and inference. Knowledge of GPU cluster...Senior- ...Excellent programming skills in Python and C/C++ Excellent software engineering fundamentals Ability to develop code in Unix/Linux environments... ...captioning, document understanding) — including handling inference latency, cost-per-call tradeoffs, and degraded-mode...SeniorInternship
$152k - $241.5k
...We’re hiring a Deep Learning Engineer with strong experience in generative... ...computer vision, and agentic systems. If you’ve spent more time... ...and C/C++. ~ Excellent software engineering fundamentals.... ...understanding) — including handling inference latency, cost-per-call...SeniorInternship$184k - $287.5k
...We are looking for a Senior Systems Software Engineer for our Robotics Team working on NVIDIA Isaac ROS ( . Modern robot development for the next... ...accelerated compute for simulation, training, and edge inference. NVIDIA’s ISAAC platform binds together high-fidelity visual...Senior$152k - $241.5k
...you passionate about redefining how software is built in the age of Generative AI... ...default entry point for out-of-framework inference globally. We are moving beyond... ...an unprecedented scale. If you are a systems‑thinking C++ engineer who wants to help scale out an agentic...Senior$184k - $287.5k
...code for multiple operating systems Qualifications BS or MS degree... ...Science, Electrical Engineering or related field (or equivalent... ...computing, PyTorch, low‑latency AI inference Understanding of system‑... ...with Linux, or Windows Systems Software development Compensation...Senior$152k - $241.5k
...Senior Software Engineer, Quantized Inference page is loaded## Senior Software Engineer, Quantized Inferencelocations... ..., performant code, e.g., writing Triton kernels, inserting quantize/... ...productivity across the team: CI, build systems, training infrastructure, pipeline...Senior$152k - $287.5k
...NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara. In this role, you will be responsible for developing system software solutions and optimizing display features. Ideal candidates should have 5+ years of experience, strong C programming skills,...Senior- ...A leading technology company in California is seeking a Senior System Software Engineer for its software development team. The role involves collaboration on NVIDIA's DRIVE self-driving platform, focusing on camera and graphics solutions. Candidates should have 5+ years...Senior
$128.7k - $261.3k
...Model Deployment & Inference Solutions team in GM... ...platform or infrastructure systems where reliability,... ...) as part of your engineering workflow. Experience... ...clean, well-tested software with clear... ...aware Python, TensorRT, Triton inference server, torch.compile, ONNX...SeniorFlexible hours- ...NVIDIA Gruppe in Santa Clara is seeking experienced Software Engineers to develop high-speed interconnect technologies. This role involves... ...possess strong troubleshooting abilities, extensive knowledge of systems software, and experience in working closely with hardware....Senior
$184k - $287.5k
...NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize... ...customers. GPU programming experience (CUDA, OAI TRITON or CUTLASS). Benefits Equity and benefits. Salary...Senior$152k - $241.5k
...NVIDIA Gruppe in Santa Clara is seeking experienced software engineers to design and debug their next-gen software stack. Candidates should... ...environment awaits those ready to tackle challenging low-level systems software development. NVIDIA offers competitive salaries...Senior$184k - $287.5k
...NVIDIA Gruppe is seeking a Systems Software Engineer to innovate and solve complex challenges. You will collaborate with design teams, develop automated testing software, and optimize workflows using AI. Ideal candidates possess at least 5 years of C++ experience, a master...Senior$184k - $356.5k
...NVIDIA Gruppe is seeking a Senior System Software Engineer to join the Tegra system software group in Santa Clara. Ideal candidates will possess strong C/C++ skills and experience with operating systems and kernel programming. Your role will involve designing test frameworks...Senior$152k - $241.5k
...NVIDIA Corporation is seeking a system software engineer based in Santa Clara, California. The role involves designing and implementing innovative NVLink interconnects and requires collaboration with various teams. The candidate must have a Bachelor's degree and at least...Senior$152k - $241.5k
...NVIDIA Gruppe in Santa Clara, CA, seeks a Senior System Software Engineer. In this role, you will work on pioneering AI and imaging solutions, partnering with top-tier teams to develop advanced software for self-driving platforms. The ideal candidate has over 5 years of...Senior- ...NVIDIA Gruppe in Santa Clara, California is seeking a Senior System Software Engineer for their Automotive Team to help develop high-performance automotive systems. This role requires expertise in system software development on Real Time OS and strong programming skills...Senior
- ...NVIDIA Gruppe is looking for a skilled GPU system software engineer in Santa Clara, California. The position requires defining and developing firmware components focused on power and performance while collaborating globally and influencing architectural designs. Applicants...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior System Software Engineer - Dynamo-Triton Inference Server. Be the first to apply!
- systems software developer Santa Clara, CA
- IT system engineer Santa Clara, CA
- system programmer Santa Clara, CA
- servers wanted Santa Clara, CA
- hotel food server Santa Clara, CA
- hotel server Santa Clara, CA
- server part time Santa Clara, CA
- food server Santa Clara, CA
- waiter server Santa Clara, CA
- process server Santa Clara, CA

