Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior System Software Engineer - Dynamo-Triton Inference Server

$152k - $241.5k

NVIDIA

We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. We are a fast-paced team building a highly-performant AI inference platform to make design and deployment of new AI models easier and accessible to all users. What you'll be doing Develop world-class GPU-accelerated AI inference serving software. Contribute to feature development and drive broad customer adoption. Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform. This platform will ensure feature parity and effectively serve both Large Language Model (LLM) and non-LLM workloads. Be an active member of open source deep learning software engineering community. Balance a variety of objectives such as building robust software designed to be deployed in production server or cloud environments, optimizing and balancing prediction throughput and latency, and developing and adopting the next generation of inference technologies. What we need to see MS or PhD in Computer Science or relevant field (or equivalent experience). 5+ years of professional experience working on deep learning software. Excellent Rust & C++ skills, familiarity with Python, and strong programming & software design skills including debugging, performance analysis, and test design. Experience with high-scale distributed systems and ML systems. Strong communication skills and ability to work in a fast-paced, agile team environment. Ways to stand out from the crowd Prior experience with AI frameworks and engines, such as TensorRT, PyTorch, ONNX, OpenVINO, vLLM, or TRT-LLM. Knowledge of GPU memory management, cache management, or high-performance networking. Experience with distributed systems programming. Experience in contributing to a large open source project: use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior System Software Engineer - Dynamo-Triton Inference Server in Santa Clara, CA vacancy
  • NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is recruiting a Senior Inference Engineer to advance AIConfigurator ( a system that automatically...  ..., and production software engineering. The work...  ...partners closely with Dynamo, TensorRT-LLM, vLLM,...  ...-LLM, vLLM, SGLang, Triton Inference Server, Dynamo, Kubernetes,... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $356.5k

    NVIDIA is seeking software engineers for next-generation graphics and computing products in Santa Clara. You will work closely with architecture and hardware teams, crafting tools crucial for chip development and validation. Ideal candidates will have strong C++ skills... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    We are seeking software engineers to work on next-generation graphics and computing products. Our...  ...applications a GPU or high-performance computing server will encounter in its lifecycle, by...  ...and algorithms, a solid foundation of systems software with emphasis on OS... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...ships with a complete software and firmware GA release...  ...such as NemoClaw, LLM inference via NIM, Hermes agents,...  ...compiler (TensorRT, NVCC, Triton), and GPU architecture...  ...Computer Science, Electrical Engineering, or related field. 12+ years in systems software engineering... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • $124k - $195.5k

     ...also vertically integrated software stacks, GPU accelerated SDKs...  ...a dedicated and motivated System Software Engineer who is passionate about AI...  ...: Run multi‑node training/inference jobs on large GPU clusters...  ...CUDA, cuDNN, TensorRT‑LLM, Triton, NCCL. Excellent written and... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...Microcontroller Firmware for GPU Server platforms, focusing on but...  ...Develop embedded management software to enable reporting and connectivity...  ...(or higher) in Electrical Engineering or Computer Science or...  ...and open source. Expertise in system software and platform security... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ..., adaptation workflows, and inference pipelines—building on the robust...  ...the delivery of practical systems that operate within tight...  ...NVIDIA is looking for a Sr. Software Engineer specializing in systems inspection...  ...as TensorRT, CUDA, cuDNN, Triton, DeepStream, TAO Toolkit, or... 
    Senior
    Immediate start
    Shift work

    NVIDIA AI

    Santa Clara, CA
    1 day ago
  • $184k - $356k

    Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM...  ...candidate has a PhD or equivalent experience, 10+ years in software engineering, and strong skills in Python and Rust. Salary... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     .... The platform routes inference, streaming, and batch...  ...native. Partner with engineering teams across NVIDIA so...  ...NVIDIA NIM, Grove, and Dynamo. Help steward an open...  ...3+ years of hands‑on software engineering. Expert‑level knowledge in a systems programming language (... 
    Senior
    Worldwide

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • Senior Technical Product Marketing Manager This...  ...will be pivotal in our inference marketing. You will work closely with engineering to understand the...  ...frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT‑LLM, vLLM,...  ...—background in software development, AI... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...debugging tools that empower NVIDIA engineers to improve perf and power...  ...to join a multifaceted software team with high standards! This...  ...insight in the workload and the system, and empower them to find...  ...TensorFlow, distributed training and inference. Knowledge of GPU cluster job... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...cutting‑edge hardware and software innovation to deliver...  ...of forward‑thinking engineers tackling some of the...  ...’re searching for a Senior Systems Software Engineer...  ...plugins, distributed inference serving, and major cloud...  ...without creating API server pressure or... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...researchers, developers, and AI engineers. This role is a hands...  ...firmware, BMC, and AI software teams, collaborate...  ...across both operating systems. What you'll be doing...  ...for workstation‑ or server‑class hardware. Track...  ...: AI training and inference, content creation tools... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • Apple’s Server ML Frameworks team in Cupertino seeks engineers to optimize high-performance GenAI applications. This role focuses on ML inference framework projects and GPU programming while collaborating with cross-functional teams to enhance performance. The ideal candidates... 

    Apple

    Cupertino, CA
    1 day ago
  • $152k - $241.5k

     ...you passionate about redefining how software is built in the age of Generative AI...  ...default entry point for out-of-framework inference globally. We are moving beyond...  ...unprecedented scale. If you are a systems-thinking C++ engineer who wants to help scale out an agentic... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...together cutting-edge hardware and software innovation to deliver...  ...We’re a team of innovative engineers dedicated to solving some of...  ...looking for an outstanding Senior Systems Software Engineer with deep...  ...device plugins to distributed inference serving and cloud platforms... 
    Senior
    Worldwide

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate...  ..., performant code, e.g., writing Triton kernels, inserting quantize/...  ...across the team: CI, build systems, training infrastructure, pipeline... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Qualcomm is searching for a Sr. Staff / Principal-level Software Engineer to lead system-level efforts for next-generation ARM server platforms. This position involves collaboration across silicon, firmware, OS, and performance teams to optimize system software and ensure... 
    Senior

    Qualcomm

    Santa Clara, CA
    4 days ago
  • $152k - $287.5k

    NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara. In this role, you will be responsible for developing system software solutions and optimizing display features. Ideal candidates should have 5+ years of experience, strong C programming skills, and... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $184k - $356.5k

    NVIDIA is seeking a Senior System Software Engineer for their Tegra system software group in Santa Clara, California. The ideal candidate will have extensive C/C++ programming skills and experience in operating systems and kernel programming. You will be responsible for... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA in Santa Clara is seeking a Software Verification Engineer to drive feature enablement on GPU systems and develop software tools for next-generation GPUs. The ideal candidate will possess a BS or MS in EE/CS and at least 5 years of experience in software verification... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA seeks a Senior Systems Software Engineer in Santa Clara, California, to enhance AI infrastructure for accelerated computing. The role involves collaborating with cross-functional teams to drive performance and scalability challenges within the NVIDIA DGX Cloud software... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • A leading technology company in California is seeking a Senior System Software Engineer for its software development team. The role involves collaboration on NVIDIA's DRIVE self-driving platform, focusing on camera and graphics solutions. Candidates should have 5+ years... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • NVIDIA is seeking a System Software Engineer to join their team in Santa Clara. The role involves developing software for complex computing systems, participating in system architecture analysis, and improving software efficiency. A successful candidate will have 8+ years... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA is seeking a Senior System Software Engineer to join the NvSci team in Santa Clara, California. In this role, you will contribute to NVIDIA's leadership in AI, building software that enables seamless cross-platform functionality and efficient integration with various... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    NVIDIA Gruppe in Santa Clara, CA, seeks a Senior System Software Engineer. In this role, you will work on pioneering AI and imaging solutions, partnering with top-tier teams to develop advanced software for self-driving platforms. The ideal candidate has over 5 years of... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    NVIDIA is seeking a System Software Engineer for their team in Santa Clara, California. This position involves designing and implementing innovative NVLink interconnects, requiring collaboration with various engineering teams to produce cutting-edge products. Qualifications... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Advanced Micro Devices, Inc. is looking for a Sr. Software Development Engineer to drive innovation in semiconductor operations. The role involves software design, development, and testing, with a focus on high-performance computing and AI solutions. Ideal candidates will... 
    Senior

    Advanced Micro Devices, Inc.

    Santa Clara, CA
    1 day ago
  • NVIDIA seeks a Senior System Software Engineer to innovate in the development of its DriveWorks SDK, designed for autonomous vehicles. The ideal candidate will have strong expertise in C and C++ programming, with at least 8 years of experience in developing and debugging... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior System Software Engineer - Dynamo-Triton Inference Server. Be the first to apply!