Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Deep Learning Inference - TensorRT

$152k - $241.5k

NVIDIA Gruppe

Senior Software Engineer – Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference. Closely follow academic developments in the field of artificial intelligence and feature update TensorRT Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models. Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams. What we need to see: A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field. 3+ years of software development experience. Strong experience with the latest C++ standards C++11/C++14/C++17/C++20, etc. Strong grasp of Machine Learning concepts. Experience and knowledge in Computer Architecture, Data Structures, Algorithms. Excellent communication skills, and an aptitude for collaboration and teamwork. Ways to stand out from the crowd: Experience developing System Software. Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL. Experience in software performance benchmarking, profiling, and optimizations. Background in compiler development Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until March 21, 2026. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Deep Learning Inference - TensorRT in Santa Clara, CA vacancy
  • NVIDIA is looking for a Senior Deep Learning Software Engineer to enhance its TensorRT performance and inference ecosystem. The role focuses on optimizing performance across various NVIDIA accelerators and developing groundbreaking methodologies. Applicants should have... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Software Engineer focused on improving performance of deep learning inference software like TensorRT. The ideal candidate will have a strong foundation in C++ and Python, relevant experience with deep learning frameworks... 
    Suggested

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • We are now looking for a Senior Deep Learning Software Engineer, TensorRT Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate...  ...analyzing and improving the performance of NVIDIA’s inference ecosystem. NVIDIA is rapidly growing its research and... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $152k - $287.5k

    NVIDIA Corporation is seeking a Senior Software Engineer to develop state-of-the-art deep learning inference software. In this role, you will work on TensorRT, collaborating with experts across multiple teams. The ideal candidate has a strong background in C++, machine... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago
  •  ...in optimizing and developing deep learning frameworks for AMD GPUs....  ...and SOTA LLM and Multimodal inference at scale across multi-GPU and...  ...collaborate across internal GPU software teams and engage with open-...  ...PERSON: Skilled engineer with strong technical and analytical... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    4 days ago
  •  .... THE ROLE: As a senior member of the LLM inference framework team, you will...  ...intersection of inference engines, distributed systems, and...  ...open-source projects Deep Learning Integration ~ Strong...  ...kernel development Software Engineering ~ Expertise... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...about redefining how software is built in the age of...  ...AI? Join NVIDIA’s TensorRT team to help lead a first...  ...for out-of-framework inference globally. We are...  ...systems‑thinking C++ engineer who wants to help scale...  ...of state‑of‑the‑art deep learning breakthroughs, and improve... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today’s most sophisticated AI applications. Our team is responsible... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    13 hours ago
  • $184k - $287.5k

     ...Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme...  ..., parallel programming, distributed systems, deep learning theories. Knowledgeable and passionate about performance... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...We are looking for a Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution. As part of the team, you will be instrumental...  ...with NVIDIA's deep learning SDKs such as TensorRT. Prior experience in writing high-performance... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  ...time large language model inference? Join NVIDIA’s TensorRT Edge‑LLM team and help shape...  ...robotics. We build the software stack that enables Large Language...  ..., Electrical/Computer Engineering, or a closely related...  ...software development experience. Deep understanding of... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...are looking for a motivated Deep Learning engineer to bring advanced CUDA...  ...scales up to 100K GPUs to inference down at microsecond latency...  ...systems principles (aka systems software fundamentals) ~ Adaptability...  ...(e.g., PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, Megatron... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...Overview Reinforcement learning post‑training is...  .... RL requires inference, rollout generation...  ...an RL Frameworks engineering team to develop the...  ...team spans the full software stack, from...  ...their need optimizing deep learning frameworks...  ...engines (vLLM, SGLang, TensorRT‑LLM) into RL... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...advanced computer vision and deep learning. Our team builds large...  ...creation of modern software, services, systems,...  ...hardware. Drive Engineering Excellence: Apply a strong...  ...with machine learning inference using GPU acceleration (such as CUDA, TensorRT, or comparable technologies... 
    Senior
    Worldwide

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $165k - $242k

     ...Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The...  ...infrastructure performance with deep technical expertise to...  ...frameworks (vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe...  ..., and we’re constantly learning. Our team cares deeply about... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    2 days ago
  •  ...NVIDIA Gruppe in Santa Clara, California is seeking a Senior Software Engineer specializing in Deep Learning Inference. In this role, you will craft and develop high-performance software tailored for scalable platforms while collaborating with experts in the field. The... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $139k - $204k

     ...What You’ll Do Senior engineers are area owners who lead designs, raise...  ...our Kubernetes‑native inference platform and meet strict P99...  ...Python or Go (C++ a plus) and deep familiarity with networked systems...  ...frameworks (vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe).... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $139k - $204k

     ...Senior Software Engineer I, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential...  ...performance with deep technical expertise to accelerate...  ...: CRWV) in March 2025. Learn more at What You'll Do...  ...frameworks (vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    13 hours ago
  • We are now looking for a Senior Deep Learning Software Engineer, LLM Performance! NVIDIA is seeking an experienced...  ...improving the performance of LLM inference. This role focuses on designing and...  ...inference benchmarking frameworks, TensorRT, and Triton. Collaborate with cross... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  •  ...Corporation is looking for a passionate Software Engineer to join the TensorRT team in Santa Clara, California. You will drive innovation in deep learning and work with cutting-edge AI...  ...contributing to high-performance AI inference solutions. Your role involves designing... 

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring...  ...for its GPU-accelerated deep learning software team. Academic and...  ...building a highly-performant AI inference platform to make design...  ...and engines, such as TensorRT, PyTorch, ONNX, OpenVINO,... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...advanced computer vision and deep learning. Our team builds large-...  ...-world impact. As a System Software Engineer for Vision AI, you will develop...  ...and tuning GPU-accelerated inference pipelines to meet strict...  ...acceleration (such as CUDA, TensorRT, or comparable technologies... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...optimization strategies for inference, such as automated...  ...‑caching. Conduct deep, layer‑by‑layer...  ...pipelines for TensorRT conversion. Scale...  .... Architect the software interface to seamlessly...  ...Science, Computer Engineering, or a related...  ...or similar machine learning frameworks.... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $248.71k - $292.6k

     ...delivers fast, efficient AI inference. Our LPU-based system...  ...fast. Sr. Staff Software Engineer - High Performance...  ...production deployments. Deep knowledge of GPU...  ...production (e.g., Triton, TensorRT, or custom GPU...  ..., MLIR, XLA) or deep learning graph optimization. Successful... 
    Senior

    I did my part and supported the Regular Toilet

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge...  ...relevant field and extensive experience with deep learning systems is essential. Competitive salary,... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing...  ...minimum of 5 years of experience in deep learning software, excellent Rust & C++... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $236k - $339.25k

     ...Machine Learning Platform Team Member At Snowflake, we are...  ...their machine learning and deep learning workloads to...  ...collaboratively and proactively with senior architects, PMs, and team...  ...in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and... 
    Senior
    Flexible hours

    Streamlit

    Menlo Park, CA
    7 hours ago
  • $184k - $287.5k

    ## Senior Software Engineer, DGX Cloud AI InfrastructureApplylocations...  ...training and inference workloads across NVIDIA...  ...scale. You will lead deep performance and reliability...  ...intersection of deep learning systems, GPU...  ...PyTorch, NeMo / Megatron, TensorRT-LLM, and adjacent NVIDIA... 
    Senior
    Remote work

    NVIDIA Corporation

    Santa Clara, CA
    3 hours ago
  • $124k - $195.5k

     ...passionate about driving innovation in deep learning and eager to work on cutting‑edge AI technology? Join NVIDIA's TensorRT team as a Software Engineer, and be at the forefront of...  ...contributing to high‑performance AI inference solutions for specialized platforms... 
    Internship

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Deep Learning Inference - TensorRT. Be the first to apply!