Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Deep Learning Inference - TensorRT

$152k - $241.5k

NVIDIA Gruppe

Senior Software Engineer – Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference. Closely follow academic developments in the field of artificial intelligence and feature update TensorRT Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models. Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams. What we need to see: A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field. 3+ years of software development experience. Strong experience with the latest C++ standards C++11/C++14/C++17/C++20, etc. Strong grasp of Machine Learning concepts. Experience and knowledge in Computer Architecture, Data Structures, Algorithms. Excellent communication skills, and an aptitude for collaboration and teamwork. Ways to stand out from the crowd: Experience developing System Software. Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL. Experience in software performance benchmarking, profiling, and optimizations. Background in compiler development Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until March 21, 2026. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA Gruppe

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Deep Learning Inference - TensorRT in Santa Clara, CA vacancy
  • We are now looking for a Senior Deep Learning Software Engineer, TensorRT Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate...  ...analyzing and improving the performance of NVIDIA’s inference ecosystem. NVIDIA is rapidly growing its research and... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • NVIDIA Corporation is seeking a Senior Software Engineer for Deep Learning Inference in Santa Clara. In this role, you will craft and develop robust inferencing...  ...software for multiple platforms and contribute to TensorRT, NVIDIA’s high-performance deep learning inference... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  •  ...in optimizing and developing deep learning frameworks for AMD GPUs....  ...and SOTA LLM and multimodal inference at scale across multi‑GPU and...  ...collaborate across internal GPU software teams and engage with open‑...  .... THE PERSON Skilled engineer with strong technical and analytical... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...about redefining how software is built in the age of...  ...AI? Join NVIDIA’s TensorRT team to help lead a first...  ...for out-of-framework inference globally. We are...  ...systems‑thinking C++ engineer who wants to help scale...  ...of state‑of‑the‑art deep learning breakthroughs, and improve... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme...  ..., parallel programming, distributed systems, deep learning theories. Knowledgeable and passionate about performance... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

    We are looking for a Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution. As part of the team, you will be instrumental...  ...with NVIDIA's deep learning SDKs such as TensorRT. Prior experience in writing high-performance... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • About the Role We are seeking a Senior Inference Engineer to accelerate the performance of Pika's AI-driven products. In this highly technical...  ..., including quantization, attention acceleration, and deep learning compiler stacks. GPU & Parallelism : Deep knowledge of GPU... 
    Senior
    Work at office
    3 days per week

    PIKA Inc

    Palo Alto, CA
    3 days ago
  • A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    5 days ago
  •  ...time large language model inference? Join NVIDIA’s TensorRT Edge‑LLM team and help shape...  ...robotics. We build the software stack that enables Large Language...  ..., Electrical/Computer Engineering, or a closely related...  ...software development experience. Deep understanding of... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • Overview Reinforcement learning post‑training is...  .... RL requires inference, rollout generation...  ...an RL Frameworks engineering team to develop the...  ...team spans the full software stack, from...  ...their need optimizing deep learning frameworks...  ...engines (vLLM, SGLang, TensorRT‑LLM) into RL... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...Team is building the software foundation for scalable...  ...for exceptional engineers who thrive on solving...  ...computing. We are seeking a Senior Software Engineer for...  ...and deployment of deep neural networks that...  ...core platform, deep learning inference, TensorRT and related compiler/... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • A leading technology company is seeking a Senior AI Software Engineer to join their team in Santa Clara, California. In this...  ...develop groundbreaking AI systems software for inference applications including deep learning framework optimizations and GPU kernel technologies... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $139k - $204k

    What You’ll Do: Senior engineers are area owners who lead designs, raise...  ...evolve our Kubernetes-native inference platform and meet strict P99...  ...Python or Go (C++ a plus) and deep familiarity with networked...  ...inference frameworks (vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe).... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    Dormont Manufacturing Co

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...optimization strategies for inference, such as automated...  ...‑caching. Conduct deep, layer‑by‑layer...  ...pipelines for TensorRT conversion. Scale...  .... Architect the software interface to seamlessly...  ...Science, Computer Engineering, or a related...  ...or similar machine learning frameworks.... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

    We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring...  ...for its GPU-accelerated deep learning software team. Academic and...  ...building a highly-performant AI inference platform to make design...  ...and engines, such as TensorRT, PyTorch, ONNX, OpenVINO,... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • NVIDIA Gruppe in Santa Clara, California is seeking a Senior Software Engineer specializing in Deep Learning Inference. In this role, you will craft and develop high-performance software tailored for scalable platforms while collaborating with experts in the field. The... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge...  ...relevant field and extensive experience with deep learning systems is essential. Competitive salary,... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...and highly motivated software professional to work...  ...intersection of CUDA and Deep Learning Systems. As the...  ...in both training and inference pipelines. Collaborate...  ...Computer Science, Computer Engineering, Electrical...  ...(e.g., PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo,... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • NVIDIA Corporation is seeking a Software Engineer for the TensorRT team in Santa Clara, California. This role...  ...focus on developing cutting-edge AI inference technology, requiring strong C++ skills and an understanding of deep learning models. The ideal candidate will... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $124k - $195.5k

    ## Software Engineer, TensorRT Specialized Platforms - New College Grad 2025Applylocations: US, CA,...  ...passionate about driving innovation in deep learning and eager to work on cutting-edge AI...  ...contributing to high-performance AI inference solutions for specialized platforms... 
    Internship

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...and industries. Within our software stack, CUTLASS stands out as...  ...(GEMM) and related math and deep learning computations on NVIDIA GPUs....  ...the-art deep learning models' inference and training passes to...  ...Computer Science, Computer Engineering, or related field (or equivalent... 
    Senior

    Nvidia Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    We are looking for outstanding Senior Deep Learning Software Engineers to develop and productize NVIDIA's deep learning solutions in autonomous driving...  ...compiler technologies to accelerate deep learning inference on NVIDIA hardware platforms for Physical AI. Working across... 
    Senior
    Work experience placement

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems software...  ...with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    A leading technology company is seeking a Senior Software Engineer for AI and DL Kernel Libraries in Santa Clara, CA. The role involves designing...  ...related field, with 6+ years of experience preferably in deep learning systems. The position offers a salary range of $184,000 -... 
    Senior
    Remote job

    NVIDIA Corporation

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

    NVIDIA Gruppe is seeking an AI & Deep Learning Compiler Engineer for its Deep Learning & AI Compiler team in Santa Clara, California. This role involves analyzing and optimizing deep learning networks, as well as developing compiler algorithms to enhance performance on... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating...  ...leader in using machine learning to create real-time, personalized...  ...talent - along with our deep experience in machine...  ...deploy, and support AI software components including... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    21 hours ago
  • A leading technology company is seeking a skilled engineer to optimize deep learning frameworks and enhance GPU kernel performance. The ideal candidate...  ...TensorFlow and PyTorch and working closely with GPU software teams. This role promises a dynamic work environment with... 
    Senior

    Advanced Micro Devices

    Santa Clara, CA
    3 days ago
  •  ...per week. The role Senior Staff AI/ML System Software Engineer What you will do The...  ...software, and machine learning fundamentals Proficient...  ...Experience with deep learning frameworks (...  ...such as ONNX Runtime, TensorRT, …) Experience with inference servers/model serving... 
    Senior
    Work experience placement
    3 days per week

    Entrada Ventures

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    NVIDIA is seeking outstanding senior engineers to work on the CUDA driver,...  ...You will join a versatile software engineering team that...  ...across diverse workloads like deep learning, scientific research, autonomous...  ...system and training/inference patterns (data/model/pipeline... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $152k - $204k

     ...infrastructure performance with deep technical expertise to...  ...: CRWV) in March 2025. Learn more at What You'll Do: Senior engineers are area owners who lead...  ...our Kubernetes-native inference platform and meet strict...  ...(vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Deep Learning Inference - TensorRT. Be the first to apply!