Senior Software Engineer, Deep Learning Inference - TensorRT
$152k - $241.5kNVIDIA Gruppe
Senior Software Engineer – Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference. Closely follow academic developments in the field of artificial intelligence and feature update TensorRT Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models. Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams. What we need to see: A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field. 3+ years of software development experience. Strong experience with the latest C++ standards C++11/C++14/C++17/C++20, etc. Strong grasp of Machine Learning concepts. Experience and knowledge in Computer Architecture, Data Structures, Algorithms. Excellent communication skills, and an aptitude for collaboration and teamwork. Ways to stand out from the crowd: Experience developing System Software. Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL. Experience in software performance benchmarking, profiling, and optimizations. Background in compiler development Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until March 21, 2026. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr
- NVIDIA is looking for a Senior Deep Learning Software Engineer to enhance its TensorRT performance and inference ecosystem. The role focuses on optimizing performance across various NVIDIA accelerators and developing groundbreaking methodologies. Applicants should have...Senior
- NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Software Engineer focused on improving performance of deep learning inference software like TensorRT. The ideal candidate will have a strong foundation in C++ and Python, relevant experience with deep learning frameworks...Suggested
- We are now looking for a Senior Deep Learning Software Engineer, TensorRT Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate... ...analyzing and improving the performance of NVIDIA’s inference ecosystem. NVIDIA is rapidly growing its research and...Senior
$152k - $287.5k
NVIDIA Corporation is seeking a Senior Software Engineer to develop state-of-the-art deep learning inference software. In this role, you will work on TensorRT, collaborating with experts across multiple teams. The ideal candidate has a strong background in C++, machine...Senior- ...in optimizing and developing deep learning frameworks for AMD GPUs.... ...and SOTA LLM and Multimodal inference at scale across multi-GPU and... ...collaborate across internal GPU software teams and engage with open-... ...PERSON: Skilled engineer with strong technical and analytical...Senior
- .... THE ROLE: As a senior member of the LLM inference framework team, you will... ...intersection of inference engines, distributed systems, and... ...open-source projects Deep Learning Integration ~ Strong... ...kernel development Software Engineering ~ Expertise...Senior
$152k - $241.5k
...about redefining how software is built in the age of... ...AI? Join NVIDIA’s TensorRT team to help lead a first... ...for out-of-framework inference globally. We are... ...systems‑thinking C++ engineer who wants to help scale... ...of state‑of‑the‑art deep learning breakthroughs, and improve...Senior$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today’s most sophisticated AI applications. Our team is responsible...Senior$184k - $287.5k
...Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme... ..., parallel programming, distributed systems, deep learning theories. Knowledgeable and passionate about performance...Senior$224k - $356.5k
...We are looking for a Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution. As part of the team, you will be instrumental... ...with NVIDIA's deep learning SDKs such as TensorRT. Prior experience in writing high-performance...Senior- ...time large language model inference? Join NVIDIA’s TensorRT Edge‑LLM team and help shape... ...robotics. We build the software stack that enables Large Language... ..., Electrical/Computer Engineering, or a closely related... ...software development experience. Deep understanding of...Senior
$184k - $287.5k
...are looking for a motivated Deep Learning engineer to bring advanced CUDA... ...scales up to 100K GPUs to inference down at microsecond latency... ...systems principles (aka systems software fundamentals) ~ Adaptability... ...(e.g., PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, Megatron...Senior- ...Overview Reinforcement learning post‑training is... .... RL requires inference, rollout generation... ...an RL Frameworks engineering team to develop the... ...team spans the full software stack, from... ...their need optimizing deep learning frameworks... ...engines (vLLM, SGLang, TensorRT‑LLM) into RL...Senior
$152k - $241.5k
...advanced computer vision and deep learning. Our team builds large... ...creation of modern software, services, systems,... ...hardware. Drive Engineering Excellence: Apply a strong... ...with machine learning inference using GPU acceleration (such as CUDA, TensorRT, or comparable technologies...SeniorWorldwide$165k - $242k
...Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The... ...infrastructure performance with deep technical expertise to... ...frameworks (vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe... ..., and we’re constantly learning. Our team cares deeply about...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work- ...NVIDIA Gruppe in Santa Clara, California is seeking a Senior Software Engineer specializing in Deep Learning Inference. In this role, you will craft and develop high-performance software tailored for scalable platforms while collaborating with experts in the field. The...Senior
$139k - $204k
...What You’ll Do Senior engineers are area owners who lead designs, raise... ...our Kubernetes‑native inference platform and meet strict P99... ...Python or Go (C++ a plus) and deep familiarity with networked systems... ...frameworks (vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe)....SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$139k - $204k
...Senior Software Engineer I, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential... ...performance with deep technical expertise to accelerate... ...: CRWV) in March 2025. Learn more at What You'll Do... ...frameworks (vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work- We are now looking for a Senior Deep Learning Software Engineer, LLM Performance! NVIDIA is seeking an experienced... ...improving the performance of LLM inference. This role focuses on designing and... ...inference benchmarking frameworks, TensorRT, and Triton. Collaborate with cross...Senior
- A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach...Senior
- ...Corporation is looking for a passionate Software Engineer to join the TensorRT team in Santa Clara, California. You will drive innovation in deep learning and work with cutting-edge AI... ...contributing to high-performance AI inference solutions. Your role involves designing...
$152k - $241.5k
We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring... ...for its GPU-accelerated deep learning software team. Academic and... ...building a highly-performant AI inference platform to make design... ...and engines, such as TensorRT, PyTorch, ONNX, OpenVINO,...Senior$224k - $356.5k
...advanced computer vision and deep learning. Our team builds large-... ...-world impact. As a System Software Engineer for Vision AI, you will develop... ...and tuning GPU-accelerated inference pipelines to meet strict... ...acceleration (such as CUDA, TensorRT, or comparable technologies...Senior$184k - $287.5k
...optimization strategies for inference, such as automated... ...‑caching. Conduct deep, layer‑by‑layer... ...pipelines for TensorRT conversion. Scale... .... Architect the software interface to seamlessly... ...Science, Computer Engineering, or a related... ...or similar machine learning frameworks....Senior$248.71k - $292.6k
...delivers fast, efficient AI inference. Our LPU-based system... ...fast. Sr. Staff Software Engineer - High Performance... ...production deployments. Deep knowledge of GPU... ...production (e.g., Triton, TensorRT, or custom GPU... ..., MLIR, XLA) or deep learning graph optimization. Successful...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge... ...relevant field and extensive experience with deep learning systems is essential. Competitive salary,...Senior- NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing... ...minimum of 5 years of experience in deep learning software, excellent Rust & C++...Senior
$236k - $339.25k
...Machine Learning Platform Team Member At Snowflake, we are... ...their machine learning and deep learning workloads to... ...collaboratively and proactively with senior architects, PMs, and team... ...in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and...SeniorFlexible hours$184k - $287.5k
## Senior Software Engineer, DGX Cloud AI InfrastructureApplylocations... ...training and inference workloads across NVIDIA... ...scale. You will lead deep performance and reliability... ...intersection of deep learning systems, GPU... ...PyTorch, NeMo / Megatron, TensorRT-LLM, and adjacent NVIDIA...SeniorRemote work$124k - $195.5k
...passionate about driving innovation in deep learning and eager to work on cutting‑edge AI technology? Join NVIDIA's TensorRT team as a Software Engineer, and be at the forefront of... ...contributing to high‑performance AI inference solutions for specialized platforms...Internship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Deep Learning Inference - TensorRT. Be the first to apply!
- software engineer internship remote Santa Clara, CA
- new grad software engineer Santa Clara, CA
- software engineer staff Santa Clara, CA
- integration software engineer Santa Clara, CA
- machine learning software engineer Santa Clara, CA
- senior robotics software engineer Santa Clara, CA
- software engineer entry level Santa Clara, CA
- software development engineer aws Santa Clara, CA
- startup software engineer Santa Clara, CA
- rust software engineer Santa Clara, CA

