Senior Software Engineer, Deep Learning Inference - TensorRT
$152k - $241.5kNVIDIA
- # Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa Claratime type: Full timeposted on: Posted Todayjob requisition id: JR2013020We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA GPUs? We are now welcoming exceptional software engineers to apply to Senior Engineering positions in the Deep Learning Inference TensorRT software team.**What you’ll be doing:*** Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance* Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.* Closely follow academic developments in the field of artificial intelligence and feature update TensorRT* Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models.* Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams.**What we need to see:*** A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field.* 3+ years of software development experience.* Strong experience with the latest C++ standardsC++11/C++14/C++17/C++20, etc..* Strong grasp of Machine Learning concepts.* Experience and knowledge in Computer Architecture, Data Structures, Algorithms.* Excellent communication skills, and an aptitude for collaboration and teamwork.**Ways to stand out from the crowd:*** Experience developing System Software.* Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL.* Experience in software performance benchmarking, profiling, and optimizations.* Background in compiler development* Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks.NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you. Come, join our TensorRT Workflows team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.#LI-HybridYour base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until June 13, 2026.This posting is for an existing vacancy.NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
- J-18808-Ljbffr NVIDIA Corporation
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Deep Learning Inference - TensorRT in Santa Clara, CA vacancy
$152k - $241.5k
Senior Software Engineer - Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms... ...functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning...Senior- NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Software Engineer focused on improving performance of deep learning inference software like TensorRT. The ideal candidate will have a strong foundation in C++ and Python, relevant experience with deep learning frameworks...Suggested
- We are now looking for a Senior Deep Learning Software Engineer, TensorRT Performance! NVIDIA is seeking an experienced Deep Learning Engineer passionate... ...analyzing and improving the performance of NVIDIA’s inference ecosystem. NVIDIA is rapidly growing its research and...Senior
- NVIDIA Corporation is seeking a Senior Software Engineer for Deep Learning Inference in Santa Clara. In this role, you will craft and develop robust inferencing... ...software for multiple platforms and contribute to TensorRT, NVIDIA’s high-performance deep learning inference...Senior
$152k - $241.5k
...about redefining how software is built in the age of... ...AI? Join NVIDIA’s TensorRT team to help lead a first... ...for out-of-framework inference globally. We are... ...systems‑thinking C++ engineer who wants to help scale... ...of state‑of‑the‑art deep learning breakthroughs, and improve...Senior- ...in optimizing and developing deep learning frameworks for AMD GPUs.... ...and SOTA LLM and multimodal inference at scale across multi‑GPU and... ...collaborate across internal GPU software teams and engage with open‑... .... THE PERSON Skilled engineer with strong technical and analytical...Senior
$184k - $287.5k
...Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme... ..., parallel programming, distributed systems, deep learning theories. Knowledgeable and passionate about performance...Senior- We are now looking for a Senior Deep Learning Software Engineer, LLM Performance! NVIDIA is seeking an experienced... ...improving the performance of LLM inference. This role focuses on designing and... ...inference benchmarking frameworks, TensorRT, and Triton. Collaborate with cross...Senior
- About the Role We are seeking a Senior Inference Engineer to accelerate the performance of Pika's AI-driven products. In this highly technical... ..., including quantization, attention acceleration, and deep learning compiler stacks. GPU & Parallelism : Deep knowledge of GPU...SeniorWork at office3 days per week
$224k - $356.5k
We are looking for a Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution. As part of the team, you will be instrumental... ...with NVIDIA's deep learning SDKs such as TensorRT. Prior experience in writing high-performance...Senior- A leading technology company is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference serving software. The ideal candidate will have over 5 years of experience with deep learning software, strong skills in Rust and C++, and a collaborative approach...Senior
- Overview Reinforcement learning post‑training is... .... RL requires inference, rollout generation... ...an RL Frameworks engineering team to develop the... ...team spans the full software stack, from... ...their need optimizing deep learning frameworks... ...engines (vLLM, SGLang, TensorRT‑LLM) into RL...Senior
- ...time large language model inference? Join NVIDIA’s TensorRT Edge‑LLM team and help shape... ...robotics. We build the software stack that enables Large Language... ..., Electrical/Computer Engineering, or a closely related... ...software development experience. Deep understanding of...Senior
$224k - $356.5k
...Team is building the software foundation for scalable... ...for exceptional engineers who thrive on solving... ...strategy for optimizing inference workloads in autonomous... ...across DNN models, TensorRT/compiler flows, CUDA... ...AI/ML infrastructure, deep learning inference, compiler/runtime...Senior- A leading technology company is seeking a Senior AI Software Engineer to join their team in Santa Clara, California. In this... ...develop groundbreaking AI systems software for inference applications including deep learning framework optimizations and GPU kernel technologies...Senior
$152k - $241.5k
We are looking for outstanding Deep Learning Software Engineers to develop and productize NVIDIA's deep learning... ...NVIDIA deep learning model training/inference software libraries for deployment on... ...software libraries such as CUDA and TensorRT. Open source project ownership or...SeniorWork experience placement$152k - $241.5k
We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring... ...for its GPU-accelerated deep learning software team. Academic and... ...building a highly-performant AI inference platform to make design... ...and engines, such as TensorRT, PyTorch, ONNX, OpenVINO,...Senior$184k - $287.5k
...optimization strategies for inference, such as automated... ...‑caching. Conduct deep, layer‑by‑layer... ...pipelines for TensorRT conversion. Scale... .... Architect the software interface to seamlessly... ...Science, Computer Engineering, or a related... ...or similar machine learning frameworks....Senior$124k - $195.5k
...passionate about driving innovation in deep learning and eager to work on cutting‑edge AI technology? Join NVIDIA's TensorRT team as a Software Engineer, and be at the forefront of... ...contributing to high‑performance AI inference solutions for specialized platforms...InternshipNVIDIA Gruppe
Santa Clara, CA1 day ago$248.71k - $292.6k
...delivers fast, efficient AI inference. Our LPU-based system... ...fast. Sr. Staff Software Engineer - High Performance... ...production deployments. Deep knowledge of GPU... ...production (e.g., Triton, TensorRT, or custom GPU... ..., MLIR, XLA) or deep learning graph optimization. Successful...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge... ...relevant field and extensive experience with deep learning systems is essential. Competitive salary,...Senior- NVIDIA Gruppe in Santa Clara, California is seeking a Senior Software Engineer specializing in Deep Learning Inference. In this role, you will craft and develop high-performance software tailored for scalable platforms while collaborating with experts in the field. The...Senior
- ...revolution, building the software and systems that... ...looking for a Senior Software Engineer to lead the... ...training and inference workloads across... .... You will lead deep performance and... ...intersection of deep learning systems, GPU... ...NeMo / Megatron, TensorRT‑LLM, and adjacent...Senior
- NVIDIA Corporation is seeking a Software Engineer for the TensorRT team in Santa Clara, California. This role... ...focus on developing cutting-edge AI inference technology, requiring strong C++ skills and an understanding of deep learning models. The ideal candidate will...
$153k - $222k
...Bangalore; Seoul; and Tokyo. Learn more at applied.co. We... ...both infrastructure engineers with expertise in... ...training approaches for deep learning model training... ...degree in Computer Science, Software Engineering, or... ...Serving, NVIDIA Triton inference server, etc.) Compensation...SeniorFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shiftDecisive Point
Sunnyvale, CA1 day ago$152k - $241.5k
...and industries. Within our software stack, CUTLASS stands out as... ...(GEMM) and related math and deep learning computations on NVIDIA GPUs.... ...the-art deep learning models' inference and training passes to... ...Computer Science, Computer Engineering, or related field (or equivalent...Senior$184k - $287.5k
We are looking for outstanding Senior Deep Learning Software Engineers to develop and productize NVIDIA's deep learning solutions in autonomous driving... ...compiler technologies to accelerate deep learning inference on NVIDIA hardware platforms for Physical AI. Working across...SeniorWork experience placement$152k - $241.5k
NVIDIA is the platform upon which every new AI‑powered application is built. We are seeking a Senior Software Engineer - AI Inference to advance open‑source LLM serving by contributing directly to upstream inference engines like vLLM and SGLang-ensuring they run best‑in...Senior$184k - $287.5k
We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems software... ...with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch...Senior$184k - $287.5k
A leading technology company is seeking a Senior Software Engineer for AI and DL Kernel Libraries in Santa Clara, CA. The role involves designing... ...related field, with 6+ years of experience preferably in deep learning systems. The position offers a salary range of $184,000 -...SeniorRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Deep Learning Inference - TensorRT. Be the first to apply!
Related searches
- software engineer amazon Santa Clara, CA
- experienced software developer Santa Clara, CA
- federal - software developer Santa Clara, CA
- software developer internship Santa Clara, CA
- senior software engineer Santa Clara, CA
- software developer fintech Santa Clara, CA
- part time software developer remote Santa Clara, CA
- software developer intern Santa Clara, CA
- software data engineer Santa Clara, CA
- software engineer Santa Clara, CA