Edge-LLM Inference Engineer (TensorRT, Autoregressive AI)
$152k - $287.5kNVIDIA
NVIDIA is seeking a talented engineer to join its TensorRT Edge-LLM team in Santa Clara, CA. You'll develop state-of-the-art inference frameworks for edge AI in automotive and robotics using modern C++. Strong experience with transformer models and CUDA is essential. The role requires collaboration across multiple teams to create high-performance software solutions. Attractive salary ranging from $152,000 to $287,500 based on experience. #J-18808-Ljbffr NVIDIA
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Edge-LLM Inference Engineer (TensorRT, Autoregressive AI) in Santa Clara, CA vacancy
$152k - $241.5k
...time large language model inference? Join NVIDIA’s TensorRT Edge-LLM team and help shape the next generation of edge AI for automotive and... ...that extends TensorRT with autoregressive model serving capabilities... ..., Electrical/Computer Engineering, or a closely related field...Suggested- NVIDIA Gruppe is looking for a skilled engineer to join their TensorRT Edge-LLM team in Santa Clara, California. The role involves developing a state-of-the-art inference framework for large language models and optimizing it for real-time performance on embedded platforms...Suggested
- ...California is seeking a talented individual to optimize inference engines for local environments, impacting the future of AI. Applicants should have a strong background in... ...candidate will work closely with cutting-edge technology and enjoy a hybrid working model. Intelligence...SuggestedLocal area
- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...Suggested
$152k - $241.5k
...deep learning and eager to work on cutting‑edge AI technology for safety‑critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high‑performance AI inference solutions for automotive safety and...Suggested- ...Robotics Title: Senior Embodied AI Engineer About Us: UnitX builds the world... ...applications. Scale for Global Impact & Edge Deployment: Ensure that all... ...ML models for real-time inference on robotic hardware (e.g., NVIDIA Jetson, TensorRT, CUDA). Advanced Embodied AI: Experience...Full time
$272k - $425.5k
Principal Software Engineer – Large-Scale LLM Memory and Storage Systems... ..., low-latency inference framework for serving generative AI and reasoning models across... ...deployment of cutting-edge LLM workloads.We are seeking... ...such as vLLM, SGLang, TensorRT-LLM), with a focus on...Local areaRemote workNVIDIA
Santa Clara, CA5 days ago$170.5k - $315.49k
..., our journey is to transform AI into something safer, more trustworthy... ...on the user's machine (AI PC, edge, on‑prem, and beyond), keeping... ...actually own. You optimize inference engines (llama.cpp, vLLM) for... ...systems‑level code Understands how LLM inference works (attention, KV...Local areaImmediate startShift work$152k - $241.5k
## Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa Claratime type:... ...positions in the Deep Learning Inference TensorRT software team.**What you’ll be doing:... ...for an existing vacancy.NVIDIA uses AI tools in its recruiting processes....- ...Deep Learning Software Engineer, TensorRT Performance! NVIDIA is... ...of NVIDIA’s inference ecosystem. NVIDIA is rapidly... ...gold standard for Gen AI performance. Work with... ...., TensorRT, TensorRT‑LLM, vLLM, SGLang, FlashInfer... ...Jetson systems or other edge AI accelerators). Your...
$184k - $287.5k
...the forefront of the AI revolution,... ...caliber Deep Learning Engineer to bridge the gap between cutting-edge multimodal architectures... ...algorithms to make LLM/VLM fast, lean, and... ...strategies for inference, including automated... ...deployment pipelines for TensorRT conversion. Scale...$197.3k - $225.1k
...creating responsible and reliable AI systems, changing banking for... ...‑class applied science and engineering teams to deliver our industry‑... ...training, large language model inference, similarity search, guardrails... ...introduce state‑of‑the‑art LLM optimization techniques to improve...Local areaCapital One
San Jose, CA3 days ago- NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. This role will involve building production-quality APIs, collaborating across teams, and enhancing...
- ...semiconductor design company, is seeking an AI Accelerator Software Principal Engineer - NPU Full‑Stack Integration to lead high‑performance inference on Arm Ethos-U85. You will optimize AI... ...scalable, low‑latency AI solutions for edge/cloud devices, leveraging Transformers...
- ...About Us Hippocratic AI is the leading generative AI company in healthcare. We have... ...the Role We're seeking an experienced LLM Inference Engineer to optimize our large language model (... ...frameworks such as vLLM , SGLang , or TensorRT-LLM Experience with custom CUDA kernels...
Dormont Manufacturing Company
Palo Alto, CA5 days ago - Cloud Hybrid Technologies, LLC is seeking a developer with hands-on experience in AI and ML systems. The role focuses on building AI/ML algorithms and technologies such as LLM inference, similarity search, and vector databases, with guardrails and LangChain integration....
$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...- NVIDIA is seeking a System Software Engineer to work on Dynamo‑Triton Inference Server in Santa Clara, CA. You will contribute to a high-performance, GPU-accelerated AI inference platform that serves both LLM and non-LLM workloads and participate in a fast-paced open source...
- NVIDIA Corporation is seeking a Senior Software Engineer for Deep Learning Inference in Santa Clara. In this role, you will craft and develop robust... ...inferencing software for multiple platforms and contribute to TensorRT, NVIDIA’s high-performance deep learning inference SDK....
- Intel Corporation in Santa Clara seeks an Inference Optimization Engineer to optimize AI models for local and edge environments. Candidates should possess over 5 years of experience in software development, proficient in C++ and Python, and comfortable with performance...Local area
- NVIDIA is looking for a Senior Software Engineer for Deep Learning Inference to develop robust inferencing software and contribute to TensorRT, their high-performance deep learning inference SDK. The ideal candidate will have at least 3 years of software development experience...
$165k - $242k
Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform... ...to inference frameworks (vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe). Experience with...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work- ...computing experiences—from AI and data centers, to PCs, gaming... ...RL training and SOTA LLM and Multimodal inference at scale across multi-GPU and... ...integrate and optimize cutting‑edge compiler technologies and drive... .... THE PERSON: Skilled engineer with strong technical and analytical...
$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...- Samsung Research America (SRA) seeks a candidate to advance robotics through cutting-edge research. You will explore AI technologies to develop robotic systems capable of interacting in human-like manners. Ideal candidates have a PhD or Master’s in EECS/Robotics, with...
$90 - $130 per hour
...partnership with Nvidia, is on the lookout for a Generative AI Security Engineer to join their Santa Clara team. This full-time role offers remote... ...for evaluating machine learning models, implementing cutting-edge techniques for bias mitigation, and collaborating with...Remote jobFull time- Tensordyne in Sunnyvale, California is searching for a Hardware Design Engineer to take ownership of hardware system development for cutting-edge AI Inference products. In this role, you will engage with ASIC, software, product, and operations teams to ensure successful...
$124k - $195.5k
...innovation in deep learning and eager to work on cutting‑edge AI technology? Join NVIDIA’s TensorRT team as a Software Engineer, and be at the forefront of technology, contributing to high‑performance AI inference solutions for specialized platforms and applications....InternshipNVIDIA
Santa Clara, CA5 days ago$197.5k - $272k
...transformation to AI-enabled software-defined... ...-grade AI on the Edge. We are looking for a great Staff AI Engineer to join our... ....g., Transformers, LLM, CNN, LSTM, Trees)... ...C++ (C++14/17 for inference). ~ Deep proficiency... ...Experience with NVIDIA TensorRT, Qualcomm SNPE....Work at officeWorldwideFlexible hoursShift work3 days per week$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy,... ...scale AI model training and inference. You will ensure our machine... ...scheduling alongside advanced LLM serving engines. Cross-... ...Engineers to productionize cutting‑edge models, establish monitoring...Local areaArcher56
San Jose, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge-LLM Inference Engineer (TensorRT, Autoregressive AI). Be the first to apply!
