Senior AI Inference Performance Engineer (CUDA/LLM/VLM)
NVIDIA AI
Lead the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated systems. Develop performance-critical kernels and contribute improvements to open-source inference engines to reduce latency and increase throughput. Requires over 6 years of experience in full-stack AI inference performance with strong programming skills in Python, C++, or Rust and expertise in CUDA. #J-18808-Ljbffr NVIDIA AI
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Performance Engineer (CUDA/LLM/VLM) in Santa Clara, CA vacancy
$162k - $243k
...Technologies, Inc. Job Area: Engineering Group, Engineering Group... ...ecosystem for large-scale LLM inference on Qualcomm platforms. In... ...-native infrastructure, and AI accelerator software. You... ...execution, compilation, and performance optimization. Develop and...SeniorPerformanceWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA1 day ago$184k - $287.5k
...projects at the intersection of CUDA and Deep Learning Systems.... ...unlock maximum hardware performance for emerging AI workloads. You will be a... ...in both training and inference pipelines.Collaborate closely... ...Computer Science, Computer Engineering, Electrical Engineering,...SeniorPerformanceFull timeNvidia
Santa Clara, CA2 days ago$195.2k - $262.2k
...for the global AI economy. We are... ...infrastructure. Built by engineers, for engineers.... ...to inference optimization, we... ...distributed systems, GPU performance, model training... .... A Senior MLE owns substantial... .... Optimize LLM and VLM endpoints for... ...orchestration. CUDA or Triton...SeniorPerformanceTemporary workImmediate startRemote work$184k - $287.5k
...re now looking for a Sr. Inference Engineer, for GPU Kernel Optimization... ...it take to push every LLM inference operation to its performance ceiling? Our LLM Inference... ...optimization: applying AI-driven analysis to diagnose... ...kernel optimization — CUDA, CUTLASS, Triton, or equivalent...SeniorPerformanceFull timeNvidia
Santa Clara, CA2 days ago- ...computing experiences—from AI and data centers, to PCs, gaming... ...ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end... ...sys, Omniperf) and NVIDIA (CUDA, Nsight Systems/Compute, DCGM... ...NVIDIA) on standardized AI and LLM workloads. Produce clear, data...SeniorPerformance
AMD
Santa Clara, CA5 days ago - Lead the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated... ...open-source inference engines to reduce latency and increase... ...in full-stack AI inference performance with... ...Rust and expertise in CUDA. A degree in Computer Science...SeniorPerformance
$184k - $287.5k
...the platform upon which every new AI-powered application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You will push... ...distributed runtimes, communication, CUDA kernels, and GPU architecture. Deliver...SeniorPerformanceFull timeNvidia
Santa Clara, CA2 days ago$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real... ...AI. This is a full-stack... ...Develop and tune high-performance kernels for critical operations... ...fall outside standard LLM serving patterns — sustained... ...(CUTLASS, Triton, raw CUDA/PTX), fused attention...SeniorPerformanceInternshipLocal areaFlexible hoursAmazon
Sunnyvale, CA1 day ago$224k - $356.5k
...unlimited potential of AI to define the next... ...is hiring a Senior Software Architect... ...Harness & Runtime Engineering team to build foundational... ...agent runtimes, inference, evaluation, and... ..., scalability, performance, resource utilization... ...:Knowledge of LLM/VLM inference, model serving...SeniorPerformanceFull timeRemote workNvidia
Santa Clara, CA1 day ago$184k - $287.5k
...globally. We seek a Senior Engineer to lead technical... ...advanced AI agent frameworks and... ...combining powerful local inference (Nemotron models)... ...understanding of LLM inference pipelines... ...accelerated computing (CUDA, TensorRT), and... ...C++ (for performance-critical systems/OS...SeniorPerformanceFull timeLocal areaShift workNvidia
Santa Clara, CA5 days ago$152k - $241.5k
...unlimited potential of AI to define the next... ...Technology Engineer, you will be at the... ...suboptimal runtime performance.Conduct hands-on trainings... ....Improve LLM & GenAI user experience... ....Experience with CUDA and NVIDIA's... ...GPU-accelerated AI inference driven by NVIDIA APIs...SeniorPerformanceFull timeLocal areaNvidia
Santa Clara, CA2 days ago$184k - $287.5k
...DGX Cloud delivers AI services and endpoints... ...are looking for a Senior Production Engineer to build software... ...infrastructure where inference and agentic... ...maintain predictable performance as workloads and demand... ...PyTorch, TensorRT-LLM, NVIDIA Dynamo, CUDA, or NCCL, and with...SeniorPerformanceFull timeNvidia
Santa Clara, CA3 days ago- NVIDIA in Santa Clara, CA, seeks a Senior Software Engineer to build AI Developer Tools and cloud-based SaaS... ...and Agents for rapid prototyping and CUDA optimization. You will architect cloud... ...and deliver scalable, high-performance services. #J-18808-Ljbffr NVIDIA GruppeSeniorPerformance
- ...smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade... ...The role focuses on PTQ and QAT workflows, performance benchmarking, and validating models in real...SeniorPerformance
$184k - $287.5k
...the generative AI revolution! The... ...language models (LLM) and diffusion... ...for maximal inference efficiency using... ...by research and engineering teams alike developing... ...looking for a Senior Deep Learning... ...improving high-performance kernel implementations in CUDA, TRT-LLM, and...SeniorPerformanceFull timeNvidia
Santa Clara, CA6 days ago$159k - $198.8k
Uniphore is the Business AI company. Our... ...Description:Staff Inference Engineer -Uniphore is... ...are looking for a Senior or Staff Inference... ...change.Inference performance: Implement and tune... ...memory access paQerns.CUDA, HIP, Triton, or CUTLASS... ..., or TensorRT-LLM• Strong Python and...SeniorPerformanceFull timeUniphore
Palo Alto, CA1 day ago$184k - $287.5k
We are now looking for a Senior High-Performance LLM Training Engineer!NVIDIA is seeking experienced engineers specializing... ...generation of GPUs powering the AI revolution.What you will be doing:... ...Programming skills in C++, Python, and CUDA.GPU computing is the most productive...SeniorPerformanceFull timeWork experience placementNvidia
Santa Clara, CA2 days ago- ...potential of generative AI to power the... ...what’s possible with LLM inference on heterogeneous... ...research and engineering team that moves fast... ...and how to squeeze performance out of them at inference... ...programming (CUDA/Triton) and performance... ...hardware.Small, senior team with high...SeniorPerformance
d-Matrix
Santa Clara, CA3 days ago $152k - $241.5k
Senior Software Engineer, GPU Code Generation for Machine Learning Inference# CAREERS AT NVIDIA## Senior Software Engineer... ...and advance high-performance AI inference on NVIDIA GPUs... ...GPU kernels using CUDA, Triton, CuTe DSL, CUTLASS... ..., TensorRT, TensorRT-LLM, vLLM, and SGLang.* A...SeniorPerformanceFull timeLocal areaRemote workNVIDIA Corporation
Santa Clara, CA9 hours ago$184k - $287.5k
...Intelligence, High Performance Computing and Visualization... ...Deep Learning engineer to bring advanced... ...technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX,... ...up to 100K GPUs to inference down at microsecond... ...with Python, C++, CUDA or related DSLs (Triton...SeniorPerformanceFull timeRemote workNvidia
Santa Clara, CA5 days ago$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team.... ...most sophisticated AI applications. Our... ...maintaining high-performance deep learning frameworks... ...state-of-the-art LLM and Generative AI... ...Triton, NCCL, and CUDA kernels—to...SeniorPerformanceFull timeNvidia
Santa Clara, CA1 day ago$152k - $241.5k
...looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into modern LLM and agentic AI workflows. Leading organizations... ...and AI agents alike build high-performance applications with ease through...SeniorPerformanceFull timeRemote workNvidia
Santa Clara, CA2 days ago- ...centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads...SeniorPerformance
- ...discovery to powering AI and the technologies... ...seeking a highly skilled Senior AI Software Engineer to join our team. The... ..., and system performance profiling within high... ...software stacks, optimizing inference pipelines and model... ...and efficiency.ROCm, CUDA & GPU Computing: Deep...SeniorPerformance
AMD
San Jose, CA1 day ago - ...NVIDIA is seeking a CUDA Engineer to optimize deep learning frameworks for GPU acceleration. You will work on kernel optimization, memory management, and performance tuning for training and inference workloads on NVIDIA's latest GPU architectures. Requirements ~5+...Performance
Best AI Tools Wiki
Santa Clara, CA1 day ago - Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed systems, and cloud-native infrastructure...Senior
$206k - $275k
...Cloud, is a leader in AI cloud infrastructure serving... ...company—Finance, GTM, Engineering, and People—to... ...forecasting, software performance analysis, and system tuning... ...etc.) integrated with LLM workflows to automate... ...latency, and control inference costs across teams....SeniorPerformanceWork at officeLocal areaWork from homeFlexible hoursLambda Labs
San Jose, CA5 days ago- ...worldwide.We’re a team of engineers, clinicians, and... ...helps care teams perform with greater... ...Job DescriptionAs a Senior Systems Research... ...and build embodied AI applications at the... ...real-time onboard inference—while serving as a... ...interfaces, and CUDA programming.Experience...SeniorPerformanceLocal areaWorldwideFlexible hours
Intuitive Surgical
Sunnyvale, CA3 days ago $272k - $431.25k
NVIDIA is the engine of modern AI, and robotics is where AI meets the physical... ..., grow, and mentor a high-performing team of robotics software engineers... ...fully uses NVIDIA GPUs, CUDA, and the accelerated-... ...simulation, training, and on-robot inference on Jetson and edge platforms...SeniorPerformanceFull timeNvidia
Santa Clara, CA5 days ago- Matroid Inc. is seeking a Senior Vision-Language Model (VLM) & Visual Foundation Model (VFM) Field Engineer to build and deploy production-grade multimodal AI systems for enterprise customers. You... ..., and integration, balancing performance, latency, and cost while collaborating...SeniorPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Performance Engineer (CUDA/LLM/VLM). Be the first to apply!
Related searches
- ai developer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai engineer Santa Clara, CA
- senior living Santa Clara, CA
- senior associate vice president Santa Clara, CA
- senior app developer Santa Clara, CA
- senior manufacturing engineer Santa Clara, CA
- senior ml engineer Santa Clara, CA