Senior GPU Kernel Engineer: Inference Performance
Neura Market
CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel-level optimization for LLM inference and end-to-end model serving, focusing on CUDA kernels and throughput/latency improvements.
You will lead kernel design reviews, mentor engineers, and drive reproducible benchmarking across vLLM, TensorRT-LLM, and related stacks while partnering with product, orchestration, and hardware teams.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior GPU Kernel Engineer: Inference Performance in Sunnyvale, CA vacancy
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...SeniorPerformanceFull time- ...we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated... ...spanning HBM bandwidth, compute utilization, kernel scheduling, memory allocation, and PCIe/Infinity Fabric...SeniorPerformance
$184k - $287.5k
We are now looking for a Senior Formal Verification Engineer for GPU Kernels! Modern AI performance relies on highly optimized GPU kernels — performance-critical code where bugs can be hard to catch and expensive to miss. NVIDIA's Deep Learning Safety Team is hiring engineers...SeniorPerformanceFull timeWork experience placement- ...industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference... ....About The RoleWe are hiring a Senior Performance Engineer to join our Product team. You are... ..., SGLang, TensorRT-LLM), GPU kernel-level optimization toolchains (...SeniorPerformanceContract workShift work
- ...NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models...Senior
NVIDIA
Santa Clara, CA3 hours ago $193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational... ...trade-offs• Develop and tune high-performance kernels for critical operations where off-... ...concurrent session load• Implement multi-GPU inference (tensor parallelism,...SeniorPerformanceInternshipLocal areaFlexible hours$184k - $287.5k
...seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with... .... You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and...SeniorPerformanceFull time- ...NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources.... ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs. The role requires deep...SeniorPerformanceLocal area
NVIDIA
Santa Clara, CA3 hours ago $184k - $287.5k
We are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking senior engineers... ...who are mindful of performance analysis and optimization... ...hardware/software stack from GPU architecture to Deep... ...language and multimodal model inference as part of NVIDIA...SeniorPerformanceFull time$184k - $287.5k
...are seeking a self‑motivated senior engineer for the Aerial Omniverse... ...implementation of a real‑time, GPU‑accelerated propagation engine... ...in computer graphics, high‑performance computing, computational... ...bandwidth trade‑offs at the kernel level.Working knowledge of electromagnetic...SeniorPerformanceFull time$152k - $241.5k
...the world.NVIDIA is hiring a Senior Compiler Engineer to join our team driving the next generation of GPU systems programming. We are... ...redefining how developers write high-performance GPU software by bringing the... ...-safe, high-performance GPU kernels in idiomatic Rust.What you’...SeniorPerformanceFull timeRemote work- ...NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer to advance Deep Learning Inference within TensorRT. You will build scalable inferencing software and contribute to high-performance GPU-accelerated deployments. Join a cross-disciplinary team to...SeniorPerformance
NVIDIA Corporation
Santa Clara, CA3 hours ago - ...Corporation in Santa Clara, CA is seeking a Senior Software Engineer to advance the CUDA driver and... ...implement features across chips and kernels, collaborating with cross-functional... ...work on Linux targets and contribute to high-performance GPU software. #J-18808-LjbffrSeniorPerformance
NVIDIA Corporation
Santa Clara, CA3 hours ago $160k - $253k
...accelerated computing is the engine of artificial... ...platforms integrate high performance compute, networking, and... .... We are looking for a Senior Technical Marketing Engineer... ...in showcasing NVIDIA's GPU architecture, server-... ...and efficiency for AI inference & training.What you’ll...SeniorPerformanceFull time- ...CoreWeave is seeking a Senior Engineer for the Benchmarking & Performance team to own CUDA kernel authoring and optimization for AI inference. You will write, profile, and tune kernels on the critical path of large‑scale model serving to maximize throughput and minimize...SeniorPerformance
CoreWeave
Sunnyvale, CA3 hours ago $184k - $356.5k
...NVIDIA is hiring a Senior Engineer to join its GPU Software team in Santa Clara, California. This role focuses on designing and developing GPU kernel drivers and embedded software, impacting both datacenter and gaming markets. Candidates should have over 10 years of software...SeniorNVIDIA
Santa Clara, CA3 hours ago- ...career. THE ROLE: Drive the performance of post‑training workloads on... ...Instinct™ GPUs. You’ll work across kernels, distributed training, and... ...is passionate about software engineering and the craft of training... ...optimizer steps.Optimize multi‑GPU/multi‑node training and communication...SeniorPerformance
$184k - $287.5k
NVIDIA is seeking a Compute Kernel Performance Architect who can develop, profile, and analyze CUDA workloads with a strong focus on GPU power behavior. In this role, you will create... ...power architects, silicon validation engineers, and software teams to characterize workload...SeniorPerformanceFull time$182k - $242k
...superior infrastructure performance with deep technical... ...high-performance GPU infrastructure across... ..., and real-time inference. Our stack is engineered for speed, scale, and... ...We're looking for a Senior Engineer for CoreWeave... ...Performance team, focused on kernel authoring and...SeniorPerformancePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA23 days ago$184k - $287.5k
NVIDIA's invention of the GPU 1999 sparked the growth of... ...company”.We're looking for a Senior Performance Compiler Engineer to join our team and work... ...both training and inference. You will be immersed in a... ...MLIR to optimize high-level kernel descriptions (written in Triton...SeniorPerformanceFull timeRemote work- ...TEAM: AMD’s Data Center GPU organization builds high-performance GPUs for largescale machine... ...The Triton compiler and kernel teams are central to unlocking... ...ROLE:AMD is seeking a Senior Product Manager to own... ...degree in Computer Science, Engineering, or related field, or...SeniorPerformance
$195.2k - $361.2k
...hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge environments — GPU/iGPUs, Vulkan backends — not datacenter H10... ...Benchmark across hardware tiers and publish honest performance comparisonsUpstream fixes and patches to...SeniorPerformanceFull timeInternshipLocal areaImmediate startShift work$152k - $241.5k
.... An era in which our GPU acts as the brains of... ...Deep Learning Compiler Engineer. NVIDIA is hiring software... ...backbone of NVIDIA inference engine, spanning... ...deliver leading inference performance, fast build time, reduced... ..., such as PyTorch.GPU kernel generation with high...SeniorPerformanceFull timeRemote work$184k - $287.5k
...transforming every industry. GPU-accelerated deep... ...an exceptional Senior Perception Engineer to help design and productize... ...quantify perception performance; analyze large-scale real... ...training or inference pipelines through custom CUDA kernels or other GPU-accelerated...SeniorPerformanceFull time- .... Your expertise will be critical in enhancing GPU kernels, deep learning models, and training/inference performance across multi-GPU and multi-node systems. You will... ...-edge compiler technologies and advanced engineering principles to drive continuous improvement. THE...SeniorPerformance
$224k - $356.5k
...transforming every industry. GPU-accelerated deep... ...an exceptional Senior Radar Perception Engineer to help design and productize... ...radar perception performance; analyze large-scale... ...optimizing training or inference pipelines through custom CUDA kernels or other GPU-...SeniorPerformanceFull time$152k - $241.5k
...Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves... ...motivated Deep Learning engineer to bring advanced... ...scales up to 100K GPUs to inference down at microsecond latency... ...compute-communication kernels to showcase ultimate performance...SeniorPerformanceFull timeRemote work$136k - $218.5k
...seeking best-in-class ASIC Verification Engineers to verify the world’s leading GPUs. In this... ...and system interface hardware of the GPU. This position will be working across many... ...the challenge of creating the highest performance chips in the industry? If so, we want to...SeniorPerformanceFull timeShift work$184k - $287.5k
...unlock maximum hardware performance for emerging AI... ...optimization, custom kernel development, and cluster... ...systems from a single GPU to supercomputer clusters... ...in both training and inference pipelines.Collaborate... ...Computer Science, Computer Engineering, Electrical...SeniorPerformanceFull time- ...NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance contexts. You will design and... ...drives experimental agents, optimize performance, and contribute to cutting-edge AI research...SeniorPerformance
Nvidia Corporation in
Santa Clara, CA3 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU Kernel Engineer: Inference Performance. Be the first to apply!
Related searches
- senior lead project manager Sunnyvale, CA
- senior robotics software engineer Sunnyvale, CA
- senior devops engineer remote Sunnyvale, CA
- senior sas administrator Sunnyvale, CA
- senior IT manager Sunnyvale, CA
- senior contracts analyst Sunnyvale, CA
- sr project manager Sunnyvale, CA
- senior windows systems engineer Sunnyvale, CA
- senior manager data science Sunnyvale, CA
- senior ui ux designer Sunnyvale, CA