Senior GPU Kernel Engineer: Inference Performance
Neura Market
CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel-level optimization for LLM inference and end-to-end model serving, focusing on CUDA kernels and throughput/latency improvements. You will lead kernel design reviews, mentor engineers, and drive reproducible benchmarking across vLLM, TensorRT-LLM, and related stacks while partnering with product, orchestration, and hardware teams. #J-18808-Ljbffr Neura Market
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior GPU Kernel Engineer: Inference Performance in Sunnyvale, CA vacancy
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...SeniorPerformanceFull time- ...we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated... ...spanning HBM bandwidth, compute utilization, kernel scheduling, memory allocation, and PCIe/Infinity Fabric...SeniorPerformance
- ...Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team that designs...Senior
$184k - $287.5k
We are now looking for a Senior Formal Verification Engineer for GPU Kernels! Modern AI performance relies on highly optimized GPU kernels — performance-critical code where bugs can be hard to catch and expensive to miss. NVIDIA's Deep Learning Safety Team is hiring engineers...SeniorPerformanceFull timeWork experience placement- ...industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference... ....About The RoleWe are hiring a Senior Performance Engineer to join our Product team. You are... ..., SGLang, TensorRT-LLM), GPU kernel-level optimization toolchains (...SeniorPerformanceContract workShift work
- Tilde Research is seeking a Kernel Engineer in Palo Alto to design, implement, and optimize high-performance GPU kernels for training and inference workloads. You will collaborate with ML researchers and engineers to push hardware limits, improve throughput, and reduce...Performance
- NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models...Senior
- ...California is looking for a Member of Technical Staff for Kernel/Compiler/Communication. This critical role requires strong expertise in CUDA and GPU optimization, along with 5+ years of experience in performance engineering. The ideal candidate will design high-performance...SeniorPerformance
- NVIDIA is seeking a Senior DL Algorithms Engineer to optimize LLM/Omni models and enhance performance across its software stack. The ideal candidate will have a PhD and 3... ...experience in deep learning, specifically in inference. This role involves profiling, analyzing...SeniorPerformance
$184k - $287.5k
...seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with... .... You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and...SeniorPerformanceFull time- NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources.... ..., while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs. The role requires deep C++...SeniorPerformanceLocal area
$184k - $287.5k
We are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking senior engineers... ...who are mindful of performance analysis and optimization... ...hardware/software stack from GPU architecture to Deep... ...language and multimodal model inference as part of NVIDIA...SeniorPerformanceFull time$184k - $287.5k
...are seeking a self‑motivated senior engineer for the Aerial Omniverse... ...implementation of a real‑time, GPU‑accelerated propagation engine... ...in computer graphics, high‑performance computing, computational... ...bandwidth trade‑offs at the kernel level.Working knowledge of electromagnetic...SeniorPerformanceFull time$152k - $241.5k
...the world.NVIDIA is hiring a Senior Compiler Engineer to join our team driving the next generation of GPU systems programming. We are... ...redefining how developers write high-performance GPU software by bringing the... ...-safe, high-performance GPU kernels in idiomatic Rust.What you’...SeniorPerformanceFull timeRemote work- ...Technical Staff to push the limits of performance at the kernel, compiler, and communication layers. You... ...on modern accelerators across large GPU clusters. You will design high-performance... ..., and collaborate with training and inference teams to reduce latency and increase...SeniorPerformance
$184k - $356.5k
...leading technology company in California is seeking a Senior DL Algorithms Engineer to drive inference performance for Deep Learning workloads. The role involves... ...have over 5 years of experience in deep learning and GPU programming. This position offers a competitive base...SeniorPerformance- NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer to advance Deep Learning Inference within TensorRT. You will build scalable inferencing software and contribute to high-performance GPU-accelerated deployments. Join a cross-disciplinary team to push...SeniorPerformance
- ...Corporation in Santa Clara, CA is seeking a Senior Software Engineer to advance the CUDA driver and... ...implement features across chips and kernels, collaborating with cross-functional... ...targets and contribute to high-performance GPU software. #J-18808-Ljbffr NVIDIA CorporationSeniorPerformance
$160k - $253k
...accelerated computing is the engine of artificial... ...platforms integrate high performance compute, networking, and... .... We are looking for a Senior Technical Marketing Engineer... ...in showcasing NVIDIA's GPU architecture, server-... ...and efficiency for AI inference & training.What you’ll...SeniorPerformanceFull time$182k - $242k
...superior infrastructure performance with deep technical... ...high-performance GPU infrastructure across... ..., and real-time inference. Our stack is engineered for speed, scale, and... ...We're looking for a Senior Engineer for CoreWeave... ...Performance team, focused on kernel authoring and...SeniorPerformancePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA18 days ago- CoreWeave is seeking a Senior Engineer for the Benchmarking & Performance team to own CUDA kernel authoring and optimization for AI inference. You will write, profile, and tune kernels on the critical path of large‑scale model serving to maximize throughput and minimize...SeniorPerformance
- ...career. THE ROLE: Drive the performance of post‑training workloads on... ...Instinct™ GPUs. You’ll work across kernels, distributed training, and... ...is passionate about software engineering and the craft of training... ...optimizer steps.Optimize multi‑GPU/multi‑node training and communication...SeniorPerformance
$184k - $287.5k
NVIDIA is seeking a Compute Kernel Performance Architect who can develop, profile, and analyze CUDA workloads with a strong focus on GPU power behavior. In this role, you will create... ...power architects, silicon validation engineers, and software teams to characterize workload...SeniorPerformanceFull time$184k - $356.5k
NVIDIA is hiring a Senior Engineer to join its GPU Software team in Santa Clara, California. This role focuses on designing and developing GPU kernel drivers and embedded software, impacting both datacenter and gaming markets. Candidates should have over 10 years of software...Senior- Advanced Micro Devices is seeking a Senior GPU Inference Performance Engineer to own end-to-end profiling of GPU-accelerated AI inference workloads. You will analyze workloads across AMD Instinct and NVIDIA GPUs, profile AI serving frameworks, and explain performance gaps...SeniorPerformance
$166k - $225k
Databricks is looking for a Sr. Research Engineer to join their Scaling Team in Mountain View, California. The role involves driving performance improvements and designing high-performance GPU kernels for training workloads. Candidates should have strong experience in CUDA...SeniorPerformance- ...TEAM: AMD’s Data Center GPU organization builds high-performance GPUs for largescale machine... ...The Triton compiler and kernel teams are central to unlocking... ...ROLE:AMD is seeking a Senior Product Manager to own... ...degree in Computer Science, Engineering, or related field, or...SeniorPerformance
$184k - $287.5k
NVIDIA's invention of the GPU 1999 sparked the growth of... ...company”.We're looking for a Senior Performance Compiler Engineer to join our team and work... ...both training and inference. You will be immersed in a... ...MLIR to optimize high-level kernel descriptions (written in Triton...SeniorPerformanceFull timeRemote work- NVIDIA in Santa Clara, CA seeks a senior software engineer focusing on GPU computing and ML inference to optimize LLM workloads on edge AI hardware. You will track... ..., map architectures to NVIDIA GPUs, and report performance metrics. With 12+ years in software engineering...SeniorPerformance
$195.2k - $361.2k
...hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge environments — GPU/iGPUs, Vulkan backends — not datacenter H10... ...Benchmark across hardware tiers and publish honest performance comparisonsUpstream fixes and patches to...SeniorPerformanceFull timeInternshipLocal areaImmediate startShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU Kernel Engineer: Inference Performance. Be the first to apply!
Related searches
- senior technology project manager Sunnyvale, CA
- remote senior business analyst Sunnyvale, CA
- senior manager clinical operations Sunnyvale, CA
- senior leadership Sunnyvale, CA
- sr. process development engineer Sunnyvale, CA
- senior manager data science Sunnyvale, CA
- senior business analyst Sunnyvale, CA
- senior control systems engineer Sunnyvale, CA
- senior director engineering Sunnyvale, CA
- senior grant accountant Sunnyvale, CA