Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior GPU Kernel Engineer for High-Performance AI Inference

CoreWeave

CoreWeave is hiring a Senior Engineer for its Benchmarking & Performance team to write, profile, and optimize GPU kernels on the LLM inference path. You will improve latency and throughput and collaborate with product, orchestration, and hardware teams to achieve strict P99 SLAs at scale.

You will lead kernel-level performance work, publish rigorous benchmarks, and mentor engineers while shaping the benchmarking workflow and end-to-end performance stories for model serving stacks.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior GPU Kernel Engineer for High-Performance AI Inference in Sunnyvale, CA vacancy
  • $184k - $287.5k

     ...'re now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it...  ...inference operation to its performance ceiling? Our LLM Inference...  ...economics, surfacing high-value optimization opportunities...  ...optimization: applying AI-driven analysis to diagnose... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel-level optimization for LLM inference and end-to-end model serving, focusing on CUDA kernels and throughput/latency improvements. You will lead kernel design reviews, mentor... 
    Senior
    Performance

    Neura Market

    Sunnyvale, CA
    16 hours ago
  • A cutting-edge AI company in California is looking...  ...of Technical Staff for Kernel/Compiler/Communication....  ...strong expertise in CUDA and GPU optimization, along with...  ...years of experience in performance engineering. The ideal candidate will design high-performance kernels and... 
    Senior
    Performance

    RadixArk

    Palo Alto, CA
    3 days ago
  • $184k - $287.5k

    We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency...  ...’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and...  .... THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis...  ...HBM bandwidth, compute utilization, kernel scheduling, memory allocation, and PCIe... 
    Senior
    Performance

    AMD

    Santa Clara, CA
    2 days ago
  •  ...NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models... 
    Senior

    NVIDIA

    Santa Clara, CA
    16 hours ago
  • $184k - $287.5k

    We are now looking for a Senior Formal Verification Engineer for GPU Kernels! Modern AI performance relies on highly optimized GPU kernels — performance-critical code where bugs can be hard to catch and expensive to miss. NVIDIA's Deep Learning Safety Team is hiring engineers... 
    Senior
    Performance
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    4 days ago
  • $160k - $253k

     ...transforming into AI factories, and NVIDIA...  ...computing is the engine of artificial...  ...platforms integrate high performance compute, networking...  ...are looking for a Senior Technical Marketing...  ...NVIDIA's GPU architecture, server...  ...efficiency for AI inference & training.What you... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate...  ...optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs. The role... 
    Senior
    Performance
    Local area

    NVIDIA

    Santa Clara, CA
    16 hours ago
  • Tilde Research is seeking a Kernel Engineer in Palo Alto to design, implement, and optimize high-performance GPU kernels for training and inference workloads. You will collaborate with ML researchers and engineers to push hardware limits, improve throughput, and reduce... 
    Performance

    Tilde Research

    Palo Alto, CA
    1 day ago
  • $166k - $225k

     ...is looking for a Sr. Research Engineer to join their Scaling Team in Mountain...  .... The role involves driving performance improvements and designing high-performance GPU kernels for training workloads....  ...comprehensive benefits. Join us to advance AI models and deliver cutting-edge... 
    Senior
    Performance

    Databricks

    Mountain View, CA
    11 hours ago
  •  ...world's largest AI chip, 56 times larger...  ...training and inference speeds; over 10 times faster than GPU-based hyperscale...  ...workloads with ultra high-speed inference....  ...are hiring a Senior Performance Engineer to join our Product...  ...TensorRT-LLM), GPU kernel-level... 
    Senior
    Performance
    Contract work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $182k - $242k

     ...CoreWeave is the top-rated AI-cloud for high-performance GPU infrastructure across...  ..., and real-time inference. Our stack is engineered for speed, scale, and cost...  ...We're looking for a Senior Engineer for CoreWeave'...  ...Performance team, focused on kernel authoring and... 
    Senior
    Performance
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Neura Market

    Sunnyvale, CA
    16 hours ago
  • $152k - $241.5k

    NVIDIA is currently seeking a Senior Developer Technology Engineer for High-Performance Databases!Would you enjoy researching...  ...research and develop techniques to GPU-accelerate high performance database...  ...an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $193.3k - $261.5k

    We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational AI. This is a full-stack inference...  ...trade-offs• Develop and tune high-performance kernels for critical operations...  ...session load• Implement multi-GPU inference (tensor... 
    Senior
    Performance
    Internship
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  •  ...computing experiences—from AI and data centers, to...  ...critical in enhancing GPU kernels, deep learning models, and training/inference performance across multi-GPU and...  ...and advanced engineering principles to drive continuous...  ...effectively within a high-performing team. KEY RESPONSIBILITIES... 
    Senior
    Performance

    AMD

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...experienced and highly motivated software...  ...hardware performance for emerging AI workloads. You will...  ...optimization, custom kernel development, and...  ...from a single GPU to supercomputer...  ...training and inference pipelines.Collaborate...  ..., Computer Engineering, Electrical Engineering... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...invention of the GPU 1999 sparked...  ...ignited modern AI — the next era...  ...tier AI Compiler Engineers to drive innovation...  ...possible in AI performance and help build...  ...focusing on kernel generation and...  ...workloads (both inference and training) and...  .... As we highly value diversity... 
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  •  ...NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance...  ...experimental agents, optimize performance, and contribute to cutting...  ..., and engineers to ensure high-quality results. #J-1880... 
    Senior
    Performance

    Nvidia Corporation in

    Santa Clara, CA
    16 hours ago
  • $152k - $241.5k

     ...learning and eager to work on cutting-edge AI technology for safety-critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and other... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  •  ...headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize...  ...proficiency in C/C++/Python on Linux, and experience with distributed, high-performance software. #J-18808-Ljbffr Jobleads-US
    Senior
    Performance

    Jobleads-US

    Santa Clara, CA
    4 days ago
  • $144k - $270.25k

     .... Our invention of the GPU in 1999 fueled the growth...  ...ignited modern AI — the next era of computing...  ...infrastructure tools used by design engineers for build and...  ..., you will craft highly efficient software to automate...  ..., scalable and high performance software that are easy... 
    Senior
    Performance
    Worldwide

    NVIDIA

    Santa Clara, CA
    16 hours ago
  • $100k

     ...industry on cutting-edge AI technology, revolutionizing performance expectations, ease of...  ...have developed a high performance RISC-V CPU...  ...contributors of all seniorities.We are seeking an Senior Engineer to develop and optimize...  ...SSE, AVX, Arm Neon), GPU programming (CUDA,... 
    Senior
    Performance
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...now looking for a Senior DL Algorithms Engineer! NVIDIA is...  ...who are mindful of performance analysis and optimization...  ...stack from GPU architecture to Deep...  ...that leads the AI revolution.What you...  ...multimodal model inference as part of NVIDIA...  ...employer. As we highly value diversity in... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $184k - $287.5k

     ...seeking a self‑motivated senior engineer for the Aerial...  ...implementation of a real‑time, GPU‑accelerated...  ...in computer graphics, high‑performance computing, computational...  ...bandwidth trade‑offs at the kernel level.Working...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...world.NVIDIA is hiring a Senior Compiler Engineer to join our team...  ...the next generation of GPU systems programming....  ...how developers write high-performance GPU software by bringing...  ...high-performance GPU kernels in idiomatic Rust....  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $184k - $287.5k

     ...platform upon which every new AI-powered application is...  .... We are seeking a Sr. HPC Performance engineer to join our team of scientists...  ...digital biology, through high performance computing (HPC)...  ...scaling strategies such as kernel design, GPU porting, data structure innovations... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $208k - $327.75k

     ...unlimited potential of AI to define the...  ...in which our GPU acts as the...  ...looking for a highly technical Product...  ...best possible performance from AI models...  ...hardware. Every inference deployment — from...  ...and internal engineering teams so customers...  ...: profiling, kernel-level or... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically...  ...our team develops the GPU accelerated mathematical...  ..., and implementing high quality and performance numerical dense linear algebra... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...every industry. GPU-accelerated...  ...an exceptional Senior Perception Engineer to help design...  ...quantify perception performance; analyze large...  ...reliable, high-performance,...  ...optimizing training or inference pipelines...  ...custom CUDA kernels or other GPU-...  .... NVIDIA uses AI tools in its... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior GPU Kernel Engineer for High-Performance AI Inference. Be the first to apply!