Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Engineer, CUDA UMD - GPU Kernel Scheduling

$272k - $431.25k

NVIDIA

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. We're looking to grow our company, and form teams with the smartest people in the world. Join us at the forefront of technological advancement.Are you a motivated system software engineer with a deep understanding of device drivers who has phenomenal C/C++ skills? If so, this role might be for you. We are looking for a seasoned software professional to work on the CUDA Driver, a core component of our platform for accelerating general purpose computation on the GPU. You will be an integral part of a team that delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, data science and self-driving cars to video games and virtual reality.What you'll be doing:As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best compute platform in the world. You will craft elegant solutions to exciting problems and shape the future direction of CUDA as you collaborate with your peers across NVIDIA.Evangelize, architect, and implement new featuresCoordinate and drive development efforts across multiple teamsHelp define forward-looking improvements to the CUDA APIs and programming modelExtend important CUDA programming models and functionality such as CUDA GraphsExplore ways to use Graphs to improve the scheduling of AI/ML workloads on our GPUS to be more efficient and faster. Write effective, maintainable, and well-tested codeDevelop code for multiple operating systemsWhat we need to see:BS or MS degree in Computer Science, Electrical Engineering​ or related field (or equivalent experience)Strong C and C++ programming skillsMinimum of 15+ years of related development experience (multiple positions for varying experience levels open)Experience driving projects across multiple teamsExperience working with large codebasesBackground with operating system interfaces for threads, process control, and virtual memoryExperience writing and debugging multithreaded programsGood written communication as well as presentation skillsWays to stand out from the crowd:Prior experience with parallel computing - preferably writing CUDA Programs or Libraries that use CUDAUnderstanding of system level architecture, such as interconnects, memory hierarchy, interrupts, and memory-mapped IOKnowledge of memory coherence and consistency modelsBackground with kernel mode developmentExperience with Linux Systems Software development as well as experience maintaining and extending programming models or higher-level language support for similar environmentsYour base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until September 18, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Engineer, CUDA UMD - GPU Kernel Scheduling in Santa Clara, CA vacancy
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push...  ..., compiler decisions, and runtime scheduling.Direct experience with LLM inference frameworks...  ...of GPU kernel optimization — CUDA, CUTLASS, Triton, or equivalent — and... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance...  ...rocprof-sys, Omniperf) and NVIDIA (CUDA, Nsight Systems/Compute, DCGM) GPUs...  ...HBM bandwidth, compute utilization, kernel scheduling, memory allocation, PCIe/Infinity Fabric... 
    Suggested

    AMD

    Santa Clara, CA
    2 days ago
  •  ...ROLEWe are seeking a Principal GenAI Inference Optimization Engineer to join our Models...  ...workloads on AMD GPU platforms. You will...  ...multiple layers—from kernels and runtimes to...  ...memory bandwidth, scheduling).- Contribute to cross...  ...systems language (C++/CUDA/HIP).- Experience... 
    Suggested

    AMD

    San Jose, CA
    1 day ago
  • $146.3k - $306.4k

     ...EnglishOracle Hardware is seeking a highly experienced Lead Principal Electrical Engineer with expert GPU and CPU systems engineering knowledge to lead complex...  ...and technical alternatives based on quality, schedule, cost, and operational impact.Identify opportunities... 
    Suggested
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    3 days ago
  • $272k - $431.25k

     ...transforming every industry. GPU-accelerated deep learning...  ...are seeking an exceptional Principal Perception Engineer to lead the design and productization...  ...pipelines.Experience with CUDA development and optimizing...  ...through custom CUDA kernels or other GPU-accelerated... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

     ...era of computing. An era in which our GPU acts as the brains of computers, robots...  ...impact on the world.We are hiring software engineers for the CUDA Tile team. NVIDIA GPUs are at the...  ...optimize the performance of tile-based kernels to ensure they execute efficiently across... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...NVIDIA is hiring a Senior Compiler Engineer to join our team driving the next generation of GPU systems programming. We are...  ...tooling of Rust to native GPU and CUDA development. On this team, you will...  ...-safe, high-performance GPU kernels in idiomatic Rust.What you’ll be... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

     ...helped craft as a member of the GPU Foundations Developer Tools...  ...Collaborate with developer tools engineers, software library developers,...  ...and both user-mode and kernel-mode drivers.Proven knowledge...  ...monitor hardware.Experience in CUDA or GPU programming models.Prior... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler...  ...(OpenGL, Vulkan, DX) and Compute (CUDA, PTX, OpenCL, Fortran, C++). This...  ...generation including instruction scheduling, software pipelining, register allocation... 
    Full time
    Remote work
    Worldwide

    Nvidia

    Santa Clara, CA
    3 days ago
  • $207k - $340k

     ...approval. We’re hiring a Principal Staff Software Engineer to lead LinkedIn’s GPU-Based Retrieval Platform,...  ...distributed serving, GPU scheduling, memory efficiency, batching, and kernel-level optimization. You will...  ...Optimize GPU performance across CUDA, Triton, memory... 
    For contractors
    Work at office
    Remote work
    Work from home
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $90.1k - $209.5k

     ...Hardware Division is seeking an experienced Electrical Engineer and Technical Program Manager to lead GPU and CPU server platform development and...  ...development programs, coordinating engineering requirements, schedules, technical dependencies, and deliverables.Collaborate... 
    Temporary work
    For contractors
    Immediate start
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    19 hours ago
  •  ...Oracle Hardware is seeking a highly experienced Lead Principal Electrical Engineer with expert GPU and CPU systems engineering knowledge to lead complex hardware development, integration, validation, and production introduction initiatives. In this senior individual... 

    Oracle Corporation

    Santa Clara, CA
    3 days ago
  • $135.2k - $306.4k

     ...Job Description The Oracle Cloud Linux team is seeking experienced Linux Kernel Developers to help advance the Linux operating system for large-scale cloud environments. This role involves contributing to Linux kernel and working on innovative projects across multiple... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    6 hours ago
  • $220.92k - $311.89k

    Job Details:Job Description: The Role and Impact As a GPU Platform Hardware Design Engineer, you will play a pivotal role in designing and developing high-quality GPU hardware platforms that drive innovation in high-performance computing, graphics, and visualization technologies... 
    Full time
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    3 days ago
  • KLA in Milpitas, CA is seeking an Algorithm Engineering Intern to join our GPU-focused team. You will accelerate and optimize image-processing and computer vision algorithms on CUDA-enabled GPUs while working on real-world semiconductor inspection and metrology problems... 
    Internship

    KLA

    Milpitas, CA
    2 days ago
  • $278.1k - $417.1k

     ...that runtime. As our Principal Engineer for On-Device AI Inference...  ..., optimization, and kernel-level tuning, to a...  ...tuning across NPU, mobile GPU, and desktop/laptop...  ...SPIR-V compute, D3D12, CUDA); profile with browser...  ...game engine: real-time scheduling, threading, memory pooling... 
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    5 days ago
  • $150.68k - $225.7k

     ...talented senior-level System Diagnostic Engineer to join our Platform Engineering team, supporting...  ...designs meet performance, quality, and schedule objectives.What You Can ExpectDesign and...  ..., including knowledge of Linux drivers, kernel concepts, and memory mappingHands-on... 
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    3 days ago
  • $133.5k - $272k

     ...trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain...  ...computer architecture - multi-threading, CPU scheduling, memory management with practical knowledge of Linux at system/kernel levelHands-on experience with Docker and Kubernetes... 

    Netskope

    Santa Clara, CA
    2 days ago
  • $226.6k - $311.58k

    Introduction to the jobASML / HMI is seeking a Principal Physics Algorithms Engineer to help define and develop the next...  ...learning and AIHigh-performance computing, GPU acceleration, and numerical optimizationC++, CUDA, Python, and modern software development practicesScientific... 
    Full time
    2 days per week

    ASML Holding

    San Jose, CA
    5 days ago
  • $230.1k - $311.2k

    At Amazon, Principal Engineers are both technical leaders and hands-on builders. As Amazon's most...  ...LLM serving on custom accelerators (TPU/GPU/ASIC); ML/post-training framework development...  ...optimization (compiler, graph, kernel) and numerical debugging; or adjacent backgrounds... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $219k - $351k

     ..., customers, partners, and communities.Principal Engineer, Architecture & Performance Research Engineer...  ...-V, ARM, or x86 cores; experience with GPU/NPU vector or accelerator architectures...  ...-end: Out-of-order execution, scheduling, RVV/SIMD, vector execution, or matrix/... 
    Work at office
    Flexible hours
    Shift work

    Samsung Semiconductor

    San Jose, CA
    3 days ago
  • $200k - $260k

     ...for talented individuals to join its fast-growing teams.As a Principal Engineer on our Mapping and Localization team, you will design and...  ...experience with LOAM, lego-LOAM, ORB-SLAM, or VINS.Experience with CUDA/GPU programming or optimization for ARM-based embedded platforms... 
    Odd job
    Full time
    Shift work

    Plus.ai

    Santa Clara, CA
    2 days ago
  • $248k - $396.75k

     ...accelerated computing, inventing the GPU and pioneering the...  ...our time.NVIDIA's IT Storage Engineering team architects, designs, deploys...  ...performance, including kernel-level concepts around I/O subsystems...  ...with HPC job schedulers such as IBM LSF or Slurm — understanding... 
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $140k - $224.25k

     ...creative, and hands-on software engineer with a test to failure...  ...optimize the testing workflows in GPU domain.Write maintainable, reliable...  ...create a realistic delivery schedule and work on challenging...  ...DLSS, Frame Generation, Reflex, CUDA, G-Sync, etc.The ability to collaborate... 
    Full time

    Nvidia

    Santa Clara, CA
    19 hours ago
  •  ...Texas City: Austin Summary The Principal Power Engineer develops new electrical systems/...  .... Participate in project planning and scheduling. Propose innovative solutions for performance...  ...low-voltage power subsystems for CPU, GPU, ASIC, SoC, and FPGA Experienced in... 
    For contractors
    Work experience placement
    Work at office
    Local area

    Celestica International LP

    San Jose, CA
    3 days ago
  • $272k - $431.25k

     ...efficient, and secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent...  ...of LLM inference pipelines (Ollama, Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT), and experience running local models on... 
    Full time
    Local area
    Shift work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $171.2k - $286.6k

    Principal Engineer/Architect - Generative AI & Edge Systems, AutomotiveCategoryAlgorithm & ArchitectureLocationSan...  ..., PyTorch, NeMo, TAO, TensorRT, CUDA, and vLLM, with working knowledge of...  ..., memory bandwidth, and CPU vs. NPU vs. GPU compute. • Hands-on experience deploying... 
    Temporary work

    MediaTek

    San Jose, CA
    4 days ago
  • $272k - $431.25k

    NVIDIA is seeking a Principal Engineer to drive the performance of large...  ...of distributed training, GPU architecture, systems...  ...framework/runtime internals, CUDA libraries, communication...  ..., memory, communication, scheduling, parallelism strategy, kernel efficiency, framework... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...ROLE: AMD is looking for a Principal Engineer to serve as a hands-on technical...  ...across the stack from GPU kernels and to serving frameworks and...  ...hierarchy, instruction scheduling, and performance tradeoffsDeep...  ...with one or more of: HIP, CUDA, OpenCL, Triton/Gluon, CUTLASS... 

    AMD

    San Jose, CA
    2 days ago
  •  ...on AMD Instinct™ GPUs. You’ll work across kernels, distributed training, and framework...  ...ideal candidate is passionate about software engineering and the craft of training performance. You...  ..., and optimizer steps.Optimize multi‑GPU/multi‑node training and communication patterns... 

    AMD

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer, CUDA UMD - GPU Kernel Scheduling. Be the first to apply!