Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer CUDA UMD - GPU Kernel Scheduling

$152k - $241.5k
Full-time

NVIDIA

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. We're looking to grow our company, and form teams with the smartest people in the world. Join us at the forefront of technological advancement. Are you a motivated system software engineer with a deep understanding of device drivers who has phenomenal C/C++ skills? If so, this role might be for you. We are looking for a seasoned software professional to work on the CUDA Driver, a core component of our platform for accelerating general purpose computation on the GPU. You will be an integral part of a team that delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, data science and self-driving cars to video games and virtual reality. What you'll be doing: As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best compute platform in the world. You will craft elegant solutions to exciting problems and shape the future direction of CUDA as you collaborate with your peers across NVIDIA.

  • Evangelize, architect, and implement new features
  • Coordinate and drive development efforts across multiple teams
  • Help define forward-looking improvements to the CUDA APIs and programming model
  • Extend important CUDA programming models and functionality such as CUDA Graphs
  • Explore ways to use Graphs to improve the scheduling of AI/ML workloads on our GPUS to be more efficient and faster.
  • Write effective, maintainable, and well-tested code
  • Develop code for multiple operating systems
What we need to see:
  • BS or MS degree in Computer Science, Electrical Engineering​ or related field (or equivalent experience)
  • Strong C and C++ programming skills
  • Minimum of 4 years of related development experience (multiple positions for varying experience levels open)
  • Experience driving projects across multiple teams
  • Experience working with large codebases
  • Background with operating system interfaces for threads, process control, and virtual memory
  • Understanding of system level architecture, such as interconnects, memory hierarchy, interrupts, and memory-mapped IO
  • Experience writing and debugging multithreaded programs
  • Good written communication as well as presentation skills
Ways to stand out from the crowd:
  • Prior experience with parallel computing - preferably writing CUDA Programs or Libraries that use CUDA
  • Knowledge of memory coherence and consistency models
  • Background with kernel mode development
  • Experience with Linux Systems Software development
  • Experience maintaining and extending programming models or higher-level language support for similar environments
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and [benefits](#). Applications for this job will be accepted at least until September 5, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer CUDA UMD - GPU Kernel Scheduling in Santa Clara, CA vacancy
  • $152k - $241.5k

    NVIDIA’s invention of the GPU in 1999 sparked the...  ...a motivated system software engineer with a deep understanding...  ...to work on the CUDA Driver, a core component...  ...Graphs to improve the scheduling of AI/ML workloads on...  ...modelsBackground with kernel mode developmentExperience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $182k - $242k

     ...high-performance GPU infrastructure...  .... Our stack is engineered for speed,...  ...looking for a Senior Engineer for CoreWeave...  ..., focused on kernel authoring and optimization...  ..., and optimize CUDA kernels—GEMMs,...  .../accelerator software, or performance...  ...) / Slurm for scheduling large GPU jobs.... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    22 hours ago
  •  ...THE ROLE: As a senior technical member...  ...high-performance GPU kernels for LLM and other...  ...analysis and system software development. You...  ...synchronization, kernel scheduling, and execution...  ...using HIP, CUDA, C/C++, or similar...  ...degree in computer engineering, computer science... 
    Suggested
    Full time

    AMD

    San Jose, CA
    12 days ago
  • $152k - $241.5k

     ...seeking talented engineers to join the...  ...team develops software that accelerates...  ...challenging problems in GPU code generation...  .... As a Senior Software Engineer...  ..., dynamic scheduling, and specialization...  ...GPU architects, kernel developers,...  ...kernels using CUDA, Triton, CuTe DSL... 
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    12 days ago
  •  ...will be critical in enhancing GPU kernels, deep learning models, and...  ...compiler technologies and advanced engineering principles to drive...  ...integrating graph compilers. Software Engineering Best Practices: Apply...  ...learning on AMD GPUs using HIP, CUDA, and assembly (ASM). Strong... 
    Senior

    AMD

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it...  ...and C++ skills with proven software engineering fundamentals.Hands...  ...decisions, and runtime scheduling.Direct experience with LLM...  ...GPU kernel optimization — CUDA, CUTLASS, Triton, or equivalent... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    We are hiring software engineers to work on the CUDA driver, a core component of our platform for accelerating general purpose computation on the GPU. Our team delivers features and improvements to...  ...driver interacts with GPU hardware, kernel mode drivers, and the operating... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...Computing and Visualization. The GPU, our invention, serves as...  ...a motivated Deep Learning engineer to bring advanced CUDA features and Distributed...  ...researchers, HW and SW architects, kernel and compiler authors and...  ...principles (aka systems software fundamentals)Adaptability... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...: We are seeking a Senior Triton Compiler and Kernel Engineer to advance Triton performance...  ...high-performance GPU kernels in Python....  ...layer in the AI software stack, connecting...  ..., optimization, scheduling, and code generation...  ...with Triton, HIP, CUDA, or GPU assembly.... 
    Full time

    AMD

    San Jose, CA
    12 days ago
  •  ...Responsibilities Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads. Develop and tune low-level CUDA kernels, including GeMM and attention kernels, using CUTLASS, Tensor Cores, and Nsight. Profile, debug, and eliminate... 
    Senior
    Full time
    Temporary work

    xAI

    Palo Alto, CA
    11 days ago
  • $184k - $287.5k

     ...is built. We are seeking a Senior Software Engineer – AI Inference Performance...  ...performance limits on NVIDIA GPU-accelerated systems. Your...  ...distributed runtimes, communication, CUDA kernels, and GPU architecture....  ...memory, communication, and scheduling. Tune serving... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    10 days ago
  • $167.7k - $245.2k

     ...ll join the Platform Engineering team building and operating...  ...Platform — the GPU infrastructure that powers...  ...how GPU capacity is scheduled and allocated across...  ...it.Your ImpactAs a Senior Platform Software Engineer on the...  ...experience (e.g., Linux kernel tuning, cgroups, or eBPF... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    1 day ago
  • $152k - $241.5k

    NVIDIA is seeking an exceptional Senior System Software Engineer to join our GPU System Software team. This team is responsible for developing comprehensive...  ...in system software, operating system internals, kernel modules, and device driver.We are widely considered to... 
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...searching for highly motivated, creative engineers to join the Platform Software team. You will work with a team of...  ...Operating systems fundamentals with Kernel , Hypervisor experience on Windows...  ...Computing and Visualization. The GPU, our invention, serves as the visual... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $148k - $287.5k

     ...Performance Computing and Visualization. The GPU, our invention, serves as the visual...  ...We are looking for a highly motivated senior software engineer for an exciting role in our...  ...about what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    9 days ago
  • $184k - $287.5k

     ...computing. An era in which our GPU acts as the brains of...  ...are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on...  ...software stacks (CUDA). Experience with modern cloud...  ...solutions. Experience with scheduling and resource management systems... 
    Senior
    Full time
    Remote work

    NVIDIA

    Santa Clara, CA
    6 days ago
  •  ...10 times faster than GPU-based hyperscale cloud...  ...Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to...  ...behavior. Tune and improve scheduling, continuous batching,...  ...communication libraries, kernels, drivers, firmware,...  ...libraries and tools.Deep CUDA experience that... 

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $152k - $241.5k

     ...We are now looking for a Senior GPU system and process scheduling architect! NVIDIA is seeking...  ...features in concert with software, hardware, and...  ...Computer Science, or Electrical Engineering (or related degree) or equivalent...  ...scheduling, OpenGL, DX, CUDA, DL/ML, PCIe, AXI, NVLink... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    12 days ago
  •  ...compiler for high-performance GPU kernels, powering major AI...  ...strategically critical to AMD’s AI software roadmap.AMD GPUs are an official...  ..., and performance engineering. You are comfortable working...  ...occupancy tuning, and instruction scheduling to maximize hardware efficiencyPerform... 
    Senior

    AMD

    San Jose, CA
    1 day ago
  •  ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN company, is...  ..., memory bandwidth, I/O, scheduling). Comfortable in the frameworks...  ...ecosystem (e.g., NCCL, CUDA-level concepts,...  ...large training clusters. Software and platform layer: NVIDIA... 
    Senior

    Mirantis

    San Jose, CA
    2 days ago
  • $152k - $241.5k

    We are seeking a Senior Software Engineer to drive integration of the NVIDIA Grove...  ...multi-node and multi-GPU environments.Improve observability...  ...containers, networking, scheduling, CUDA/GPU utilization, and...  ...tools or similar), and/or kernel-level performance tuning.Experience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

     ...foundational to modern HPC and AI. At the center of this platform are CUDA Core Libraries that enable developers to build fast, reliable, and scalable GPU-accelerated software. We are hiring a Senior Software Engineer to develop the Rust experience for CUDA Core Libraries. You... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    19 hours ago
  • $224k - $356.5k

     ...next era of computing. An era in which our GPU acts as the brains of computers, robots,...  ...on the world.We are looking for a Senior System Software Engineer to join the GPU Virtualization team and advance open-source Linux kernel support for NVIDIA GPUs. In this role, you... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $262k - $364k

     ...opportunities, drive XLA:GPU/Triton performance...  ...years of experience in software development.7 years of experience...  ...-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance engineering techniques.Experience...  ...team also writes custom kernels in CUDA, Triton, and Pallas... 
    Senior
    Immediate start
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $182k - $242k

     ...About this role  We’re looking for a Senior Engineer for CoreWeave’s Benchmarking &...  ...~ Exposure to performance-critical GPU systems (CUDA, NCCL, NVLink/PCIe, memory bandwidth)...  ...environments. Background working with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    8 days ago
  • $184k - $287.5k

    Join NVIDIA's GPU SW Kernel organization, where we're groundbreaking the...  ...AI systems to transform GPU software development. Our team leads the...  ...closely with GPU SW kernel engineers to pinpoint high-impact automation...  ...) and familiarity with CUDA, kernel-mode software, or GPU... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...RoleWe are seeking a GPU Performance Engineer to optimize AI workloads...  ...will work across the software and hardware stack to perform deep GPU kernel-level performance...  ...kernel performance, scheduling, memory utilization,...  ...level optimization using CUDA, HIP/ROCm, or... 
    Senior

    AMD

    Santa Clara, CA
    3 days ago
  • $182k - $242k

     ...at . About the Team Senior engineers are area owners who lead designs...  ...(e.g. micro-batch schedulers speculative decoding KV-cache...  ...scheduling cost-per-token analytics GPU resource isolation)....  ...TorchServe). Experience with CUDA kernels NCCL/SHARP RDMA/NUMA or GPU... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    19 hours ago
  • $152k - $204k

     ...at  . What You’ll Do: Senior engineers are area owners who lead designs...  ...(e.g., micro-batch schedulers, speculative decoding, KV-cache...  ..., cost-per-token analytics, GPU resource isolation). Who...  ...performance by developing and tuning CUDA kernels, reducing model latency,... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    22 hours ago
  • $152k - $241.5k

     ...and Visualization. The GPU, our invention, serves...  ...motivated Performance engineer to influence the roadmap...  ...principles (aka systems software fundamentals)Implement...  ...cloud provisioning and scheduling tools (Kubernetes, SLURM...  ...deploymentsFamiliarity with CUDA programming and/or... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer CUDA UMD - GPU Kernel Scheduling. Be the first to apply!