Sr. Software Engineer, Kernels/CUDA
Full-time
xAI
Responsibilities
- Design, build, and optimize massive GPU clusters for large-scale training and inference workloads.
- Develop and tune low-level CUDA kernels using CUTLASS, Tensor Cores, and Nsight.
- Profile, debug, and eliminate bottlenecks across GPU memory, networking, filesystems, and multi-GPU operations.
- Collaborate with AI research teams to deliver production-grade performance and scalability.
Requirements
- At least 5 years of experience with low-level systems programming in C/C++.
- Deep low-level systems programming experience with C, C++, PTX, and SASS.
- Experience with large-scale GPU clusters or distributed compute infrastructure at production scale.
- Hands-on experience optimizing GPU kernels with CUTLASS, custom kernels, and Nsight profiling.
- Experience building or operating high-performance infrastructure for AI training or inference workloads.
- Ability to optimize memory-bound and compute-bound workloads from first principles.
Benefits
- Equity and comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Sr. Software Engineer, Kernels/CUDA in Palo Alto, CA vacancy
$152k - $241.5k
...advancement.Are you a motivated system software engineer with a deep understanding of device drivers... ...software professional to work on the CUDA Driver, a core component of our platform... ...coherence and consistency modelsBackground with kernel mode developmentExperience with Linux...SeniorFull timeNvidia
Santa Clara, CA1 day ago- ...be critical in enhancing GPU kernels, deep learning models, and training... ...technologies and advanced engineering principles to drive... ...integrating graph compilers. Software Engineering Best Practices: Apply... ...learning on AMD GPUs using HIP, CUDA, and assembly (ASM). Strong knowledge...Senior
AMD
Santa Clara, CA14 hours ago $200k - $375k
...next-generation supercomputer hardware and bring up the OS and software stack on it. Requirements At least 5 years of hands-on... ...including switches and routers. Deep knowledge of the Linux kernel and networking stack, or transferable experience with another production...SeniorFull timeTemporary workxAI
Palo Alto, CA7 days ago- ...integrate, and optimize state‑of‑the‑art CUDA kernels to power AI models that accelerate... .... Working closely with researchers and engineers, you’ll help make Voltai the world’s leading... ...with the latest NVIDIA hardware and software stacks (Hopper, Blackwell, NVLink,...Suggested
Voltai
Palo Alto, CA1 day ago $184k - $287.5k
We are hiring software engineers to work on the CUDA driver, a core component of our platform for accelerating general purpose computation on the GPU.... ...accomplish this, the CUDA driver interacts with GPU hardware, kernel mode drivers, and the operating system. Unified Memory...SeniorFull timeNvidia
Santa Clara, CA14 hours ago$160k - $275k
...systems including hardware and software to train and run the largest... ...Do HereDesign and optimize kernels that interface directly with... ...our ML Research and Hardware Engineering teamsProvide expertise and guidance... ...-level optimization, or GPU/CUDA programmingLanguage: at least...Daily paidFull timeWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekMatX
Mountain View, CA3 days ago$184k - $287.5k
...looking for a motivated Deep Learning engineer to bring advanced CUDA features and Distributed Runtime... ...AI researchers, HW and SW architects, kernel and compiler authors and CUDA driver... ...operating systems principles (aka systems software fundamentals)Adaptability and passion...SeniorFull timeNvidia
Santa Clara, CA14 hours ago$160k - $250k
...better models power more useful products, and what we learn from people using those products shapes what we build next. SOFTWARE ENGINEER, KERNELS/CUDA (C++) We are building one of the world's largest AI supercomputers from the ground up. As part of the Compute...Temporary work$175k - $270k
...possible, with the ultimate goal of enabling human life on Mars.SR. WI-FI SOFTWARE ENGINEER (STARLINK)At SpaceX we’re leveraging our experience in... ...the Wi-Fi software and product roadmapDebug and optimize kernel-level system performanceCollaborate with our RF and EE...SeniorPermanent employmentTemporary workLive inRemote workWorldwideWeekend workSpaceX
Palo Alto, CA1 day ago$162k - $203k
...protect it for future generations. Role Summary As a Software Engineer specializing in safety-critical self-driving middleware, you... ...using and/or building libraries for hardware accelerators (CUDA, TensorRT, OpenCL, etc.) ~ Experience contributing to...SeniorFull timeContract workLocal area$180k
...better models power more useful products, and what we learn from people using those products shapes what we build next. SOFTWARE ENGINEER, LINUX KERNEL At SpaceXSI, we design, build, and operate the largest AI supercomputers in the world, from the ground up. As a...Temporary workX.ai
Palo Alto, CA4 days ago$193.3k - $261.5k
...behavior and continuously improve at massive scale.As a Senior Software Development Engineer, you will lead the design and development of critical... ...platforms in production environments- Experience with CUDA kernels or ML/low-level kernelsPreferred qualification - 5+...SeniorInternshipLocal areaFlexible hoursAmazon
Palo Alto, CA14 hours ago$200k - $375k
...throughput, concurrency, reliability, and tail latency at production scale. Benchmark, fine-tune, and accelerate inference engines through GPU kernel work and code generation. Develop tools to trace, replay, and resolve issues across orchestration and GPU-kernel...SeniorFull timeTemporary workxAI
Palo Alto, CA7 days ago$125k - $165k
...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. SOFTWARE ENGINEER, LINUX KERNEL (STARLINK) SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally...Temporary workInternshipWork at officeMonday to Friday$184k - $287.5k
...foundational to modern HPC and AI. At the center of this platform are CUDA Core Libraries that enable developers to build fast, reliable, and scalable GPU-accelerated software. We are hiring a Senior Software Engineer to develop the Rust experience for CUDA Core Libraries. You...SeniorFull timeNvidia
Santa Clara, CA1 day ago$204k - $259k
...Waymo Android System Software Engineer Waymo is an autonomous driving technology company with the mission to be the world's most trusted... ...software, including bootloader configuration, device trees, and kernel porting during the initial hardware bring-up phase. OS/...SeniorFull timeRemote workCapitalG
Mountain View, CA3 days ago$193.3k - $261.5k
...Amazon builds AWS Neuron, the software development kit used to... ...hardware-software boundary, our engineers build systematic infrastructure... ...and create high-performance kernels for ML functions, ensuring every... ...tracing.- Familiarity with CUDA kernels or equivalent ML or low...SeniorWork experience placementInternshipLocal areaFlexible hoursAmazon
Cupertino, CA14 hours ago$224k - $356.5k
...the world.We are looking for a Senior System Software Engineer to join the GPU Virtualization team and advance open-source Linux kernel support for NVIDIA GPUs. In this role, you... ..., QEMU and VFIO, on device assignment, PCIe SR-IOV, memory management and virtual-device lifecycle...SeniorFull timeNvidia
Santa Clara, CA3 days ago$194k - $349k
...the threats detected in their environments. This is a Sr. Software Development Engineer II (SDE) role in the CTIO team that is bringing... ...experience required for macOS-focused candidates; Windows OS Kernel and Driver Development experience required for Windows-focused...SeniorPermanent employmentWork experience placementWork at officeLocal areaRemote workSunnyvale, CA27 days ago$184k - $287.5k
Join NVIDIA's GPU SW Kernel organization, where we're groundbreaking... ...AI systems to transform GPU software development. Our team leads... ...funnelWork closely with GPU SW kernel engineers to pinpoint high-impact... ...) and familiarity with CUDA, kernel-mode software, or GPU...SeniorFull timeNvidia
Santa Clara, CA3 days ago$152k - $241.5k
We are hiring senior engineers to work on the CUDA driver, a core component of our platform for accelerating... ...interaction with GPU hardware, kernel mode drivers, and the operating system... ...This role incorporates strong system software programming skills, a detailed understanding...SeniorFull timeNvidia
Santa Clara, CA14 hours ago- ...global scale. From chips and software to rack-scale systems, our team... ...The Role: Principal Software Engineer, KernelsWhat you will do:The... ...and maintenance of software kernels for next-generation AI hardware... ...using libraries such as CUDA, etc.Experience in implementing...Work experience placement3 days per week
d-Matrix
Santa Clara, CA14 hours ago $164k - $295k
...cybersecurity starts with you. About the Role: This is a Software Development Engineer role on the Cloud Runtime Protection team that builds the... ...or a equivalent technical field. Experience developing Kernel modules for Linux Experience developing production eBPF...SeniorPermanent employmentWork experience placementWork at officeLocal area2 days per week3 days per weekSunnyvale, CA10 days ago$162k - $203k
...position, you will be an individual contributor developing embedded software for Rivian's next-generation autonomous driving platform. You... ...experience with a Bachelor's or Master's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field....SeniorFull timeContract workWork experience placementLocal area$128.37k - $185.86k
...Description Job Description We are CARIAD , an automotive software development team with the Volkswagen Group. Our mission is... ...of the car and everyone around it. Role Summary: The Sr Software Engineer, Integration integrates production C++ software, embedded...SeniorPermanent employmentTemporary workRemote workCariad, Inc.
Mountain View, CA21 days ago- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...to contribute to our planning software, PlanPoint, which helps our... ...operative medical images.As a Sr Software Engineer, you will design... ...with parallel programming and Cuda is a plusExperience with game...SeniorLocal areaWorldwideFlexible hours
Intuitive Surgical
Sunnyvale, CA14 hours ago $175k - $280k
...SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SR. SOFTWARE ENGINEER, BEAM PLANNING (STARLINK MOBILE)The Starlink Mobile network will expand Starlink’s vision by providing ubiquitous connectivity...SeniorPermanent employmentTemporary workWorldwideWeekend workSpaceX
Palo Alto, CA6 hours ago$184k - $287.5k
...discovery. We are looking for a Senior Software Engineer to join the cuEquivariance team — an NVIDIA... ...builds and ships the production GPU kernels and software interfaces that power... ...throughout the scientific field. The work spans CUDA kernel engineering, Python library...SeniorFull timeNvidia
Santa Clara, CA3 days ago$162.8k - $203.5k
...desire to protect it for future generations. Role Summary Rivian's Autonomy organization is looking for a Senior Software Engineer, ML Applications to join the Data & Cloud team. You will design and deliver large-scale applications and data pipelines using...SeniorFull timeContract workTemporary workPart timeLocal areaShift work- ...millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by... ...Function of Position:As a Sr Software Engineer Navigation on the Future Forward... ...Runtime) and GPU-accelerated computing (CUDA)Experience with robotic kinematics, forward...SeniorLocal areaWorldwideFlexible hours
Intuitive Surgical
Sunnyvale, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Software Engineer, Kernels/CUDA. Be the first to apply!
Related searches
- software engineer internship remote Palo Alto, CA
- software engineer remote Palo Alto, CA
- graduate software developer no experience Palo Alto, CA
- work from home software developer Palo Alto, CA
- information technology software engineer Palo Alto, CA
- senior software engineer remote Palo Alto, CA
- rust software engineer Palo Alto, CA
- part time software developer Palo Alto, CA
- junior software developer remote Palo Alto, CA
- software engineer travel Palo Alto, CA