Software Design Engineer - GPU Kernel Optimization
AMD
ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.THE ROLE:As a senior technical member of the team, you will play a key role in designing, developing, and optimizing high-performance GPU kernels for LLM and other ML models. You will analyze performance bottlenecks and develop architecture-aware optimizations to maximize compute efficiency, memory bandwidth utilization, and overall GPU performance. You will also collaborate closely with GPU architecture, compiler, library, and framework teams to develop scalable solutions and advance GPU performance across current and next-generation platforms. THE PERSON:The ideal candidate has strong experience in GPU programming, performance analysis and system software development. You will provide technical leadership, guiding teams and driving projects/initiatives independently. You will define goals, scope, and own development efforts while collaborating effectively within a high-performing team.KEY RESPONSIBILITIES:Architect and Optimize AI Workloads: Lead the optimization of LLMs, quantized models, and emerging AI workloads for AMD GPU architectures.Develop High-Performance GPU Kernels: Design, implement, profile, and optimize GPU kernels, with a strong focus on maximizing hardware utilization and application performance.Drive Performance Analysis: Perform deep performance characterization across compute, memory bandwidth, cache hierarchy, synchronization, kernel scheduling, and execution efficiency to identify and eliminate bottlenecks.Advance Compiler and Code-Generation Technologies: Develop compiler-level optimizations and code-generation techniques using LLVM, MLIR, and related technologies to achieve portable and scalable GPU performance.Innovate with AI-Assisted Development: Build AI-powered coding agents and automation workflows for kernel generation, optimization, benchmarking, and validation.Collaborate with model and infrastructure teams to improve end-to-end AI system performance.PREFERRED EXPERIENCE:Strong C++ and/or Python skills Solid understanding of GPU compute, memory hierarchy, cache behavior, synchronization, and performance bottlenecks.Strong experience developing and optimizing GPU kernels using HIP, CUDA, C/C++, or similar technologies.Strong analytical/problem-solving skills and pronounced attention to details Must be a self-starter, and able to independently drive tasks to completion ACADEMIC CREDENTIALS:Bachelors or Masters degree in computer engineering, computer science or a related field#LI-JG1This role is not eligible for visa sponsorship.Benefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
- ...play a pivotal role in optimizing and developing deep... ...critical in enhancing GPU kernels, deep learning models... ...and advanced engineering principles to drive continuous... ...& Optimize Models: Design and optimize deep learning... ...graph compilers. Software Engineering Best...Suggested
$152k - $241.5k
NVIDIA’s invention of the GPU in 1999 sparked the growth of the... ....Are you a motivated system software engineer with a deep understanding of... ...our team, you will use your design abilities, coding expertise,... ...consistency modelsBackground with kernel mode developmentExperience...SuggestedFull time- Cisco Systems, Inc. is hiring a Senior Software Engineer to debug, profile, and optimize the AI cluster networking and GPU performance stack from boot to application level. You will tackle kernel-level failures, PCIe issues, driver behavior, and network latency while tuning...Suggested
- ...future. Whether you’re designing next-gen processors,... ...Senior Triton Compiler and Kernel Engineer to advance Triton... ...developing high-performance GPU kernels in Python. It... ...layer in the AI software stack, connecting frameworks... ...: Develop and optimize Triton compiler support...Suggested
- ...We're looking for a senior software engineer who combines deep systems performance... ...can shape software from GPU kernels through distributed... ...most demanding use cases.Co-design hardware and software: Partner... ...hierarchy, and kernel optimization (HIP/CUDA).Hands-on delivery...SuggestedShift work
$152k - $241.5k
...exceptional Senior System Software Engineer to join our GPU System Software team. This... ...including proof of concept, design, architecture, algorithm... ...implementation, and both pre/post-SI optimization. Your primary focus will... ...system internals, kernel modules, and device driver...Full timeLocal areaRemote work- ...for high-performance GPU kernels, powering major AI frameworks... ...critical to AMD’s AI software roadmap.AMD GPUs are... ...teams to co-design high-performance solutions... ...architecture, and performance engineering. You are comfortable... ..., and rigorously optimize high-performance matmul...
$184k - $287.5k
...Algorithmic Model Optimization Team specifically... ...an innovative software platform (TRT Model... ...by research and engineering teams alike developing... ...high-performance kernel implementations... ...and profile GPU kernel-level performance... ...architecting and designing a modular and...Full time- Cisco is seeking a Senior Software Engineer to join the CVIS team in Milpitas, CA, responsible for debugging, profiling and optimizing the AI cluster networking and GPU performance stack from boot-time through the Linux kernel, RDMA, NCCL and application-level communications...
$105.65k - $200.34k
Job Details:Job Description: As a GPU Logic Design Engineer, you will play a vital role in developing cutting-edge graphics IPs required for next... ...to define architecture and microarchitecture features, optimizing logic to meet power, performance, area, and timing targets...Full timeInternshipLocal areaImmediate startShift work- NVIDIA is seeking a Senior System Software Engineer to join our GPU System Software team in Santa Clara, CA. You will own display feature development... .... You will work on VESA Display Port, DP, HDMI and eDP, optimize cross-team, influence SoC/GPU architecture, and partner...
$124k - $195.5k
...networking, systems, and software to solve some of the... ...a System Software Engineer to join NVIDIA’s GPU Performance and... ...team. You will help design, develop, and debug... ...software mechanisms that optimize GPU performance,... ...maintain low-level kernel software.Good understanding...Full timeInternship- ...GPU Physical Design Engineer Work Locations (2) Submit Resume Do you love creating sophisticated solutions to highly complex challenges?... ...design cycle. Drive best in class PD construction and optimization recipes for performance, power and Area (PPA). Collaborate...Temporary work
- ...and AI. Whether you’re designing next-gen processors,... ...next-generation systems software for AMD GPUs with Rust... ..., runtimes, low-level GPU software, firmware,... ...support, system interfaces, engineering practices, and... ..., dialects, analyses, optimization passes, legalization,...Local area
$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer... ...direction and long-term roadmaps for such initiatives.Monitor and optimize the performance of our infrastructure ensuring high...Full time$184k - $287.5k
NVIDIA is seeking a Senior Software Engineer to join our CSP... ...embedded firmware, Linux kernel development, and... ....What you’ll be doing:Design and develop software solutions... ...drivers, and system optimizations for GB200 and next-gen... ...crowd:Experience with GPU computing (CUDA), deep...Full time- ...future. Whether you're designing next-gen processors, enabling... ...highly motivated AI Model Optimization & Software Engineer Interns/Co-op to join our... ..., performance analysis, GPU computing, distributed systems... ..., and optimize GPU or CPU kernels using technologies such as...Full timeSummer workInternshipSummer internshipWorldwide
$136k - $218.5k
...of external EDA with highly optimized, internal EDA tools. Our team... ...seeking an innovative CAD Software Engineer with particular interest in... ..., AI, and feedback from RTL designers, so having experience relevant... ...team supporting the latest in GPU and AI technology? If so, we...Full timeWork experience placement$152k - $241.5k
NVIDIA is seeking an innovative and highly motivated engineer with deep expertise in systems software to join our GPU Software team. In this role, you will help design and develop key components of our production GPU kernel drivers and embedded software, shaping products...Full time$213k - $263k
...fully autonomous vehicle’s software stack. To achieve our mission... ...other teammates to ensure we design and optimize hardware and software for... ...Will Develop high-performance GPU primitives and abstractions... ...stack Deep insights into GPU kernel performance, compilation...Full timeRemote work- ...10 times faster than GPU-based hyperscale cloud... ...Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and optimize our GPU serving stack,... ...GPU inference stack. Design, build, deploy, and maintain... ...libraries, kernels, drivers, firmware, networking...
$224k - $356.5k
...networking, systems, and software to solve some of the world... ...a Senior System Software Engineer to join NVIDIA’s GPU Performance and Power Management... ...initial architectural design and pre-silicon validation... ...mechanisms that dynamically optimize GPU performance, power,...Full timeRemote work$180.2k - $297.2k
...consumed by millions of people around the world. Come build with us!Role and ResponsibilitiesWe are seeking a highly skilled GPU Design Verification Engineer (GCDV) to join our team at SARC/ACL. As a key member of our team, you will concentrate on graphics core verification,...Hourly payFull timeRelocation$141.91k - $269.1k
...graphics, media, and display, to ensure design will meet specification requirements.Defines... ...resolve failing tests.Collaborate with GPU architects, RTL developers, and physical... ...Bachelor’s degree in electronics, computer engineering, or related engineering with 5+ years of...Full timeLocal areaImmediate startShift work$124k - $208.4k
...Come build with us!Role and ResponsibilitiesAs a Senior GPU Design Verification Engineer - GCDV, you will contribute to the verification of top-level... ...aligns with architectural intent and evolving software usage models.You take initiatives on moderate-to-complex...Hourly payFull timeRelocation- ...advance your career. THE ROLE:Join AMD’s Datacenter GPU Product Application Engineering team to lead a high-performing group of... ...Deep understanding of AMD GPU architecture, ROCm software stack, and performance optimization strategies.Proven experience supporting large-scale...For contractors
- ...performance-obsessed AI Infrastructure Engineer to push LLM inference on Intel GPUs. You will optimize the end-to-end stack, profile... ..., and write high-performance kernels for attention, MoE, and... ...compiler teams to shape future GPU roadmaps. This role offers hybrid...
$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our... ...a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today... ..., OAI Triton, NCCL, and CUDA kernels—to implement and optimize model serving...Full time$152k - $241.5k
...with architecture, software, product, and... ...Learning Software Engineer to help develop simulation... ...AI-accelerating GPU hardware and... ...learning compiler kernel code generation and... ...computational graph optimization using analysis based... ...and system-level design decisions.What we...Full time$184k - $287.5k
...built. We are seeking a Senior Software Engineer - AI Inference Performance... ...limits on NVIDIA GPU-accelerated systems. Your work... ...runtimes, communication, CUDA kernels, and GPU architecture. Deliver... ...prefill and decode workloads. Optimize time to first token, inter-token...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Design Engineer - GPU Kernel Optimization. Be the first to apply!
- scientific software engineer San Jose, CA
- intel software engineer San Jose, CA
- director software engineering San Jose, CA
- software engineer San Jose, CA
- senior robotics software engineer San Jose, CA
- financial software developer San Jose, CA
- graduate software developer San Jose, CA
- part time software developer remote San Jose, CA
- software engineer remote San Jose, CA
- part time software developer San Jose, CA



