Principal Software Development Engineer - Compiler & ML Acceleration
Advanced Micro Devices Inc
WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.THE PERSON:We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization, with a strong focus on enabling high-performance execution for AI workloads.This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.KEY RESPONSIBILITIES:• Lead architecture design and development of compiler components and optimization pipelines for machine learning• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code• Drive model compilation and data movement optimization for ML inference workloads• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization• Contribute to long-term roadmap decisions for compiler and ML acceleration softwarePREFERRED EXPERIENCE:• Strong experience in compiler development (front-end, middle-end, and/or back-end) and code optimization• Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure• Proven experience working on neural network workloads• Deep understanding of graph-level and compiler-level optimizations for ML models• Strong C++ development skills and experience working in large, complex codebases• Ability to operate at Principal-level technical scope, influencing architecture and direction beyond individual deliverables• Experience targeting or optimizing for NPUs or specialized AI accelerators• Familiarity with model compilation stacks and custom lowering pipelines• Contributions to compiler or ML infrastructure in production environmentsACADEMIC CREDENTIALS:Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent This role is not eligible for visa sponsorship.#LI-JG1#LI-HYBRIDBenefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
- ...the forefront of software and hardware... ...week.The Role: Principal Software Engineer, KernelsWhat you... ...responsible for the development, enhancement, and... ...with a team of compiler experts to build... ...other software (ML and systems) and... ...DSPs, GPUs, and AI accelerators using libraries...SuggestedWork experience placement3 days per week
$190k - $300k
...are at the forefront of software and hardware... ...the US/Canada.The role: Principal Software Engineer, SDK & Lowering StackWhat... ...kernel developers and compiler teams.Create development tools to be used in kernel... ...GPUs, TPUs, or custom ML accelerators.Background working in...SuggestedWork experience placement$152k - $241.5k
...production. That position depends on software as much as hardware, and compiler engineering is a big part of what makes it... ...stack to provide comprehensive acceleration for modern machine learning models... ...years of experience building AI/ML systems.Solid understanding of machine...SuggestedFull timeRemote work- ...great products that accelerate next-generation... ...a unified ROCm software stack across AMD’... ...stack, spanning compilers, kernels, runtime... ...system software, AI/ML frameworks,... ...Workload Performance Engineering: Lead the profiling... ...: Drive the development of advanced tools...Suggested
$152k - $241.5k
...Learning Applications and Compiler Engineer!NVIDIA is seeking... ...design teams to feedback software observations, influence future... ...inference and related spatial accelerators at top tier ML, compiler, and computer... ...with compiler or runtime development, including IR design,...SuggestedFull time$193.3k - $261.5k
...these custom-designed accelerator SoCs for use by AWS internal... ...a Senior SoC Modeling Engineer to join the team and... ....As part of the ML accelerator modeling team... ..., emulation, and software teams to build, debug,... ...used in both our SoC development process and by our partner...InternshipLocal areaFlexible hours$272k - $431.25k
...heterogeneous clusters so that many accelerators feel like a single system at datacenter... ...-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap for... ...systems, high-performance storage, or ML systems infrastructure in C/C++ and...Full timeLocal areaRemote work$185.5k - $265k
About ZscalerZscaler accelerates digital transformation to ensure our customers can... ....RoleWe are looking for a Principal Software Development Engineer to join our team. This is a hybrid... ...Qualifications)Foundational understanding of AI/ML technologies and experience...Full timeWork at officeLocal areaRemote work3 days per week- ...SummaryWe are seeking a visionary Senior Principal Software Engineer / Technical Staff Member to spearhead... ...in Python, Bash, Perl, or TCL.AI/ML Practice: Practical experience deploying... ...in demand. Guided by a bold vision to accelerate market advancements, Celestica delivers...Temporary workFor contractorsWork at officeLocal areaWorldwideShift work
$180k - $300k
...at the forefront of software and hardware innovation... ...are looking for a Principal Software Engineer in QA to join our... ...side with software development, product, and systems... ...through runtime and ML workload execution.What... ..., and d-Matrix AI accelerators, ensuring correct end...$193.3k - $261.5k
...SoCs and the low-level software stack that brings... ...a Systems Software Engineer who wants to work at... ...enable SoC validation, accelerate system software development, and enable... ...exploration. As part of the ML accelerator systems... ...designers, modelers, compiler engineers, and ML...Local areaFlexible hours$149.52k - $175.9k
...frameworks, reusable components, accelerators, and reference architectures... ...use cases.Partner with engineering, product, architecture, and business... ...experience supporting AI/ML Platforms, MLOps, Model Lifecycle... ...Azure AI/OpenAI), and modern software engineering practices....Full timeWork experience placementLocal area3 days per week$272k - $431.25k
...graphics, PC gaming, and accelerated computing for more than 25... ...people.We are looking for a Principal Software Engineer to join our DGX Cloud team... ...doing:Lead the build and development of next-generation APIs, state... ...aspects of the NVIDIA AI/ML software stack (CUDA,...Full time- ...build great products that accelerate next-generation computing experiences... ...THE ROLE: We are seeking a Principal Software Engineer to serve as the senior... ...debug — partner with development, hardware, firmware, and customer... ..., CUDA, oneAPI, SYCL)AI/ML frameworks (PyTorch,...Contract workShift work
$165.2k - $223.6k
...these custom SoCs — that let software teams start development months before silicon arrives... ...We're looking for a software engineer to build and own the models and... ...pieces of the stackNo ML background needed. You'll learn the ML accelerator domain on the job.This role can...Local areaFlexible hours$212k - $265k
About ZscalerZscaler accelerates digital transformation to ensure... ....RoleWe are looking for a Principal Software Engineer (Service Platform &... ...Expectations)Lead the hands-on development and migration to a workflow... ...services that leverage LLMs and ML for intelligent signal...Full timeTemporary workWork at officeLocal area$272k - $431.25k
...is seeking a highly motivated Principal System Software Engineer to drive next-generation innovations... ...directly to the architecture, development, optimization, and scaling of... ...frameworks.Experience with GPU-accelerated computing and AI/ML software platforms....Full time$100k
...unify innovations in software models, compilers, platforms,... ...that power internal development, orchestrate workloads... ...backend or infrastructure engineer with experience building... ...orchestration, and ML services.Develop... ...operated on custom accelerator hardware.Advanced Kubernetes...Permanent employment$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia and... ...Design Verification Engineers to build the next generation... ...and UVM- 8+ YOE in testbench development including: stimulus, checkers... ...verifying complex CPU, GPU, or ML accelerator designsAmazon is...Local areaWork from homeFlexible hours$184k - $287.5k
...building an RL Frameworks engineering team to develop the... ...team spans the full software stack, from collaborating... ...contention.Beyond GPU-accelerated training, this work... ...networking, math library, and compiler teams so the... ...learning infrastructure, or ML systems...Full time$159.2k - $301.6k
...day, hundreds of engineers as customers — running... ...reduces toil, accelerates developer... ...looking for a senior Software Developer to own... ...years of software development experience with deep... ...managementAI/ML integration experience... ...Universal Binary compilation, code signing and...Full timeTemporary workLocal areaWorldwide$184k - $287.5k
...outstanding AI systems engineers to develop... ...the inference systems software stack! We build innovative... ...systems software to accelerate for AI inference. As... ...domain specific compilers and runtimesCollaborating... ...) experience with ML/DL systems development preferableStrong experience...Full timeRemote work$127.1k - $185k
...Our org spans silicon engineering, hardware design and verification, software, and operations. We've... ...Inferentia and Trainium ML Accelerators, and scalable NVMe... ...looking for a Software Development Engineer to help build... ...profiling.- Exposure to compiler toolchains, code...InternshipLocal areaFlexible hours- ...great products that accelerate next-generation... ...utilizing cutting-edge compiler technologies and advanced engineering principles to... ...goals, scope, and own development efforts while... ...graph compilers. Software Engineering Best Practices... ...compute into ML frameworks (e.g.,...
- HPE Labs - Senior Software Engineer - Integrated HPC & Quantum... ...and better ways to accelerate what’s next. We know... ...expertise in software development and quantum computing... ...extend quantum circuit compilation, circuit execution,... ...platforms, GPU computing, AI/ML frameworks (e.g.,...Full timeWork experience placementWork at officeLocal areaImmediate start2 days per week
$193.3k - $261.5k
...Labs designs silicon and software that accelerates innovation. Our custom... ...seeking a Senior Software Engineer to join our ML Distributed Training... ...be responsible for the development, enablement, and performance... ...closely with chip architects, compiler engineers, runtime...InternshipLocal areaFlexible hours$165.2k - $223.6k
...is an inventive research and development company that designs and engineers high-profile consumer products... ...compression platform, compiler and custom neural accelerator silicon. Come join us to accelerate... ...for a talented and passionate software engineer to be part of an...InternshipLocal areaFlexible hoursNight shiftDay shift$120k - $275k
...silicon and rack design through compilers and kernels to ML models. Our systems... ...backend-focused compiler engineers. We're looking for compiler... ...degree Possess outstanding software engineering skills with a... ...path to parenthoodLearning & Development $1,500 yearly towards your...Full timeWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$100k
...computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse... ...the one in this posting.Who You AreA passionate software engineer eager to work on compiler technologies and the challenges...Permanent employment$165.2k - $223.6k
...is the complete software stack for the AWS... ...machinelearning accelerators and the Trn1 and... ...is for a software engineer in the Machine Learning... ...Applications (ML Apps) team for... ...responsible for development, enablement and performance... ...chip architects, compiler engineers and...InternshipLocal areaWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Development Engineer - Compiler & ML Acceleration. Be the first to apply!
- principal software engineer San Jose, CA
- ngo software engineer San Jose, CA
- software data engineer San Jose, CA
- graduate software engineer San Jose, CA
- software system engineer San Jose, CA
- graduate software developer San Jose, CA
- software engineer - early career San Jose, CA
- entry level software engineer remote San Jose, CA
- software engineer intern San Jose, CA
- software developer positions San Jose, CA
