Principal Software Development Engineer - Compiler & ML Acceleration
Advanced Micro Devices Inc
WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.THE PERSON:We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization, with a strong focus on enabling high-performance execution for AI workloads.This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.KEY RESPONSIBILITIES:• Lead architecture design and development of compiler components and optimization pipelines for machine learning• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code• Drive model compilation and data movement optimization for ML inference workloads• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization• Contribute to long-term roadmap decisions for compiler and ML acceleration softwarePREFERRED EXPERIENCE:• Strong experience in compiler development (front-end, middle-end, and/or back-end) and code optimization• Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure• Proven experience working on neural network workloads• Deep understanding of graph-level and compiler-level optimizations for ML models• Strong C++ development skills and experience working in large, complex codebases• Ability to operate at Principal-level technical scope, influencing architecture and direction beyond individual deliverables• Experience targeting or optimizing for NPUs or specialized AI accelerators• Familiarity with model compilation stacks and custom lowering pipelines• Contributions to compiler or ML infrastructure in production environmentsACADEMIC CREDENTIALS:Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent This role is not eligible for visa sponsorship.#LI-JG1#LI-HYBRIDBenefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.
- ...highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler... ...Strong proficiency in C++ and object‑oriented software development. Hands‑on experience with GPU programming...Suggested
$135k - $165k
...maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain... ...closely with senior engineers to translate machine... ...workloads for TetraMem’s AI accelerator architecture.... ...machine learning application development. Solid understanding...SuggestedFull timeLocal area$193.3k - $261.5k
...non-internship professional software development experience. We require 5... ...as a mentor, tech lead, or engineering team lead. We prefer a... ...candidates who want to move into an ML-aligned role or deepen... ...of these custom-designed accelerator SoCs for internal AWS teams...SuggestedFull timeInternship- ...portfolio of several ML accelerator devices with NPUs (neural... ...(Vitis Unified Software Platform) targets several... ...AMD's proprietary AI-engine architecture.THE PERSON... ...sophisticated issues in a complex compiler tool stack. This role will be in software development, in the AI group in...Suggested
$272k - $425.5k
Principal Software Engineer - Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software... ...heterogeneous clusters so that many accelerators feel like a single system at... ...systems, high-performance storage, or ML systems infrastructure in C/C++ and Python...SuggestedLocal areaRemote work$190k - $300k
...are at the forefront of software and hardware... ...the US/Canada.The role: Principal Software Engineer, SDK & Lowering StackWhat... ...kernel developers and compiler teams.Create development tools to be used in kernel... ...GPUs, TPUs, or custom ML accelerators.Background working in...Work experience placement$120k - $400k
...including hardware and software to train and run the largest ML workloads for AGI. We primarily... ...Design and implement compilers tailored for our... ...Focus on midend and backend development Requirements :... ...Possess outstanding software engineering skills with a focus on efficiency...Full timeWork experience placementLocal area- ...great products that accelerate next-generation... ...a unified ROCm software stack across AMD’... ...stack, spanning compilers, kernels, runtime... ...system software, AI/ML frameworks,... ...Workload Performance Engineering: Lead the profiling... ...: Drive the development of advanced tools...
$152k - $241.5k
...Learning Applications and Compiler Engineer!NVIDIA is seeking... ...design teams to feedback software observations, influence future... ...inference and related spatial accelerators at top tier ML, compiler, and computer... ...with compiler or runtime development, including IR design,...Full time$168.4k - $193.5k
...years of non-internship professional software development experience. We need 5+ years of full... ...as a mentor, tech lead, or engineering team lead. We require 7+ years of... ...value experience with machine learning accelerator hardware and/or software. Responsibilities...Full timeInternship$193.3k - $261.5k
...Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference The Annapurna Labs team at Amazon... ...software development kit used to accelerate deep learning and GenAI workloads on... ...toolkit includes an ML compiler, runtime, and application framework...Work experience placementInternshipLocal areaFlexible hours$167k - $270.5k
...great outcomes. Job Summary As a Principal Software Engineer to join our CPQ (Configure Price and... ...complex challenges and drive the development of company objectives. This role requires... ...foundational and agentic AI/ML workflows, ensuring the secure and effective...Full timeWork at officeVisa sponsorshipWork visa3 days per week$193.3k - $261.5k
...We have at least 5 years of non-internship professional software development experience. We have at least 5 years of programming experience... .... We have experience as a mentor, tech lead, or engineering team lead. We hold a bachelors degree in computer science...Full timeInternship$165.2k - $223.6k
...non-internship professional software development experience At least 3... ...and apply sound software engineering practices in large-scale systems... ...for deployment on custom ML accelerators Contribute to every... ...accelerators Collaborate across compiler, runtime, framework,...Full timeInternship$143.4k - $165.6k
...need 3+ years of professional software development experience outside of... ...learning applications and AI accelerators. We lead the design, development... ...enhance the performance of ML kernels and ML frameworks.... ...functional partners so our C++ compiler surfaces the right...Full timeInternshipFlexible hours$193.3k - $261.5k
...scaling ~5+ years of full software development lifecycle experience,... ...tech lead, or leading an engineering team ~ Masters degree in... ...across the stack with our compiler and runtime teams Coach... ...cloud-scale machine learning accelerators. In this Senior Software Development...Full timeInternship$193.3k - $261.5k
...We require 5 years of full software development life cycle experience,... ...mentor, technical lead, or engineering team lead. We prefer a... ...for inference on Trainium accelerators. We deliver high-performance... ...across the stack with the compiler and runtime teams. We...Full timeInternship$174k - $252k
Deliver compiler parallelization features and optimization... ...issues and improving engineering experience.Minimum... ...of experience with software development in one or more... ...Learning infrastructure, ML execution frameworks... ...PyTorch), or hardware accelerators (e.g., TPUs, GPUs).2...$143.7k - $223.6k
...internship professional software development experience. We... ...We work alongside engineering peers to develop and... ...applications and AI accelerators. We design, build,... ...enhance the performance of ML kernels and ML frameworks... ...teams so our C++ compiler produces the information...Full timeInternshipFlexible hours$193.3k - $261.5k
...these custom-designed accelerator SoCs for use by AWS internal... ...a Senior SoC Modeling Engineer to join the team and... ....As part of the ML accelerator modeling team... ..., emulation, and software teams to build, debug,... ...used in both our SoC development process and by our partner...InternshipLocal areaFlexible hours- ...and automation to ensure quality. Apply software design principles and troubleshooting... ...Trust Security Services. Collaborate with Engineering Architects, Product Managers, Customers,... .... Foundational understanding of AI/ML technologies and experience leveraging, securing...Full timeWork at office
$221.2k - $387.1k
...knowledge systems, and advanced ML, to complex cybersecurity... .... Define architecture and engineering standards for scalability, reliability... .... Champion AI-native development, testing, evaluation, and... ...Requirements ~15+ years of software engineering experience with significant...Full timeFlexible hours$221.2k - $387.1k
...It all started when engineer Fred Luddy wrote code that automated... ...knowledge systems, and advanced ML techniques. Explore and... ...coding agents and autonomous development, testing, evaluation, and operational... ...technical foundation in software architecture, distributed...Full timeWork at officeImmediate startRemote workFlexible hours$190.9k - $334.1k
...started when engineer Fred Luddy wrote... ...to the cloud, accelerating our business... ...Senior Staff IAM Software Engineer to... .... Lead the development of end-to-end... ...Partner with principal-level staff to... ...another high-level, compiled language ~5+... ...(Neo4j) or ML-assisted role...Permanent employmentFull timeWork at officeImmediate startRemote workWorldwideRelocationFlexible hours$180k - $300k
...at the forefront of software and hardware innovation... ...are looking for a Principal Software Engineer in QA to join our... ...side with software development, product, and systems... ...through runtime and ML workload execution.What... ..., and d-Matrix AI accelerators, ensuring correct end...- ...are at the forefront of software and hardware innovation,... ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat... ...be responsible for the development, enhancement, and... ...closely with other software (ML and compilers) and hardware experts in...3 days per week
- ...for general or deep learning compiler engineers to join our compiler team... ...products to our clients and the development for ongoing products. Also,... ...compiler technology to accelerate applications in deep... ...infrastructure compiler and the software stack for our proprietary high...Full timeWork at officeRemote workAfternoon shift
$165.2k - $223.6k
...SoCs and the low-level software stack that brings... ...a Systems Software Engineer who wants to work at... ...enable SoC validation, accelerate system software development, and enable... ...exploration. As part of the ML accelerator systems... ...designers, modelers, compiler engineers, and ML...Local areaFlexible hours$200k - $220k
...material cost and performance, while enabling accelerated growth for a diverse set of high-growth application... ...high-volume manufacturing, we are seeking a Principal Machine Control Software Engineer to support the development, integration, and maintenance of equipment...Full timeTemporary work$272k - $431.25k
...advanced computing, as a Principal Software Engineer for DGX Cloud. At NVIDIA,... ...build the best platform for ML/AI infrastructure? Do you... ...safety to our massive GPU accelerated container platform. We are... ...innovative ways to simplify the development, deployment, and...Full timeWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Development Engineer - Compiler & ML Acceleration. Be the first to apply!
- principal software engineer San Jose, CA
- software developer positions San Jose, CA
- senior software engineer remote San Jose, CA
- software engineer contract San Jose, CA
- cybersecurity software engineer San Jose, CA
- part time software developer remote San Jose, CA
- junior software developer internship San Jose, CA
- junior software engineer San Jose, CA
- software system engineer San Jose, CA
- software engineer remote San Jose, CA



