Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Development Engineer - Compiler & ML Acceleration

Advanced Micro Devices Inc

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.THE PERSON:We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization, with a strong focus on enabling high-performance execution for AI workloads.This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.KEY RESPONSIBILITIES:• Lead architecture design and development of compiler components and optimization pipelines for machine learning• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code• Drive model compilation and data movement optimization for ML inference workloads• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization• Contribute to long-term roadmap decisions for compiler and ML acceleration softwarePREFERRED EXPERIENCE:• Strong experience in compiler development (front-end, middle-end, and/or back-end) and code optimization• Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure• Proven experience working on neural network workloads• Deep understanding of graph-level and compiler-level optimizations for ML models• Strong C++ development skills and experience working in large, complex codebases• Ability to operate at Principal-level technical scope, influencing architecture and direction beyond individual deliverables• Experience targeting or optimizing for NPUs or specialized AI accelerators• Familiarity with model compilation stacks and custom lowering pipelines• Contributions to compiler or ML infrastructure in production environmentsACADEMIC CREDENTIALS:Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent This role is not eligible for visa sponsorship.#LI-JG1#LI-HYBRIDBenefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Software Development Engineer - Compiler & ML Acceleration in San Jose, CA vacancy
  •  ...highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler...  ...Strong proficiency in C++ and object-oriented software development.Hands-on experience with GPU programming... 
    Suggested

    AMD

    San Jose, CA
    2 days ago
  •  ...portfolio of several ML accelerator devices with NPUs (neural...  ...(Vitis Unified Software Platform) targets several...  ...AMD's proprietary AI-engine architecture.THE PERSON...  ...sophisticated issues in a complex compiler tool stack. This role will be in software development, in the AI group in... 
    Suggested

    AMD

    San Jose, CA
    1 day ago
  •  ...the forefront of software and hardware...  ...week.The Role: Principal Software Engineer, KernelsWhat you...  ...responsible for the development, enhancement, and...  ...with a team of compiler experts to build...  ...other software (ML and systems) and...  ...DSPs, GPUs, and AI accelerators using libraries... 
    Suggested
    Work experience placement
    3 days per week

    d-Matrix

    Santa Clara, CA
    4 days ago
  • $190k - $300k

     ...are at the forefront of software and hardware...  ...the US/Canada.The role: Principal Software Engineer, SDK & Lowering StackWhat...  ...kernel developers and compiler teams.Create development tools to be used in kernel...  ...GPUs, TPUs, or custom ML accelerators.Background working in... 
    Suggested
    Work experience placement

    d-Matrix

    Santa Clara, CA
    4 days ago
  •  ...great products that accelerate next-generation...  ...a unified ROCm software stack across AMD’...  ...stack, spanning compilers, kernels, runtime...  ...system software, AI/ML frameworks,...  ...Workload Performance Engineering: Lead the profiling...  ...: Drive the development of advanced tools... 
    Suggested

    AMD

    San Jose, CA
    2 days ago
  • $152k - $241.5k

     ...Learning Applications and Compiler Engineer!NVIDIA is seeking...  ...design teams to feedback software observations, influence future...  ...inference and related spatial accelerators at top tier ML, compiler, and computer...  ...with compiler or runtime development, including IR design,... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...production. That position depends on software as much as hardware, and compiler engineering is a big part of what makes it...  ...stack to provide comprehensive acceleration for modern machine learning models...  ...years of experience building AI/ML systems. Strong software engineering... 

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $193.3k - $261.5k

     ...these custom-designed accelerator SoCs for use by AWS internal...  ...a Senior SoC Modeling Engineer to join the team and...  ....As part of the ML accelerator modeling team...  ..., emulation, and software teams to build, debug,...  ...used in both our SoC development process and by our partner... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $272k - $431.25k

     ...heterogeneous clusters so that many accelerators feel like a single system at datacenter...  ...-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap for...  ...systems, high-performance storage, or ML systems infrastructure in C/C++ and... 
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $185.5k - $265k

    About ZscalerZscaler accelerates digital transformation to ensure our customers can...  ....RoleWe are looking for a Principal Software Development Engineer to join our team. This is a hybrid...  ...Qualifications)Foundational understanding of AI/ML technologies and experience... 
    Full time
    Work at office
    Local area
    Remote work
    3 days per week

    Zscaler

    San Jose, CA
    3 days ago
  • $180k - $300k

     ...at the forefront of software and hardware innovation...  ...are looking for a Principal Software Engineer in QA to join our...  ...side with software development, product, and systems...  ...through runtime and ML workload execution.What...  ..., and d-Matrix AI accelerators, ensuring correct end... 

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $185.5k - $265k

     ...About Zscaler Zscaler accelerates digital transformation to ensure our customers...  ...Role We are looking for a Principal Software Development Engineer to join our team. This is a hybrid...  ...Foundational understanding of AI/ML technologies and experience leveraging... 
    Full time
    Work at office
    Local area
    Worldwide

    Zscaler

    San Jose, CA
    9 hours ago
  • $165.2k - $223.6k

     ...SoCs and the low-level software stack that brings...  ...a Systems Software Engineer who wants to work at...  ...enable SoC validation, accelerate system software development, and enable...  ...exploration. As part of the ML accelerator systems...  ...designers, modelers, compiler engineers, and ML... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...days) to receive an alert: Senior Principal Software Engineer Date: Jul 30, 2026 Location: San...  ...in Python, Bash, Perl, or TCL. AI/ML Practice: Practical experience deploying...  ...in demand. Guided by a bold vision to accelerate market advancements, Celestica... 
    Temporary work
    For contractors
    Work at office
    Local area
    Worldwide
    Shift work

    Jobleads-US

    San Jose, CA
    4 days ago
  • $272k - $431.25k

     ...graphics, PC gaming, and accelerated computing for more than 25...  ...people.We are looking for a Principal Software Engineer to join our DGX Cloud team...  ...doing:Lead the build and development of next-generation APIs, state...  ...aspects of the NVIDIA AI/ML software stack (CUDA,... 
    Full time

    Nvidia

    Santa Clara, CA
    21 hours ago
  • $165.2k - $223.6k

     ...these custom SoCs — that let software teams start development months before silicon arrives...  ...We're looking for a software engineer to build and own the models and...  ...pieces of the stackNo ML background needed. You'll learn the ML accelerator domain on the job.This role can... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $165.2k - $223.6k

     ...Neuron is the complete software stack for the AWS...  ...scale machine learning accelerators and the servers that...  .... As the Software Development Engineer for the Neuron Runtime...  ...Improving performance of ML Kernels and ML...  ...ensure that the our C++ compiler generates key information... 
    Internship
    Local area
    Work from home
    Flexible hours

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    -123
  • NVIDIA seeks a Sr. Principal Systems Software Engineer for the Apache Spark Acceleration group to drive GPU-accelerated data processing in production deployments. You'll develop Java, Scala, and CUDA/C++ libraries to accelerate Spark DataFrames and I/O on common formats... 

    NVIDIA

    Santa Clara, CA
    21 hours ago
  • $272k - $431.25k

     ...is seeking a highly motivated Principal System Software Engineer to drive next-generation innovations...  ...directly to the architecture, development, optimization, and scaling of...  ...frameworks.Experience with GPU-accelerated computing and AI/ML software platforms.... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • Lemurian Labs in Santa Clara is seeking a Compiler Code Generation Engineer to design and build core code generation capabilities inside our high-performance...  ..., portable AI compiler. You will translate high-level ML computations into optimized machine code across... 

    Lemurian Labs Inc.

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    2100 NVIDIA USA is seeking an AI Research Engineer / Applied Scientist to develop innovative technologies in machine learning compilers and AI systems. The ideal candidate will have strong expertise in AI/ML, particularly in compiler optimization and low-level programming... 

    2100 NVIDIA USA

    Santa Clara, CA
    3 days ago
  • $183k - $247.6k

    Our Machine Learning Acceleration (MLA) team develops the Inferentia and...  ...Design Verification Engineers to build the next generation...  ...and UVM- 8+ YOE in testbench development including: stimulus, checkers...  ...verifying complex CPU, GPU, or ML accelerator designsAmazon is... 
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    21 hours ago
  • $100k

     ...unify innovations in software models, compilers, platforms,...  ...that power internal development, orchestrate workloads...  ...backend or infrastructure engineer with experience building...  ...orchestration, and ML services.Develop...  ...operated on custom accelerator hardware.Advanced Kubernetes... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    2 days ago
  • $193.3k - $261.5k

     ...Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads...  ...accelerator. Neuron includes an ML compiler, runtime, collectives library, and...  ...and software boundary, our engineers build the infrastructure that large... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    6 days ago
  • $165.2k - $223.6k

     ...is an inventive research and development company that designs and engineers high-profile consumer products...  ...compression platform, compiler and custom neural accelerator silicon. Come join us to accelerate...  ...for a talented and passionate software engineer to be part of an... 
    Internship
    Local area
    Flexible hours
    Night shift
    Day shift

    Amazon

    Sunnyvale, CA
    1 day ago
  • $100k

     ...computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse...  ...the one in this posting.Who You AreA passionate software engineer eager to work on compiler technologies and the challenges... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago
  • HPE Labs - Senior Software Engineer - Integrated HPC & Quantum...  ...and better ways to accelerate what’s next. We know...  ...expertise in software development and quantum computing...  ...extend quantum circuit compilation, circuit execution,...  ...platforms, GPU computing, AI/ML frameworks (e.g.,... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    Milpitas, CA
    2 days ago
  • $127.1k - $185k

     ...Our org spans silicon engineering, hardware design and verification, software, and operations. We've...  ...Inferentia and Trainium ML Accelerators, and scalable NVMe...  ...looking for a Software Development Engineer to help build...  ...profiling.- Exposure to compiler toolchains, code... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $159.2k - $301.6k

     ...day, hundreds of engineers as customers — running...  ...reduces toil, accelerates developer...  ...looking for a senior Software Developer to own...  ...years of software development experience with deep...  ...managementAI/ML integration experience...  ...Universal Binary compilation, code signing and... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    4 days ago
  • $184k - $287.5k

     ...outstanding AI systems engineers to develop...  ...the inference systems software stack! We build innovative...  ...systems software to accelerate for AI inference. As...  ...domain specific compilers and runtimesCollaborating...  ...) experience with ML/DL systems development preferableStrong experience... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Development Engineer - Compiler & ML Acceleration. Be the first to apply!