Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Development Engineer - Compiler & ML Acceleration

Advanced Micro Devices Inc

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:AMD is building the next generation of compiler and software infrastructure to accelerate Large Language Models (LLMs) and ML workloads on emerging accelerator architectures.THE PERSON:We are looking for a Principal Software Development Engineer to lead technical development in compiler technology, MLIR-based infrastructure, and model-to-hardware optimization, with a strong focus on enabling high-performance execution for AI workloads.This role sits at the intersection of compiler development, ML frameworks, and AI model execution, supporting advanced acceleration pipelines targeting NPUs and other specialized compute engines.KEY RESPONSIBILITIES:• Lead architecture design and development of compiler components and optimization pipelines for machine learning• Design and implement MLIR-based compiler flows to lower high-level ML representations into highly optimized hardware-specific code• Drive model compilation and data movement optimization for ML inference workloads• Define and implement compiler strategies for operator fusion, memory planning, scheduling, and performance optimization• Work cross-functionally with hardware, runtime, frontend, and systems teams to align compiler capabilities with evolving accelerator architectures• Provide technical leadership and mentorship, influencing compiler direction and best practices across the organization• Contribute to long-term roadmap decisions for compiler and ML acceleration softwarePREFERRED EXPERIENCE:• Strong experience in compiler development (front-end, middle-end, and/or back-end) and code optimization• Hands-on expertise with MLIR and/or LLVM-based compiler infrastructure• Proven experience working on neural network workloads• Deep understanding of graph-level and compiler-level optimizations for ML models• Strong C++ development skills and experience working in large, complex codebases• Ability to operate at Principal-level technical scope, influencing architecture and direction beyond individual deliverables• Experience targeting or optimizing for NPUs or specialized AI accelerators• Familiarity with model compilation stacks and custom lowering pipelines• Contributions to compiler or ML infrastructure in production environmentsACADEMIC CREDENTIALS:Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent This role is not eligible for visa sponsorship.#LI-JG1#LI-HYBRIDBenefits offered are described: AMD benefits at a glance.AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.This posting is for an existing vacancy.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Software Development Engineer - Compiler & ML Acceleration in San Jose, CA vacancy
  •  ...highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler...  ...Strong proficiency in C++ and object‑oriented software development. Hands‑on experience with GPU programming... 
    Suggested

    Socket

    San Jose, CA
    1 day ago
  • $135k - $165k

     ...maintain, and optimize software components within TetraMem’s compiler, runtime, and SDK toolchain...  ...closely with senior engineers to translate machine...  ...workloads for TetraMem’s AI accelerator architecture....  ...machine learning application development. Solid understanding... 
    Suggested
    Full time
    Local area

    TETRAMEM INC

    San Jose, CA
    13 days ago
  • $193.3k - $261.5k

     ...non-internship professional software development experience. We require 5...  ...as a mentor, tech lead, or engineering team lead. We prefer a...  ...candidates who want to move into an ML-aligned role or deepen...  ...of these custom-designed accelerator SoCs for internal AWS teams... 
    Suggested
    Full time
    Internship

    Annapurna Labs Inc.

    Cupertino, CA
    7 days ago
  •  ...portfolio of several ML accelerator devices with NPUs (neural...  ...(Vitis Unified Software Platform) targets several...  ...AMD's proprietary AI-engine architecture.THE PERSON...  ...sophisticated issues in a complex compiler tool stack. This role will be in software development, in the AI group in... 
    Suggested

    AMD

    San Jose, CA
    3 days ago
  • $272k - $425.5k

    Principal Software Engineer - Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software...  ...heterogeneous clusters so that many accelerators feel like a single system at...  ...systems, high-performance storage, or ML systems infrastructure in C/C++ and Python... 
    Suggested
    Local area
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $190k - $300k

     ...are at the forefront of software and hardware...  ...the US/Canada.The role: Principal Software Engineer, SDK & Lowering StackWhat...  ...kernel developers and compiler teams.Create development tools to be used in kernel...  ...GPUs, TPUs, or custom ML accelerators.Background working in... 
    Work experience placement

    d-Matrix

    Santa Clara, CA
    5 hours ago
  • $120k - $400k

     ...including hardware and software to train and run the largest ML workloads for AGI. We primarily...  ...Design and implement compilers tailored for our...  ...Focus on midend and backend development Requirements :...  ...Possess outstanding software engineering skills with a focus on efficiency... 
    Full time
    Work experience placement
    Local area

    Matx

    Mountain View, CA
    1 day ago
  •  ...great products that accelerate next-generation...  ...a unified ROCm software stack across AMD’...  ...stack, spanning compilers, kernels, runtime...  ...system software, AI/ML frameworks,...  ...Workload Performance Engineering: Lead the profiling...  ...: Drive the development of advanced tools... 

    AMD

    San Jose, CA
    3 days ago
  • $152k - $241.5k

     ...Learning Applications and Compiler Engineer!NVIDIA is seeking...  ...design teams to feedback software observations, influence future...  ...inference and related spatial accelerators at top tier ML, compiler, and computer...  ...with compiler or runtime development, including IR design,... 
    Full time

    Nvidia

    Santa Clara, CA
    5 hours ago
  • $168.4k - $193.5k

     ...years of non-internship professional software development experience. We need 5+ years of full...  ...as a mentor, tech lead, or engineering team lead. We require 7+ years of...  ...value experience with machine learning accelerator hardware and/or software. Responsibilities... 
    Full time
    Internship

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    8 days ago
  • $193.3k - $261.5k

     ...Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference The Annapurna Labs team at Amazon...  ...software development kit used to accelerate deep learning and GenAI workloads on...  ...toolkit includes an ML compiler, runtime, and application framework... 
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $167k - $270.5k

     ...great outcomes. Job Summary As a Principal Software Engineer to join our CPQ (Configure Price and...  ...complex challenges and drive the development of company objectives. This role requires...  ...foundational and agentic AI/ML workflows, ensuring the secure and effective... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    3 days per week

    Palo Alto Networks

    Santa Clara, CA
    1 day ago
  • $193.3k - $261.5k

     ...We have at least 5 years of non-internship professional software development experience. We have at least 5 years of programming experience...  .... We have experience as a mentor, tech lead, or engineering team lead. We hold a bachelors degree in computer science... 
    Full time
    Internship

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    8 days ago
  • $165.2k - $223.6k

     ...non-internship professional software development experience At least 3...  ...and apply sound software engineering practices in large-scale systems...  ...for deployment on custom ML accelerators Contribute to every...  ...accelerators Collaborate across compiler, runtime, framework,... 
    Full time
    Internship

    Annapurna Labs Inc.

    Cupertino, CA
    7 days ago
  • $143.4k - $165.6k

     ...need 3+ years of professional software development experience outside of...  ...learning applications and AI accelerators. We lead the design, development...  ...enhance the performance of ML kernels and ML frameworks....  ...functional partners so our C++ compiler surfaces the right... 
    Full time
    Internship
    Flexible hours

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    8 days ago
  • $193.3k - $261.5k

     ...scaling ~5+ years of full software development lifecycle experience,...  ...tech lead, or leading an engineering team ~ Masters degree in...  ...across the stack with our compiler and runtime teams Coach...  ...cloud-scale machine learning accelerators. In this Senior Software Development... 
    Full time
    Internship

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    8 days ago
  • $193.3k - $261.5k

     ...We require 5 years of full software development life cycle experience,...  ...mentor, technical lead, or engineering team lead. We prefer a...  ...for inference on Trainium accelerators. We deliver high-performance...  ...across the stack with the compiler and runtime teams. We... 
    Full time
    Internship

    Annapurna Labs Inc.

    Cupertino, CA
    7 days ago
  • $174k - $252k

    Deliver compiler parallelization features and optimization...  ...issues and improving engineering experience.Minimum...  ...of experience with software development in one or more...  ...Learning infrastructure, ML execution frameworks...  ...PyTorch), or hardware accelerators (e.g., TPUs, GPUs).2... 

    Google

    Sunnyvale, CA
    7 days ago
  • $143.7k - $223.6k

     ...internship professional software development experience. We...  ...We work alongside engineering peers to develop and...  ...applications and AI accelerators. We design, build,...  ...enhance the performance of ML kernels and ML frameworks...  ...teams so our C++ compiler produces the information... 
    Full time
    Internship
    Flexible hours

    Annapurna Labs Inc.

    Cupertino, CA
    7 days ago
  • $193.3k - $261.5k

     ...these custom-designed accelerator SoCs for use by AWS internal...  ...a Senior SoC Modeling Engineer to join the team and...  ....As part of the ML accelerator modeling team...  ..., emulation, and software teams to build, debug,...  ...used in both our SoC development process and by our partner... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    5 days ago
  •  ...and automation to ensure quality. Apply software design principles and troubleshooting...  ...Trust Security Services. Collaborate with Engineering Architects, Product Managers, Customers,...  .... Foundational understanding of AI/ML technologies and experience leveraging, securing... 
    Full time
    Work at office

    Zscaler

    San Jose, CA
    22 days ago
  • $221.2k - $387.1k

     ...knowledge systems, and advanced ML, to complex cybersecurity...  .... Define architecture and engineering standards for scalability, reliability...  .... Champion AI-native development, testing, evaluation, and...  ...Requirements ~15+ years of software engineering experience with significant... 
    Full time
    Flexible hours

    ServiceNow

    Santa Clara, CA
    12 days ago
  • $221.2k - $387.1k

     ...It all started when engineer Fred Luddy wrote code that automated...  ...knowledge systems, and advanced ML techniques. Explore and...  ...coding agents and autonomous development, testing, evaluation, and operational...  ...technical foundation in software architecture, distributed... 
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    13 days ago
  • $190.9k - $334.1k

     ...started when engineer Fred Luddy wrote...  ...to the cloud, accelerating our business...  ...Senior Staff IAM Software Engineer to...  .... Lead the development of end-to-end...  ...Partner with principal-level staff to...  ...another high-level, compiled language ~5+...  ...(Neo4j) or ML-assisted role... 
    Permanent employment
    Full time
    Work at office
    Immediate start
    Remote work
    Worldwide
    Relocation
    Flexible hours

    ServiceNow

    Santa Clara, CA
    16 days ago
  • $180k - $300k

     ...at the forefront of software and hardware innovation...  ...are looking for a Principal Software Engineer in QA to join our...  ...side with software development, product, and systems...  ...through runtime and ML workload execution.What...  ..., and d-Matrix AI accelerators, ensuring correct end... 

    d-Matrix

    Santa Clara, CA
    4 days ago
  •  ...are at the forefront of software and hardware innovation,...  ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat...  ...be responsible for the development, enhancement, and...  ...closely with other software (ML and compilers) and hardware experts in... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    5 hours ago
  •  ...for general or deep learning compiler engineers to join our compiler team...  ...products to our clients and the development for ongoing products. Also,...  ...compiler technology to accelerate applications in deep...  ...infrastructure compiler and the software stack for our proprietary high... 
    Full time
    Work at office
    Remote work
    Afternoon shift

    Baidu Usa

    Sunnyvale, CA
    1 day ago
  • $165.2k - $223.6k

     ...SoCs and the low-level software stack that brings...  ...a Systems Software Engineer who wants to work at...  ...enable SoC validation, accelerate system software development, and enable...  ...exploration. As part of the ML accelerator systems...  ...designers, modelers, compiler engineers, and ML... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $200k - $220k

     ...material cost and performance, while enabling accelerated growth for a diverse set of high-growth application...  ...high-volume manufacturing, we are seeking a Principal Machine Control Software Engineer to support the development, integration, and maintenance of equipment... 
    Full time
    Temporary work

    Halo Industries, Inc.

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...advanced computing, as a Principal Software Engineer for DGX Cloud. At NVIDIA,...  ...build the best platform for ML/AI infrastructure? Do you...  ...safety to our massive GPU accelerated container platform. We are...  ...innovative ways to simplify the development, deployment, and... 
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Development Engineer - Compiler & ML Acceleration. Be the first to apply!