Sr. Machine Learning Compiler Engineer, AWS Neuron

Salary: $193,500 - 193,500 per year Requirements:

• We require 5+ years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
• We require at least 2+ years of experience developing compiler features and optimizations.
• We need proficiency in one or more programming languages, with C++ preferred, and also C or Python.
• We value a masters or PhD degree in computer science or an equivalent background.
• We prefer experience with resource management, scheduling, code generation, and compute graph optimization.
• We prefer experience optimizing TensorFlow, PyTorch, or JAX deep learning models.
• We prefer experience working with multiple toolchains and instruction set architectures.
• Knowledge of compilers or building ML models on accelerators is a plus.
• Familiarity with OpenXLA, StableHLO, or MLIR is an added advantage.

• We design, build, test, deploy, and maintain software that improves the performance, stability, and user experience of the Neuron compiler.
• We develop the next generation Neuron compiler that converts ML models from frameworks such as PyTorch, TensorFlow, and JAX for deployment on AWS Inferentia and Trainium servers.
• We solve challenging compiler optimization problems to achieve strong performance across a wide range of ML model families, including large language models, stable diffusion, vision transformers, and multimodal models.
• We work closely with chip architects, runtime and OS engineers, scientists, and ML application teams to deliver cutting-edge models on AWS accelerators with strong cost and performance results.
• We create compiler optimization and verification passes, surface accelerator capabilities and quirks to developers, and build tools to analyze numerical errors and diagnose compiler defects.
• We participate in design reviews, code reviews, and technical discussions.
• We communicate with internal teams and external open-source communities, including answering compiler-related questions in public forums.
• We contribute to pre-silicon design and help bring new products and features to market.
• We represent the Neuron Compiler in open-source ecosystems such as StableHLO, OpenXLA, and MLIR.

• AWS
• Cloud
• IoT
• Support
• PyTorch
• Python
• TensorFlow
• AI
• EC2
• GitHub
• Hardware
• Java
• Security
• Web

More:

We are AWS, the worlds most comprehensive and broadly adopted cloud platform, and our Utility Computing organization builds foundational services and new innovations across compute, database, storage, IoT, platform, and productivity applications. This role sits on the AWS Neuron Compiler team in Cupertino, California, where we work in a startup-like environment with strong mentorship, knowledge sharing, and career growth. We offer a collaborative and inclusive culture, work-life balance, and comprehensive benefits that include medical, dental, vision, prescription coverage, life insurance options, mental health support, 401(k) matching, paid time off, parental leave, and sign-on payments and RSUs as part of the total compensation package.

last updated 35 week of 2026