Software Development Manager, AWS Neuron

Salary: $93,000 - 128,000 per year Requirements:

• We require at least 2 years of engineering team management experience.
• We look for 6+ years of direct experience working within engineering teams.
• We need 4+ years of experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
• We expect experience partnering with product or program management teams.
• We require a solid understanding of compilers, including resource management, instruction scheduling, code generation, and compute graph optimization.
• We need strong software design fundamentals and excellent system-level coding skills.
• A masters degree or Ph.D. in Computer Science or a related technical field is preferred.
• Candidates must currently be located in, or willing to relocate to, Cupertino, CA.

• We will have you lead, develop, and mentor a team of compiler engineers, including hiring, career progression, and team health.
• You will own the execution and delivery of NKI compiler features across release cycles, balancing scope, quality, and timelines.
• You will set the technical direction and roadmap for the NKI compiler area in collaboration with senior engineers.
• You will partner across framework, kernel, runtime, hardware pre-silicon design, and product management teams to launch new capabilities.
• You will drive resolution of complex, high-priority technical issues while staying close enough to the code and hardware to guide the team.
• You will represent your teams work and priorities to senior leadership and cross-organizational stakeholders.
• You will anchor decisions in customer impact, ensuring we build what unblocks real ML workloads on Trainium.
• You will support roadmap planning, technical reviews, profiling analysis, and escalation handling to keep the team moving quickly.

• AWS
• Cloud
• Hardware
• Support
• Machine Learning
• Flow
• PyTorch

More:

We are Amazon Annapurna Labs, building innovative silicon and software for AWS customers at cloud scale. Our AWS Neuron and Trainium products power large-scale machine learning workloads through the Neuron Software Development Kit, including the Neuron Kernel Interface for directly programming NeuronDevices on AWS Trainium instances. We serve customers such as Epic Games, Snap, Airbnb, Autodesk, Amazon Alexa, and Amazon Rekognition, among many others. Our team is small, agile, and highly collaborative, bringing together experts in silicon engineering, hardware design and verification, software, and operations. We value inclusion, continuous learning, work-life balance, mentorship, and career growth, and this role is based in Cupertino, CA with comprehensive benefits including health coverage, sign-on payments, and RSUs.

last updated 33 week of 2026