Sr Software Development Engineer, Neuron

Salary: $193,300 - 261,500 per year Requirements:

• We require a bachelors degree in computer science or an equivalent background.
• We require 5 years of experience building complex software systems that have been successfully delivered to customers.
• We require 5 years of experience contributing to the architecture and design of new and existing systems, including architecture, design patterns, reliability, and scaling.
• A masters degree in computer science or an equivalent field is preferred.
• Familiarity with collective communication algorithms such as all-reduce and all-gather, or with distributed training frameworks, is preferred.

• We enhance collective algorithms and topologies to improve training performance.
• We use tools such as Neuron Explorer to pinpoint bottlenecks in compute and bus bandwidth utilization.
• We monitor and analyze processor, DMA, firmware, and workload metrics.
• We optimize collective operations to scale AI compute across the data center.
• We collaborate closely with our hardware team to co-optimize software and Trainium silicon.
• We develop and refine C/C++ implementations of collective communication patterns.
• We investigate and implement improvements for the specific training topologies used by modern large language models.
• We build and maintain analysis frameworks and automation solutions.

• AI
• AWS
• EC2
• Firmware
• Hardware
• Support
• Model Training
• Cloud
• Flow
• Machine Learning

More:

We are Annapurna Labs, part of AWS, and we design hardware and software building blocks that are critical to EC2 infrastructure and the AWS customer experience. Our Neuron Collectives team owns the software stack that enables collective operations for Trainium, our purpose-built AI training chip for scaling frontier model training across thousands of chips in the data center. This role sits at the intersection of hardware, firmware, and distributed systems, with a strong focus on performance, collaboration, and technical growth. We offer a culture of inclusion, work-life balance, mentorship, career development, and comprehensive benefits, including health coverage, retirement support, paid time off, parental leave, and equity-based compensation. This position is based in Cupertino, California, with an annual base salary range of 193,300 to 261,500 USD.

last updated 37 week of 2026