Software Development Engineer, Neuron

Salary: $165,600 - 165,600 per year Requirements:

• We want someone who has built complex software systems that have been successfully delivered to customers.
• We value experience contributing to the architecture and design of new and existing systems, including architecture patterns, reliability, and scaling.
• A bachelors degree in computer science or an equivalent background is required.
• We look for knowledge of engineering practices across the full software, hardware, and network development lifecycle, including coding standards, code reviews, source control, build processes, testing, certification, and live site operations.
• We prefer recent development experience within the last three years, or experience in embedded development using C/C++.
• A masters degree in computer science or a similar field is preferred.
• We also value experience with hardware/software integration and real-time systems.
• Familiarity with collective communication algorithms such as all-reduce and all-gather, or with distributed training frameworks, is preferred.

• We enhance collective algorithms and topologies to improve training performance.
• We use tools such as Neuron Explorer to pinpoint bottlenecks in compute and bus bandwidth usage.
• We monitor and assess processor, DMA, firmware, and workload metrics.
• We optimize collective operations so AI compute can scale across the data center.
• We collaborate closely with the hardware team to co-optimize software and Trainium silicon.
• We develop and refine C/C++ implementations of collective communication patterns.
• We investigate and deliver improvements for the training topologies used by modern large language models.
• We build and maintain analysis frameworks and automation tools.

• AI
• AWS
• EC2
• Embedded
• Firmware
• Hardware
• Support
• Network
• Cloud
• Flow
• Machine Learning

More:

We are Annapurna Labs, part of AWS, and we design hardware and software building blocks that support EC2 infrastructure and improve the AWS customer experience. Our Neuron Collectives team is working on software for AWS Trainium, a high-priority AI training chip used to power frontier models. This role sits at the intersection of hardware, firmware, and distributed systems, with opportunities to work on cutting-edge AI training technology at AWS scale. We foster an inclusive culture, support work-life balance, and encourage mentorship and career growth. We also offer comprehensive benefits, including health coverage, 401(k) matching, paid time off, parental leave, sign-on payments, and RSUs. The listed location is Cupertino, CA, with a base salary range of USD 165,600 annually.

last updated 37 week of 2026