Software Engineer, Trainium Collectives

Salary: $165,200 - 223,600 per year Requirements:

• We require 3 years of non-internship professional software development experience.
• We require 2 years of non-internship experience in system design or architecture, including design patterns, reliability, and scaling for new and existing systems.
• We require experience programming in at least one software language.
• We prefer 3 years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• We prefer a bachelors degree in computer science or an equivalent qualification.

• We will enhance collective algorithms and topologies to improve training efficiency.
• We will use tools such as Neuron Explorer to diagnose compute and bus bandwidth bottlenecks.
• We will monitor and analyze processor, DMA, firmware, and workload metrics.
• We will optimize collective operations to scale AI compute across the data center through low-level device driver development.
• We will collaborate closely with hardware teams to co-optimize software and Trainium silicon.
• We will develop and refine C and C++ implementations of collective communication patterns.
• We will investigate and implement improvements for training topologies used by modern large language models.
• We will build and maintain analysis frameworks and automation solutions.

• AI
• AWS
• EC2
• Firmware
• Hardware
• Support
• Machine Learning
• Cloud

More:

We are Annapurna Labs, part of AWS, and we build hardware and software components for EC2 infrastructure. Our team develops networking solutions for machine learning and high-performance computing workloads on AWS. You will work in a mixed-discipline, international environment alongside infrastructure experts, hardware engineers, RTL engineers, scientists, and architects. We value mentorship, encourage continuous learning, support flexibility in working hours, and prioritize work-life balance. The team collaborates with principal-level engineers and directors, creating strong opportunities for career growth. We also offer comprehensive benefits, including health coverage, 401(k) matching, paid time off, parental leave, sign-on payments, and restricted stock units. The role is based in Cupertino, California, with an annual base salary range of 165,200 to 223,600 USD.

last updated 37 week of 2026