Senior Software Developer - AI/ML Distributed Systems

Salary: $151,300 - 261,500 per year Requirements:

• I hold a Bachelor's degree in computer science or a related field.
• I have over 5 years of professional software development experience, excluding internships.
• I possess more than 5 years of programming experience in at least one software programming language.
• I have spent over 5 years leading design or architecture for new and existing systems, focusing on design patterns, reliability, and scaling.
• I have accumulated over 5 years of experience in the complete software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• I have experience as a mentor or tech lead, or have led an engineering team.
• I am knowledgeable in machine learning, particularly large-scale training with large language models (LLMs) and have expertise in PyTorch.

Responsibilities:

• In this role, I will be responsible for spearheading the development of distributed training support within PyTorch, as well as integrating it with the Neuron compiler and runtime stacks. I will enable distributed training strategies to optimize models for peak performance and efficiency on AWS's custom silicon, including Trainium servers. Strong software development skills, a willingness to delve deep, the ability to collaborate effectively with cross-functional teams, and a solid foundation in machine learning will be essential for my success.

Technologies:

• AWS
• Cloud
• Hardware
• Support
• Machine Learning
• OSS
• PyTorch
• DevOps
• EC2
• LLM
• TensorFlow
• Web

More:

Annapurna Labs designs innovative silicon and software solutions. Our clients come to us for cloud solutions that tackle previously unimaginable challenges. Our specialized chips, accelerators, and software stacks empower us to confront technical obstacles that have never been encountered before, delivering results that assist our clients in making significant changes in the world.

As a part of the AWS Neuron team, I will play a crucial role in the Distributed Training team for AWS Neuron, focusing on the development, enablement, and performance enhancement of various machine learning model families. This includes large-scale language models like GPT-OSS, Quen, and Llama, as well as models such as Stable Diffusion and Vision Transformers.

Our team at Annapurna Labs, which became part of AWS in 2015, encompasses various disciplines, including silicon engineering, hardware design, software, and operations. We strive to create an environment that encourages knowledge-sharing and mentorship, emphasizing career growth and project assignments that help team members develop their engineering skills.

At AWS, we embrace diverse experiences and welcome candidates from unconventional backgrounds to apply, even if they do not meet every qualification outlined. We value a culture of inclusion and support work-life balance, believing that employee well-being fosters better outcomes in our work. We also provide ongoing mentorship and resources to help team members become more well-rounded professionals.

Overall, we are committed to fostering a supportive and inclusive workplace that empowers every employee to contribute to our customers' success.

last updated 37 week of 2026