Sr. Software Engineer - AI/ML Networking

Salary: $193,300 - 261,500 per year Requirements:

• We require 5+ years of non-internship professional software development experience.
• We require 5+ years of programming experience in at least one software language.
• We require 5+ years of experience leading system design or architecture, including design patterns, reliability, and scaling for new and existing systems.
• We require 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• We require experience serving as a mentor, tech lead, or engineering manager.
• We require hands-on C/C++ coding experience.
• A bachelors degree in computer science or an equivalent background is preferred.
• Experience with ML communications technologies such as NCCL, NIXL, or NVSHMEM is preferred.
• Strong knowledge of low-level, performance-focused systems, including Linux, kernels, memory, and high-performance coding is highly valued.
• Experience with high-speed networking or HPC interconnects such as RDMA, InfiniBand, libfabric, UCX, NIXL, or MPI is highly valued.
• Embedded systems experience is a plus.
• Prior AI/ML experience is welcome but not required.

• We build and optimize low-level data movement software across accelerators, servers, and heterogeneous memory over AWSs highest-performance network fabric.
• We push performance toward the hardware roofline by profiling, identifying bottlenecks, and closing the gap between functional code and peak machine efficiency.
• We work across the stack, from kernel and network transport layers to inference frameworks, and collaborate with teams building chips, runtimes, and models.
• We deliver features that run on our largest clusters and support our largest customers serving the biggest AI models in production.
• We focus on networking solutions for machine learning and high-performance computing workloads on AWS.
• We collaborate closely with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects.
• We mentor junior engineers and also learn from senior technical leaders.

• AI
• AWS
• EC2
• Embedded
• Fabric
• Hardware
• InfiniBand
• Support
• Linux
• Machine Learning
• Network
• RDMA
• Cloud
• LLM

More:

We are Annapurna Labs, an integral part of AWS, building the hardware and software foundations behind EC2. Our team works at the intersection of AI, silicon, and networking, developing infrastructure for machine learning and high-performance computing workloads on AWS. We offer a fast-paced environment with strong mentorship, global collaboration, flexible working hours, respect for work-life balance, and opportunities for career growth. The role is based in Cupertino, California, and the posted base salary range is $193,300 to $261,500 annually, with additional sign-on payments, restricted stock units, and comprehensive benefits including medical, dental, vision, life insurance, mental health support, retirement matching, paid time off, and parental leave.

last updated 37 week of 2026