Lead Software Engineer, ML Network Stack - Annapurna Labs
Amazon Locker
Lead the development of the network stack for EC2 distributed AI/ML systems, specifically enabling NVIDIA GPUs to work with AWS machines. Direct a team of software engineers to deliver features required for the largest AI models and ML workloads. Requirements Requires 5+ years of experience in system design, software development life cycle, and programming in C or C++. Candidates must have experience as a tech lead or mentor and preferably have knowledge of ML communication libraries or RDMA networking. Key Skills C C++ ML Networking RDMA NCCL NVSHMEM NIXL CUDA Kernels Linux Distributed Systems System Architecture Software Development Life Cycle HPC Embedded Systems Technical Leadership Network Stack Benefits Sign-on Payments Restricted Stock Units (RSUs) Health Insurance Medical Insurance Dental Insurance Vision Insurance Prescription Insurance Basic Life & AD&D Insurance Supplemental Life Plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement 401(k) Matching Paid Time Off Parental Leave #J-18808-Ljbffr
$193.3k - $261.5k
...seeking an experienced engineer and technical... ...team that owns the network stack for EC2 distributed AI/ML systems. The team... ...would be joining is Annapurna Labs, an integral part... ...hardware and software components that are... ...regarded. You'll be leading senior, mid-level,...SuggestedLocal areaFlexible hours$193.3k - $261.5k
...single chip, the network between... ...looking for an engineer to work at the... ...data-movement software across accelerators... ...Work across the stack — from kernel and... ...plus.Prior AI/ML experience is welcome... ...a role on the leading edge of AI/ML... ...'d be joining Annapurna Labs, an integral part...SuggestedInternshipLocal areaFlexible hours$165.2k - $223.6k
...single chip, the network between... ...looking for an engineer to work at the... ...data-movement software that transfers... ...Work across the stack — from network... ...welcome.Prior AI/ML experience is not... ...a team at the leading edge of AI/ML infrastructure... ...'d be joining Annapurna Labs, an integral...SuggestedInternshipLocal areaFlexible hours$213k - $287.5k
Annapurna Labs (our organization within Amazon Utility... ...silicon and software that accelerates innovation... ..., and software stacks enable us to take... ...Methodology Engineer to help us trail-blaze... ...methodologies (RTL2GDS) for ML Accelerator chips... ...- Experience leading or solely...SuggestedLocal areaFlexible hours$193.3k - $261.5k
...Senior SoC Systems Software Engineer, Annapurna Labs Machine Learning Accelerators... ...low‑level software stack that brings these... ...working together across a network. We're looking for... .... As part of the ML accelerator systems... ...Experience as a mentor, tech lead or leading an...SuggestedFlexible hours$193.3k - $261.5k
...Senior Virtual Platform Software Engineer, Annapurna Labs Machine Learning Accelerators, AWS AWS's Trainium... ...you own significant pieces of the stack No ML background needed. You’ll learn the... ...~ Experience as a mentor, tech lead or leading an engineering team ~7+...InternshipFlexible hours$193.3k - $261.5k
...Description Annapurna Labs designs silicon and software that accelerates innovation... ..., and software stacks enable us to take on... ...scalable firmware for ML acceleration... ...members develop your engineering expertise so you feel... ...experience 5+ years of leading design or...InternshipLocal areaFlexible hours$193.3k - $261.5k
...Post-Silicon Systems Software Validation Engineer, Annapurna Labs Annapurna Labs,... ...the complete vertical stack—silicon, PCB, high-... ...Acceleration team, you'll lead and own critical... ...next-generation AI/ML accelerators meet... ..., HBM, GPUs, neural networks, ML HW architecture...InternshipLocal areaFlexible hours$127.1k - $185k
We're looking for a talented early-career engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. You'll work on software that enables the world's largest AI models to train across massive GPU clusters, developing support for communication...InternshipLocal areaFlexible hours- ...Annapurna Labs, an integral part of AWS, Cupertino, seeks a Lead Software Engineer to own the ML networking stack for EC2 distributed AI/ML systems. You will guide design across ML communication libraries (NCCL, NVSHMEM, NIXL) and CUDA kernels, mentoring engineers and...
$213k - $287.5k
Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions... ...chips, accelerators, and software stacks enable us to take on technical... ...our team members develop your engineering expertise so you feel empowered to...Local areaFlexible hours$212.7k - $287.7k
...delivers best-in-class ML training performance... ...enabled by the AWS Neuron Software Development Kit (SDK),... ....The Team: The Amazon Annapurna Labs team is responsible... ...world's most talented engineers. Our team covers multiple... ...an SDM III, you will lead a team of experienced...Local areaWork from homeRelocationFlexible hoursDay shift- ...Annapurna Labs in Cupertino, part of AWS, is seeking a Software Development Engineer focused on AI/ML networking disaggregated inference. You will build data-m movement software across accelerators... ..., and collaborate across the stack from network transport to inference...
$212.7k - $287.7k
...delivers best-in-class ML inference performance... ...all enabled by edge software stack, the AWS Neuron... ...The Team: The Amazon Annapurna Labs team is a responsible... ...world’s most talented engineers. Our team covers multiple... ...a Manager III you be leading a team of experienced...Local areaWork from homeRelocationFlexible hours$213k - $287.5k
...all industries. We are seeking experienced Design Verification Engineers to build the next generation of our cloud server chips. Our success... ...techniques- Experience with verifying complex CPU, GPU, or ML accelerator designsAmazon is an equal opportunity employer and does...Local areaWork from homeFlexible hours- ...Annapurna Labs, AWS, seeks a Systems Software Engineer to work at the boundary of hardware and software on ML accelerator platforms. You’ll develop and validate SoC models and the software stack used to bring chips to life in large-scale training and inference clusters...
$184k - $287.5k
...rack, multi-tenant AI/ML datacenters with NVIDIA... ...NVIDIA seeks a Senior Software Engineer for our CSP (Cloud... ...focus on the cloud-native stack for datacenter... ...-native stacks across networking (RDMA/RoCE), storage,... ...working for us. NVIDIA is leading the way in groundbreaking...Full timeRemote work$213k - $287.5k
...datacenters all around the world. As a Sr. EMIR Engineer, you’ll contribute to the EMIR sign-off... ...engineers, Emulation engineers and software engineers.Basic qualifications- 5+ years... ...PrimeTime or similar)- Some experience with lab equipment and capable of doing lab power...Local areaFlexible hours$213k - $287.5k
...all around the world. As a Sr. SoC Power Engineer, you’ll contribute to the project at the... ...architects, designers, verification engineers, software teams, and Physical Design experts -... ...reduce power- Make power measurements in the lab and correlate back to simulations.- Work...Local areaFlexible hours$176.6k - $247.3k
...technologies and architectures, while ensuring high design quality and making the right trade-offs.Key job responsibilitiesAs an ASIC Design Engineer, you will:• Develop and implement high-performance, area and power-efficient RTL designs to meet project specifications and...Local areaWork from homeFlexible hours- ...Amazon's Annapurna Labs unit seeks a Senior SoC Systems Software Engineer to push the boundary between hardware and software, from functional models to live silicon... ...RTL designers, modelers, compiler engineers, and ML teams. The role emphasizes low‑level firmware, drivers...
$184k - $287.5k
...Technical Engagement Lead to evangelize... ...computing stack across critical... ..., systems, and software libraries within... ...high-performance networking (InfiniBand),... ...with partner AI engineering and researchers... ...include AI/ML, high-performance... ...leading AI research labs and the most...Full time$224k - $356.5k
...progress.We’re looking for a Senior Full-Stack Software Engineer to join the AI Hub team within the DGX... ...Superclusters.What You’ll Be Doing:Lead the architecture and delivery of high-scale... ...pairing, and coaching.Stay ahead of AI/ML infrastructure trends and drive...Full time$230k - $280k
...each layer of the stack — from electrons to... ...Crusoe’s Cloud Engineering organization is 380... ...purpose. You’ll lead Engineering Operations... ...technical background (software engineering, SRE,... ...CoreWeave, Lambda Labs, or a similar cloud... ...Background in AI/ML infrastructure....Temporary work$150k - $225k
...life. We are looking for a Lead Embedded Software Engineer to own the full path from... ...across the embedded stack. Make and own key technical... ...Implement and optimize networking stacks - BLE, Thread, and Wi... ...Familiarity with TinyML or edge ML frameworks (TFLite Micro, Edge...Full timeWork at officeImmediate startVisa sponsorshipNight shift$184k - $287.5k
NVIDIA is seeking a Senior Systems Software test (lead) Engineer to join our Cloud Service Provider... ...CSP) Engagements team, focusing on ML software stack validation for Datacenter products... ...firmware, drivers, OS integration, networking, and large-scale cluster environments...Full timeLocal area$115k - $130k
...server, storage, and networking solutions for Data... ..., and committed engineers, technologists, and... ...infrastructure within our AI lab(s) and data center... ...Deployment: Rack, stack, cable, label, and... ...-performance AI/ML and GPU compute... ...recurring failure modes.Lead 24/7 NOC operations...Work at officeWorldwideNight shift- ...Annapurna Labs, part of Amazon, is at the forefront of hardware co-design in AWS and beyond.... ...The team designs and builds hardware and software to power accelerated computing,... ...scale. We are seeking a verification engineer to verify and validate hardware/software...
$244.14k - $413.16k
XPENG is a leading smart technology company at the forefront of innovation... ....XPENG Robotics Xplore Lab is a frontier research and technology... ...in robotics research or engineering.Experience leading technical projects... ...resources to support your ML model development/research....Full time$272k - $431.25k
NVIDIA is the engine of modern AI, and robotics... ...Isaac Sim, Isaac Lab, Isaac ROS, the foundation... ...you’ll be doing:Lead the Isaac... ...performing team of robotics software engineers; set... ...accelerated-computing stack across simulation,... ...computing and modern ML infrastructure, and...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Software Engineer, ML Network Stack - Annapurna Labs. Be the first to apply!
- lead engineer Cupertino, CA
- data center network engineer Cupertino, CA
- network engineer level Cupertino, CA
- network implementation engineer Cupertino, CA
- senior network engineer Cupertino, CA
- computer network engineer Cupertino, CA
- network software engineer Cupertino, CA
- network engineer internship Cupertino, CA
- network consulting engineer Cupertino, CA
- core network engineer Cupertino, CA



