Sr. Hardware Engineer - ML Acceleration, Annapurna Labs
Amazon Locker
Sr. Hardware Engineer - ML Acceleration, Annapurna Labs
AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. Annapurna Labs designs silicon and software that accelerates innovation, delivering custom chips, accelerators, and software stacks to tackle technical challenges and deliver results that help customers change the world.
We are seeking a Hardware Design Engineer with a role in the definition, design and validation of AWS next generation ML Chips, Cards and server integration. As a senior member of our hardware team, you will participate in the design and execution of PCIe and Serdes topics, with the goal of creating customized platforms that fit within AWS datacenter technology.
As a member of the Machine Learning Acceleration team you’ll be responsible for the design and optimization of hardware in our data centers. You’ll provide leadership in applying new technologies to large scale server deployments in a continuous effort to deliver a world-class customer experience. This is a fast-paced, intellectually challenging position, and you’ll work with thought leaders in multiple technology areas. You’ll have high standards for yourself and everyone you work with, and you’ll be constantly looking for ways to improve product performance, quality and cost. We’re changing an industry, and we want individuals who are ready for this challenge and want to reach beyond what is possible today.
About the team
Why AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences inspire us to embrace our uniqueness.
Work/Life Balance
We value work-life harmony. Achieving success at work should not come at the expense of home life, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Mentorship and Career Growth
We’re continuously raising our performance bar and offer knowledge-sharing, mentorship and other career-advancing resources to help you develop into a better-rounded professional.
Diverse Experiences
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Equal Opportunity Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Role responsibilities
- Define, design and validate AWS next generation ML Chips, Cards and server integration.
- Lead the design and execution of PCIe and Serdes topics for customized platform integration.
- Design and optimize hardware in data centers; apply new technologies to large scale server deployments.
- Collaborate with cross-functional teams to improve product performance, quality and cost.
- Provide technical leadership and mentorship within the hardware team.
Basic Qualifications
- Deep knowledge with PCIe interface Gen4 or above, both Electrical and Functional at the chip level and at the PCB level.
- Deep understanding of Transmission line theory and Electromagnetics and its application in SerDes, single-ended signal and parallel bus interfaces. Work with ODMs, IP Silicon vendors, component suppliers and internal design teams on cross-boundary triaging, debugging, and resolving issues.
- Hands-on lab equipment skills (VNA, realtime scope, sampling scope and accessories) for electrical validation and characterization.
- Scripting skills to automate tests, logs parsing and data collection.
- Strong technical communication skills (verbal and written) to interface with cross-functional technical leads within and/or outside of the organization.
Preferred Qualifications
- Experience with Server HW designs, design validation, production tests and signal integrity of high speed interfaces.
- Knowledge of the product development cycle from concept to mass production.
- Strong analytical capabilities.
- The ability to work independently and drive tasks from start to finish.
- Ability to work cross-functionally with SW teams to define and implement diagnostics for hardware validation at component, interface, and system level.
- Experience with server (x86 / ARM) design or architecture.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Los Angeles County applicants: duties include working safely and cooperatively, adhering to standards, communicating effectively, and following laws and company policies. Criminal history may have a direct relationship with job duties. We will consider qualified applicants with arrest and conviction records. For disability accommodations during the application process, visit the Amazon accommodations page. Our compensation reflects cost of labor across US markets; base pay ranges shown and may vary by location. This position will remain posted until filled. Applicants should apply via our career site.
Posted: August 27, 2025
Posted: July 30, 2025
Posted: June 10, 2025
Posted: September 18, 2025
Posted: April 4, 2025
Share this job
Important FAQs for current Government employees
Before proceeding, please review the following FAQs
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability or other legally protected status.
#J-18808-Ljbffr$183k - $247.6k
...for their cloud services.Annapurna Labs (our organization within AWS... ...silicon and software that accelerates innovation. Customers... ...the world.We are seeking a Hardware Design Engineer with role in the definition... ...validation of AWS next generation ML Chips, Cards and server...SeniorLocal areaFlexible hours$193.3k - $261.5k
...(UC) provides product Annapurna Labs (our organization within... ...and software that accelerates innovation. Customers... ...seeking a Senior Firmware Engineer to join our Power... ...performance management on ML Acceleration Chips. In... ...optimization on ML acceleration hardware Develop real-time...SeniorInternshipLocal areaFlexible hours- ...Sr. ASIC Design Engineer, Cloud-Scale Machine Learning Acceleration team - Annapurna Labs Annapurna Labs designs silicon and software that accelerates innovation. Customers... ...for the design and optimization of hardware in our data centers including AWS Inferentia...Senior
$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SOCs that are... ...seeking experienced Design Verification Engineers to build the next generation of our... ...Experience with verifying complex CPU, GPU, or ML accelerator designsAmazon is an equal...SeniorLocal areaWork from homeFlexible hours$183k - $247.6k
Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that... ...the design and optimization of hardware in our data centers including AWS... ...our team members develop your engineering expertise so you feel empowered...SeniorLocal areaFlexible hours- ...Annapurna Labs (U.S.) Inc. is seeking a Senior Firmware Engineer to join our Power Architecture team to develop firmware for ML acceleration hardware. You will design control algorithms, implement tracing and instrumentation, and collaborate with hardware teams to maximize...Senior
$193.3k - $261.5k
...drivers that expose the hardware to the OS, runtime... ...for a Systems Software Engineer who wants to work at the... ...enable SoC validation, accelerate system software development... .... As part of the ML accelerator systems modeling... ...your teammatesAnnapurna Labs, our organization...SeniorLocal areaFlexible hours$193.3k - $261.5k
...silicon. We're looking for a software engineer to build and own the models and... ...pieces of the stackNo ML background needed. You'll learn the ML accelerator domain on the job.This role can be... ...with machine learning accelerator hardware and/or softwareAmazon is an equal...SeniorInternshipLocal areaFlexible hours$193.3k - $261.5k
...are seeking an experienced engineer to work on distributed AI/ML systems. This role... ...to scale across multiple accelerators & servers. Most of our stack... ...org you would be joining is Annapurna Labs, an integral part of AWS and develops hardware and software components that...SeniorInternshipLocal areaFlexible hours- Sr. Product Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services (AWS) job located in Cupertino... ...innovation in machine learning acceleration software. AWS Neuron is the... ...to contribute to and influence engineering discussions around technology decisions...Senior
$176.6k - $239k
Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully integrated... ...disciplines including silicon engineering, hardware design and verification, software, and... ...AWS Neuron, Inferentia and Trainium ML Accelerators, and in storage with scalable NVMe,...SeniorLocal areaFlexible hours$193.3k - $261.5k
...AWS Machine Learning accelerators are at the forefront... ...delivers best-in-class ML inference performance... ...a whole, the Amazon Annapurna Labs team is responsible for... ...including silicon engineering, hardware design and verification... ....You: As a Sr. Machine Learning Compiler...SeniorInternshipLocal areaWork from homeRelocationFlexible hours$183k - $247.6k
...accepted on an ongoing basisAWS Compute & ML Services owns the design, planning,... ...’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security... ...(HWEng) team creates compute, accelerator, edge and storage server designs for...SeniorLocal areaFlexible hours$206.9k - $279.9k
...in machine learning acceleration software. AWS Neuron... ...delivering best-in-class ML performance in the... ...kernel optimization, and hardware acceleration.The... ...contribute to and influence engineering discussions around... ....About Amazon Annapurna Labs:Amazon Annapurna Labs...Flexible hours$208.3k - $281.8k
...supports the training AI/ML ecosystem and what... ...will partner with engineering teams building training... ...professional. About Amazon Annapurna Labs Amazon Annapurna Labs... ...silicon engineering, hardware design, software and... ...with AI/ML training accelerators and hardware,...Local areaFlexible hours$122.6k - $185k
...high performance and scalability in AI/ML and HPC workloads.You are intrigued by... ...looking for builders like you. The AWS Hardware Engineering team creates server designs for Amazon’... ...reliability into future/new designs for AWS Accelerated server solutions for AWS Cloud. About...Local areaFlexible hours$183k - $247.6k
...UC) provides product Annapurna Labs (our organization within... ...and software that accelerates innovation. Customers... ...thermal constraints for ML accelerator designs... ...solutions across the hardware-software stack-... ...members develop your engineering expertise so you feel...SeniorLocal areaFlexible hours- ...A leading technology firm in Cupertino is seeking a Sr. Hardware Engineer to design and validate next-generation ML Chips. This role involves leading PCIe designs, collaborating with teams to enhance product performance, and applying innovative technologies. Ideal candidates...Senior
$193.3k - $261.5k
...created innovative software and hardware solutions that make it... ...optimizes the performance of complex ML models executed on AWS... ...our custom chips designed to accelerate deep-learning workloadsThis role is for a senior software engineer in the Compiler team for AWS Neuron...SeniorLocal areaFlexible hours$193.3k - $261.5k
...create innovative software and hardware solutions that make deep... ...optimizes the performance of complex ML models on AWS Inferentia and... ..., custom chips designed to accelerate deep‑learning workloads. This... ...is for a senior software engineer in the Compiler team responsible...SeniorFlexible hours$255k - $340k
...home day is currently Tuesday.Hardware Engineering at Lambda is responsible for... ...OEM and white-label HPC AI/ML, general purpose compute,... ...and prototype new hardware in labs.Review BOMs to ensure configuration... ...AI/ML infrastructure and accelerated compute hardware (e.g.,...SeniorWork at officeLocal areaWork from homeFlexible hours$159k - $230k
...instrumentation.Contribute within a team of hardware/software designers, test engineers, on project planning within hardware development labs, ensuring adequate resources are met as... ...execute tests of end-to-end highly complex ML system design involving CPU, DDR memory, storages...Senior$193.3k - $261.5k
...Senior SoC Software DevOps Engineer role centers on... ...ability to deliver advanced ML infrastructure to its... ...the intersection of hardware and software requiring... ...improvements that accelerate team productivity. The... ...Software organization within Annapurna Labs (AWS). Our three...SeniorLocal areaImmediate startFlexible hours- ...Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SoCs that... ...workloads in datacenters worldwide. As a Sr. EMIR Engineer, you’ll contribute to the EMIR sign‑off... ...or similar) Some experience with lab equipment and capability to do lab power...SeniorWorldwide
$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SoCs that... ...datacenters all around the world. As a Sr. EMIR Engineer, you’ll contribute to the EMIR sign-off... ...PrimeTime or similar)- Some experience with lab equipment and capable of doing lab...SeniorLocal areaFlexible hours$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SoCs that... ...all around the world. As a Sr. SoC Power Engineer, you’ll contribute to the project at the... ...power* Make power measurements in the lab and correlate back to simulations.* Work...SeniorLocal areaFlexible hours$193.3k - $261.5k
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS... ...development kit used to accelerate deep learning and GenAI... ...accelerator. Neuron includes an ML compiler, runtime,... ...and JAX down to the hardware and software boundary, our engineers build the infrastructure...SeniorInternshipLocal areaFlexible hours$183k - $247.6k
...services.We are seeking an experienced Sr. Physical Design STA Engineer to build the next generation of our... ...member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and optimization of Hardware in our data centers including...SeniorFull timeLocal areaFlexible hours$193.3k - $261.5k
Annapurna Labs is an integral part of AWS and develops hardware and software components that are critical building blocks for EC2 infrastructure. We specialize in... ...AWS Neuron Collectives team is seeking a Software Engineer to optimize collective operations for AWS...SeniorLocal areaWork from homeFlexible hours$193.3k - $261.5k
...looking for a Senior Software Development Engineer to join the ENA Express team. You will... ...network, including HPC clusters, large-scale ML training, financial services, and other... ...bandwidth utilization.• Collaborate with hardware and firmware partners to define software/...SeniorInternshipLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Hardware Engineer - ML Acceleration, Annapurna Labs. Be the first to apply!
- hardware electronics engineer Cupertino, CA
- hardware design engineer Cupertino, CA
- computer engineer Cupertino, CA
- computer hardware engineer Cupertino, CA
- computer vision engineer Cupertino, CA
- senior computer engineer Cupertino, CA
- power electronics hardware engineer Cupertino, CA
- senior hardware engineer Cupertino, CA
- hardware engineer Cupertino, CA
- senior lead project manager Cupertino, CA

