Sr Hardware Development Engineer, High Performance AI & ML Servers
$183k - $247.6kAmazon Locker
Description
Do you want to shape the future of AI? Join the team building the foundation of the world’s most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale. Here, you’ll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you’re passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what’s next for AWS — and for the entire AI industry.
You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
Key job responsibilities
Lead technical solutions for complex high performance server and/or accelerator server and rack system architectural challenges
Own end-to-end system reliability, proactively identifying and resolving deficiencies before customer impact
Design and implement solutions to address system-level issues at large scale
Decompose complex server system problems (testability, reliability, diagnostics) into deliverable tasks and features
Apply expertise across hardware, software, system design, x86 architecture, processes, and operations
Collaborate with hardware, software, manufacturing, supply chain and product management teams
Develop and implement diagnostic tools and monitoring solutions for production systems
Debug complex system failures in time sensitive settings
A day in the life
Your day to day responsibilities will include interfacing with our internal and external customers to understand project requirements and facilitate system development on top of your server design. You will be responsible for solving operational challenges to our existing fleet with the goal of improving the current customer experience as well as developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale.
About the team
The team is comprised of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best specialized server fleet possible to our customers.
Why AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Mentorship and Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Diverse Experiences
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Basic Qualifications
Experience in developing functional specifications, design verification plans and functional test procedures
Experience in server technologies such as, thermal, mechanical, power, and signal integrity
Bachelor's degree or above in electrical engineering, computer engineering, or equivalent
5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience
5+ years of process development experience
Experience in English-language communication skills, both written and verbal
In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networking
Preferred Qualifications
Master's degree or above in electrical engineering, computer engineering, or equivalent
Experience working with interdisciplinary teams to execute product design from concept to production
10+ years of server, storage, networking, or large-scale distributed systems experience
Experience working with engineering and product teams to define a product and bring it to market
5+ years of data center engineering or operations experience
Experience in Linux/RHEL, or experience with programming/scripting (Batch, VB, PowerShell, Java, C#, Chef, Perl, Ruby and/or PHP) and experience that includes strong analytical skills, attention to detail, and effective communication abilities
Experience with server validation and issue root causing
Experience with leading hardware and software development engineering teams
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .
USA, CA, Cupertino - 183,000.00 - 247,600.00 USD annually
USA, TX, Austin - 159,200.00 - 215,300.00 USD annually
USA, WA, Seattle - 159,200.00 - 215,300.00 USD annually
$183k - $247.6k
...fleet of GPU-accelerated servers powering AI/ML training and inference at... ...architectures, drives the hardware designs, and owns the... ...seeking a Cloud Hardware Development Engineer to define server architectures... ...that enable high-performance AI training and inference...SeniorPerformanceLocal areaWorldwideFlexible hoursDay shift$131k - $175k
...awards, such as Best Engineering Team, Best Company... ...of quality and performance in everything we do... ...teams, including hardware, software, thermal... ...the world’s largest AI and cloud... ...power, cooling, into high-density GPU environments... ...or large-scale AI/ML cluster...SeniorPerformanceRemote workFlexible hours$183k - $247.6k
...operation of all AWS server instances. In other words... ...a diverse team of hardware engineers, software engineers,... ...manufacturing. You will perform PCIe component and... ...years' experience in high-volume manufacturing... ...yield, DPMO) including development of test metrics...SeniorPerformanceContract workLocal areaFlexible hours$171k - $325k
...combination of design, development, and fabrication... ...CPU IP Design Engineer. Responsible for Defining... ...of our latest AI-enabled RISC-V CPU... ...Features, Performance, Power, and Area.Essential... ...Vector CPUExplore high-performance... ...CPUExperience with Hardware multi-threading, virtualization...SeniorPerformanceFull timeLocal area$183k - $247.6k
...you’ll support the development and management of... ....We are seeking a Hardware Design Engineer with role in the definition... ...next generation ML Chips, Cards and server integration. As a... .... You’ll have high standards for... ...improve your products performance, quality and cost....SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...26AWS Compute & ML Services owns the... ...and all of the servers, storage, networking... ...of software, hardware, and network engineers, supply chain... ...industry-leading in performance, frugality and... ...architecturally sound, high-quality server... ...and support the development of automated...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...and operation of all AWS server instances. In other... ...join a diverse team of hardware engineers, software engineers, system... .... As a Senior Hardware Development Engineer on the AWS... ...multiple domains, including high speed interconnects, multi-core performant processors, and high-...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...next-generation server components. You will... ...architecture and development of components... ...and programmable hardware. You will interact... ...interdisciplinary team of engineers to design,... ...areas. You have high standards for yourself... ...ways to improve performance, quality, and...SeniorPerformanceLocal areaFlexible hours$175k - $225k
The AI infrastructure market... ...looking for a Sr. Technical Product... ....This is a high-impact, high-... ...working with engineering to define the... ...across hardware (NVIDIA Blackwell... ..., high-performance storage protocols... ...storage, or AI/ML... ...joint solution development, and partner-...SeniorPerformanceShift work$144k - $208k
...system-level test development, managing... ...Partner with design engineering teams to drive... ...updates and performance dashboards.Author... ...Author and maintain high-quality... ...generation of hardware experiences, delivering... ...Introduction (ML-NPI) team is... ...behind Google’s AI infrastructure,...SeniorPerformanceContract workWorldwide- ...experiences—from AI and data centers,... ...solutions that combine hardware and software into... ...credible with Engineering and TME; effective... ...executable plansA high ownership mindset... ...judgment in balancing performance, supportability,... ...infrastructureAI/ML platformsHPC systemsEnterprise...SeniorPerformance
- ...world's largest AI chip, 56 times... ...workloads with ultra high-speed inference... ...' Wafer-Scale Engine (WSE). We build... ..., high-performance kernel enablement... ...distributed systems, hardware architecture,... ...for ML model compilation... ...optimization as well as development of high-...SeniorPerformance
- ...computing experiences—from AI and data centers, to... ...:We are hiring AI / ML Platform Engineers to build the platform... ...AI Engineers, and hardware domain experts to... ...reproducibility, observability, performance, and developer... ...GPU clusters or high-performance ML infrastructure...SeniorPerformance
$152k - $241.5k
We are looking for outstanding Senior High Performance AI Engineers to build the next generation of agentic AI systems for the CUDA ecosystem. Our... ...with NVIDIA's libraries, runtimes, compilers, and hardware. You will collaborate closely with internal NVIDIA software...SeniorPerformanceFull timeRemote work$183k - $247.6k
...Services’ Network Products Development team is looking for experienced hardware engineering professionals to help... ...experience in high speed digital design as... ...centers and all of the servers, storage, networking,... ...continuously raising our performance bar as we strive to become...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...centers and all of the servers, storage, networking... ...team of software, hardware, and network engineers, supply chain... ...set the standards on performance, quality, cost, and... ...lead the design and development of server products utilizing... ...areas. You’ll have high standards for...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...Senior Hardware Development Engineer, AWS Mainstream Compute Job ID: 10417771 | Amazon Web Services... ...and developing compute and storage server products at scale, working closely with... ...partners to deliver reliable, high‑performance, and cost‑effective solutions. Key...SeniorPerformance$178.7k - $241.7k
...? Join the Data & AI Analytics team as... ...management team and the development engineers, is required to... ...a Sr. WW Specialist responsible... ...experience developing highly scalable programs... ...continuously raising our performance bar as we strive... ...limited to, AI/ML, GenAI, Analytics,...SeniorPerformanceLocal areaWorldwideFlexible hours$143.3k
...Networking and Outpost hardware team. We are a start-... ...in building high performant hardware used to run... ...drives changes back into development and builds mechanisms... ...computing.We aim to hire engineers who will thrive in a... ...development on top of your server design. You will be...SeniorPerformanceLocal areaFlexible hours$193.3k - $261.5k
...right moment. As AI models... ...looking for an engineer to work at the... ...of what the hardware allows. Get it... ...pieces of the high-speed... ...accelerators, servers, and heterogeneous... ...AWS's highest-performance network fabric... ....Prior AI/ML experience is... ...professional software development experience- 5...SeniorPerformanceInternshipLocal areaFlexible hours$140k - $215k
...world’s most advanced AI-native platform.... ...Data Science and Engineering to ensure our... ...delivery. It's a high-autonomy, high-visibility... ...cybersecurity, AI/ML, or emerging... ...metrics, classifier performance, and detection quality... ...development opportunities for...SeniorPerformanceFull timeWork experience placementWork at officeLocal areaShift work2 days per week3 days per week- ...millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one... .... Every day, our work helps care teams perform with greater precision and patients... ...generation robotic platforms. As a Senior AI/ML Research Engineer, you will develop and fine...SeniorPerformanceLocal areaWorldwideFlexible hours
$155k - $185k
...provider of advanced server, storage, and... ...passionate, and committed engineers, technologists,... ...leader for AI data center... ...infrastructure, and high performance networking products... ...key role in the development process of AI server... ...the boards. As a Sr. Hardware Design Engineer,...SeniorPerformanceContract workWork at officeWorldwide$193.3k - $261.5k
...Neuron, the software development kit used to... ...Neuron includes an ML compiler, runtime,... ...techniques, numerics, and high-performance kernels that these... ...— a true hardware and software co-design... ...the direction of AI acceleration technology... ..., and collectives engineers to land it. You...SeniorPerformanceInternshipLocal areaWork from homeFlexible hoursShift work$160k - $250k
...world’s most advanced AI-native platform. We work... ...experienced Software Development Engineer to join our AI... ...:Design and implement highly scalable microservices... ...productsDeep understanding of AI/ML security challenges,... ...scalable and performant Cloud Native Service experience...SeniorPerformanceFull timeWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$193.3k - $261.5k
..., the software development kit used to accelerate... ...and Trainium ML accelerators.... ...and training performance.The High-Performance... ...PyTorch till the hardware-software boundary, our engineers build systematic... ...'s possible in AI acceleration.As... ...Inferentia silicon and servers. Strong...SeniorPerformanceWork experience placementInternshipLocal areaFlexible hours$198k - $326k
...it will be performed both from home... ...LinkedIn's AI model... ...training, feature engineering and serving... ..., and hardware to harness... ...implement high performance... ...guide the development of containerized... ...of new ML models per... ...scale.As a Sr. Staff Software... ...and client-server architecturesExperience...SeniorPerformanceFor contractorsWork at officeFlexible hours- ...of supercomputing, high-performance computing, cloud, and AI. Whether you’re... ...s dynamic Systems Development team, where you’ll... ...bringing cutting-edge servers and switch... ...alongside experts across hardware, software, power,... ...functionally with internal engineering teams and external...Performance
$184k - $230k
...educational organizations.As a Sr. Staff Hardware Engineer, you will drive the design and development of next-generation... ...as part of a small, highly collaborative global... ...direct impact on the performance, reliability, and scalability... ...tools, including AI-based systems, to help...SeniorPerformanceContract workLocal areaWorldwide$152k - $241.5k
We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency... ...deliver efficiency in our usage of hardware, software, and infrastructure... ...equal opportunity employer. As we highly value diversity in our current and...SeniorPerformanceFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Hardware Development Engineer, High Performance AI & ML Servers. Be the first to apply!
- senior computer engineer Cupertino, CA
- hardware design engineer Cupertino, CA
- hardware engineer Cupertino, CA
- power electronics hardware engineer Cupertino, CA
- computer engineer Cupertino, CA
- hardware electronics engineer Cupertino, CA
- senior hardware engineer Cupertino, CA
- computer hardware engineer Cupertino, CA
- computer vision engineer Cupertino, CA
- product development engineer Cupertino, CA


