Sr Hardware Development Engineer, High Performance AI & ML Servers
A W S
Job TitleJoin the team building the foundation of the world's most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale.Here, you'll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you're passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what's next for AWS — and for the entire AI industry.You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.Key Job ResponsibilitiesLead technical solutions for complex high performance server and/or accelerator server and rack system architectural challengesOwn end-to-end system reliability, proactively identifying and resolving deficiencies before customer impactDesign and implement solutions to address system-level issues at large scaleDecompose complex server system problems (testability, reliability, diagnostics) into deliverable tasks and featuresApply expertise across hardware, software, system design, x86 architecture, processes, and operationsCollaborate with hardware, software, manufacturing, supply chain and product management teamsDevelop and implement diagnostic tools and monitoring solutions for production systemsDebug complex system failures in time sensitive settingsA Day in the LifeYour day to day responsibilities will include interfacing with our internal and external customers to understand project requirements and facilitate system development on top of your server design. You will be responsible for solving operational challenges to our existing fleet with the goal of improving the current customer experience as well as developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale.About the TeamThe team is comprised of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best specialized server fleet possible to our customers.Why AWSAmazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Inclusive Team CultureHere at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.Work/Life BalanceWe value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.Mentorship and Career GrowthWe're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.Diverse ExperiencesAmazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.Basic Qualifications- Experience in developing functional specifications, design verification plans and functional test procedures- Experience in server technologies such as, thermal, mechanical, power, and signal integrity- Bachelor's degree or above in electrical engineering, computer engineering, or equivalent- 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience- 5+ years of process development experience- Experience in English-language communication skills, both written and verbal- In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networkingPreferred Qualifications- Master's degree or above in electrical engineering, computer engineering, or equivalent- Experience working with interdisciplinary teams to execute product design from concept to production- 10+ years of server, storage, networking, or large-scale distributed systems experience- Experience working with engineering and product teams to define a product and bring it to market- 5+ years of data center engineering or operations experience- Experience in Linux/RHEL, or experience with programming/scripting (Batch, VB, PowerShell, Java, C#, Chef, Perl, Ruby and/or PHP) and experience that includes strong analytical skills, attention to detail, and effective communication abilities- Experience with server validation and issue root causing- Experience with leading hardware and software development engineering teams
- ...Sr Hardware Development Engineer, High Performance AI & ML Servers Do you want to shape the future of AI? Join the team building the foundation of the world's most advanced cloud for AI training and inference - where multi-billion-parameter models come to life at scale...SeniorPerformance
$173.9k - $235.2k
...of Generative AI at AWS? Join the... ...in AI/ML and HPC workloads... ...the limits of performance, efficiency, and... ...a diverse AWS Hardware Engineering team of software... ...baremetal server hardware up to... ...operations. Driving high quality and... ...professional software development experience ~...SeniorPerformanceInternshipLocal areaFlexible hours$183k - $247.6k
...Senior Hardware Development Engineer, Cloud AI/ML Server Team Job ID: 10517013 | Amazon Data Services, Inc. Application... ...The team is deeply technical and high-trust — you own platforms end to... ...specifications that enable high-performance AI training and inference at...SeniorPerformanceLocal areaWorldwideFlexible hoursDay shift- ...Systems Development EngineerAWS runs the world's largest fleet of AI/ML accelerator servers. When a model with billions of... ...the intersection of hardware, software, and... ...Systems Development Engineer to build automation... ...influencing functional and performance readiness of the...SeniorPerformancePermanent employment
- ...Amazon Web Services (AWS) is seeking a Hardware Design/System Engineer to shape next‑gen server platforms for AI and HPC at scale in Cupertino. You will design, build, and operate high‑performance infrastructure that powers AI training and inference workloads, collaborating...Performance
- ...Amazon Web Services, Inc. in Cupertino, California is seeking a Cloud Hardware Development Engineer to help design, build, and operate high-performance AI/ML server fleets at scale. You will partner with EC2 to define architectures and translate workload requirements...Performance
$131k - $175k
...awards, such as Best Engineering Team, Best Company... ...of quality and performance in everything we do... ...teams, including hardware, software, thermal... ...the world’s largest AI and cloud... ...power, cooling, into high-density GPU environments... ...or large-scale AI/ML cluster...SeniorPerformanceRemote workFlexible hours$169.8k - $254.6k
...Cloud System Hardware and Validation... ...and Validation Engineering develops cutting... ...rack level AI inference solutions... ...of cards, servers and networking... ...the design and development of rack-level... ...system-level performance goals.Resolve... ...experience in dense, high-layer count...SeniorPerformanceWork experience placementWork from home$100.6k
...Science, Electrical Engineering, Computer Engineering, and AI/ML students to join an AI Hardware Engineering internship... ...working within a highly technical team of researchers... ...developer tooling, performance libraries, reference... ..., compilers, kernel development, GPU programming,...PerformanceInternshipLocal areaImmediate startShift work$183k - $247.6k
...Sr Hardware Dev Engineer, OEM Solid State Drives Team Job... ...AWS Compute & ML Services owns the... ...centers and all of the servers, storage,... ...industry-leading in performance, frugality and operational... ...sound, high-quality server systems... ...and support the development of automated...SeniorPerformanceLocal area$183k - $247.6k
...operation of all AWS server instances. In other words... ...a diverse team of hardware engineers, software engineers,... ...manufacturing. You will perform PCIe component and... ...years' experience in high-volume manufacturing... ...yield, DPMO) including development of test metrics...SeniorPerformanceContract workLocal areaFlexible hours$183k - $247.6k
...Sr Hardware Development Engineer, AWS Board Core Design and Services Team Job ID:... ...will own next‑generation server components. You will have... ...technology areas. You have high standards for yourself and... ...looking for ways to improve performance, quality, and cost. At AWS...SeniorPerformanceLocal areaFlexible hours$171k - $325k
...combination of design, development, and fabrication... ...CPU IP Design Engineer. Responsible for Defining... ...of our latest AI-enabled RISC-V CPU... ...Features, Performance, Power, and Area.... ...Vector CPU Explore high-performance strategies... ...Experience with Hardware multi-threading, virtualization...SeniorPerformanceFull timeWork experience placementLocal area$194k - $349k
...world’s most advanced AI-native platform. We work... ...experienced Software Development Engineer to join our AI... ...Design and implement highly scalable microservices... ...reliability, accuracy and performance Conduct thorough code... ...Deep understanding of AI/ML security challenges,...SeniorPerformancePermanent employmentWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$179.5k - $260k
...Job TitleApplied AI EngineerJob DescriptionWe are... ...designed to power complex, high-stakes workflows. Our... ...looking for an Applied AI Engineer with strong backend and... ...build, and scale secure, performant systems. You'll work closely with product, AI/ML, and design teams to deliver...PerformanceFull timeWorldwideFlexible hoursNight shift$213k - $287.5k
....We are seeking a Hardware Design Engineer with role in the definition... ...next generation ML Chips, Cards and server integration. As a... .... You’ll have high standards for... ...improve your products performance, quality and cost.... ...of the product development cycle from concept...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...and operation of all AWS server instances. In other... ...join a diverse team of hardware engineers, software engineers, system... .... As a Senior Hardware Development Engineer on the AWS... ...multiple domains, including high speed interconnects, multi-core performant processors, and high-...SeniorPerformanceLocal areaFlexible hours$183k - $247.6k
...next-generation server components. You will... ...architecture and development of components... ...and programmable hardware. You will interact... ...interdisciplinary team of engineers to design,... ...areas. You have high standards for yourself... ...ways to improve performance, quality, and...SeniorPerformanceLocal areaFlexible hours$185.2k - $299.48k
...Inclusion. We weave AI into the fabric of... ...We are hiring AI Engineers at the Principal and... ...a data science or ML research role. You... ...datasets. Design cost and performance optimization... ...& Influence: Lead high-ambiguity, cross-team... ...Master's degree). Sr. Principal: 15+ years...SeniorPerformanceFull timeWork at office- ...core infrastructure technology for an AI powered, large scale, highly performant agentic search serving stack. This... ....We are looking for a seasoned Engineering Manager who will build and lead a team of backend infrastructure and ML engineers, own the technical roadmap...SeniorPerformance
- ...Director, Product Management – Hardware Engineering (AI Infrastructure)Lead the... ...platforms that power high-performance GPU, CPU, and storage clusters... ...platforms, including servers, networking, storage, power... ...availability or delivery.Lead the development and execution of end-to-...SeniorPerformance
$194k - $349k
...world’s most advanced AI-native platform. We work... ...on the endpoint, and performs rich correlation and... ...environments. This is a Sr. Engineering Manager role in the... ...major components and development projects as well as... ...minimizing costs, making sure high standards are being...SeniorPerformancePermanent employmentWork experience placementWork at officeLocal areaRemote work$183k - $247.6k
...Senior Hardware Development Engineer, AWS Mainstream Compute Job ID: 10417771 | Amazon Web Services... ...and developing compute and storage server products at scale, working closely with... ...partners to deliver reliable, high‑performance, and cost‑effective solutions. Key...SeniorPerformance- ...Services, Inc. in Cupertino is seeking a Senior Hardware Development Engineer to define server architectures for AI/ML workloads and drive validation from PCBA bring-up... ...power delivery, thermal/mechanical design, and high-speed interconnects, with a track record of end-...Senior
- ...AWS Hardware Engineering ServicesAWS Hardware Engineering Services... ...and all of the servers, storage, networking,... ...set the standards on performance, quality, cost, and operational... ...lead the design and development of server products... ...areas. You'll have high standards for...SeniorPerformance
- ...Palo Alto Networks is building a brand-new AIRS initiative focused on AI/ML infrastructure and high-performance distributed backends. You will lead architecture from the ground up as a senior technical leader, shaping scalable control planes and microservices in a hybrid...SeniorPerformance
$184.7k - $324.8k
...Machine Learning and AI Location: Cupertino... ...leveraging advanced AI/ML techniques to enhance both... ...We are seeking a highly innovative and passionate... ...deep expertise in prompt engineering, foundation model... ...autograders that assess product performance, user experience, and...SeniorPerformanceRelocation$152k - $241.5k
...is hiring software engineers for its GPU-... ...power a revolution in AI, enabling breakthroughs... ...team building a highly-performant AI inference... ...Contribute to feature development and drive broad customer... ...Triton Inference Server and NVIDIA Dynamo... ...systems and ML systems.Strong communication...SeniorPerformance$124.92k - $171.77k
...Sr. AI Engineer SiTime is seeking a hands-on Sr. AI Engineer to design... ...enterprise. This role will translate high-value business problems into... ...response, and ongoing performance and cost monitoring for AI services... ...3+ years building AI/ML or generative AI solutions....SeniorPerformance- ...world's largest AI chip, 56 times... ...workloads with ultra high-speed inference... ...' Wafer-Scale Engine (WSE). We build... ..., high-performance kernel enablement... ...distributed systems, hardware architecture,... ...for ML model compilation... ...optimization as well as development of high-...SeniorPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Hardware Development Engineer, High Performance AI & ML Servers. Be the first to apply!
- hardware design engineer Cupertino, CA
- hardware engineer Cupertino, CA
- computer engineer Cupertino, CA
- power electronics hardware engineer Cupertino, CA
- computer hardware engineer Cupertino, CA
- computer vision engineer Cupertino, CA
- senior hardware engineer Cupertino, CA
- digital hardware engineer Cupertino, CA
- senior computer engineer Cupertino, CA
- computer systems engineer Cupertino, CA





