Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Hardware Development Engineer, High Performance AI & ML Servers

A W S

Job TitleJoin the team building the foundation of the world's most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale.Here, you'll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you're passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what's next for AWS — and for the entire AI industry.You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.Key Job ResponsibilitiesLead technical solutions for complex high performance server and/or accelerator server and rack system architectural challengesOwn end-to-end system reliability, proactively identifying and resolving deficiencies before customer impactDesign and implement solutions to address system-level issues at large scaleDecompose complex server system problems (testability, reliability, diagnostics) into deliverable tasks and featuresApply expertise across hardware, software, system design, x86 architecture, processes, and operationsCollaborate with hardware, software, manufacturing, supply chain and product management teamsDevelop and implement diagnostic tools and monitoring solutions for production systemsDebug complex system failures in time sensitive settingsA Day in the LifeYour day to day responsibilities will include interfacing with our internal and external customers to understand project requirements and facilitate system development on top of your server design. You will be responsible for solving operational challenges to our existing fleet with the goal of improving the current customer experience as well as developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale.About the TeamThe team is comprised of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best specialized server fleet possible to our customers.Why AWSAmazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Inclusive Team CultureHere at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.Work/Life BalanceWe value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.Mentorship and Career GrowthWe're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.Diverse ExperiencesAmazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.Basic Qualifications- Experience in developing functional specifications, design verification plans and functional test procedures- Experience in server technologies such as, thermal, mechanical, power, and signal integrity- Bachelor's degree or above in electrical engineering, computer engineering, or equivalent- 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience- 5+ years of process development experience- Experience in English-language communication skills, both written and verbal- In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networkingPreferred Qualifications- Master's degree or above in electrical engineering, computer engineering, or equivalent- Experience working with interdisciplinary teams to execute product design from concept to production- 10+ years of server, storage, networking, or large-scale distributed systems experience- Experience working with engineering and product teams to define a product and bring it to market- 5+ years of data center engineering or operations experience- Experience in Linux/RHEL, or experience with programming/scripting (Batch, VB, PowerShell, Java, C#, Chef, Perl, Ruby and/or PHP) and experience that includes strong analytical skills, attention to detail, and effective communication abilities- Experience with server validation and issue root causing- Experience with leading hardware and software development engineering teams

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Sr Hardware Development Engineer, High Performance AI & ML Servers in Cupertino, CA vacancy
  •  ...Sr Hardware Development Engineer, High Performance AI & ML Servers Do you want to shape the future of AI? Join the team building the foundation of the world's most advanced cloud for AI training and inference - where multi-billion-parameter models come to life at scale... 
    Senior
    Performance

    Alternance Amazon

    Cupertino, CA
    2 days ago
  • $173.9k - $235.2k

     ...of Generative AI at AWS? Join the...  ...in AI/ML and HPC workloads...  ...the limits of performance, efficiency, and...  ...a diverse AWS Hardware Engineering team of software...  ...baremetal server hardware up to...  ...operations. Driving high quality and...  ...professional software development experience ~... 
    Senior
    Performance
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $183k - $247.6k

     ...Senior Hardware Development Engineer, Cloud AI/ML Server Team Job ID: 10517013 | Amazon Data Services, Inc. Application...  ...The team is deeply technical and high-trust — you own platforms end to...  ...specifications that enable high-performance AI training and inference at... 
    Senior
    Performance
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon Inc.

    Cupertino, CA
    1 day ago
  •  ...Systems Development EngineerAWS runs the world's largest fleet of AI/ML accelerator servers. When a model with billions of...  ...the intersection of hardware, software, and...  ...Systems Development Engineer to build automation...  ...influencing functional and performance readiness of the... 
    Senior
    Performance
    Permanent employment

    A W S

    Cupertino, CA
    3 days ago
  •  ...Amazon Web Services (AWS) is seeking a Hardware Design/System Engineer to shape next‑gen server platforms for AI and HPC at scale in Cupertino. You will design, build, and operate high‑performance infrastructure that powers AI training and inference workloads, collaborating... 
    Performance

    Amazon

    Cupertino, CA
    5 days ago
  •  ...Amazon Web Services, Inc. in Cupertino, California is seeking a Cloud Hardware Development Engineer to help design, build, and operate high-performance AI/ML server fleets at scale. You will partner with EC2 to define architectures and translate workload requirements... 
    Performance

    Amazon

    Cupertino, CA
    4 days ago
  • $131k - $175k

     ...awards, such as Best Engineering Team, Best Company...  ...of quality and performance in everything we do...  ...teams, including hardware, software, thermal...  ...the world’s largest AI and cloud...  ...power, cooling, into high-density GPU environments...  ...or large-scale AI/ML cluster... 
    Senior
    Performance
    Remote work
    Flexible hours

    Arista Networks

    Santa Clara, CA
    2 days ago
  • $169.8k - $254.6k

     ...Cloud System Hardware and Validation...  ...and Validation Engineering develops cutting...  ...rack level AI inference solutions...  ...of cards, servers and networking...  ...the design and development of rack-level...  ...system-level performance goals.Resolve...  ...experience in dense, high-layer count... 
    Senior
    Performance
    Work experience placement
    Work from home

    Qualcomm

    Santa Clara, CA
    3 days ago
  • $100.6k

     ...Science, Electrical Engineering, Computer Engineering, and AI/ML students to join an AI Hardware Engineering internship...  ...working within a highly technical team of researchers...  ...developer tooling, performance libraries, reference...  ..., compilers, kernel development, GPU programming,... 
    Performance
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    4 days ago
  • $183k - $247.6k

     ...Sr Hardware Dev Engineer, OEM Solid State Drives Team Job...  ...AWS Compute & ML Services owns the...  ...centers and all of the servers, storage,...  ...industry-leading in performance, frugality and operational...  ...sound, high-quality server systems...  ...and support the development of automated... 
    Senior
    Performance
    Local area

    Amazon

    Cupertino, CA
    1 day ago
  • $183k - $247.6k

     ...operation of all AWS server instances. In other words...  ...a diverse team of hardware engineers, software engineers,...  ...manufacturing. You will perform PCIe component and...  ...years' experience in high-volume manufacturing...  ...yield, DPMO) including development of test metrics... 
    Senior
    Performance
    Contract work
    Local area
    Flexible hours

    AmazonWebServices

    Cupertino, CA
    4 days ago
  • $183k - $247.6k

     ...Sr Hardware Development Engineer, AWS Board Core Design and Services Team Job ID:...  ...will own next‑generation server components. You will have...  ...technology areas. You have high standards for yourself and...  ...looking for ways to improve performance, quality, and cost. At AWS... 
    Senior
    Performance
    Local area
    Flexible hours

    Amazon Inc.

    Cupertino, CA
    1 day ago
  • $171k - $325k

     ...combination of design, development, and fabrication...  ...CPU IP Design Engineer. Responsible for Defining...  ...of our latest AI-enabled RISC-V CPU...  ...Features, Performance, Power, and Area....  ...Vector CPU Explore high-performance strategies...  ...Experience with Hardware multi-threading, virtualization... 
    Senior
    Performance
    Full time
    Work experience placement
    Local area

    GLOBALFOUNDRIES

    Santa Clara, CA
    5 days ago
  • $194k - $349k

     ...world’s most advanced AI-native platform. We work...  ...experienced Software Development Engineer to join our AI...  ...Design and implement highly scalable microservices...  ...reliability, accuracy and performance Conduct thorough code...  ...Deep understanding of AI/ML security challenges,... 
    Senior
    Performance
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    23 days ago
  • $179.5k - $260k

     ...Job TitleApplied AI EngineerJob DescriptionWe are...  ...designed to power complex, high-stakes workflows. Our...  ...looking for an Applied AI Engineer with strong backend and...  ...build, and scale secure, performant systems. You'll work closely with product, AI/ML, and design teams to deliver... 
    Performance
    Full time
    Worldwide
    Flexible hours
    Night shift

    Edelman

    Sunnyvale, CA
    5 days ago
  • $213k - $287.5k

     ....We are seeking a Hardware Design Engineer with role in the definition...  ...next generation ML Chips, Cards and server integration. As a...  .... You’ll have high standards for...  ...improve your products performance, quality and cost....  ...of the product development cycle from concept... 
    Senior
    Performance
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    17 hours ago
  • $183k - $247.6k

     ...and operation of all AWS server instances. In other...  ...join a diverse team of hardware engineers, software engineers, system...  .... As a Senior Hardware Development Engineer on the AWS...  ...multiple domains, including high speed interconnects, multi-core performant processors, and high-... 
    Senior
    Performance
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $183k - $247.6k

     ...next-generation server components. You will...  ...architecture and development of components...  ...and programmable hardware. You will interact...  ...interdisciplinary team of engineers to design,...  ...areas. You have high standards for yourself...  ...ways to improve performance, quality, and... 
    Senior
    Performance
    Local area
    Flexible hours

    AmazonWebServices

    Cupertino, CA
    5 days ago
  • $185.2k - $299.48k

     ...Inclusion. We weave AI into the fabric of...  ...We are hiring AI Engineers at the Principal and...  ...a data science or ML research role. You...  ...datasets. Design cost and performance optimization...  ...& Influence: Lead high-ambiguity, cross-team...  ...Master's degree). Sr. Principal: 15+ years... 
    Senior
    Performance
    Full time
    Work at office

    Palo Alto Networks, Inc.

    Santa Clara, CA
    1 day ago
  •  ...core infrastructure technology for an AI powered, large scale, highly performant agentic search serving stack. This...  ....We are looking for a seasoned Engineering Manager who will build and lead a team of backend infrastructure and ML engineers, own the technical roadmap... 
    Senior
    Performance

    Apple

    Santa Clara, CA
    2 days ago
  •  ...Director, Product Management – Hardware Engineering (AI Infrastructure)Lead the...  ...platforms that power high-performance GPU, CPU, and storage clusters...  ...platforms, including servers, networking, storage, power...  ...availability or delivery.Lead the development and execution of end-to-... 
    Senior
    Performance

    Hackajob

    Santa Clara, CA
    3 days ago
  • $194k - $349k

     ...world’s most advanced AI-native platform. We work...  ...on the endpoint, and performs rich correlation and...  ...environments. This is a Sr. Engineering Manager role in the...  ...major components and development projects as well as...  ...minimizing costs, making sure high standards are being... 
    Senior
    Performance
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Sunnyvale, CA
    22 days ago
  • $183k - $247.6k

     ...Senior Hardware Development Engineer, AWS Mainstream Compute Job ID: 10417771 | Amazon Web Services...  ...and developing compute and storage server products at scale, working closely with...  ...partners to deliver reliable, high‑performance, and cost‑effective solutions. Key... 
    Senior
    Performance

    Amazon

    Cupertino, CA
    1 day ago
  •  ...Services, Inc. in Cupertino is seeking a Senior Hardware Development Engineer to define server architectures for AI/ML workloads and drive validation from PCBA bring-up...  ...power delivery, thermal/mechanical design, and high-speed interconnects, with a track record of end-... 
    Senior

    Amazon

    Cupertino, CA
    3 days ago
  •  ...AWS Hardware Engineering ServicesAWS Hardware Engineering Services...  ...and all of the servers, storage, networking,...  ...set the standards on performance, quality, cost, and operational...  ...lead the design and development of server products...  ...areas. You'll have high standards for... 
    Senior
    Performance

    A W S

    Cupertino, CA
    5 days ago
  •  ...Palo Alto Networks is building a brand-new AIRS initiative focused on AI/ML infrastructure and high-performance distributed backends. You will lead architecture from the ground up as a senior technical leader, shaping scalable control planes and microservices in a hybrid... 
    Senior
    Performance

    Palo Alto Networks

    Santa Clara, CA
    2 days ago
  • $184.7k - $324.8k

     ...Machine Learning and AI Location: Cupertino...  ...leveraging advanced AI/ML techniques to enhance both...  ...We are seeking a highly innovative and passionate...  ...deep expertise in prompt engineering, foundation model...  ...autograders that assess product performance, user experience, and... 
    Senior
    Performance
    Relocation

    Apple

    Cupertino, CA
    5 days ago
  • $152k - $241.5k

     ...is hiring software engineers for its GPU-...  ...power a revolution in AI, enabling breakthroughs...  ...team building a highly-performant AI inference...  ...Contribute to feature development and drive broad customer...  ...Triton Inference Server and NVIDIA Dynamo...  ...systems and ML systems.Strong communication... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $124.92k - $171.77k

     ...Sr. AI Engineer SiTime is seeking a hands-on Sr. AI Engineer to design...  ...enterprise. This role will translate high-value business problems into...  ...response, and ongoing performance and cost monitoring for AI services...  ...3+ years building AI/ML or generative AI solutions.... 
    Senior
    Performance

    SiTime

    Santa Clara, CA
    4 days ago
  •  ...world's largest AI chip, 56 times...  ...workloads with ultra high-speed inference...  ...' Wafer-Scale Engine (WSE). We build...  ..., high-performance kernel enablement...  ...distributed systems, hardware architecture,...  ...for ML model compilation...  ...optimization as well as development of high-... 
    Senior
    Performance

    Cerebras Systems

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Hardware Development Engineer, High Performance AI & ML Servers. Be the first to apply!