Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Hardware Development Engineer, High Performance AI & ML Servers

A W S

Job Title

Join the team building the foundation of the world's most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale.

Here, you'll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you're passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what's next for AWS — and for the entire AI industry.

You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

Key Job Responsibilities

Lead technical solutions for complex high performance server and/or accelerator server and rack system architectural challenges

Own end-to-end system reliability, proactively identifying and resolving deficiencies before customer impact

Design and implement solutions to address system-level issues at large scale

Decompose complex server system problems (testability, reliability, diagnostics) into deliverable tasks and features

Apply expertise across hardware, software, system design, x86 architecture, processes, and operations

Collaborate with hardware, software, manufacturing, supply chain and product management teams

Develop and implement diagnostic tools and monitoring solutions for production systems

Debug complex system failures in time sensitive settings

A Day in the Life

Your day to day responsibilities will include interfacing with our internal and external customers to understand project requirements and facilitate system development on top of your server design. You will be responsible for solving operational challenges to our existing fleet with the goal of improving the current customer experience as well as developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale.

About the Team

The team is comprised of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best specialized server fleet possible to our customers.

Why AWS

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture

Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Work/Life Balance

We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Mentorship and Career Growth

We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Diverse Experiences

Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Basic Qualifications

- Experience in developing functional specifications, design verification plans and functional test procedures

- Experience in server technologies such as, thermal, mechanical, power, and signal integrity

- Bachelor's degree or above in electrical engineering, computer engineering, or equivalent

- 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience

- 5+ years of process development experience

- Experience in English-language communication skills, both written and verbal

- In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networking

Preferred Qualifications

- Master's degree or above in electrical engineering, computer engineering, or equivalent

- Experience working with interdisciplinary teams to execute product design from concept to production

- 10+ years of server, storage, networking, or large-scale distributed systems experience

- Experience working with engineering and product teams to define a product and bring it to market

- 5+ years of data center engineering or operations experience

- Experience in Linux/RHEL, or experience with programming/scripting (Batch, VB, PowerShell, Java, C#, Chef, Perl, Ruby and/or PHP) and experience that includes strong analytical skills, attention to detail, and effective communication abilities

- Experience with server validation and issue root causing

- Experience with leading hardware and software development engineering teams

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr Hardware Development Engineer, High Performance AI & ML Servers in Austin, TX vacancy
  • $173.9k - $235.2k

     ...experienced Senior Systems Development Engineer to lead the...  ...for our server platforms. You will...  ...and accelerated (AI/ML) compute fleet healthy...  ...a combination of hardware, software, system...  ...— driving high quality and reliability...  ...GPU subsystems- Perform root cause analysis... 
    Senior
    Performance
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  • $173.9k - $235.2k

     ...of Generative AI at AWS? Join the...  ...in AI/ML and HPC workloads...  ...the limits of performance, efficiency, and...  ...a diverse AWS Hardware Engineering team of software...  ...baremetal server hardware up to...  ...operations. Driving high quality and...  ...professional software development experience- 4+... 
    Senior
    Performance
    Internship
    Local area
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  • $173.9k - $235.2k

     ...centers and all of the servers, storage, networking...  ...Web Services (AWS) Hardware Engineering team creates compute...  ...the standards on performance, quality, cost, and...  ...We are looking for a Sr System Development Engineer, Mfg Bring...  ..., spanning compute, AI/GPU, networking, and... 
    Senior
    Performance
    Contract work
    Internship
    Local area
    Flexible hours

    Amazon

    Austin, TX
    18 hours ago
  • $183k - $247.6k

     ...operates a fleet of servers at the Edge,...  ...architectures, drives the hardware designs, and owns...  ...a Cloud Hardware Development Engineer to define server...  ...technical and high-trust — you own...  ...interconnect performance* Own hardware debug...  ...Engineering Edge & AI/ML Server platform... 
    Senior
    Performance
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    Austin, TX
    18 hours ago
  • $173.9k - $235.2k

     ...operates a fleet of servers at the Edge, powering...  ...the intersection of hardware, software, and scale...  ...are seeking a Systems Development Engineer to build automation software...  ...on x86 and ARM2. Perform root cause analysis...  ...Hardware Engineering Edge & AI/ML Server platform team... 
    Senior
    Performance
    Permanent employment
    Internship
    Local area
    Worldwide
    Flexible hours
    Night shift
    Day shift

    Amazon

    Austin, TX
    18 hours ago
  • $183k - $247.6k

     ...Next Generation of AI accelerator...  ...bleeding-edge HW development projects? Have you...  ...our own Silicon to Hardware to Software and deploy...  ...System Design Engineers to build the next...  ...of our cloud server infrastructure, Project...  ..., designed for high-performance AI training. As a... 
    Senior
    Performance
    Local area
    Flexible hours

    Amazon

    Austin, TX
    2 days ago
  • €54k - €68k per year

     ...without adding hardware, installing...  ...in performance and a decrease...  ...problem and the AI-native curiosity...  ...Hardware Engineering team helps research...  ...GPUs, servers and...  ...topologies, high-speed interconnects...  ...Experience with AI/ML frameworks (...  ...of kernel development, compiler... 
    Performance
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide
    Flexible hours

    Cloudflare_

    Austin, TX
    17 days ago
  • $159.2k - $215.3k

     ...the future of AI infrastructure!...  ...Manufacturing Test Engineering team developing...  ...acceleration hardware, deployed across our global server fleet.Annapurna...  ...breakthrough performance in cloud computing...  ..., Test Development Engineers, and...  ...deploying tests in high-volume manufacturing... 
    Senior
    Performance
    Flexible hours

    Amazon

    Austin, TX
    2 days ago
  • $171k - $325k

     ...combination of design, development, and fabrication...  ...CPU IP Design Engineer. Responsible for Defining...  ...of our latest AI-enabled RISC-V CPU...  ...Features, Performance, Power, and Area.Essential...  ...Vector CPUExplore high-performance...  ...CPUExperience with Hardware multi-threading, virtualization... 
    Senior
    Performance
    Full time
    Local area

    Globalfoundries

    Austin, TX
    3 days ago
  • $171k - $231.4k

     ...of GPU-accelerated servers powering AI/ML workloads at cloud scale...  ...— solving systemic hardware issues and building...  ...cross-functional engineering teams spanning hardware...  ...team is small and high-trust — you own programs...  ...with global development teams and ODM partners... 
    Senior
    Interim role
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    Austin, TX
    18 hours ago
  • $100k

     ...leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost...  ...of technologists have developed a high performance RISC-V CPU from scratch...  ...a BS, MS, or PhD in Electrical Engineering, Computer Engineering, or a related... 
    Senior
    Performance
    Permanent employment

    Tenstorrent

    Austin, TX
    3 days ago
  • $148.7k - $201.2k

     ...backbone of Generative AI cloud at AWS? Do...  ...price performance improvements in...  ...offerings that enable high performance and...  ...in AI/ML and HPC workloads...  ...like you.The AWS Hardware Engineering team creates server designs for Amazon...  ...drive the debug and development of next-generation... 
    Performance
    Internship
    Local area
    Flexible hours

    Amazon

    Austin, TX
    5 days ago
  • $183k - $247.6k

     ...centers and all of the servers, storage, networking...  ...team of software, hardware, and network engineers, supply chain...  ...set the standards on performance, quality, cost, and...  ...lead the design and development of server products utilizing...  ...areas. You’ll have high standards for... 
    Senior
    Performance
    Local area
    Flexible hours

    Amazon

    Austin, TX
    3 days ago
  • $178.4k - $267.6k

     ...Technologies, Inc.Job Area:Engineering Group,...  ...EngineeringGeneral Summary:AI Performance Engineer (Cloud...  ...is developing hardware and software...  ...edge research and development to commercial deployment...  ...and implement high-level kernels, e....  ...architecture, ML accelerators, in-... 
    Senior
    Performance
    Work experience placement
    Work from home

    Qualcomm

    Austin, TX
    5 days ago
  • $156.8k - $255.3k

     ...across the globe. AI is creating new possibilities...  ...’re looking for a Sr. Member of...  ...systems while meeting high standards for reliability, security, performance, and customer trust...  ...to customer needs, engineering priorities, and...  ...architecting and shipping AI/ML or Generative AI... 
    Senior
    Performance
    Work at office
    Immediate start
    Remote work
    Visa sponsorship

    eBay

    Austin, TX
    4 days ago
  • $210k - $272k

     ...832Category: Systems Development EngineeringLocation:...  ...design and develop the hardware and software that...  ...how work gets done. Engineers define intent, author...  ...specifications, and orchestrate AI agents that execute...  ...a collaborative, high-performance engineering culture.... 
    Senior
    Performance

    Dell Technologies

    Round Rock, TX
    2 days ago
  • $172k - $202.5k

     ...Gartner’s CIO and AI Leader group is seeking...  ...(e.g., AI/ML, quantum, blockchain...  ...management.Deliver high-impact presentations...  ...Security, Engineering, or related discipline...  ...continuous professional development.Competitive...  ...your passion and performance.We hire remarkable... 
    Senior
    Performance
    Full time
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Gartner

    Austin, TX
    5 days ago
  • $183k - $247.6k

    The Annapurna AI Manufacturing, Quality...  ...Reliability Engineer you will engage...  ...engineers. * Perform Reliability...  ...products under development and products in...  ...custom silicon and servers including the...  ...software, firmware, hardware, and silicon...  ...or on high-tech hardwarePreferred... 
    Senior
    Work experience placement
    Local area
    Flexible hours

    Amazon

    Austin, TX
    4 days ago
  •  ...DescriptionThe RoleThe AI Quality and...  ...Software Engineer, you will be responsible...  ...Product Development engineering teams...  ...data quality, performance, and...  ...(DBX), and AI/ML integrations within...  ...Quality teams.Write high-quality, performant...  ...(e.g., SQL Server, Oracle, PostgreSQL... 
    Senior
    Performance
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Austin, TX
    4 days ago
  • $110.7k - $171.8k

     ...DescriptionSoftware Development Engineers are expert problem...  ...tools (including AI-assisted...  ...secure, scalable, and high-quality technology...  ...observability, and performance.AI & Agentic SystemsDesign...  ...Protocol) tool servers that expose...  ...equivalent) for AI/ML service deployments... 
    Senior
    Performance
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area

    Visa

    Austin, TX
    5 days ago
  •  ...scientific discovery to powering AI and the technologies...  ...career.SENIOR PRODUCT DEVELOPMENT ENGINEER THE ROLE:The Product Development...  ...(AI), Machine Learning (ML), and High-Performance Computing (HPC)...  ...the manufacturing of GPU hardware and knowledge of AI, ML, and... 
    Senior
    Performance

    AMD

    Austin, TX
    2 days ago
  • $160k - $250k

     ...world’s most advanced AI-native platform. We work...  ...on the endpoint, and performs rich correlation and...  ...environments.This is a Sr. Engineering Manager role in the CTIO...  ...major components and development projects as well as...  ...minimizing costs, making sure high standards are being... 
    Senior
    Performance
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    Austin, TX
    2 days ago
  •  ...directly to consumer hardware without removing...  ...Overview:As a Staff R&D AI Engineer, you will lead the development of cutting-edge AI...  ...and validate performance across domainsOptimize...  ...of experience in AI/ML engineering with 4+...  ...packageIncluding a high-deductible HSA... 
    Performance
    Temporary work
    Live out
    Work at office
    Local area
    Flexible hours

    webAI

    Austin, TX
    5 days ago
  •  ...part of the Software Engineering Department supporting innovative system development initiatives. The ideal...  ...scalable, resilient, and high-performance Java-based...  ...Implement and optimize AI-assisted development workflows...  ...Practical knowledge of AI/ML implementation, Large... 
    Senior
    Performance

    Experis

    Austin, TX
    4 days ago
  • $198k - $247k

     ...We blend design, product engineering, analytics, automation, and AI-native delivery to build...  ...scale. As an AI/ML Architect, you’ll design...  ...programs.* Drive business development through proposals, executive...  ...lead, mentor, and retain a high-performing, inclusive team of AI/ML... 
    Senior
    Performance
    Temporary work
    Local area

    Slalom

    Austin, TX
    18 hours ago
  •  ...concurrent workstreams spanning AI/ML, data platform modernization...  ..., and data architecture and engineering, paired with distinctive...  ...Transformation: Drive AI-DLC (AI-Driven Development Life Cycle) methodologies...  ...re continuously raising our performance bar as we strive to become... 
    Senior
    Performance

    AWS

    Austin, TX
    1 day ago
  •  ...of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing...  ...build world-class engineering teams, and drive...  ...and influence hardware, firmware, runtime,...  ...strategies, and career development programs.Foster a...  ...understanding of AI/ML frameworks, inference... 
    Senior
    Performance

    AMD

    Austin, TX
    1 day ago
  •  ...review procedures.This role performs direct supervisory...  ...partners closely with AI Model Supervision, Compliance...  ...standards, and high-quality review execution...  ...Exam ReadinessSupport development and refinement of supervisory...  ...understanding of AI/ML or other model-enabled... 
    Senior
    Performance
    Full time
    Work at office
    Work from home
    Relocation
    Monday to Friday

    The Charles Schwab Corporation

    Austin, TX
    3 days ago
  • $184k - $287.5k

     ...the unlimited potential of AI to define the next era of...  ...customer workloads to NVIDIA's hardware and software ecosystem,...  ...internal product and engineering priorities.Lead technical...  ...Deep technical expertise in high-performance computing, AI/ML, data center infrastructure... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Austin, TX
    4 days ago
  • $224k - $356.5k

     ...group is solving some of AI’s hardest...  ...transport optimization, hardware-software co-design, and...  ...research and production engineering!What you will be doing...  ...Architecting and implementing high-performance communication and...  ...debugging.Understanding of ML systems concepts—... 
    Senior
    Performance
    Full time

    Nvidia

    Austin, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Hardware Development Engineer, High Performance AI & ML Servers. Be the first to apply!