Lead HPC & AI Infrastructure Architect
Advanced Micro Devices , Inc.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture. Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.THE ROLE
We are seeking a Lead HPC & AI Infrastructure Architect to own the architecture and technical direction of large-scale CPU and GPU platforms across on-premises infrastructure, public cloud, and specialized GPU cloud providers. You will translate scientific computing, engineering, and AI requirements into secure, reliable, and cost-effective platforms for tightly coupled HPC workloads, distributed model training, and inference services. This hands-on leadership role spans design, workload validation, deployment, and lifecycle management. You will guide infrastructure engineering and SRE teams and partner with researchers, AI engineers, cloud providers, and hardware vendors to deliver production-ready platforms.THE PERSON
You combine deep systems expertise with practical architectural judgment. You take ownership of complex technical problems, validate decisions with measurable results, and communicate tradeoffs clearly. You collaborate across engineering, operations, security, and research teams; mentor engineers; and balance performance, reliability, security, delivery timelines, and cost. You can independently guide initiatives from requirements through production acceptance.KEY RESPONSIBILITIES
Own the HPC and AI infrastructure roadmap, reference architectures, and standards for CPU/GPU clusters. Define workload placement across bare metal, virtual machines, Slurm, and Kubernetes. Lead designs covering CPU/NUMA and GPU topology, accelerator interconnects, networking, storage, and identity. Establish validated hardware, firmware, driver, and runtime baselines. Architect RDMA-capable fabrics and storage tiers. Validate collective communication, parallel I/O, dataset delivery, and checkpoint performance at target scale. Design resource sharing through Slurm accounting, fair-share, quotas, QoS, preemption, and tenant isolation. Enable reproducible environments, self-service onboarding, and inference capacity planning. Standardize provisioning, configuration, and fleet upgrades through infrastructure as code, automation, and CI/CD; manage images, containers, and configuration drift. Define production acceptance criteria, service-level objectives, and fleet observability. Partner with SRE on fault isolation, job recovery, checkpoint/restart, incident analysis, and capacity planning. Benchmark HPC and distributed AI workloads; improve scaling efficiency, throughput, inference latency, GPU utilization, and cost efficiency through bottleneck analysis. Embed federated identity, least-privilege access, tenant and network isolation, secrets management, controlled container privileges, audit logging, and vulnerability management. Lead architecture reviews, proofs of concept, provider evaluations, and technical escalations. Document tradeoffs, mentor engineers, and align delivery with stakeholders and infrastructure partners.PREFERRED EXPERIENCE
Typically 10+ years in infrastructure, cloud engineering, or distributed systems, including 5+ years designing and delivering production HPC or GPU platforms; equivalent demonstrated experience is welcome. Ownership of large-scale cluster deployments involving hundreds of nodes or comparable complexity, with measurable improvements in workload performance, reliability, or cost. Deep expertise in a major cloud platform such as Azure, OCI, or AWS, with experience integrating cloud and on-premises systems. Familiarity with specialized GPU providers such as Crusoe or TensorWave. Strong Linux troubleshooting skills across CPU/NUMA topology, PCIe, GPU connectivity, drivers, virtualization, containers, and distributed runtime environments. Hands-on Slurm scheduling and resource governance, plus Kubernetes experience. Understanding of MPI, distributed training, collective communication, and AI inference infrastructure. AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting. HPC networking and storage, including RDMA, RoCE or InfiniBand, topology and oversubscription tradeoffs, parallel I/O, data placement, checkpointing, and enterprise connectivity. Parallel and shared storage technologies such as Lustre, IBM Storage Scale, BeeGFS, NFS, or VAST, and object storage; network, storage, and collective benchmarks for cluster acceptance. Terraform or equivalent infrastructure as code, Ansible or comparable configuration management, Python or Bash, and Git-based CI/CD. Familiarity with Azure CycleCloud or AWS ParallelCluster. Observability and SRE practices using tools such as Prometheus and Grafana, including secure access, resource controls, fault recovery, and production readiness. Experience establishing observability and SRE practices using tools such as Prometheus and Grafana, and designing security boundaries and resource controls for shared infrastructure. Ability to lead cross-functional technical work independently, communicate architecture tradeoffs clearly, and guide projects from requirements through production acceptance. Coordination with hardware and data center teams on rack power, liquid cooling, facility capacity, and other constraints affecting GPU platform design. Preferred qualifications Hands-on experience with AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting. Experience with Azure, OCI, Crusoe, or TensorWave GPU environments, and cluster provisioning frameworks such as Azure CycleCloud or AWS ParallelCluster. Experience with Lustre, IBM Storage Scale, BeeGFS, or VAST, plus network, storage, and collective communication benchmarks used for cluster acceptance. Experience with LLM serving platforms such as vLLM or SGLang, model parallelism, inference capacity planning, and usage accounting or cost allocation. Understanding of rack power, liquid cooling, and facility capacity constraints, with experience coordinating platform requirements with hardware and data center teams.ACADEMIC CREDENTIALS
Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience. This role is not eligible for visa sponsorship.#LI-RD1
Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy. #J-18808-Ljbffr Advanced Micro Devices , Inc.Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead HPC & AI Infrastructure Architect in Eastern, KY vacancy
- ...high-performance computing (HPC) and cloud infrastructure that supports its clients'... ...As an HPC Network Solutions Architect, you will design, integrate... ...form the backbone of HPC, AI/ML, and data-intensive workloads... ...EVPN, and VXLAN fabrics. Lead proof-of-concept and...SuggestedTemporary workFlexible hours
- NorthMark Strategies LLC in Dallas, TX is seeking an experienced HPC Network Solutions Architect to design, integrate, and optimize high-performance networking for HPC, AI/ML, and data-intensive workloads. You'll engage with customers across the solution lifecycle, from...Suggested
- ...while mentoring senior engineers and engaging exec-level stakeholders. The role emphasizes platform selection for routing, automation, telemetry, and AI-enabled network operations in a highly secure, FedRAMP-aware environment. #J-18808-Ljbffr CrowdStrike Holdings, Inc.SuggestedRemote job
- Diamondback Energy in Dallas, TX seeks a Lead Systems Administrator to guide the enterprise infrastructure architecture, design, and lifecycle management across on‑premises and cloud environments. You will drive security, governance, and modernization initiatives, mentor...Suggested
- F5 Networks, Inc. is seeking a Solutions Architect for BNK to lead architecture strategy for enterprise Kubernetes, AI workloads, and high-performance networking. You will collaborate with a Principal Account Executive to qualify opportunities and translate technical capabilities...Suggested
- ...they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but... ...who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks...Local area
- Motional AD Inc. is seeking a Principal Engineer, Data & ML Infrastructure to lead the Ground Truth Regression team’s data and model evaluation framework. You will drive large-scale data workflows, cloud orchestration, and ML metric development for autonomous driving perception...
- Prime Intellect is hiring a Customer Success professional to own onboarding and deployment for AI workloads on our frontier infrastructure. You will build trusted relationships with customer teams, manage issues and escalations, and partner with engineering and operations...
- ...Fidelity is seeking a Senior AI Technology Risk professional to shape enterprise AI governance and risk management. You will collaborate with risk, compliance, cybersecurity, and audit teams to assess AI architectures, data flows, model lifecycles, and control environments...
- ...control baselines across identity, data, endpoint, network, cloud and AI environments. This is a build role with architecture decisions that are binding and implemented with engineering teams. You will lead security design reviews, define data protection models, and...
- CDM Smith is seeking a Data and AI Solution Manager to join our Business Technology team. You will lead the development and execution of our enterprise AI platform, bridging business stakeholders, product users, technology teams and implementation partners to deliver measurable...
- ...will translate evolving regulations, including the EU Cyber Resilience Act, into control designs, collaborate with security, legal, and engineering teams, and drive remediation strategies to completion while shaping AI-first compliance processes. #J-18808-Ljbffr VulnU
- Cloudflare, Inc. is seeking a Deal Desk Manager to lead an AI-driven deal desk and transform how we structure, price, and close complex enterprise deals. You will guide non-standard transactions from scoping to execution, balancing competitive differentiation with long...
- ...guardrails, gates and audit evidence that ship in the platform, and you keep our public compliance claims honest. What you’ll do Map the EU AI Act, NIST AI RMF and ISO 42001 to enforceable product controls Define the evidence customers' auditors will ask for Own our...
$280k - $360k
About the Role At River AI, we are building an entirely new kind of AI company. As we... ...experienced IT leadership to ensure our technology infrastructure keeps pace with our growth. We are... ...secure, scalable infrastructure; lead the IT function; implement best-in-class...Monday to Friday- Micron Technology, Inc. in Boise, Idaho, seeks an Engineering Lead to supervise the Analytical Chemistry Lab, providing technical direction... .... You will lead a team, advance metrology, automation, data and AI-enabled solutions, manage instrument maintenance, method...
- ...platform across product catalog, pricing calculations, and downstream systems. You'll work with React frontend, Spring Boot microservices, AWS cloud, and AI-powered development, focusing on code quality, testing, observability, and high standards. #J-18808-Ljbffr BazetaRemote work
- ...governance-focused professional to translate regulatory frameworks into concrete product controls and verifiable claims. You will map EU AI Act and NIST AI RMF to enforceable safeguards, define auditor evidence, and own the compliance page for accuracy across the platform....
- ...Public Trust Job Description Summary The AI Lead will set the technical direction and... ...deployment, monitoring, and sustainment. Architect secure, scalable solutions across cloud... ..., financial services, energy, infrastructure, and national security markets. Built to...Temporary workFlexible hours
- Snowflake is seeking a Senior Technical Program Manager — ML/AI to own complex, cross-team ML/AI programs from scoping through launch. You will partner with ML engineers, researchers, product managers, and leaders to define roadmaps, surface dependencies, and build execution...
- Nightwing seeks a strong technical leader to guide LLM and neural network infrastructure across on‑prem, cloud, and API subscription deployments for a 300+ engineer organization. Applicants should bring 5+ years with LLMs and ML frameworks, 7+ years in vulnerability research...
- ...Security and Emerging Technology at Georgetown University seeks a leader to establish and guide a new CSET team focused on frontier AI capabilities, risks, compute, agents, and policy implications. The role blends research strategy, publications, policy briefings, and...
- Google in Sunnyvale, CA is seeking a Technical Program Manager to lead complex, multi-disciplinary programs across AI and Infrastructure. You will plan requirements, identify risks, and communicate with cross-functional partners while aligning with executives and engineers...
$100k - $130k
Center for Security and Emerging Technology, Georgetown University Lead a new CSET team studying frontier AI capabilities, risks, compute, agents, and policy implications. The role combines research strategy, publication, policy briefings, team leadership, and collaboration...- ...Corporation's Neuromorphic Computing Lab seeks a senior technical leader to shape the next generation runtime stack for neuromorphic AI at the edge. You will drive architecture from firmware to framework, delivering real-time performance and production-grade quality while...
- Appen seeks a Strategic Project Lead, Healthcare, to drive complex medical AI data programs from design to delivery in a fast-paced, global environment. You will bridge customer objectives, clinical expertise, and Appen's delivery capability, owning quality and direction...Remote job
- Ordinary Experts is seeking Technical Leads to drive architecture and implementation across cloud and AI engagements, working directly with clients on substantive engineering problems. You will shape delivery, mentor teams, and own release engineering practices with hands...
- ...report to the CEO and collaborate with Sales, Product, and Customer Experience to establish Qumis as the category leader in insurance AI. You will own two critical motions: PLG growth and scaling demand gen, while defining the growth strategy and executing campaigns,...
- Forward is seeking an Incident Management Lead to build an AI-assisted layer that detects issues before they become incidents and coordinates cross-functional response when they occur. You will own the governance between reactive resolution and proactive prevention, delivering...
- Neurophos is seeking an SoC Lead to own the integration of the full chip or major module for a bandwidth-challenging system. You will... ...top-level integration flows and collaborate with system architects, RTL, physical design, and verification leads to optimize tradeoffs...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead HPC & AI Infrastructure Architect. Be the first to apply!

