Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead HPC & AI Infrastructure Architect

Advanced Micro Devices , Inc.

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMDis shapingthefuture. Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career. THE ROLE We are seeking a Lead HPC & AI Infrastructure Architect to own the architecture and technical direction of large-scale CPU and GPU platforms across on-premises infrastructure, public cloud, and specialized GPU cloud providers. You will translate scientific computing, engineering, and AI requirements into secure, reliable, and cost-effective platforms for tightly coupled HPC workloads, distributed model training, and inference services. This hands-on leadership role spans design, workload validation, deployment, and lifecycle management. You will guide infrastructure engineering and SRE teams and partner with researchers, AI engineers, cloud providers, and hardware vendors to deliver production-ready platforms. THE PERSON You combine deep systems expertise with practical architectural judgment. You take ownership of complex technical problems, validate decisions with measurable results, and communicate tradeoffs clearly. You collaborate across engineering, operations, security, and research teams; mentor engineers; and balance performance, reliability, security, delivery timelines, and cost. You can independently guide initiatives from requirements through production acceptance. KEY RESPONSIBILITIES Own the HPC and AI infrastructure roadmap, reference architectures, and standards for CPU/GPU clusters. Define workload placement across bare metal, virtual machines, Slurm, and Kubernetes. Lead designs covering CPU/NUMA and GPU topology, accelerator interconnects, networking, storage, and identity. Establish validated hardware, firmware, driver, and runtime baselines. Architect RDMA-capable fabrics and storage tiers. Validate collective communication, parallel I/O, dataset delivery, and checkpoint performance at target scale. Design resource sharing through Slurm accounting, fair-share, quotas, QoS, preemption, and tenant isolation. Enable reproducible environments, self-service onboarding, and inference capacity planning. Standardize provisioning, configuration, and fleet upgrades through infrastructure as code, automation, and CI/CD; manage images, containers, and configuration drift. Define production acceptance criteria, service-level objectives, and fleet observability. Partner with SRE on fault isolation, job recovery, checkpoint/restart, incident analysis, and capacity planning. Benchmark HPC and distributed AI workloads; improve scaling efficiency, throughput, inference latency, GPU utilization, and cost efficiency through bottleneck analysis. Embed federated identity, least-privilege access, tenant and network isolation, secrets management, controlled container privileges, audit logging, and vulnerability management. Lead architecture reviews, proofs of concept, provider evaluations, and technical escalations. Document tradeoffs, mentor engineers, and align delivery with stakeholders and infrastructure partners. PREFERRED EXPERIENCE Typically 10+ years in infrastructure, cloud engineering, or distributed systems, including 5+ years designing and delivering production HPC or GPU platforms; equivalent demonstrated experience is welcome. Ownership of large-scale cluster deployments involving hundreds of nodes or comparable complexity, with measurable improvements in workload performance, reliability, or cost. Deep expertise in a major cloud platform such as Azure, OCI, or AWS, with experience integrating cloud and on-premises systems. Familiarity with specialized GPU providers such as Crusoe or TensorWave. Strong Linux troubleshooting skills across CPU/NUMA topology, PCIe, GPU connectivity, drivers, virtualization, containers, and distributed runtime environments. Hands-on Slurm scheduling and resource governance, plus Kubernetes experience. Understanding of MPI, distributed training, collective communication, and AI inference infrastructure. AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting. HPC networking and storage, including RDMA, RoCE or InfiniBand, topology and oversubscription tradeoffs, parallel I/O, data placement, checkpointing, and enterprise connectivity. Parallel and shared storage technologies such as Lustre, IBM Storage Scale, BeeGFS, NFS, or VAST, and object storage; network, storage, and collective benchmarks for cluster acceptance. Terraform or equivalent infrastructure as code, Ansible or comparable configuration management, Python or Bash, and Git-based CI/CD. Familiarity with Azure CycleCloud or AWS ParallelCluster. Observability and SRE practices using tools such as Prometheus and Grafana, including secure access, resource controls, fault recovery, and production readiness. Experience establishing observability and SRE practices using tools such as Prometheus and Grafana, and designing security boundaries and resource controls for shared infrastructure. Ability to lead cross-functional technical work independently, communicate architecture tradeoffs clearly, and guide projects from requirements through production acceptance. Coordination with hardware and data center teams on rack power, liquid cooling, facility capacity, and other constraints affecting GPU platform design. Preferred qualifications Hands-on experience with AMD Instinct GPUs, ROCm, RCCL, and multi-node PyTorch workloads, including compatibility validation and performance troubleshooting. Experience with Azure, OCI, Crusoe, or TensorWave GPU environments, and cluster provisioning frameworks such as Azure CycleCloud or AWS ParallelCluster. Experience with Lustre, IBM Storage Scale, BeeGFS, or VAST, plus network, storage, and collective communication benchmarks used for cluster acceptance. Experience with LLM serving platforms such as vLLM or SGLang, model parallelism, inference capacity planning, and usage accounting or cost allocation. Understanding of rack power, liquid cooling, and facility capacity constraints, with experience coordinating platform requirements with hardware and data center teams. ACADEMIC CREDENTIALS Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience. This role is not eligible for visa sponsorship. #LI-RD1 Benefits offered are described: AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy. #J-18808-Ljbffr Advanced Micro Devices , Inc.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead HPC & AI Infrastructure Architect in Brooklyn, NY vacancy
  • $85 - $140 per hour

     ...your Hyper V experienceLooking for an Infrastructure Engineer/Architect to design and engineer enterprise-...  ...SLOs and SLAs; track and reduce events leading to errors or risks.Cross-Functional Collaborate...  ...capacity planning teams. Leverage AI-assisted tooling for research,... 
    Suggested
    Contract work
    Temporary work
    Remote work

    TEKsystems

    Jersey City, NJ
    3 days ago
  •  ...they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but...  ...who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks... 
    Suggested
    Local area

    Fluidstack

    Brooklyn, NY
    4 days ago
  •  ...Financial Group (MUFG), one of the world’s leading financial groups. Across the globe,...  ...a talented and experienced Modern Infrastructure and Security Architect, Vice President who is collaborative...  ...of emerging technologies, including AI‑enabled capabilities and intelligent... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work

    MUFG

    Jersey City, NJ
    2 days ago
  •  ...Compute is seeking a Sales Engineer to bridge AI hardware capabilities with customer objectives, translating workloads into infrastructure configurations and proving our GPUaaS...  ...reliability, and cost-efficiency. You will lead technical sales efforts, review BOMs, develop... 
    Suggested

    Alpha Compute Corp.

    Brooklyn, NY
    18 hours ago
  • $176.72k - $265.08k

     ...65,080.00Category: Technology, Infrastructure, ProfessionalCompany: CitiAbout Citi:Citi, the leading global bank, has approximately...  ...progress together.The Role:The AI Strategic Partnerships Lead sits...  ...with Project Managers, enterprise architects, and engineering teams to... 
    Suggested
    Full time

    Citigroup

    Jersey City, NJ
    18 hours ago
  • $198.9k - $357.9k

     ...As a Global Microsoft Presales Leader for AI Business Solutions, you will play a...  ...deals. This role is focused on defining and leading global presales strategy, establishing best...  ...sales teams and regional stakeholders to architect compelling solutions, strengthen EY’s value... 
    Summer holiday
    Local area
    Immediate start
    Flexible hours

    EY (Ernst & Young)

    Hoboken, NJ
    3 days ago
  •  ...to define the architecture for, and deliver, production agentic AI solutions across our software portfolio. You will build critical...  ...leadership. 10+ years in software engineering, including 4+ years leading AI and agentic architecture or technical delivery across... 
    Work at office

    Verisk Analytics

    Jersey City, NJ
    18 hours ago
  • $141k - $278k

     ...Summary Salesforce Life Sciences Lead Technical ArchitectOur Deloitte Sales & Service...  ..., advanced analytics, Generative AI, transformative technologies, and creative...  ...operators, creatives, designers, engineers, and architects. Our team balances business strategy,... 
    Work experience placement
    Local area

    Deloitte

    Jersey City, NJ
    3 days ago
  • $188.6k - $339.4k

     ...provide speed to market and business value.The opportunityAs an Associate Director in Information Security, this position leads the application of AI engineering within a global technology program, working closely with program leadership, workstream leads and... 
    Work experience placement
    Summer holiday
    Local area
    Immediate start
    Flexible hours

    EY (Ernst & Young)

    Hoboken, NJ
    1 day ago
  •  ...or Washington, DC Our client, an industry leader in applied AI, has an excellent opportunity for a Network Support Engineer to...  ...connectivity, troubleshoot end-user network issues, and support office infrastructure initiatives. The role requires hands-on execution, experience... 
    Work at office

    Eliassen Group

    Jersey City, NJ
    1 day ago
  • $167.1k - $300.9k

     ...Associate Director, Collibra Solution Architect & Platform Lead, you will serve as the CBS Data...  ...requires a good working knowledge of the IT infrastructure within EY but more importantly a...  ...in capital markets.Enabled by data, AI and advanced technology, EY teams help... 
    Summer holiday
    Work at office
    Local area
    Immediate start
    Flexible hours

    EY (Ernst & Young)

    Hoboken, NJ
    4 days ago
  •  ...JPMorgan Chase & Co. is seeking a Senior Associate – AI Solutions Enablement within the CAO Chief Data and Analytics Office. You will lead enablement and PMO for the AI Solutions portfolio, directing select high-priority AI initiatives and ensuring disciplined execution... 
    Work at office

    Jobleads-US

    Jersey City, NJ
    18 hours ago
  •  ...Build what’s next in enterprise AI—solutions that materially improve how teams make decisions, automate work, and serve internal customers...  ...Corporate Functions. As an Applied AI and Machine Learning Lead at JPMorganChase within Corporate Technology Data Science and AI... 

    Jobleads-US

    Jersey City, NJ
    4 days ago
  •  ...JPMorgan Chase & Co. seeks an Applied AI and Machine Learning Lead in Corporate Technology Data Science and AI to design, build, and deploy scalable generative AI solutions that deliver measurable business value. You will translate business needs into production-ready... 

    Jobleads-US

    Jersey City, NJ
    4 days ago
  •  ...part of a innovative and forward thinking agile team to enhance, build, and deliver advanced technology products.  As an Applied AI/ML Lead within the Corporate Sector, Trade Surveillance Technology team, you will be responsible for delivering AI/ML enabled analytical... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    5 days ago
  • $61k - $101k

     ...and at least 6 years of hands-on experience building and deploying AI/ML models in production. Strong programming skills in Python...  ...junior colleagues through guidance, mentorship, and code reviews. Lead projects from requirements discovery and design through... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    9 days ago
  •  ...Job Description Build what’s next in enterprise AI—solutions that materially improve how teams make decisions, automate work, and...  ...supported Corporate Functions. As an Applied AI and Machine Learning Lead at JPMorganChase within Corporate Technology Data Science and AI... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    6 days ago
  • $61k - $101k

     ...manipulation. We have experience with LLM orchestration, agentic AI libraries, and GenAI models such as OpenAI or similar tools to...  ...Morgan to identify exceptional professionals for this Applied AI/ML Lead role within the Corporate Oversight and Governance team. We are a... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    a month ago
  • $61k - $101k

     ...data. ~ Hands-on experience with LLM orchestration and agentic AI libraries, and proficiency using generative AI models such as OpenAI...  ...TensorFlow Cloud More: We are hiring an Applied AI/ML Lead for our Data Science team within Corporate Oversight and... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    4 days ago
  • $61k - $101k

     ...field At least 6 years of professional AI/ML experience delivering production...  ...Preferred: Experience with Kubernetes and infrastructure-as-code tools such as Terraform Preferred...  .../ML roadmaps with business priorities Lead the architecture, design, and end-to-end... 
    Full time
    Worldwide

    J.P. Morgan

    Jersey City, NJ
    6 days ago
  • The Coca-Cola Company is seeking a Supply Chain Intelligence, Digital & Productivity Lead to drive AI-enabled insights across manufacturing, warehousing, and logistics. You will translate data into action, build scalable digital use cases, and partner with cross-functional... 

    The Coca-Cola Company

    Brooklyn, NY
    1 day ago
  • Google's XR team is seeking an Android XR Application Compatibility AI Technical Lead to design and scale automated evaluation frameworks for Android XR apps, leveraging computer vision and LLMs to detect spatial layout issues and rendering distortions. You will collaborate... 

    Jobleads-US

    Brooklyn, NY
    1 day ago
  • Nightwing seeks a strong technical leader to guide LLM and neural network infrastructure across on‑prem, cloud, and API subscription deployments for a 300+ engineer organization. Applicants should bring 5+ years with LLMs and ML frameworks, 7+ years in vulnerability research... 

    Jobleads-US

    Brooklyn, NY
    3 days ago
  • $280k - $360k

    About the Role At River AI, we are building an entirely new kind of AI company. As we...  ...experienced IT leadership to ensure our technology infrastructure keeps pace with our growth. We are...  ...secure, scalable infrastructure; lead the IT function; implement best-in-class... 
    Monday to Friday

    Venture Post

    Brooklyn, NY
    2 days ago
  •  ...closely with management and customers, developing management reports and dashboards, and contributing to product strategy, including AI aspects. Candidates should have a technical background, experience in process management, and strong language skills in German and English... 
    Flexible hours

    MSO Solutions GmbH

    Brooklyn, NY
    3 days ago
  • GitLab’s Enablement & AI organization helps revenue teams build the knowledge, skills, tools, and confidence to sell GitLab effectively and deliver better customer outcomes. The team partners across Sales, Customer Success, Solutions Architecture, Partnerships, Product... 

    GitLab Inc.

    Brooklyn, NY
    4 days ago
  • Amsive LLC is seeking an Associate Manager, SEO to lead data‑driven organic and AI search campaigns across SaaS, e‑commerce, higher education, healthcare and finance. You will guide a small team, shape content and technical strategies, and drive results for multiple accounts... 
    Remote job

    Amsive LLC

    Brooklyn, NY
    2 days ago
  • Tiger Analytics is seeking an Engagement Lead to join its advanced analytics and AI team, owning end-to-end client engagements from inception to delivery. You will translate complex business problems into scalable analytics and AI solutions and lead cross-functional teams... 

    Tiger Analytics

    Brooklyn, NY
    2 days ago
  • BambooHR is seeking a Program Manager for Customer Experience (CX) AI initiatives in Utah on a hybrid schedule. You will own a...  ...teams to define success and deliver measurable results. You will lead projects, coach others, and drive adoption of data-driven approaches... 

    BambooHR LLC.

    Brooklyn, NY
    2 days ago
  • Cencora, via NeoOptima, seeks a Director-level Medical Lead to drive strategic client engagements in Medical Affairs and Medical Excellence with a focus on value demonstration and evidence generation. You will lead advisory work for life sciences clients, shape operating... 
    Remote job

    World Courier

    Brooklyn, NY
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead HPC & AI Infrastructure Architect. Be the first to apply!