Head of AI Infrastructure
Confidential
Head of AI Infrastructure
About the Company
AI compute and systems company building purpose-built training hardware.
Industry
Computer Hardware
Type
Privately Held
About the Role
The Company is seeking a Head of AI Infrastructure to lead the transition from in-house prototypes to production deployments of training workloads for external partners. This role is pivotal in bridging the gap between internal and customer-facing systems, and the ideal candidate will have a background in production training-infrastructure at frontier scale, with a deep understanding of the full stack from networking to user-facing tooling. The Head of AI Infrastructure will be responsible for owning this transition and leading the engineering organization, with a focus on interconnect, scheduler, checkpointing, and failure recovery. The company is particularly interested in candidates who have a hands-on engineering background and can demonstrate a customer-facing temperament, as the role involves significant interaction with research customers. The successful candidate for the Head of AI Infrastructure position at the company will be a seasoned professional with a proven track record in AI engineering. The role demands a leader who can not only manage the engineering team but also actively contribute to the technical aspects of the infrastructure. The Head of AI Infrastructure will be at the forefront of the company's AI infrastructure, driving the development and deployment of cutting-edge training hardware. The company values a candidate with a strong engineering-led background, as opposed to a research-supervisory focus, and is particularly interested in individuals who have a history of hands-on work in the field. The position is critical for the company's growth and requires a candidate who can seamlessly integrate with the existing team and contribute to the company's mission of advancing AI technology.
Hiring Manager Title
CEO
Functions
- Engineering
- Oracle is looking for a Senior Manager to lead the OCI AI Infrastructure Network Operations team in Santa Clara, California. The successful candidate will manage a team focused on RDMA/RoCE network fabrication, driving improvements in reliability and performance, and building...Suggested
- ...Head of Marketing & Growth Infrastructure About the Company High-growth technology company serving complex B2B industrial and manufacturing markets... ...experience, with a preference for those who have worked in AI, SaaS, deep tech, industrial, manufacturing, or similar...Suggested
- Advanced Micro Devices (AMD) is seeking an AI Infrastructure Messaging Manager to lead AMD’s AI narrative for Enterprise Customers and Digital Native audiences. This role focuses on translating product capabilities into clear, differentiated messaging across various platforms...Suggested
- A dynamic technology company in Santa Clara is seeking an experienced professional to manage lab infrastructure and deployments across multiple engineering teams. The ideal candidate has over 5 years of experience in lab administration or IT infrastructure management,...Suggested
- ...Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry... ...the deployment, configuration, and validation of network infrastructure using Python, including topology provisioning, fabric bring‑up,...Suggested
$100k - $150k
The Institute of Foundation Models in Sunnyvale, California, is seeking a motivated IT Specialist to build and maintain IT infrastructure. The role includes ensuring network security, configuring systems, and providing technical support. Ideal candidates should have a...Visa sponsorship$108k - $162k
...Responsibilities We are seeking a highly skilled Sr. Systems & Infrastructure Engineer to join a dynamic, security-first IT team operating across... ...cloud operations (CloudOps), Microsoft 365 administration, AI-augmented tooling, and endpoint management through Microsoft Intune...Permanent employment- ...testing, leveraging proprietary in-house tools. Be familiar with HPC/AI applications and benchmarks, address customer support issues,... ...software and hardware upgrades to sustain exceptional HPC infrastructure performance. Document and analyze test plans, reports, logs, and...Worldwide
- ...Since 2009, we have helped institutions modernize and secure their infrastructure through resilient networking, wireless, security, and cloud... ...solutions include enterprise networking, physical security, UCaaS, AI-enabled communications, and Push-to-Talk, enabling reliable and...Full timeLocal area
- Crusoe Energy Systems is seeking a Staff Technical Program Manager in Sunnyvale, California, to drive technical projects in AI infrastructure. The ideal candidate will manage technical programs across various teams, proactively identifying risks and aligning product and...
$120k - $150k
...Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious...Temporary workFor contractors- ...Network Deployment Engineer to lead the deployment of network infrastructure across data centers. The role involves managing technical implementations... ...skills. Join a team dedicated to revolutionizing AI compute infrastructure with competitive pay and comprehensive benefits...
- ...amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU... ...setting. Knowledge of deploying and automating network infrastructure in public/private clouds, with experience in Ansible/Terraform....
$108k - $178.25k
...benefits. Applications for this job will be accepted at least until July 3, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal...$140k - $190k
...possible, with the ultimate goal of enabling human life on Mars. DATA INFRASTRUCTURE OPERATIONS MANAGER II (STARLINK) The Infrastructure Operations... ...the training, validation, and continuous improvement of our AI models. We're seeking talented, high-ownership individuals to...Permanent employmentTemporary workFlexible hours$170.6k - $390k
...premises, cloud, and hybrid environments, and partnering closely with infrastructure, cloud, application, and security operations teams. Join... ...while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future...Summer holidayRemote workFlexible hours$155.8k - $224.2k
...solutions that empower critical industries to thrive in a rapidly digitizing, energy-intensive world. From revolutionizing power for AI-driven data centers to ensuring resilience for hospitals, electric grids, manufacturing facilities, and utilities, our solid oxide fuel...Full timeWork at officeWorldwide$214k - $305k
...or a related area. 5 years of experience with cloud data center infrastructure including power, network, cooling, zonal architecture, services... ...and trusted cloud infrastructure and solutions powered by AI. Google Cloud accelerates every organization’s ability to digitally...Full time$118k - $170k
...perform exceptionally well in challenging environments. RUCKUS Networks leverages advanced technologies like Artificial Intelligence (AI) and Machine Learning (ML) to enhance network performance and reduce total cost of ownership. The Embedded Software Engineering...$135k - $200k
...perform exceptionally well in challenging environments. RUCKUS Networks leverages advanced technologies like Artificial Intelligence (AI) and Machine Learning (ML) to enhance network performance and reduce total cost of ownership. How You’ll help us connect the world:...- CoreWeave is seeking an AI Infrastructure Product Marketing Manager to own the product marketing strategy for their infrastructure portfolio, which includes compute, storage, and networking. The ideal candidate will have at least 3 years of experience in product marketing...Remote job
$184k - $356.5k
NVIDIA Gruppe is seeking an Engineering Manager to lead a team solving AI's infrastructure problems with systems-level software. You will guide engineers in building distributed AI systems, balancing project delivery with innovative research. The ideal candidate has over...$136k - $218.5k
Join NVIDIA's Infrastructure Specialists team as a Commercial Specialist Program Manager in Santa Clara, California. You will engage with key clients to deliver AI infrastructure solutions, leading innovative projects and ensuring their success. Ideal candidates will have...$193k - $234k
Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious...Temporary workRemote work$184k - $287.5k
...NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data... ...We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company....$86.4k - $118.8k
...semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate change, reliably connect humans and the world, and help drive...Shift workDay shift$152k - $241.5k
...devices, driving the fabric that connects the world’s most powerful AI and high-performance computing systems. As part of this role,... ...robust, maintainable, and easily portable verification infrastructure and regression test suites. Identify, troubleshoot and own the...- ...Gruppe is seeking a Senior Firmware Engineer to join their Firmware team. In this role, you will develop advanced networking features for AI, cloud, and HPC. You will work closely with various design teams and be involved in everything from implementation to verification of...
- NVIDIA Corporation is seeking a Senior Firmware Engineer in Santa Clara, CA, to enhance networking features for AI and cloud environments. You will work with architecture, software, and hardware design teams to implement new firmware functionalities and develop verification...
- ...excellent Senior Firmware Engineer to join the Firmware team. The NVIDIA Firmware team develops groundbreaking networking features for AI, cloud, HPC and storage. We drive the data growth of the world’s biggest companies. With many hardworking engineers around the globe,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!
- infrastructure engineering manager San Jose, CA
- head of infrastructure
- senior infrastructure manager
- cloud infrastructure manager
- infrastructure supervisor
- infrastructure support manager
- infrastructure engineering manager
- director of infrastructure
- head of it infrastructure
- information technology infrastructure manager

