Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

AI compute and systems company building purpose-built training hardware.

Industry
Computer Hardware

Type
Privately Held

About the Role

The Company is seeking a Head of AI Infrastructure to lead the transition from in-house prototypes to production deployments of training workloads for external partners. This role is pivotal in bridging the gap between internal and customer-facing systems, and the ideal candidate will have a background in production training-infrastructure at frontier scale, with a deep understanding of the full stack from networking to user-facing tooling. The Head of AI Infrastructure will be responsible for owning this transition and leading the engineering organization, with a focus on interconnect, scheduler, checkpointing, and failure recovery. The company is particularly interested in candidates who have a hands-on engineering background and can demonstrate a customer-facing temperament, as the role involves significant interaction with research customers. The successful candidate for the Head of AI Infrastructure position at the company will be a seasoned professional with a proven track record in AI engineering. The role demands a leader who can not only manage the engineering team but also actively contribute to the technical aspects of the infrastructure. The Head of AI Infrastructure will be at the forefront of the company's AI infrastructure, driving the development and deployment of cutting-edge training hardware. The company values a candidate with a strong engineering-led background, as opposed to a research-supervisory focus, and is particularly interested in individuals who have a history of hands-on work in the field. The position is critical for the company's growth and requires a candidate who can seamlessly integrate with the existing team and contribute to the company's mission of advancing AI technology.

Hiring Manager Title
CEO

Functions

  • Engineering
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in San Jose, CA vacancy
  • Oracle is looking for a Senior Manager to lead the OCI AI Infrastructure Network Operations team in Santa Clara, California. The successful candidate will manage a team focused on RDMA/RoCE network fabrication, driving improvements in reliability and performance, and building... 
    Suggested

    Oracle

    Santa Clara, CA
    3 days ago
  •  ...Head of Marketing & Growth Infrastructure About the Company High-growth technology company serving complex B2B industrial and manufacturing markets...  ...experience, with a preference for those who have worked in AI, SaaS, deep tech, industrial, manufacturing, or similar... 
    Suggested

    Confidential

    San Jose, CA
    3 days ago
  • Advanced Micro Devices (AMD) is seeking an AI Infrastructure Messaging Manager to lead AMD’s AI narrative for Enterprise Customers and Digital Native audiences. This role focuses on translating product capabilities into clear, differentiated messaging across various platforms... 
    Suggested

    Advanced Micro Devices

    Santa Clara, CA
    4 days ago
  • A dynamic technology company in Santa Clara is seeking an experienced professional to manage lab infrastructure and deployments across multiple engineering teams. The ideal candidate has over 5 years of experience in lab administration or IT infrastructure management,... 
    Suggested

    Nexthop Systems Inc

    Santa Clara, CA
    1 day ago
  •  ...Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry...  ...the deployment, configuration, and validation of network infrastructure using Python, including topology provisioning, fabric bring‑up,... 
    Suggested

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    4 days ago
  • $100k - $150k

    The Institute of Foundation Models in Sunnyvale, California, is seeking a motivated IT Specialist to build and maintain IT infrastructure. The role includes ensuring network security, configuring systems, and providing technical support. Ideal candidates should have a... 
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    3 days ago
  • $108k - $162k

     ...Responsibilities We are seeking a highly skilled Sr. Systems & Infrastructure Engineer to join a dynamic, security-first IT team operating across...  ...cloud operations (CloudOps), Microsoft 365 administration, AI-augmented tooling, and endpoint management through Microsoft Intune... 
    Permanent employment

    Dormont Manufacturing Company

    Milpitas, CA
    2 days ago
  •  ...testing, leveraging proprietary in-house tools. Be familiar with HPC/AI applications and benchmarks, address customer support issues,...  ...software and hardware upgrades to sustain exceptional HPC infrastructure performance. Document and analyze test plans, reports, logs, and... 
    Worldwide

    Supermicro

    San Jose, CA
    3 days ago
  •  ...Since 2009, we have helped institutions modernize and secure their infrastructure through resilient networking, wireless, security, and cloud...  ...solutions include enterprise networking, physical security, UCaaS, AI-enabled communications, and Push-to-Talk, enabling reliable and... 
    Full time
    Local area

    IT Management Corp. dba 101 VOICE

    Santa Clara, CA
    3 days ago
  • Crusoe Energy Systems is seeking a Staff Technical Program Manager in Sunnyvale, California, to drive technical projects in AI infrastructure. The ideal candidate will manage technical programs across various teams, proactively identifying risks and aligning product and... 

    Crusoe Energy Systems

    Sunnyvale, CA
    4 days ago
  • $120k - $150k

     ...Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious... 
    Temporary work
    For contractors

    Crusoe

    Sunnyvale, CA
    2 days ago
  •  ...Network Deployment Engineer to lead the deployment of network infrastructure across data centers. The role involves managing technical implementations...  ...skills. Join a team dedicated to revolutionizing AI compute infrastructure with competitive pay and comprehensive benefits... 

    Crusoe Energy Systems

    Sunnyvale, CA
    3 days ago
  •  ...amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU...  ...setting. Knowledge of deploying and automating network infrastructure in public/private clouds, with experience in Ansible/Terraform.... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $108k - $178.25k

     ...benefits. Applications for this job will be accepted at least until July 3, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $140k - $190k

     ...possible, with the ultimate goal of enabling human life on Mars. DATA INFRASTRUCTURE OPERATIONS MANAGER II (STARLINK) The Infrastructure Operations...  ...the training, validation, and continuous improvement of our AI models. We're seeking talented, high-ownership individuals to... 
    Permanent employment
    Temporary work
    Flexible hours

    United States Digital Space LLC

    Sunnyvale, CA
    3 days ago
  • $170.6k - $390k

     ...premises, cloud, and hybrid environments, and partnering closely with infrastructure, cloud, application, and security operations teams. Join...  ...while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future... 
    Summer holiday
    Remote work
    Flexible hours

    EY

    San Jose, CA
    1 day ago
  • $155.8k - $224.2k

     ...solutions that empower critical industries to thrive in a rapidly digitizing, energy-intensive world. From revolutionizing power for AI-driven data centers to ensuring resilience for hospitals, electric grids, manufacturing facilities, and utilities, our solid oxide fuel... 
    Full time
    Work at office
    Worldwide

    Bloom Energy

    San Jose, CA
    4 days ago
  • $214k - $305k

     ...or a related area. 5 years of experience with cloud data center infrastructure including power, network, cooling, zonal architecture, services...  ...and trusted cloud infrastructure and solutions powered by AI. Google Cloud accelerates every organization’s ability to digitally... 
    Full time

    Google

    Sunnyvale, CA
    2 days ago
  • $118k - $170k

     ...perform exceptionally well in challenging environments. RUCKUS Networks leverages advanced technologies like Artificial Intelligence (AI) and Machine Learning (ML) to enhance network performance and reduce total cost of ownership. The Embedded Software Engineering... 

    Ruckus

    Sunnyvale, CA
    3 days ago
  • $135k - $200k

     ...perform exceptionally well in challenging environments. RUCKUS Networks leverages advanced technologies like Artificial Intelligence (AI) and Machine Learning (ML) to enhance network performance and reduce total cost of ownership. How You’ll help us connect the world:... 

    RUCKUS Networks

    Sunnyvale, CA
    2 days ago
  • CoreWeave is seeking an AI Infrastructure Product Marketing Manager to own the product marketing strategy for their infrastructure portfolio, which includes compute, storage, and networking. The ideal candidate will have at least 3 years of experience in product marketing... 
    Remote job

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $184k - $356.5k

    NVIDIA Gruppe is seeking an Engineering Manager to lead a team solving AI's infrastructure problems with systems-level software. You will guide engineers in building distributed AI systems, balancing project delivery with innovative research. The ideal candidate has over... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $136k - $218.5k

    Join NVIDIA's Infrastructure Specialists team as a Commercial Specialist Program Manager in Santa Clara, California. You will engage with key clients to deliver AI infrastructure solutions, leading innovative projects and ensuring their success. Ideal candidates will have... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $193k - $234k

    Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from electrons to tokens — to power the world's most ambitious... 
    Temporary work
    Remote work

    Crusoe Energy Systems

    Sunnyvale, CA
    4 days ago
  • $184k - $287.5k

     ...NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data...  ...We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company.... 

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $86.4k - $118.8k

     ...semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate change, reliably connect humans and the world, and help drive... 
    Shift work
    Day shift

    Analog Devices

    San Jose, CA
    3 days ago
  • $152k - $241.5k

     ...devices, driving the fabric that connects the world’s most powerful AI and high-performance computing systems. As part of this role,...  ...robust, maintainable, and easily portable verification infrastructure and regression test suites. Identify, troubleshoot and own the... 

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  •  ...Gruppe is seeking a Senior Firmware Engineer to join their Firmware team. In this role, you will develop advanced networking features for AI, cloud, and HPC. You will work closely with various design teams and be involved in everything from implementation to verification of... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • NVIDIA Corporation is seeking a Senior Firmware Engineer in Santa Clara, CA, to enhance networking features for AI and cloud environments. You will work with architecture, software, and hardware design teams to implement new firmware functionalities and develop verification... 

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  •  ...excellent Senior Firmware Engineer to join the Firmware team. The NVIDIA Firmware team develops groundbreaking networking features for AI, cloud, HPC and storage. We drive the data growth of the world’s biggest companies. With many hardworking engineers around the globe,... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!