Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

AI compute and systems company building purpose-built training hardware.

Industry
Computer Hardware

Type
Privately Held

About the Role

The Company is seeking a Head of AI Infrastructure to lead the transition from in-house prototypes to production deployments of training workloads for external partners. This role is pivotal in bridging the gap between internal and customer-facing systems, and the ideal candidate will have a background in production training-infrastructure at frontier scale, with a deep understanding of the full stack from networking to user-facing tooling. The Head of AI Infrastructure will be responsible for owning this transition and leading the engineering organization, with a focus on interconnect, scheduler, checkpointing, and failure recovery. The company is particularly interested in candidates who have a hands-on engineering background and can demonstrate a customer-facing temperament, as the role involves significant interaction with research customers. The successful candidate for the Head of AI Infrastructure position at the company will be a seasoned professional with a proven track record in AI engineering. The role demands a leader who can not only manage the engineering team but also actively contribute to the technical aspects of the infrastructure. The Head of AI Infrastructure will be at the forefront of the company's AI infrastructure, driving the development and deployment of cutting-edge training hardware. The company values a candidate with a strong engineering-led background, as opposed to a research-supervisory focus, and is particularly interested in individuals who have a history of hands-on work in the field. The position is critical for the company's growth and requires a candidate who can seamlessly integrate with the existing team and contribute to the company's mission of advancing AI technology.

Hiring Manager Title
CEO

Functions

  • Engineering
Confidential
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in Fremont, CA vacancy
  • $120k - $170k

     ...Computer Inc. is seeking a Business Development Director for its Infrastructure Solutions Group in Fremont, California. This pivotal role...  ...ideal candidate will have over 8 years of experience in the Server/AI/Computer Hardware industry, overseeing strategic initiatives that... 
    Suggested

    ASUSTeK Computer Inc.

    Fremont, CA
    2 days ago
  • $179k - $225k

    ## Data Center Infrastructure and Technology Lead ArhitectApplylocations: US - Oregon - Statewide: Fremont, CAtime type: Full timeposted on:...  ...BOM optimization* SI/PI architecture* engineering automation and AI-assisted tooling* ecosystem technology strategyProvide deep... 
    Suggested

    SYNNEX Corporation

    Fremont, CA
    4 days ago
  • Relanto in Fremont, California is looking for a skilled Full Stack Architect to lead the design of innovative AI solutions. This role involves architecting cloud-native applications utilizing Python and Google Cloud Platform. The ideal candidate should have experience... 
    Suggested

    Relanto

    Fremont, CA
    1 day ago
  • $108k - $162k

     ...Responsibilities We are seeking a highly skilled Sr. Systems & Infrastructure Engineer to join a dynamic, security-first IT team operating...  ...cloud operations (CloudOps), Microsoft 365 administration, AI-augmented tooling, and endpoint management through Microsoft Intune... 
    Suggested
    Permanent employment

    Onto

    Milpitas, CA
    2 days ago
  • $107.74k - $141.45k

     ...Public Trust/Other Required: None Job Family: IT Infrastructure and Operations Job Qualifications: Skills: Network...  ...countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development. Join our Talent... 
    Suggested
    Temporary work
    Immediate start
    Remote work
    Work from home
    Worldwide
    Relocation package
    Flexible hours

    General Dynamics Information Technology

    Hayward, CA
    2 days ago
  • $170k - $195k

     ...solutions, architecting with Check Point's AI Defense Plane to help enterprises secure...  ...AI does what we want it to do. We are heading towards a future where AI agents run our...  ...design solutions that align with their infrastructure using our platform. Partner with Customer... 
    Remote work

    Lakera

    Fremont, CA
    2 days ago
  •  ...that provide the specialized processing power needed to drive AI innovation, while delivering the efficiency required to support...  ...including PDF, ECN and DCQCN. ~ Versed in High-Bandwidth network infrastructure including experience with operating 400G and 800G network... 
    Remote work
    Flexible hours

    Graphcore

    Milpitas, CA
    15 hours ago
  • Relanto is seeking a highly skilled Full Stack Architect to lead the design of next-gen Agentic AI solutions. This role involves architecting intelligent, cloud-native applications for high-tech customers, leveraging technologies like Python, Angular, and Google Cloud... 

    Relanto

    Fremont, CA
    3 days ago
  • $144k - $224k

     ...III on our Data Platform team, you will implement and scale the infrastructure required to ingest, process, and synchronize massive datasets...  ...fleet analytics. Stakeholder Collaboration: Work closely with AI and Hardware teams to ensure data tools meet the needs of those... 
    Full time
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Agility Robotics

    Fremont, CA
    2 days ago
  • $86k - $108k

     ...Senior IT Infrastructure Specialist The Senior IT Infrastructure Specialist is a core position that blends technical depth with strategic...  ...and evaluate emerging IT technologies and market trends (such as AI-driven operations, hybrid cloud, and SD-WAN) to address... 
    Contract work
    Work at office
    Local area
    Remote work
    Afternoon shift

    ASUS

    Fremont, CA
    3 days ago
  • $207k - $301k

     ...Experience architecting and developing robust database solutions tailored for the semiconductor manufacturing domain. Experience leveraging AI/ML methods, specifically utilizing Gemini, to drive technical excellence and improve system productivity. Familiarity with critical... 

    Google Inc.

    Fremont, CA
    5 days ago
  •  ...and optimizing all operational functions within a fast-paced IT infrastructure and server rack manufacturing environment. This role drives...  ...performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance computing... 
    Flexible hours

    AMAX

    Fremont, CA
    4 days ago
  • $168.8k - $241.2k

     ...or similar) to accelerate technical workflows. A willingness to continuously learn and adapt, crucial in the ever‑evolving field of AI Message to applicants applying to work in the U.S. and/or Canada: The starting salary range posted for this position is $168,800.00... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Flexible hours
    3 days per week

    Cisco Systems, Inc.

    Milpitas, CA
    2 days ago
  •  ...exciting is the scale of our impact; we are building cloud-native, AI-integrated solutions that solve the most complex challenges in...  ...complex production and customer issues across application, infrastructure, database, and networking layers. Collaborate with engineering... 

    Cisco

    Milpitas, CA
    15 hours ago
  •  ...Location: Newark, CA Department: IT Department Head: IT Manager Job Overview: Unigen is seeking an experienced...  ...Experience with DevOps ecosystems (CI/CD tools, cloud infrastructure) Exposure to AI-enabled automation for IT service management or knowledge... 

    Unigen

    Newark, CA
    15 hours ago
  • $75k - $95k

     ...79, AMAX is a globally recognized leader in GPU-accelerated IT infrastructure, specializing in transforming standard IT systems into advanced...  ...performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance... 
    Temporary work
    Overseas
    Flexible hours

    AMAX

    Fremont, CA
    13 days ago
  • $165k - $241.4k

     ...office. Meet the Team Cisco is building a next-generation DPU-enabled networking platform for secure, high-performance infrastructure and large-scale AI clusters. Our team is responsible for designing the foundational networking, security, and programmable services that... 
    Full time
    Temporary work
    Work at office
    Flexible hours
    3 days per week

    Cisco

    Milpitas, CA
    1 day ago
  • Cisco Systems, Inc. is looking for an experienced software developer in Milpitas for a hybrid position that requires strong skills in C/C++ and Python. You will contribute to innovative projects in high-speed networking, focusing on scalable software systems. The role focuses...

    Cisco Systems, Inc.

    Milpitas, CA
    2 days ago
  • $206k - $282k

     ...goals, strategies, resources and technology solutions. Role Summary Lead technical product portfolio and infrastructure roadmap development across Hyve’s compute, AI, storage, and networking platforms. This role combines deep technical infrastructure expertise with... 
    Full time

    Hyve Solutions

    Fremont, CA
    20 hours ago
  • $170k - $195k

     ...this pivotal role, you will engage directly with customers to understand their needs and provide tailored solutions using Check Point's AI Defense Plane. You'll collaborate closely with teams across the organization, ensuring a seamless onboarding experience and helping... 
    Remote job

    Lakera Inc

    Fremont, CA
    4 days ago
  •  ...Job Title: Infrastructure Engineering - Network Engineer II Job Id: 64599-1 Location: Fremont, CA Role Mandate: The main function of a network engineer is to determine user requirements and design specifications for computer networks. A typical... 

    Apex Informatics

    Fremont, CA
    2 days ago
  • $110k - $125k

     ...Manufacturing Fremont (QMF) Network Engineering team is responsible for architecting, building, automating, and managing our Network Infrastructure at our campus in Fremont, CA and our public cloud providers. As a Network Engineer, you will work with talented colleagues on... 
    Full time
    Local area
    Immediate start
    Remote work

    Goebel Fixture Company

    Fremont, CA
    4 days ago
  • $274k - $304k

     ...AI Platform Engineer - Training & Inference Saviynt's AI-powered identity platform manages and governs human and non-human...  ...between self-hosted SLMs and cloud LLMs • Build RL training infrastructure: define Flyte workflows for RL pipelines (rollout, reward shaping... 

    Saviynt

    Milpitas, CA
    3 days ago
  • Note:- It's a 5 days onsite Position: Network Engineer Location: Bethpage, NY Duration: 12+ Months Contract Must have skills: Networking & SD-WAN Cloud Security & Zero Trust SASE Platform expertise Secondary skills (50%)/ experience ...
    Contract work

    InterSources

    Fremont, CA
    5 days ago
  • $170.36k - $230k

     ...and workflow automation Demonstrated ability to build IAM programs from foundational concepts through mature operational state AI fluency with demonstrated experience using AI tools effectively in the context of this role Excellent communication skills with ability... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours

    Blackhawk Network

    Pleasanton, CA
    5 days ago
  • $168k - $360k

     ...The candidate should combine deep wireless expertise with strong problem-solving skills and the ability to collaborate across infrastructure, security, and engineering teams. What You'll Do Collaborate closely with Network Architects on wireless design and initiatives... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Fremont, CA
    4 days ago
  •  ...Role Description: We have an exciting opportunity to join our network infrastructure teams as an Optical Network Deployment Engineer working on Backbone Network capacity deployment. This role will be focused on network deployment (IP, optical), and network operations... 

    E-Solutions

    Fremont, CA
    2 days ago
  •  ...Female both can apply Role Description We are looking for a Data Platform Engineer to build and improve the underlying data infrastructure, services, and operational capabilities that power analytics, reporting, and machine learning use cases. In this role, you will... 
    Full time
    Remote work

    Vurke

    Union City, CA
    4 days ago
  • $180k - $225k

     ...of the Conquer platform. As our Senior Platform Engineer, Voice Infrastructure, you will own and evolve the systems that power how sales teams...  ...Experience with call recording, transcription, or AI-driven voice features Experience with VoIPmonitor Exposure... 
    Local area
    Remote work

    Conquer

    Fremont, CA
    17 days ago
  • Role: Network Design and Configuration Engineer Location: Hollister, CA & Fremont, CA (Onsite) Requirements 8+ years of experience designing production network systems Strong experience with high-availability architectures Hands-on routing and firewall configuration experience...
    Local area

    BayOne Solutions

    Fremont, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!