Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

AI compute and systems company building purpose-built training hardware.

Industry
Computer Hardware

Type
Privately Held

About the Role

The Company is seeking a Head of AI Infrastructure to lead the transition from in-house prototypes to production deployments of training workloads for external partners. This role is pivotal in bridging the gap between internal and customer-facing systems, and the ideal candidate will have a background in production training-infrastructure at frontier scale, with a deep understanding of the full stack from networking to user-facing tooling. The Head of AI Infrastructure will be responsible for owning this transition and leading the engineering organization, with a focus on interconnect, scheduler, checkpointing, and failure recovery. The company is particularly interested in candidates who have a hands-on engineering background and can demonstrate a customer-facing temperament, as the role involves significant interaction with research customers. The successful candidate for the Head of AI Infrastructure position at the company will be a seasoned professional with a proven track record in AI engineering. The role demands a leader who can not only manage the engineering team but also actively contribute to the technical aspects of the infrastructure. The Head of AI Infrastructure will be at the forefront of the company's AI infrastructure, driving the development and deployment of cutting-edge training hardware. The company values a candidate with a strong engineering-led background, as opposed to a research-supervisory focus, and is particularly interested in individuals who have a history of hands-on work in the field. The position is critical for the company's growth and requires a candidate who can seamlessly integrate with the existing team and contribute to the company's mission of advancing AI technology.

Hiring Manager Title
CEO

Functions

  • Engineering
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in Fremont, CA vacancy
  • $120k - $150k

     ...Job Description Job Description AMAX is an IT infrastructure and advanced computing solutions company serving enterprise and OEM customers...  ...computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance computing... 
    Suggested
    Full time
    Flexible hours
    Shift work

    AMAX

    Fremont, CA
    5 days ago
  • $135k - $220k

     ...Join to apply for the Senior Network Engineer role at Pony.ai Join to apply for the Senior Network Engineer role at Pony.ai This...  ...mobility, and we're seeking a talented Network Engineer to join our infrastructure team. In this pivotal role, you'll design, implement, and... 
    Suggested
    Full time
    Temporary work

    Pony.ai

    Fremont, CA
    4 days ago
  • $65 - $80 per hour

     ...support a large-scale production and corporate network and server infrastructure in data centers, Point of Presence (POP), edge, backbone,...  ...knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr Zenotis Group
    Suggested
    Full time
    Local area
    Remote work

    Zenotis Group

    Fremont, CA
    1 day ago
  • $23 per hour

     ...Staffmark is an E-Verify employer. See our Privacy Notice for Candidates and Employees/Contractors at By applying, you consent to receive AI-generated and non-AI-generated calls, texts, or emails from Staffmark Group, its affiliates, and partners. Frequency varies and... 
    Suggested
    Hourly pay
    Weekly pay
    Temporary work
    For contractors
    Local area
    Monday to Friday
    Day shift

    Staffmark Group

    Fremont, CA
    18 hours ago
  • $75k - $95k

     ...79, AMAX is a globally recognized leader in GPU-accelerated IT infrastructure, specializing in transforming standard IT systems into advanced...  ...performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance... 
    Suggested
    Temporary work
    Overseas
    Flexible hours

    AMAX

    Fremont, CA
    20 days ago
  • $170k - $220k

     ...prioritize what matters most for the team and business. Prior experience working in a startup is a plus Experience using IDE embedded AI is a plus Join DTEX in our mission to build the world’s best platform for workforce cybersecurity and insider risk management!... 
    Full time
    Remote work
    Work from home
    Worldwide
    Flexible hours

    DTEX

    Fremont, CA
    1 day ago
  • $108k - $162k

     ...Responsibilities We are seeking a highly skilled Sr. Systems & Infrastructure Engineer to join a dynamic, security-first IT team operating...  ...cloud operations (CloudOps), Microsoft 365 administration, AI-augmented tooling, and endpoint management through Microsoft Intune... 
    Permanent employment

    Onto

    Milpitas, CA
    4 days ago
  •  ...experienced AIML Architect to lead the design and evolution of AI‑powered solutions across our design and verification tools. In...  ...execution Evaluate and select AI technologies, models, frameworks, and infrastructure to meet product and business objectives Architect end‑to‑end AI... 

    Siemens EDA (Siemens Digital Industries Software)

    Fremont, CA
    18 hours ago
  •  ...that provide the specialized processing power needed to drive AI innovation, while delivering the efficiency required to support...  ...including PDF, ECN and DCQCN. Experience with high-bandwidth network infrastructure including operating 400G and 800G network fabrics and tackling... 
    Remote work

    Graphcore

    Milpitas, CA
    1 hour ago
  •  ...startups to the Fortune 50, our customers rely on YES to help them unleash products that change lives – from cellphones and IoT devices, to AI and virtual reality, to diagnostic tests for COVID. As a preferred provider of wet and dry process technology, we look forward to... 
    Full time
    Local area
    Flexible hours

    Yield Engineering Systems

    Fremont, CA
    2 days ago
  • $86k - $108k

     ...The Senior IT Infrastructure Specialist is a core position that blends technical depth with strategic leadership. This role is responsible for...  ...evaluate emerging IT technologies and market trends (such as AI-driven operations, hybrid cloud, and SD-WAN) to address identified... 
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Afternoon shift

    ASUS

    Fremont, CA
    18 hours ago
  •  ...and optimizing all operational functions within a fast-paced IT infrastructure and server rack manufacturing environment. This role drives...  ...performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance computing... 
    Flexible hours

    AMAX

    Fremont, CA
    11 days ago
  • $123.6k - $174k

     ...trulyexcitingis the scale of our impact; we are building cloud-native, AI-integrated solutions that solve the most complex challenges in...  ...complex production and customer issues across application, infrastructure, database, and networking layers. ~ Collaborate with... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    Milpitas, CA
    3 days ago
  •  ...and humor. Collaboration is at the heart of everything we do. We work closely with leading communications and cloud platforms, using AI/ML to help customers innovate. We are committed to diversity and inclusion and have been recognized as a Best Place to Work. #J-18808... 

    Smarsh

    Pleasanton, CA
    18 hours ago
  • $133.9k - $154.5k

     ...Every day we work toward transforming global markets. Overview The AI Platform Engineering Lead drives the AI Platform Operations...  ...defines the architecture, standards, and governance across AI/ML infrastructure, workflow automation, and agentic AI capabilities, including... 
    Full time
    Contract work
    Temporary work
    Flexible hours

    Ice Services

    Pleasanton, CA
    18 hours ago
  • $170.36k - $230k

     ...Principal Infrastructure Engineer About Blackhawk Network: Today, through BHN’s single global platform, businesses of all kinds can tap into...  ...programs from foundational concepts through mature operational state AI fluency with demonstrated experience using AI tools effectively... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Flexible hours

    Fyrfly

    Pleasanton, CA
    3 days ago
  • $110k - $125k

     ...Manufacturing Fremont (QMF) Network Engineering team is responsible for architecting, building, automating, and managing our Network Infrastructure at our campus in Fremont, CA and our public cloud providers. As a Network Engineer, you will work with talented colleagues on... 
    Full time
    Local area
    Immediate start
    Remote work

    Goebel Fixture Company

    Fremont, CA
    2 days ago
  • Note:- It's a 5 days onsite Position: Network Engineer Location: Bethpage, NY Duration: 12+ Months Contract Must have skills: Networking & SD-WAN Cloud Security & Zero Trust SASE Platform expertise Secondary skills (50%)/ experience ...
    Contract work

    InterSources

    Fremont, CA
    2 days ago
  •  ...Job Title: Infrastructure Engineering - Network Engineer II Job Id: 64599-1 Location: Fremont, CA Role Mandate: The main function of a network engineer is to determine user requirements and design specifications for computer networks. A typical... 

    Apex Informatics

    Fremont, CA
    4 days ago
  •  ...Manufacturing Fremont (QMF) Network Engineering team is responsible for architecting, building, automating, and managing our Network Infrastructure at our campus in Fremont, CA and our public cloud providers. Responsibilities Implement, and maintain various network... 

    Quanta Manufacturing Fremont

    Fremont, CA
    19 hours ago
  • $120k - $240k

     ...Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending...  ...and on-prem). ~ Expertise in containerization (Docker) and Infrastructure-as-Code tools (Terraform, Helm, Ansible, or similar). ~... 
    Temporary work

    pony.ai

    Fremont, CA
    more than 2 months ago
  • $180k - $225k

     ...of the Conquer platform. As our Senior Platform Engineer, Voice Infrastructure, you will own and evolve the systems that power how sales teams...  ...Experience with call recording, transcription, or AI-driven voice features Experience with VoIPmonitor Exposure... 
    Local area
    Remote work

    Conquer

    Fremont, CA
    24 days ago
  • $136.3k - $231.7k

     ...models, both for hardware design and as part of their algorithms. AI, including several traditional machine learning techniques and...  ...processes. You will also work with a data scientists and AI infrastructure engineers whose mission is to build and scale machine learning... 
    Minimum wage
    Work experience placement
    Flexible hours

    KLA

    Milpitas, CA
    3 days ago
  •  ...services. You'll bridge the gap between data engineering and advanced AI-driven applications. You'll work with cutting-edge AI/ML...  ...to product development in programming, data analysis and CI/CD infrastructure. Responsibilities: Application design and development... 
    Work experience placement
    Work at office

    Hewlett Packard Enterprise

    Alviso, CA
    1 day ago
  •  ...Founded in 2017, Wayve is the leading developer of Embodied AI technology. Our advanced AI software and foundation models enable...  ...embodied systems — and work with engineering teams to build the infrastructure to scale it. Your work will directly influence the performance,... 
    Full time
    Work at office
    Remote work
    Work from home
    Visa sponsorship
    Relocation package
    Flexible hours

    GrabJobs

    Fremont, CA
    5 days ago
  • $55k - $75k

     ...language, content and intellectual property services. Through content transformation and multilingual data analysis, our combination of AI-enabled technology and human expertise helps our clients to grow by ensuring they are understood anywhere, in any language. Our... 
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    RWS

    Fremont, CA
    5 days ago
  •  ...Female both can apply Role Description We are looking for a Data Platform Engineer to build and improve the underlying data infrastructure, services, and operational capabilities that power analytics, reporting, and machine learning use cases. In this role, you will... 
    Full time
    Remote work

    Vurke

    Union City, CA
    1 day ago
  • Role: Network Design and Configuration Engineer Location: Hollister, CA & Fremont, CA (Onsite) Requirements 8+ years of experience designing production network systems Strong experience with high-availability architectures Hands-on routing and firewall configuration experience...
    Local area

    BayOne Solutions

    Fremont, CA
    3 days ago
  •  ...technologies to adapt them for variety of platform solutions. Architectural design and documentation of the company's global network infrastructure, including corporate and e-commerce. Responsible in preparing high level project design and test approaches, technology... 
    Permanent employment
    Temporary work

    Ingrain Systems Inc

    Fremont, CA
    18 hours ago
  • $235k - $250k

     ...Job Description Job Description Saviynt's AI-powered identity platform manages and governs human and non-human access to all...  ...instrumental in designing, building, and maintaining the shared infrastructure services and platforms that our product and application teams will... 

    Saviynt

    Milpitas, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!