Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Hardware Operations & AI Infrastructure

Crux, Inc.

Built to set the gold standard for integrated AI infrastructure

Crux AI is a newly formed, U.S.-based integrated AI infrastructure company created to remove the physical and operational constraints on consequential AI ambitions. Crux brings together power, high-density data centers, TPU silicon, networking, orchestration software, and ongoing operations as one integrated system.

Crux is being capitalized to plan every layer together, develop each one to demanding standards, and operate the whole system with efficiency and reliability. That gives hyperscalers, frontier AI labs, sovereign customers, enterprises, and AI-native companies greater freedom to pursue the AI they are here to create.

WHAT YOU'LL DO

You will own everything inside the rack, physically, across Crux’s entire fleet — the TPU hosts, network switches, optics, cabling, and liquid-cooling manifolds that arrive on a truck and have to become a validated, customer-ready cluster on the date Sales committed. The role runs the full hardware lifecycle: inbound logistics and receiving, rack integration and structured cabling, power-on and validation handoff, break/fix and RMA, spares and asset records, and decommission at generation transitions — at Crux-owned campuses and at colocation sites where you hold a partner’s remote-hands team to our standard. You will build this function from zero: the deployment playbook, the spares program, the DCIM discipline, and the site technician teams that inherit them. Where Facility Operations owns the power and cooling that reach the rack, and the SRE & Software Engineering team owns the provisioning, health, and remediation software, you own the hands, the parts, and the records — a node the software has quarantined is a ticket in your queue until a technician has swapped the part and it has passed validation again. You will work hand-in-glove with Google’s hardware and support organizations, Capacity Delivery, Construction, Network Engineering, Facility Operations, the SRE & Software Engineering team, and Strategic Supply.

In this role, you will:

  • Build and lead the fleet hardware operations organization — site hardware leads, deployment technicians, and break/fix technicians — with staffing templates, shift and on-call coverage models, and training and certification standards that scale ahead of the capacity ramp; hire people better than you at their craft.

  • Own cluster deployment end to end: inbound logistics and receiving inspection, staging and secure storage, rack integration and elevations, structured fiber and copper cabling to a published standard, liquid-cooled rack installation and manifold connection with Facility Operations, power-on, and validation handoff to the SRE team — treating each cluster as a gated schedule from dock to first customer workload.

  • Run break/fix and RMA for the fleet: repair queue and SLAs by severity, parts swaps and node re-validation, RMA processing with Google and OEM/ODM partners, and failure-rate trending by component and generation that feeds back into Supply and Google.

  • Own the spares program and asset lifecycle: spares depot sizing per site against failure rates and lead times, inventory accuracy, serialized asset tracking from receipt through decommission in DCIM (NetBox or equivalent), and reconciliation to Finance’s fixed-asset register.

  • Own decommission and generation transitions: rack decommission procedures, data-bearing device sanitization and destruction with chain-of-custody, asset disposition (ITAD, return, or redeploy), and the physical sequencing of TPU generation swaps inside live facilities.

  • Manage colocation and partner remote-hands teams to Crux’s hardware standard — scopes of work, SLAs, access and escort procedures, and an audit program with witnessed work — and enforce remedies when performance slips.

  • Author and enforce the hardware operations standards library — deployment playbook, cabling and labeling standards, MOPs for energized-rack work, ESD and lifting safety, change control on production hardware — applied consistently across owned and partner sites.

  • Report fleet hardware performance to the executive team monthly — deployment velocity (racks per week versus plan), time-to-repair, spares fill rate, RMA aging, and inventory accuracy — and drive the corrective actions those numbers demand.

SIGNALS OF SUCCESS

  • 60 days — Fluent in the TPU rack, cabling, and liquid-cooling requirements set from Google; deployment playbook v1 and cabling/labeling standard drafted; DCIM platform and asset-tracking model selected with Business Systems; staffing plan and coverage model for the first site approved with hiring in motion.

  • 6 months — First cluster deployed dock-to-validation under your playbook, with racks-per-week tracked against plan; break/fix queue, RMA process with Google, and spares depot live at the first site; every serialized asset in DCIM and reconciled to Finance; partner remote-hands scope and SLA in force at any colo site.

  • 1+ year — Fleet hardware operations running as a repeatable function across multiple sites with published time-to-repair, spares fill rate, and inventory accuracy at or better than target; component failure trending informing Supply negotiations and Google escalations; first TPU generation transition executed with decommission, sanitization, and disposition clean; site hardware leads in place and owning their sites.

EXPERIENCES, ATTRIBUTES AND MINDSET THAT INDICATE A GOOD MATCH

Experiences

  • 10+ years in data center hardware or server operations — deployment, break/fix, and asset lifecycle for large server and network fleets — including 5+ years leading technician teams across shifts and sites in a 24/7 environment.

  • Direct experience deploying high-density AI/HPC clusters: accelerator-dense racks, high-radix fabric cabling (InfiniBand, RoCE, or equivalent optical fabrics), and liquid-cooled rack installation — you have run the dock-to-validation sequence yourself, not just approved the plan.

  • Built or scaled a hardware operations program through rapid growth: deployment playbooks, spares and RMA programs, DCIM/CMDB discipline with audited inventory accuracy, and vendor or colo remote-hands management under contractual SLAs.

Attributes

  • Outcome driven and hands-on. This is a builder’s seat, not a supervisory one. You will be on the dock for the first delivery, in the cold aisle for the first rack, and on the phone with Google for the first RMA — not because there is no team, but because the person accountable for the fleet’s hardware has to be close enough to the work to change it. Then you hire people better than you at their craft and stay close enough to know when something is off before it shows up in a report.

  • Records are part of the work. You believe a swap that is not in DCIM did not happen, that inventory accuracy is a safety and financial control rather than paperwork, and that the spares depot is sized from failure data, not from a guess.

Mindset

  • Posses a high tolerance for ambiguity. Hardware will arrive before the standard is finished and the customer date will not move. You write the procedure, run it, fix it, and hand it to the next site rather than waiting for one to arrive.

  • Demonstrate velocity through discipline, not heroics. Racks per week is produced by staging, kitting, labeled cabling, and rehearsed sequences — and a deployment saved by a weekend of overtime is a playbook that failed. You build the system that makes the next cluster boring.

  • AI-agentic first. Fluent with AI agents — or committed to becoming so quickly — and you embed them as first principles in how you and your team work, defaulting to agentic workflows before adding headcount or process.

Nice to have [Preferred, not required]:

  • Hardware or server operations leadership at a hyperscaler (Google, AWS, Meta, Microsoft) or neocloud (CoreWeave, Lambda, Nebius, Nscale or similar) during a multi-site deployment ramp.

  • Direct TPU deployment experience, or large GPU cluster deployments (NVL-class or DGX/HGX-class racks) including burn-in and validation handoff.

  • DCIM/CMDB administration (NetBox or similar), ITIL/ITSM process design, and comfort with failure-rate and inventory analytics.

  • Experience with data-bearing device sanitization standards (NIST 800-88), ITAD vendor management, and export-control handling for accelerator hardware.

  • Experience managing colocation remote-hands and smart-hands providers to SLA from the tenant side, including audit program design.

  • Safety program experience for hardware work — ESD, lifting and material handling, energized-rack MOPs, working at height.

Salary Range Information

The annual salary range for this position has been estimated based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Crux

  • We offer generous base, bonus and additional incentive based compensation

  • Health, dental, and vision coverage for you and your dependents

  • Company-paid life insurance and disability

  • Full suite of other optional benefits

  • 401(k) Plan with 4% company match

  • Hybrid schedule offering four days in-office collaboration paired with one remote workday for focused, individual work

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Head of Hardware Operations & AI Infrastructure in Palo Alto, CA vacancy
  • $217k - $236k

    Partner with AI researchers to match hardware with model compute, power, bandwidth, and latency needs.Establish...  ...and vendor relations; partner with Operations to transition prototypes into field...  ...management.Familiarity with test infrastructure.Understanding of hardware... 
    Suggested

    Google

    Mountain View, CA
    2 days ago
  • $160k - $275k

     ...solutions from silicon to systems including hardware and software to train and run the...  ...the tapeout schedule.Define the core operational processes and modes of work for the HW...  ...Bonus Points If You HaveExperience with AI infrastructure, datacenter racks, networking systems,... 
    Suggested
    Daily paid
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    2 days ago
  • $217k - $236k

     ...Program Manager, Off-the-Shelf Hardware, DeepMind Share Technical...  ...management. Familiarity with test infrastructure. Understanding of hardware requirements for AI research. Knowledge of...  ...relations; partner with Operations to transition prototypes into... 
    Suggested

    Google LLC

    Mountain View, CA
    1 day ago
  • $97.6k - $188.4k

     ...Program ManagementCompany: MicrosoftOverviewThe Foundry and Inference Training (FIT) team within Microsoft AI Infrastructure builds the platforms, systems, and operating mechanisms that enable teams to develop, train, deploy, and run AI services at scale. You will help FIT... 
    Suggested
    Ongoing contract
    Full time
    For contractors
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    2 days ago
  • $189k - $210k

     ...Sr Staff Technical Program Manager, Hardware Systems Mountain View, CA Lightmatter...  ...is leading the revolution in AI data center infrastructure, enabling the next giant leaps in human...  ...; coordinate with finance and operations to ensure spend is planned, visible,... 
    Suggested
    Full time
    Contract work
    Temporary work
    Work at office
    Flexible hours
    Shift work

    Lightmatter, Inc.

    Mountain View, CA
    3 days ago
  • $250k - $300k

     ...Role Overview Velaura AI is seeking an experienced Director of IT Infrastructure & Operations to ownIT and infrastructure end to end: the hybrid compute environment...  ...interesting to us: semiconductor, EDA, hardware, or AI‑infrastructure experience; supporting a... 
    For contractors
    Remote work
    Flexible hours

    Velaura

    Santa Clara, CA
    1 day ago
  • $130k - $185k

     ...enabling human life on Mars. DATA INFRASTRUCTURE OPERATIONS MANAGER (STARLINK) The Infrastructure...  ...validation, and continuous improvement of our AI models. We're seeking talented, high-...  ...or more of the following fields: ~ Hardware or product management ~ Engineering... 
    Temporary work
    Flexible hours

    SpaceX

    Sunnyvale, CA
    1 day ago
  • $125k - $190k

     ...has developed an artificial intelligence (AI) powered technology stack purpose-built...  ...integration efforts specifically for our current hardware platform, ensuring its stability and...  ...the Hardware, Software, systems, and operations teams to ensure cross functional deliverables... 
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    3 days ago
  •  ...scientific discovery to powering AI and the technologies people...  ..., inference, evaluation infrastructure, agentic/recursive self-improvement...  ...shared platforms supporting hardware and software optimization,...  ...engineering systems.Experience operating in matrixed, cross-functional... 
    Shift work

    AMD

    Santa Clara, CA
    5 days ago
  •  ...the future of physical AI. Founded in 2017 and...  ...creating the digital infrastructure needed to bring intelligence...  ...and infrastructure, operating systems, and autonomy....  ...from home before heading to the office, or leaving...  ...looking for a Manager, Hardware Technical Program... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago
  • $143k - $198k

    Meta's Infrastructure organization is responsible for designing, building, and operating one of the world's largest data center networks. As a Staff Business Operations professional...  ...Qualifications:Demonstrated ongoing AI skill development (e.g., prompt/context engineering... 
    Hourly pay
    Local area

    Jobleads-US

    Menlo Park, CA
    6 days ago
  • $168k - $258.75k

     ...platforms that power the next generation of AI and data center infrastructure. We are seeking a Technical Program Manager, CPU Hardware Programs to lead progress across complex...  ..., firmware, validation, performance, operations, and product teams. You will clarify complex... 
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $163k - $236k

     ...products or silicon development tooling and infrastructure projects.Assess complexity and scope out...  ...sustaining activities for silicon and hardware products.Minimum qualifications:Bachelor...  ...support Google's custom silicon for AI by managing memory-related aspects of custom... 
    Contract work

    Google

    Sunnyvale, CA
    5 days ago
  • $119.8k - $234.7k

     ...ManagementCompany: MicrosoftOverviewWe are part of the Cloud & AI division at Microsoft. Our mission is to build and operate the trusted cloud and AI platform that enables...  ...segment of the industry. This role is in the AI Infrastructure team which powers the Microsoft AI Foundry,... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    1 day ago
  • $240k - $333k

     ...reports. 7 years of experience driving hardware and data center infrastructure programs.Preferred qualifications:10...  ...production ramp for next-generation AI/ML compute racks, high-density power...  ...facilities, supply chain, and site operations.Google's projects, like our users,... 
    Worldwide
    Shift work

    Google

    Sunnyvale, CA
    4 days ago
  • $163k - $236k

     ...the unique needs and mission of the ADI team.Stay on the edge of AI and data across Google and the broader industry. Attend...  ...experience.5 years of experience in program management.Experience in AI infrastructure.Preferred qualifications:5 years of experience managing cross-... 

    Google

    Mountain View, CA
    3 days ago
  • $163k - $236k

     ...publish data center network hardware requirements, ensuring global...  ...demand plans for networking infrastructure.Optimize inventory health...  ...ensure product success and operational efficiency.Minimum qualifications...  ...growth and delivery through AI-Powered supply chain... 
    Temporary work

    Google

    Sunnyvale, CA
    1 day ago
  •  ...happens on-site across active hardware labs, test floors, and...  ...you will build and own our IT operations end to end. You’ll be responsible...  ...role, you will actively use AI agents and build agentic workflows...  ...robotics lab & compute infrastructure: Help maintain our lab workstation... 
    Work at office
    Local area

    Mind Robotics

    Palo Alto, CA
    4 days ago
  • $200k - $322k

     ...Hardware Infrastructure is seeking a Senior Technical Program Manager to lead the strategy and execution...  ...of programs to support the bringup, operations and modernization of the...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 

    NVIDIA Corporation

    Santa Clara, CA
    13 hours ago
  • $159k - $230k

     ...management, or commodity management within the technology or AI hardware industry.Experience designing and implementing end-to-end...  ...users see online is the architecture built by the Technical Infrastructure team to keep it running. From developing and maintaining our... 
    Temporary work

    Google

    Sunnyvale, CA
    3 days ago
  •  ...engineers, researchers, and operators who have spent our careers working...  ...on the hardest problems in AI, robotics, engineering, and...  .... About the Role As Head of Data Operations at Maven...  ...robot learning, evaluation, infrastructure, hardware, and data teams to translate... 
    Immediate start

    Maven Robotics, Inc.

    Santa Clara, CA
    1 day ago
  • $182k - $242k

     ...is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...CoreWeave combines superior infrastructure performance with deep...  ...and lead how maintenance and operational changes are planned, coordinated...  ...coordinated changes across hardware, firmware, networking, and software... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Coreweave

    Sunnyvale, CA
    13 hours ago
  • $193k - $291k

     ...world’s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver,...  ...that each software release is ready for the road.As Head of Software Operations, you will lead the organization responsible for this... 

    Nuro

    Mountain View, CA
    2 days ago
  • $170k - $255k

     ...Hardware Technical Program Manager, Hyperscale Line of Business Everpure (NYSE: P) has evolved from storage pioneer to data platform,...  ...the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and... 
    Contract work
    Work at office
    Flexible hours

    Pentair

    Santa Clara, CA
    1 day ago
  • $168k - $258.75k

     ...CSP/NCP cloud environments, on-prem infrastructure bring-up, and hardware automation.What you'll be doing:As an...  ...Engineering/SRE, and Data Center Operations) and their leadership, driving critical...  ...dependencies between pioneering AI software stacks and foundational physical... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    6 days ago
  • $192k - $278k

     ...program management. 8 years of infrastructure work experience.Preferred...  ...development with engineers. The AI and Infrastructure team is...  ...the future. From software to hardware our teams are shaping the future...  ...Networking, Data Center operations, systems research, and much more... 
    Work experience placement
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $163k - $236k

     ...slices across multiple layers of the infrastructure stack from hardware and kernel/runtime up through cluster...  ...early, and deliver risk assessments.Operate in an environment where static multi-...  ...with a single live source of truth, AI-assisted workflows, and concise decision... 
    Worldwide
    Shift work

    Google

    Sunnyvale, CA
    3 days ago
  • $240k - $333k

     ...strategic program roadmaps, operational priorities, and resource allocation...  ...time-to-market.Partner with Infrastructure Finance and engineering...  ...program alignment with Hardware Supply Chain and Systems and...  ...organizations.Experience leveraging AI/ML tools or automated... 

    Google

    Sunnyvale, CA
    4 days ago
  • $166k - $271k

     ...needs of the team.The LinkedIn Infrastructure Engineering Technical Program...  ....com. The org builds and operates massive-scale systems: physical...  ...observability, and Data and AI/ML platforms.Engineering Team...  ...platforms, Infrastructure, and Hardware.Experience working in cloud... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    3 days ago
  •  ...the future of physical AI. Founded in 2017 and...  ...creating the digital infrastructure needed to bring intelligence...  ...and infrastructure, operating systems, and autonomy....  ...from home before heading to the office, or leaving...  ...role As the Head of Hardware Manufacturing... 
    Full time
    Contract work
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Hardware Operations & AI Infrastructure. Be the first to apply!