Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Infrastructure Operations

Full-time

Runware

About Runware

Runware is the AI inference platform that builds and operates its own infrastructure, end to end. One API gives developers access to image, video, audio, 3D and language models, and our Sonic Inference Engine runs them on hardware we designed ourselves: custom servers, custom boards and a closed-loop, water-free cooling system, packed into Sonic Inference Pods — roughly 1 MW of liquid-cooled GPU compute in a 20-foot container that can be sited wherever power is cheap and available.

This is why infrastructure at Runware is the product, not a cost center. Our edge is that we run inference 30–90% cheaper per GPU-hour than our peers, and that edge is earned in the data center: in how fast we can stand up a new site, how tightly we run our fleet, and how little downtime our customers ever see. More than 20 billion requests have run through the platform for over a million developers, with customers such as Wix, Quora, Freepik and Higgsfield building production applications on top of it.

We raised a $50M Series A led by Dawn Capital, with Comcast Ventures, Speedinvest, Insight Partners and a16z speedrun participating, and we are now building out a global network of pods across the US and Europe. We need someone to own how that network is operated.

The role

As Head of Infrastructure Operations, you'll own the physical and operational backbone of Runware: the servers, storage and networking across every site we run, and the team that keeps them running. You'll take us from a handful of pods to a global fleet, and you'll decide how that fleet is built, provisioned, monitored, maintained and scaled.

This is a hands-on leadership role. You'll set the operating model and hire the team, but you'll also be in the terminal, in the rack and in the incident channel when it matters. The people who do best here are senior operators who never stopped being engineers, who are already using AI tools to multiply their own output, and who know what a high-performance infrastructure team looks like because they've built one before.

You'll report to Risto Haukioja, Head of AI Infrastructure and work closely with the hardware, platform and inference engineering teams, and with our data center, power and hardware partners.

What you'll do

  • Build and run global infrastructure operations across our pod sites in the US and Europe: site bring-up, rack and stack, cabling, power and cooling integration, burn-in and acceptance, through to steady-state operations and decommissioning.
  • Own the server, storage and network layers of the fleet end to end: Linux fleet management, bare-metal provisioning and imaging, firmware and driver lifecycle, high-throughput storage for model weights and caches, and the data center and inter-site networks that tie it together.
  • Define how a new site goes live, then make it faster every time. Turn pod deployment into a repeatable, documented, largely automated playbook so that standing up the next 1 MW is a routine, not a project.
  • Set and hit reliability targets. Own capacity planning, monitoring, alerting, on-call, incident response and post-incident reviews, and drive the GPU, node and network failure rates down over time.
  • Hire, lead and develop a high-performance team of data center, systems and network engineers across time zones, and set the bar for how that team operates.
  • Manage colocation, power, connectivity and hardware vendors and partners, including capacity contracts, lead times, spares and RMA flows, and site-level budgets.
  • Partner with hardware and platform engineering so that what we design is operable at scale, and feed what you learn in the field back into the next generation of servers and pods.
  • Use AI to accelerate the work: automate runbooks, triage and tooling with LLM-based agents, and expect your team to do the same, so that a small team can run a very large fleet.
  • Own the operational side of security and compliance for our physical infrastructure: access control, hardening, asset tracking and audit readiness, including data residency requirements for in-country deployments.

Requirements

What we're looking for

  • 15+ years in infrastructure engineering and operations, with at least several of those leading the function at a company that runs its own hardware at scale.
  • A track record of building infrastructure operations across multiple sites, regions or countries, not just operating what someone else built. You've opened data centers, pods or colocation footprints and know what goes wrong between the plan and the first production workload.
  • Deep, current, hands-on Linux expertise: kernel and driver behaviour, performance tuning, bare-metal provisioning, configuration management and fleet automation. You can still debug a misbehaving node at 2 a.m. and you'd rather fix the root cause than restart it.
  • Strong storage fundamentals: NVMe, distributed and parallel file systems, object storage, and designing for the throughput and IOPS that model loading and caching demand.
  • Strong networking fundamentals: L2/L3 design, BGP, data center fabrics, high-bandwidth interconnects and the debugging skills to find a flapping link or a misconfigured switch quickly.
  • Experience running high-performance teams: you've hired, led and retained strong engineers, set clear standards, and built an on-call and incident culture that people are proud of rather than burned out by.
  • You use AI to accelerate your own output every day, for scripting, runbooks, analysis, documentation and debugging, and you have a clear view of how a small team armed with these tools should operate differently from a traditional ops org.
  • Comfortable owning outcomes in a fast-moving, ambiguous environment, making decisions with incomplete information and being accountable for uptime, cost and delivery.
  • Able to travel to sites in the US and Europe as needed.

Nice to have

  • Experience operating large GPU fleets for AI training or inference, including NVIDIA driver, Fabric Manager and NCCL stacks, and GPU health and failure management at scale.
  • Hands-on experience with RDMA fabrics (InfiniBand or RoCE), 400G+ Ethernet and the tooling to monitor them.
  • Experience with liquid-cooled, high-density or modular and containerized data center designs, and with power and cooling integration at the site level.
  • Familiarity with the hardware supply chain: server ODMs, component lead times, inventory and spares strategy, and RMA economics.
  • A strong automation stack background: Ansible, Terraform, PXE and image pipelines, IPMI and Redfish, and observability with Prometheus and Grafana or similar.
  • Experience with Kubernetes or Slurm on bare metal.
  • Experience building or running infrastructure to meet data residency, sovereignty or compliance requirements across jurisdictions.

Benefits

What we offer

  • A rare mandate: build global AI infrastructure operations from the ground up, at a company whose business depends on doing it better than anyone else, with the budget and backing to match.
  • Meaningful stock options.
  • We're a remote-first collective, meeting in person twice a year to plan, brainstorm and celebrate wins. We keep core hours for collaboration and calls; outside those, you set your own schedule.
  • Our release cycles are fast and intense, and they're followed by real downtime. We expect you to take it.
  • Generous paid time off, including vacation, sick days and public holidays.
  • Paid maternity, paternity and caregiver leave.
  • Twice-yearly company retreats in inspiring locations.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Head of Infrastructure Operations in Palo Alto, CA vacancy
  • $175k - $215k

     ...Network Operations ManagerWaymo is an autonomous driving technology company with the mission to be the world's most trusted driver....  ...build and operate a resilient, scalable, and intelligent digital infrastructure that powers both Waymo's commercialization and day-to-day... 
    Suggested
    Full time
    Remote work

    Waymo

    Mountain View, CA
    4 days ago
  •  ...Job Description Job Description The role Step is looking for its first Infrastructure Engineer to help us define and implement how we deploy and run our software in the cloud. This is an opportunity to start as an individual contributor and help us build and lead... 
    Suggested
    Work experience placement
    Work from home
    Flexible hours

    Hired Recruiters

    Palo Alto, CA
    3 days ago
  • $170k - $200k

     ...LVIS is building the future of AI-driven neurodiagnostics with a global team of innovators. LVIS is seeking an experienced Head of Operations to oversee and scale company operations across HR, compliance, legal coordination, business administration, and... 
    Suggested

    LVIS

    Palo Alto, CA
    1 day ago
  •  ...VC Lab, the leading venture capital accelerator worldwide, and operate the Decile Hub platform, which combines CRM, back office, digital...  ...room, and many other critical tools for VCs.   We are hiring a Head of Operations to lead the day-to-day operations of our complex... 
    Suggested
    Remote work
    Worldwide

    decilegroup

    Palo Alto, CA
    7 days ago
  • $250k - $325k

     ...Head Of Business Operations A leading national law firm is seeking a Head of Business Operations for its wholly owned AI subsidiary, the firm's frontier development arm dedicated to bringing technology-industry practices into the legal domain. The role can be based... 
    Suggested

    C&M Legal Search

    Palo Alto, CA
    2 days ago
  •  ...industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world’s largest network of...  ...Visit us at . We are seeking an experienced Senior Manager, Infrastructure Maturity & Assessment to lead rigorous baseline assessments and... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    4 days ago
  • $130k - $185k

     ...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. DATA INFRASTRUCTURE OPERATIONS MANAGER (STARLINK) The Infrastructure Operations team is responsible for the end-to-end management of suppliers, costs,... 
    Temporary work
    Flexible hours

    SpaceX

    Sunnyvale, CA
    4 days ago
  • $92.29 - $102.54 per hour

     ...find an exceptional professional ready to drive transformative change and directly elevate the efficiency of vital patient care operations. In this dynamic role, you will have the unique opportunity to spearhead high-impact, cross-functional improvement initiatives, directly... 
    Hourly pay
    Temporary work
    Work at office

    Skill Corp

    Palo Alto, CA
    3 days ago
  • $132.4k - $179.2k

     ...Program Operations Manager Aeva's mission is to bring the next wave of perception to a broad range of applications from automated...  ...effectively executed Help establish scalable program-management infrastructure and best practices as Aeva's programs and organization... 
    Flexible hours

    Aeva, Inc

    Mountain View, CA
    1 day ago
  • $149k - $220k

     ...Lightmatter is leading the revolution in AI data center infrastructure, enabling the next giant leaps in human progress. The company invented...  ...future of computing with light! Lightmatter’s Supply Chain Operations team designs and executes the complex, global manufacturing... 
    Full time
    Contract work
    Temporary work
    Immediate start

    Lightmatter

    Mountain View, CA
    1 day ago
  • $70 per hour

     ...vehicle-level network and security specifications and build the real-time diagnostic and automated verification infrastructure that keeps our fleet operating safely. Waymo interns partner with leaders in the industry on projects that create impact to the company. We... 
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    Mountain View, CA
    18 hours ago
  •  ...City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions...  ...to Live." WHO ARE WE LOOKING FOR? We are looking for a Head of Infrastructure Engineering in our Palo Alto office to lead... 
    Work at office

    woven-by-toyota

    Palo Alto, CA
    1 day ago
  • $132k - $198k

     ...$2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the TeamSoftware Operations is the processing muscle behind Nuro Driver. We take the onroad miles our fleet collects and turn them into usable data, which becomes... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $161k - $264.5k

     ...for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation....  ...WE LOOKING FOR? We are looking for a Head of Infrastructure Engineering in our...  ...example and mentoring the team members to operate accordingly Engage and participate... 
    Temporary work
    For contractors
    Work at office
    Flexible hours

    Woven by Toyota

    Palo Alto, CA
    26 days ago
  •  ...industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world’s largest network of...  ...are seeking an exceptional consulting leader to serve as our Infrastructure Resiliency Lead, a senior L5 position with enterprise-wide ownership... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    4 days ago
  • $250k - $300k

    Santa Clara, CAIT - IT /Full-time /On-siteRole OverviewVelaura AI is seeking an experienced Director of IT Infrastructure & Operations to own IT and infrastructure end to end: the hybrid compute environment our designers depend on, the security program that protects our... 
    Full time
    For contractors
    Remote work
    Flexible hours

    Auradine

    Santa Clara, CA
    3 days ago
  • $165k - $265k

     ...of enabling human life on Mars. SR. NETWORK ENGINEER, AI INFRASTRUCTURE (STARSHIELD) Starshield leverages SpaceX's Starlink technology...  ..., and more. As a Network Engineer you will drive the operation, build and deployment of the Starshield data center network,... 
    Temporary work
    Internship
    Immediate start
    Weekend work

    SpaceX

    Palo Alto, CA
    3 days ago
  • $188k - $274k

     ...manufacturability, testability, and supply chain responsiveness in pursuit of high quality, optimal cost and maximum capacity.Manage all operations-related communications, upward and downward, throughout the organization; escalate key issues and present options for resolution... 
    Contract work

    Google

    Mountain View, CA
    3 days ago
  •  ...industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world’s largest network of...  ...us at . We are seeking an experienced leaders for Intelligent Infrastructure Services Advisory to lead large-scale technology transformation... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    3 days ago
  •  ...Our approximately 814,000 people bring deep insights across industries and functions, with capabilities spanning strategy, process, operating model, change management, talent, data, technology and AI. We deliver this expertise through consulting, managed services,... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    9 hours ago
  • $132.5k - $302.4k

     ...are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...landscape, accelerate digital transformation, optimize operational performance, and realize measurable business value from their... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    9 hours ago
  • $175k - $400k

     ...conformance issues in close collaboration with Sourcing and Legal counselWho You Are:5+ years of experience in contract management, legal operations, or commercial contract administration in high-tech or high volume manufacturing sectorsDeep understanding of commercial law... 
    Daily paid
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    MatX

    Mountain View, CA
    1 day ago
  •  ...industries, we offer Strategy and, Interactive, Technology, and Operations services, all powered by the world’s largest network of...  ...communities. Visit us at . .We are seeking a Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    4 days ago
  •  ...This role is the primary design thinker for the engagement — mapping how work gets done today, designing the future-state human + AI operating model, and ensuring every reinvention initiative builds to a consistent, high-quality blueprint. This role sits at the... 
    Live in
    Work at office
    Local area
    Immediate start

    Accenture

    Mountain View, CA
    4 days ago
  • Growing software company is seeking an experienced Contracts Manager to lead the drafting, review, negotiation, and management of a wide range of commercial agreements. This role will support both sales contracting and procurement/vendor contracting, with a strong emphasis...
    Contract work

    Robert Half

    Menlo Park, CA
    2 days ago
  • $126k - $248k

     ...Engineer to take ownership of key areas of MongoDB's global network infrastructure. You'll design, deploy, and troubleshoot network and VPN...  ...stakeholders.What You’ll DoOwn the design, deployment, and operation of MongoDB's global network infrastructure Cisco Meraki, including... 
    Casual work
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    Palo Alto, CA
    1 day ago
  •  ...Mudflap has quickly grown into a profitable fintech platform that processes billions in annual payment volume.As a Manager of Payment Operations at Mudflap, you'll lead how we support small trucking operators whose income doesn't always arrive on a predictable schedule. You... 
    Work at office
    Remote work

    Mudflap

    Palo Alto, CA
    18 hours ago
  • $170.4k - $255.6k

     ...and other firewall policies, network segmentation, NAC/802.1X, and identity-integrated zero-trust access. Segment instrument, operational technology, and manufacturing networks; support validated-system change controls, audits, and ISO/SOX evidence. Integrate network... 

    Pacific Biosciences

    Menlo Park, CA
    1 day ago
  •  ...Head Of It Infrastructure Engineering & Ops The Company is one of the fastest growing and best performing banks in the US, and as such is...  ...improving client experience and developing a disciplined focus on operational rigor and regulatory adherence. The bank is already well... 
    Full time
    Contract work
    Temporary work

    Professional Recruiters

    Santa Clara, CA
    1 day ago
  • Job Description Job Description Job Description Core skills: Program management, organizational, basic troubleshooting Core responsibilities: Demo coordination (managing form responses, Google chat communications, calendar invites, running "briefing...
    Work at office

    ClifyX, INC

    Menlo Park, CA
    22 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Infrastructure Operations. Be the first to apply!