Head of AI Infrastructure
Confidential
Head of AI Infrastructure
About the Company
Venture-backed energy technology company building a new kind of AI compute network.
Industry
Information Technology and Services
Type
Privately Held, VC-backed
About the Role
The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the organization. This is a hands-on position that involves owning the AI platform end-to-end, from compute and memory to network, storage, orchestration, and field operations. The successful candidate will be responsible for bringing up, running, and benchmarking GPU pods in production, as well as continuously measuring and improving inference performance. The role also includes the safe and efficient rollout of frequent updates, designing for graceful failure, and operating a multi-tenant, bare-metal Kubernetes GPU platform. As the fleet expands, the Head of AI Infrastructure will be tasked with building and leading the infrastructure team, acting as the senior technical voice for customers, and setting the infrastructure roadmap. Applicants for the Head of AI Infrastructure position at the company should have a minimum of 12 years' experience in infrastructure, with a strong background in hands-on ownership of physical production compute at scale. Experience in a hyperscaler, GPU cloud, or neocloud environment is essential, as is practical knowledge of AI inference and depth in at least two of the specified technical areas. The role requires strong Linux skills, proficiency in Python or Go, and a proven track record of technical leadership. Nice-to-have qualifications include experience with edge or distributed-site infrastructure, large GPU clusters, and a background at a GPU, chip, or infrastructure vendor. The ideal candidate will be adept at running distributed or multi-site infrastructure and will have the ambition to build and manage a team as the company grows.
Hiring Manager Title
CTO
Functions
- Engineering
- ...communities. Visit us at . .We are seeking a Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help... ...opportunities to improve efficiency through automation, AI-enabled operations, and process optimization.Client Relationship...SuggestedFull timeWork experience placementLive inWork at officeLocal area
- We are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help... ...infrastructure solutions.Support cloud transformation, automation, AI-enabled operations, resilience, and platform modernization...SuggestedFull timeWork experience placementLive inWork at officeLocal area
$114.6k - $234.6k
...design of state-of-the-art RDMA clusters tailored specifically for AI, ML, HPC workloads. We strive to be the go-to experts in... ...deployment, and operations of large-scale global Oracle Cloud Infrastructure (OCI). Primarily focused on the development and support of high...SuggestedTemporary workFlexible hours$102.3k - $209.5k
Job Description At Oracle Cloud Infrastructure (OCI), we build and operate cloud infrastructure at global scale. OCI Dedicated Region25 (DR2... ...reviews, troubleshooting sessions, and knowledge sharing. Use AI-assisted engineering tools responsibly to accelerate network modeling...SuggestedTemporary workFlexible hours$65.7k - $118.3k
...improve our operational efficiency? Join our critical Network Infrastructure Engineering team Our Network Infrastructure Engineering Team takes... ...: Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on...SuggestedWork experience placementWork at office- ...refreshes, network migrations, lifecycle management, and strategic infrastructure initiatives. The ideal candidate has strong experience... ...utilizing Mist Wireless Assurance, Mist Wired Assurance, and Marvis AI . Use AI-driven networking insights and analytics to identify...Full timeContract workRemote work
- ...stable companies at the core of the tech industry-powering the infrastructure behind AI, cloud computing, and the innovations of tomorrow. At E2... ...family-centric culture Collaborate with department heads to assess near- and long-term network capacity needs Plan,...For contractorsWork at office
$94.4k - $224.6k
.... Work: Experience leading large-scale network transformation and modernization programs. Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance application workloads. Knowledge of software-defined networking, intent...Work experience placementLive inWork at officeLocal areaRemote work$112.5k - $202.5k
...technologies in building, configuring and maintaining network infrastructure in support of Akamai's global platform providing the technical... ...Delivery : Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on...Work experience placementWork at office- ...to ensure the efficient operation of the healthcare system's IT infrastructure. Partners closely with operational leaders and end users to... ...other IT systems (e.g., Epic, 3rd Party Imaging Applications, AI, etc.). Integration and Data Management: Collaborate with...Work at officeLocal areaRemote workShift work
$99k - $232k
...LevelManagerJob Description & SummaryThe OpportunityAs a Cloud Infrastructure and Operations Delivery Manager you will oversee client-facing... ...improve cloud operations through automation, digital tooling, and AI-enabled workflows- Building client relationships and...Full timeH1b$102.3k - $209.5k
Job Description Oracle Cloud Infrastructure (OCI) is building the next generation of cloud technologies that operate at massive scale. Our customers... ...from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers...Temporary workWorldwideFlexible hours- ...platforms, wireless services, firewalls, WAN connectivity, and related infrastructure that enable critical business operations. This job is located... ...and gateways, Juniper Mist wireless access points, Mist AI, Marvis Virtual Network Assistant, Junos OS, routers, switches,...Local areaWork from homeHome officeMonday to FridayFlexible hours
$99k - $232k
...ApplicableSpecialismData, Analytics & AIManagement LevelManagerJob Description & SummaryThe OpportunityAs a Engineering Manager, Google Cloud AI/ML you will lead the design and delivery of Google Cloud AI and machine learning solutions within our Data & Analytics Engineering...Full timeH1b$124k - $280k
...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Engineering Manager, Google Cloud AI/ML you will lead engineering efforts that design, build, and scale AI and machine learning solutions on Google Cloud, focusing on...Full timeH1b- ...CloudWatch, Prometheus, DatadogExperience/Knowledge of writing Infrastructure-as-Code (IaC), using tools like CloudFormation or TerraformExperience... ...tasks using Python or other languagesKnowledge in leveraging AI/LLM tools to enable self-service on diagnosing infrastructure...
$110.7k - $218.3k
...translate that operating knowledge into a future state vision. From there, they will work closely with technical teams, including agentic AI capabilities, to build it. You will define where the client is today, articulate where they need to go, and own the future state...Local area$130k - $180k
...consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This... ...across mission-critical services. Establish CI/CD, GitOps, Infrastructure as Code (IaC), automated testing, and deployment strategies for...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...activitiesSets the overall guidance and expectations for team output, practices, and collaborationLeads team adoption of enterprise-authorized AI-assisted engineering practices and SDLC/TLM automation to improve delivery speed, quality, and operational outcomes, while setting...Immediate start
$146.99k - $167.79k
...helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and...Hourly payFull timeLive inWork at officeLocal areaFlexible hours$110k - $125k
...Organizations are racing to put data to work across analytics and AI, while AI copilots and agents are emerging as an entirely new... ...responsible for the organization's AI platforms, endpoints, infrastructure, networks, SaaS applications, cloud platforms, IAM, and more....Full timeWork at officeLocal areaWorldwide3 days per week- ..., tactical operations, and the execution and implementation of processes and procedures Sets direction and governance for agentic AI-enabled engineering and SDLC/TLM automation within a technical area to drive measurable improvements in speed, quality, and operational...
- ...secure and high-quality production code, and reviews and debugs code written by othersDrives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI...
- ...driving performance, reliability, and scalability across hybrid infrastructure environments. Key Responsibilities Architect, manage,... ...infrastructure with organizational needs. Utilize automation and AI-enabled tools to improve troubleshooting, monitoring,...
$61k - $101k
...as Bitbucket or GitHub. We expect practical cloud-native experience. We require hands-on experience using enterprise-authorized AI-assisted software development tools for coding, test creation, troubleshooting, or documentation, with the ability to critically...Full time$60 - $62 per hour
...Network Data Engineer With Good Experience in • Cisco data network infrastructure. • Good Experience in Data Centres • Good Experience in CISCO... ...Onsite $60 - $62 an hour We may use artificial intelligence (AI) tools to support parts of the hiring process, such as...- ...system. This platform supports the company’s robotics, controls, AI, and safety-critical applications. The Platform Software... ..., and maintain reusable frameworks, utilities, APIs, and core infrastructure used by other engineering teams. This is a strong fit for a hands...
$100k - $150k
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship$137.2k - $205.8k
Senior Staff Infrastructure Engineer - IEB07BEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond... ...will solve complex challenges, mentor engineers, and apply AI as a responsible productivity accelerator while retaining...Full timeTemporary workWork at office3 days per week- ...With your expertise in delivering infrastructure solutions, you are a top-performer in your field. Come on board as a highly appreciated member... ...were successfully met. Uses enterprise-authorized AI capabilities within the work environment to accelerate infrastructure...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!
- infrastructure manager Columbus, OH
- director of infrastructure Columbus, OH
- head of infrastructure Columbus, OH
- infrastructure engineering manager Columbus, OH
- infrastructure manager
- senior infrastructure manager
- information technology infrastructure manager
- cloud infrastructure manager
- infrastructure support manager
- infrastructure supervisor




