Head of AI Infrastructure
Confidential
Head of AI Infrastructure
About the Company
Venture-backed energy technology company building a new kind of AI compute network.
Industry
Information Technology and Services
Type
Privately Held, VC-backed
About the Role
The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the organization. This is a hands-on position that involves owning the AI platform end-to-end, from compute and memory to network, storage, orchestration, and field operations. The successful candidate will be responsible for bringing up, running, and benchmarking GPU pods in production, as well as continuously measuring and improving inference performance. The role also includes the safe and efficient rollout of frequent updates, designing for graceful failure, and operating a multi-tenant, bare-metal Kubernetes GPU platform. As the fleet expands, the Head of AI Infrastructure will be tasked with building and leading the infrastructure team, acting as the senior technical voice for customers, and setting the infrastructure roadmap. Applicants for the Head of AI Infrastructure position at the company should have a minimum of 12 years' experience in infrastructure, with a strong background in hands-on ownership of physical production compute at scale. Experience in a hyperscaler, GPU cloud, or neocloud environment is essential, as is practical knowledge of AI inference and depth in at least two of the specified technical areas. The role requires strong Linux skills, proficiency in Python or Go, and a proven track record of technical leadership. Nice-to-have qualifications include experience with edge or distributed-site infrastructure, large GPU clusters, and a background at a GPU, chip, or infrastructure vendor. The ideal candidate will be adept at running distributed or multi-site infrastructure and will have the ambition to build and manage a team as the company grows.
Hiring Manager Title
CTO
Functions
- Engineering
- ...Head of Infrastructure About the Company Progressive AI & software development firm Industry Computer Software Type Privately Held About the Role The Company is seeking a Head of Infrastructure to lead the design, implementation, and optimization...Suggested
$220k - $350k
...Grade Level (for internal use): 16 The Role: Global Head of Cloud & Infrastructure Responsibilities and Impact: Lead S&P Global's Cloud... ...forward deployment engineering, enterprise architecture, and AI foundations across all global business divisions Architect...SuggestedFull timeLive inWorldwideFlexible hours- ...Job Description: Director of Infrastructure Engineering 1-0970-4c4f-a273-a1b557d5ad9f&utm_source=referral&utm_medium=share&utm... ...to build and scale the platform that powers production AI systems. You'll own the strategy and execution behind our cloud...SuggestedFull timeRemote work
$198.25k - $231.25k
...- Best Lawyers® “Best Law Firms”. Summary The Director, Infrastructure is a senior technology leader responsible for the strategic planning... ...technology platforms, support secure adoption of cloud and AI-enabled productivity capabilities, and communicate effectively...SuggestedWork at officeRemote workFlexible hours- ...IT Infrastructure Manager Location: New York City (On-site, 5 days/week with occasional travel to New Jersey) About Dana-co Dana-co... ...governance, automation, and cost optimization Evaluate and implement AI-powered tools and automation to improve IT operations and...Suggested
- ...communities. Visit us at . .We are seeking a Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help... ...opportunities to improve efficiency through automation, AI-enabled operations, and process optimization.Client Relationship...Full timeWork experience placementLive inWork at officeLocal area
- We are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help... ...infrastructure solutions.Support cloud transformation, automation, AI-enabled operations, resilience, and platform modernization...Full timeWork experience placementLive inWork at officeLocal area
- .../ Denver, CO / New York, NY Hybrid Full-time Not specified Infrastructure Job Description About Us At Cloudflare, we are on a... ...candidates who have the instinct to spot a “normalized” problem and the AI-native curiosity to create a solution using the latest tools....Full timeLocal area
- ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries.... ...transformation and modernization programs.Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance...Full timeWork experience placementLive inWork at officeLocal areaRemote work
- ...Fluidstack is building civilization-scale infrastructure for AI and seeks a Network Deployment / Infrastructure Delivery leader. You will own the network activation path, drive readiness gates, and coordinate engineering, deployment, and supply chain across multiple sites...
- ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries.... ...transformation and modernization programs.Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance...Full timeWork experience placementLive inWork at officeLocal areaRemote work
- ...Job Description Job Description Infrastructure Deal Lead Career Launch AI Talent Network Location: New York, NY (Hybrid) Employment Type: Full-Time Industry: Infrastructure / Investment Banking / Financial Services Experience Level: Analyst / Early...Full timeInternship
$182k - $242k
CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and... ...startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$125k - $140k
...DREAM employee, please click here to review our Internal Selection Process before applying. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying...Full timeTemporary workInterim roleSummer workWork at officeLocal areaRemote workFlexible hours2 days per week$145k - $155k
...in Purchase, NY, and involves leading a team, managing network infrastructure, and collaborating across various divisions. The position requires... ...Authorization: By applying for this job, you agree to receive AI-generated calls, text messages, and/or emails from Mitchell...Full timeRemote workRelocation- ...into business terms for executive stakeholdersConduct cloud and infrastructure security strategy, readiness and discovery assessments; be... ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...Full timeWork experience placementLive inWork at officeLocal areaRemote work
- Principal Duties: Serve as the Infrastructure Delivery Program Director. Leads enterprise innovation initiatives by bridging strategic technology... ...for driving process and technology adoption, which may include AI/ML, facilitating executive discovery sessions, and translating...
$155.33k - $191.58k
...production. In this role, you will architect and support the global infrastructure that powers our corporate offices, warehouses, and flagship New... ....com. At Peloton, we embrace technology, including AI, to enhance productivity and accelerate innovation in the work...Temporary workLocal areaWorldwide- ...recommendations. Perform minor software upgrades on network infrastructure. Conduct proactive performance assessments of clients' network... ...@nri-na.com. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...Temporary workFlexible hours
$140k - $185k
...Job Description Job Description Sponsor Network Analyst Career Launch AI Talent Network Location: New York, NY (Hybrid) Type: Full-Time Compensation: $140,000 – $185,000 total compensation (varies by employer) About This Role This Sponsor Network Analyst...Full timeInternship- Beam is an ultrafast AI inference platform. We built a serverless runtime that launches GPU‑backed containers in less than 1 second... ...new data center sites, and we need someone to stand up that infrastructure and drive deployments to completion. Deploy and validate data...
$185k - $220k
...investing, our Technology team is constantly evolving our firm’s IT infrastructure and engineering capabilities, positioning us at the forefront... ...architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our...Work experience placement$64.37k - $102.99k
...Location: Remote Home, US Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs,... ...organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 52,000...Local areaRemote workWorldwideFlexible hoursWeekend work$112.5k - $202.5k
...technologies in building, configuring and maintaining network infrastructure in support of Akamai's global platform providing the technical... ...Delivery : Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on...Work experience placementWork at office- ...• Design, implement, maintain, and optimize Carrier Grade NAT infrastructure supporting large-scale broadband subscriber services. • Engineer... ...details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex...Contract workRemote workNight shift
- ...support, ensuring new initiatives are delivered on time and existing infrastructure stays highly available, secure, and performant. The position... ...US and global (EMEA/AP) team. We use Artificial Intelligence (AI) to enhance our recruitment process. Join a global leader...
- ...Gruve is an innovative software services startup dedicated to transforming enterprises to AI powerhouses. We specialize in cybersecurity, customer experience, cloud infrastructure, and advanced technologies such as Large Language Models (LLMs). Our mission is to assist...Shift workNight shift
$42 - $47 per hour
Get AI-powered advice on this job and more exclusive features. This range is provided by Aditi Consulting. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $42.00/hr - $47.00/hr Payrate: $42.00 - $47.0...Full timeContract work- About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development...
- ...Work Location Type: #onsite #remote #hybrid IREN is a leading AI Cloud Service Provider, delivering large-scale GPU clusters for... ...performance data center networks that power large-scale AI/ML and cloud infrastructure. Acts as the escalation point for complex network issues,...Daily paidFull timeTemporary workLive outRemote workRelocation packageShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!
- infrastructure manager New York, NY
- director of infrastructure New York, NY
- head of infrastructure New York, NY
- infrastructure engineering manager New York, NY
- infrastructure manager
- senior infrastructure manager
- information technology infrastructure manager
- cloud infrastructure manager
- infrastructure support manager
- infrastructure supervisor




