Head of AI Infrastructure
Confidential
Head of AI Infrastructure
About the Company
Early-stage hyperscale innovator building a next-generation neocloud for large-scale AI workloads.
Industry
Information Technology and Services
Type
Privately Held, VC-backed
About the Role
The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the design, deployment, and operation of a next-generation, global, security-first GPU cloud platform. The successful candidate will be responsible for creating and evolving an elastic GPU cloud fabric that can scale from hundreds to thousands of accelerators while ensuring low-latency performance for AI training and inference. This role demands a technical leader with a strong background in cloud infrastructure, platform engineering, or systems architecture, and a proven track record in operating large GPU clusters. Key responsibilities include defining compute, storage, and high-speed network blueprints, owning Kubernetes-based scheduling, and guiding enterprise customers through technical engagements. The Head of AI Infrastructure will also be instrumental in building and mentoring a distributed team of infrastructure architects and site-reliability engineers. Applicants for the Head of AI Infrastructure position at the company should have at least 10 years' of experience in a relevant field, with a focus on PCIe or NVLink topologies, high-performance networking, and distributed storage for AI workloads. Deep production experience with Kubernetes or similar schedulers in GPU environments is essential, as is a proven track record in customer-facing technical roles. The ideal candidate will be comfortable in a fast-paced, venture-backed environment and have a passion for solving problems at a multi-petaflop scale. Bonus points are awarded for hands-on experience with liquid cooling, hybrid or multi-cloud deployments, and large-scale model training frameworks. The role offers the opportunity to make an immediate impact, work with cutting-edge technology, and be part of a global, remote-first culture.
Travel Percent
Less than 10%
Functions
- Engineering
- ...Head of Infrastructure Engineering About the Company Pioneering cloud infrastructure company Industry Information Technology and Services... ...lead the design, deployment, and operations of cutting-edge AI and HPC infrastructure. This pivotal role involves driving...Suggested
- ...'re looking for a technical leader to own and evolve our cloud infrastructure, security posture, and development operations. This is a foundational... ...Partner with technical leadership to advance the product's AI capabilities Drive technical decisions on build vs. buy,...SuggestedFull timeRemote workFlexible hours
Growth Signals
Boston, MA2 days ago - ...architecture) ~40% automation & engineering (IaC, scripting, AI-driven ops) ~20% trading / low-latency exposure (nice to have... ...What you'll do: Architect and evolve a global network infrastructure Drive an automation-first approach (Ansible, Terraform, code...SuggestedRemote work
Cannon Search Partners
Boston, MA20 hours ago - ...IT Infrastructure Manager, Cloud Platform Location - US (Pittsburgh or Boston) or Toronto, Canada Why Confluence? At Confluence, we... ...Stage 2: Screening Call with Talent Acquisition Team Stage 3: AI Interview Scheduler Stage 4: Hiring Manager Interview Stage 5:...SuggestedWork at officeRemote workFlexible hours
Confluence Technologies
Boston, MA4 days ago $245k - $275k
...platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help... ...more! See benefits for additional details. Use of AI: We may use artificial intelligence (AI) tools to support...SuggestedWork at officeRemote workAHEAD USA
Boston, MA20 hours ago- ...industry expertise, we are able to harness the potential of Cloud, AI, ML, IoT, 5G, and quantum computing to design and implement... ...; assist in the design, implementation and migration to new IT infrastructure and cloud (IaaS/PaaS) environments Primary liaison with client...Full timeH1bLocal area
KPMG
Boston, MAa month ago $38.03 - $76.06 per hour
...performance metrics to identify efficiency issues and supports infrastructure growth with guidance. Responsibilities Planning & Execution... ...from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn...Hourly payTemporary workFlexible hoursOracle
Boston, MA2 days ago$140k - $165k
...00-$85,000.00 4 days ago Boston, MA $100,000.00-$125,000.00 6 days ago Boston, MA $75,000.00-$85,000.00 6 days ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-LjbffrFull timeLocal areaFranklin Fitch
Boston, MA2 days ago$90 - $100 per hour
...Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Maverick Technology Partners... ...Responsibilities Design, implement, and support enterprise networking infrastructure Architect, deploy, and operate SASE solutions Implement...Full timeContract workRemote workMaverick Technology Partners
Boston, MA2 days ago- ...across the full lifecycle of mobile network infrastructure from lab integration and commissioning... ...right in. This role is based out of our Head Quarters office in Nashua, NH, 45 miles north... ...monitoring capabilities, including AI/ML-driven anomaly detection and intelligent...Work at office
Parallel Wireless
Boston, MA20 hours ago - ...Eliassen Group values transparency in our recruitment practices. Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring process. You may receive email and SMS notifications from the...Hourly payContract workLocal areaRemote workNight shiftWeekend work
Eliassen Group
Boston, MA5 days ago - ...strong background in networking and security platforms to join our Infrastructure and Technology Service team. The successful candidate will work... ...able to respond to successful applicants. Note: The use of AI tools during interviews or assessments is strictly prohibited...Work at office
Eclipse Trading
Dorchester, MA10 days ago - ...Get AI-powered advice on this job and more exclusive features. Interview process will require an in-person interview. Tax... ...within a technical environment (e.g., software development, IT infrastructure, product development). Required Skills Proven experience...Contract workShift work
FirstPRO
Boston, MA1 day ago $170.6k - $390k
...premises, cloud, and hybrid environments, and partnering closely with infrastructure, cloud, application, and security operations teams. Join... ...while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future...Summer holidayRemote workFlexible hoursEY
Boston, MA20 hours ago$80k - $150k
...The role focuses on gathering, refining, and documenting requirements that support evolving technology and data platforms, including AI-enabled capabilities. Responsibilities · Partner with business, operations, and technology stakeholders to gather, analyze, and...Remote workFlexible hours1 day per weekWellington Insurance Group
Boston, MA20 hours ago$80k - $153k
...as a bridge between business strategy and technical execution, communicating effectively with senior stakeholders Apply Generative AI tools responsibly to enhance analysis quality, accelerate synthesis, and improve documentation and decision support Drive...Work from homeFidelity Investments
Boston, MA3 days ago$85.4k
...standard process-modeling practices, data-analysis techniques, and modern digital tools-including BPMN, SaaS integration frameworks, and AI-enabled platforms-to support system development, customer-experience enhancements, and continuous improvement efforts. This...Remote workMAXIMUS
Boston, MA3 days ago$120k - $150k
...plans, researchers, and life sciences companies. From fulfilling a single patient's request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future of how data is connected and used to improve health. By joining...Datavant
Boston, MA13 hours ago$90k - $180k
...and business analysts to solve more complex problems and help document solutions for future reuse • Assist with the integration of AI technologies into GDAS support processes. • Engage in proactive problem-solving and continuous improvement of data support methodologies...Remote workFlexible hoursRotating shiftWeekend work1 day per weekWellington Management
Boston, MA12 hours ago- ...Eliassen Group values transparency in our recruitment practices. Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring process. You may receive email and SMS notifications from the...Hourly payContract workLocal areaRemote work
Eliassen Group
Boston, MA7 days ago $90k - $180k
...and business analysts to solve more complex problems and help document solutions for future reuse · Assist with the integration of AI technologies into GDAS support processes. · Engage in proactive problem-solving and continuous improvement of data support methodologies...Remote workFlexible hoursRotating shiftWeekend work1 day per weekWellington Insurance Group
Boston, MA20 hours ago- ...network project that includes both wired and wireless network infrastructure and related hardware & software. The project's objectives are to... ...****@*****.*** #CJ We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...Full timeLocal areaMonday to FridayFlexible hours
$109.2k - $223.4k
...Job Description We are the AI Infrastructure - Network Operations team at OCI. We support and operate the RDMA/RoCE network fabrics for OCI's largest AI and HPC customers. These fabrics are the foundation underneath OCI's AI, GPU and HPC services, and support major...Temporary workImmediate startFlexible hoursOracle
Boston, MA2 days ago$186.07k - $218.9k
...protocols (LoRaWAN, Bluetooth, Zigbee, etc) and networked security infrastructure (e.g., IP cameras and alarms). ~ Extensive experience working... ...security tooling to support penetration testing and AI penetration testing activities. Experience pentesting AI systems...Local areaCoinbase
Boston, MA3 days ago$166k - $282k
...Engineering, Product Engineering, R&D, Security, Finance, and Infrastructure, and is accountable for shaping a coherent portfolio of capabilities... ..., trustworthy, and easy to adopt for technical users. Apply AI and automation intentionally where they improve product...Full timeTemporary workWork at officeAthenahealth
Boston, MA20 hours ago$140k - $170k
A leading health and performance company is seeking a Senior Business Systems Analyst in Boston, MA. The role focuses on improving customer support and streamlining Membership Services through technical solutions and automation. Candidates need 5+ years of experience in...- Google seeks a GCP Outcome Customer Engineer to drive initial and ongoing revenue for our customers in Cambridge, MA. This role involves deploying cloud solutions and ensuring clients maximize their Google Cloud investment. Successful candidates will have 10+ years in customer...
$90k - $180k
...primary contacts for external parties during the onboarding process, providing technical support and guidance. Design and implement AI-assisted intelligent tools to automate FIX onboarding workflows, including configuration validation, message conformance checks,...Remote workFlexible hours1 day per weekWellington Management
Boston, MA4 days ago$33.9 - $44.07 per hour
...business needs with the support and guidance of fellow Applications Team members Assist in identifying opportunities for automation and AI-enabled capabilities and support their implementation under the guidance of fellow Applications Team members, ensuring adherence to...Hourly payWork at officeChristian Science Inc
Boston, MA4 days ago$90k - $180k
...primary contacts for external parties during the onboarding process, providing technical support and guidance. Design and implement AI-assisted intelligent tools to automate FIX onboarding workflows, including configuration validation, message conformance checks,...Remote workFlexible hours1 day per weekWellington Insurance Group
Boston, MA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!
- director of infrastructure Boston, MA
- head of infrastructure Boston, MA
- infrastructure manager Boston, MA
- infrastructure engineering manager Boston, MA
- information technology infrastructure manager
- director of infrastructure
- infrastructure supervisor
- head of infrastructure
- senior infrastructure manager
- infrastructure manager