Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

Venture-backed energy technology company building a new kind of AI compute network.

Industry
Information Technology and Services

Type
Privately Held, VC-backed

About the Role

The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the organization. This is a hands-on position that involves owning the AI platform end-to-end, from compute and memory to network, storage, orchestration, and field operations. The successful candidate will be responsible for bringing up, running, and benchmarking GPU pods in production, as well as continuously measuring and improving inference performance. The role also includes the safe and efficient rollout of frequent updates, designing for graceful failure, and operating a multi-tenant, bare-metal Kubernetes GPU platform. As the fleet expands, the Head of AI Infrastructure will be tasked with building and leading the infrastructure team, acting as the senior technical voice for customers, and setting the infrastructure roadmap. Applicants for the Head of AI Infrastructure position at the company should have a minimum of 12 years' experience in infrastructure, with a strong background in hands-on ownership of physical production compute at scale. Experience in a hyperscaler, GPU cloud, or neocloud environment is essential, as is practical knowledge of AI inference and depth in at least two of the specified technical areas. The role requires strong Linux skills, proficiency in Python or Go, and a proven track record of technical leadership. Nice-to-have qualifications include experience with edge or distributed-site infrastructure, large GPU clusters, and a background at a GPU, chip, or infrastructure vendor. The ideal candidate will be adept at running distributed or multi-site infrastructure and will have the ambition to build and manage a team as the company grows.

Hiring Manager Title
CTO

Functions

  • Engineering
Confidential
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in Boston, MA vacancy
  •  ...communities. Visit us at . We are seeking an experienced Senior Manager, Infrastructure Maturity & Assessment to lead rigorous baseline assessments and...  ...our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    2 days ago
  • We are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...infrastructure solutions.Support cloud transformation, automation, AI-enabled operations, resilience, and platform modernization... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  •  ...communities. Visit us at . .We are seeking a Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...opportunities to improve efficiency through automation, AI-enabled operations, and process optimization.Client Relationship... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  •  ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries....  ...transformation and modernization programs.Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Boston, MA
    4 days ago
  • $122.2k - $240.5k

    Position Summary Senior Network Engineer Our Enterprise Networks practice, part of Hybrid Cloud Infrastructure within AI & Engineering, helps clients architect, modernize, and operate the network foundation that underpins their digital and AI-driven ambitions. We... 
    Suggested
    Local area

    Deloitte

    Boston, MA
    5 days ago
  •  ...Do you have a passion for optical network infrastructure and cutting edge DWDM technologies? Would you enjoy building high use and highly...  ...point of escalation for production network issues. Leveraging AI-driven tools and scripting to automate operational workflows, accelerate... 
    Work at office
    Worldwide

    Akamai

    Cambridge, MA
    1 day ago
  • $60 - $68 per hour

     ...studio environments, and AWS cloud. Our network is evolving: an AI-driven Juniper/Mist campus fabric, a Palo Alto Networks...  ...Design, implement, and operate our Juniper/Mist campus and branch infrastructure. Engineer and maintain the Palo Alto Networks security stack. Build... 
    Hourly pay
    Work experience placement

    WideNet Consulting

    Boston, MA
    2 days ago
  •  ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries....  ...transformation and modernization programs.Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Boston, MA
    4 days ago
  • $112.5k - $202.5k

     ...technologies in building, configuring and maintaining network infrastructure in support of Akamai's global platform providing the technical...  ...Delivery: Scaling the world's biggest moments without a glitch. AI: Enabling our customers to build, secure, and scale AI apps on... 
    Work experience placement
    Work at office

    Akamai

    Cambridge, MA
    3 days ago
  • $200k - $250k

     ...VIA is making an impact, and so can you. VIA is the digital infrastructure company mission-critical organizations rely on when speed and security...  ..., and deliver humanitarian aid. VIA’s products span agentic AI, zero-trust identity, quantum-resistant data, and offline... 
    Full time
    For contractors
    Summer work
    Remote work
    Work from home
    Flexible hours

    VIA

    Somerville, MA
    11 days ago
  •  ...into business terms for executive stakeholdersConduct cloud and infrastructure security strategy, readiness and discovery assessments; be...  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Boston, MA
    5 days ago
  •  ...Senior Vice President, Director of Performance Measurement & Infrastructure About the Company Globally recognized provider of strategic...  ...pivotal role in shaping the future of its data, infrastructure, and AI capabilities. The successful candidate will be responsible for... 

    Confidential

    Boston, MA
    23 hours ago
  • $245k - $275k

     ...platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help...  ...leave - Plus more! See benefits for additional details. Use of AI:We may use artificial intelligence (AI) tools to support parts... 
    Full time
    Work at office

    AHEAD

    Boston, MA
    9 hours ago
  •  ...readiness across complex networking domains including routing, switching, cloud-managed networking, SD-WAN, security-adjacent workflows, and AI-driven support experiences.The ideal candidate brings deep hands-on experience with HPE Juniper Networking platforms such as ACX... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    Hewlett Packard Enterprise

    Boston, MA
    4 days ago
  • $180k - $355.5k

    Position Summary Associate VP, Network Engineering Our Enterprise Networks practice, part of Hybrid Cloud Infrastructure within AI & Engineering, helps clients architect, modernize, and operate the network foundation that underpins their digital and AI-driven ambitions... 
    Local area

    Deloitte

    Boston, MA
    1 day ago
  • $94.4k - $224.6k

     .... Work: Experience leading large-scale network transformation and modernization programs. Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance application workloads. Knowledge of software-defined networking, intent... 
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Boston, MA
    2 days ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryThe OpportunityAs a Cloud Infrastructure and Operations Delivery Manager you will oversee client-facing...  ...improve cloud operations through automation, digital tooling, and AI-enabled workflows- Building client relationships and... 
    Full time
    H1b

    PwC

    Boston, MA
    2 days ago
  • $90k - $180k

     ...platforms supporting portfolio analysis, risk, or performance.Working familiarity with Python, SQL and data analysis tools.Experience with AI-enabled tooling ecosystems (e.g. Copilot) and adoption patternsWhy Wellington ManagementAt Wellington Management, technology is... 
    Full time
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Boston, MA
    2 days ago
  • $96k - $144k

     ...end-user support team as well as with our Security, Networking, AI, Risk, and Trust teams, and the broader Engineering department. About...  ...make their work easier today and scale for where the business is headed.Leave behind clean configurations, least-privilege access, and... 
    Apprenticeship
    Internship
    Immediate start

    Klaviyo

    Boston, MA
    2 days ago
  • $156k - $195k

    Datadog’s People Technology team is building the future of AI at work. We’re looking for a People Systems Developer to design and...  ...technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect... 
    Work at office

    Datadog

    Boston, MA
    1 day ago
  • $112k - $168k

     ...technical escalation point when systems break.Klaviyo is building an AI-first future, and IT is where a lot of that gets real. You will...  ...Security Groups, ACLs, and IAM in AWS and GCP.Experience with infrastructure-as-code (Terraform, Ansible) or version-controlled... 
    Work at office
    Shift work

    Klaviyo

    Boston, MA
    2 days ago
  • $200k - $300k

     ...builders, and researchers who want to be part of that loop.As an AI robotics company that deploys its inventions directly into the...  ...operate the tools the company runs on. That only works if the infrastructure underneath them is built for it: environments they can stand up... 
    Full time
    Immediate start
    Shift work

    Tutor Intelligence

    Watertown, MA
    1 day ago
  • $172k - $236.5k

     ...connective tissue that powers data and technology infrastructure across Flagship's growing portfolio of...  ...computing, containerized pipelines, and AI/ML infrastructure. They will partner...  ...matures.Work with portfolio company CTOs and heads of data science and bioinformatics to... 
    For contractors

    Seres Therapeutics

    Somerville, MA
    2 days ago
  • $111k - $138.3k

     ...are directly used by our customers’ systems, as well as both Sonos-internal and our partner services and systemsLeverage Generative AI tools (e.g., GitHub Copilot, Claude Code, Google Gemini) as part of your daily workflow to accelerate code generation, testing, and debuggingParticipate... 
    Full time
    Temporary work
    Work at office
    Immediate start
    Remote work
    3 days per week

    Sonos

    Boston, MA
    1 day ago
  • $180.5k - $236.91k

    Hi, we're Oscar. We're hiring a Senior Software Engineer, Cloud Infrastructure / SRE to join our Engineering team.Oscar is the first health...  ...paid wellness time and reimbursements.Artificial Intelligence (AI): Our AI Guidelines outline the acceptable use of artificial intelligence... 
    Full time
    Work at office
    Remote work

    Oscar Health Insurance

    Boston, MA
    5 days ago
  • $153.6k - $207.8k

     ...including senior technology and business leaders, to understand their business objectives and translate them into innovative cloud and AI solutions that drive meaningful impact in pharmaceutical innovation.As a PCA, you'll be responsible for creating and leading solution... 
    Flexible hours

    AmazonWebServices

    Boston, MA
    3 days ago
  • $86k - $146k

     ...testability, and reliable delivery improvements that help the team ship software with confidence. Explore emerging technologies — including AI-assisted development and intelligent automation — and bring ideas that improve the product and team effectiveness. Required... 
    Full time
    Temporary work
    H1b
    Work at office
    Worldwide
    Home office
    Flexible hours
    3 days per week

    NASDAQ OMX

    Boston, MA
    3 days ago
  • $90k - $210k

     ...innovative team. You will support projects that provide critical AI, machine learning, simulation, situational awareness, and...  ...software applications using Python.Develop and maintain cloud infrastructure using infrastructure-as-code practices.Oversee the deployment of... 
    Full time

    MORSE Corp

    Cambridge, MA
    2 days ago
  •  ...helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $118.7k - $197.9k

     ...technical documentation. ·Support application integration, cloud infrastructure, networking, security, and migration activities. ·Test and...  ...deadlines ·Ability to provide clear guidance to others The Team AI & Engineering leverages cutting-edge engineering capabilities to... 
    Local area

    Deloitte

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!