Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

Venture-backed energy technology company building a new kind of AI compute network.

Industry
Information Technology and Services

Type
Privately Held, VC-backed

About the Role

The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the organization. This is a hands-on position that involves owning the AI platform end-to-end, from compute and memory to network, storage, orchestration, and field operations. The successful candidate will be responsible for bringing up, running, and benchmarking GPU pods in production, as well as continuously measuring and improving inference performance. The role also includes the safe and efficient rollout of frequent updates, designing for graceful failure, and operating a multi-tenant, bare-metal Kubernetes GPU platform. As the fleet expands, the Head of AI Infrastructure will be tasked with building and leading the infrastructure team, acting as the senior technical voice for customers, and setting the infrastructure roadmap. Applicants for the Head of AI Infrastructure position at the company should have a minimum of 12 years' experience in infrastructure, with a strong background in hands-on ownership of physical production compute at scale. Experience in a hyperscaler, GPU cloud, or neocloud environment is essential, as is practical knowledge of AI inference and depth in at least two of the specified technical areas. The role requires strong Linux skills, proficiency in Python or Go, and a proven track record of technical leadership. Nice-to-have qualifications include experience with edge or distributed-site infrastructure, large GPU clusters, and a background at a GPU, chip, or infrastructure vendor. The ideal candidate will be adept at running distributed or multi-site infrastructure and will have the ambition to build and manage a team as the company grows.

Hiring Manager Title
CTO

Functions

  • Engineering
Confidential
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in Columbus, OH vacancy
  •  ...communities. Visit us at . .We are seeking a Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...opportunities to improve efficiency through automation, AI-enabled operations, and process optimization.Client Relationship... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Columbus, OH
    3 days ago
  • We are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...infrastructure solutions.Support cloud transformation, automation, AI-enabled operations, resilience, and platform modernization... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Columbus, OH
    3 days ago
  • $114.6k - $234.6k

     ...design of state-of-the-art RDMA clusters tailored specifically for AI, ML, HPC workloads. We strive to be the go-to experts in...  ...deployment, and operations of large-scale global Oracle Cloud Infrastructure (OCI). Primarily focused on the development and support of high... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Columbus, OH
    5 days ago
  • $102.3k - $209.5k

    Job Description At Oracle Cloud Infrastructure (OCI), we build and operate cloud infrastructure at global scale. OCI Dedicated Region25 (DR2...  ...reviews, troubleshooting sessions, and knowledge sharing. Use AI-assisted engineering tools responsibly to accelerate network modeling... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Columbus, OH
    4 days ago
  • $65.7k - $118.3k

     ...improve our operational efficiency? Join our critical Network Infrastructure Engineering team Our Network Infrastructure Engineering Team takes...  ...: Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on... 
    Suggested
    Work experience placement
    Work at office

    Akamai

    Columbus, OH
    4 days ago
  •  ...refreshes, network migrations, lifecycle management, and strategic infrastructure initiatives. The ideal candidate has strong experience...  ...utilizing Mist Wireless Assurance, Mist Wired Assurance, and Marvis AI . Use AI-driven networking insights and analytics to identify... 
    Full time
    Contract work
    Remote work

    DataField Technology Services

    Columbus, OH
    2 days ago
  •  ...stable companies at the core of the tech industry-powering the infrastructure behind AI, cloud computing, and the innovations of tomorrow. At E2...  ...family-centric culture Collaborate with department heads to assess near- and long-term network capacity needs Plan,... 
    For contractors
    Work at office

    E2 Optics

    Columbus, OH
    2 days ago
  • $94.4k - $224.6k

     .... Work: Experience leading large-scale network transformation and modernization programs. Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance application workloads. Knowledge of software-defined networking, intent... 
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Columbus, OH
    1 day ago
  • $112.5k - $202.5k

     ...technologies in building, configuring and maintaining network infrastructure in support of Akamai's global platform providing the technical...  ...Delivery : Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on... 
    Work experience placement
    Work at office

    Akamai

    Columbus, OH
    3 days ago
  •  ...to ensure the efficient operation of the healthcare system's IT infrastructure. Partners closely with operational leaders and end users to...  ...other IT systems (e.g., Epic, 3rd Party Imaging Applications, AI, etc.). Integration and Data Management: Collaborate with... 
    Work at office
    Local area
    Remote work
    Shift work

    OhioHealth

    Columbus, OH
    7 days ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryThe OpportunityAs a Cloud Infrastructure and Operations Delivery Manager you will oversee client-facing...  ...improve cloud operations through automation, digital tooling, and AI-enabled workflows- Building client relationships and... 
    Full time
    H1b

    PwC

    Columbus, OH
    21 hours ago
  • $102.3k - $209.5k

    Job Description Oracle Cloud Infrastructure (OCI) is building the next generation of cloud technologies that operate at massive scale. Our customers...  ...from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers... 
    Temporary work
    Worldwide
    Flexible hours

    Oracle

    Columbus, OH
    1 day ago
  •  ...platforms, wireless services, firewalls, WAN connectivity, and related infrastructure that enable critical business operations. This job is located...  ...and gateways, Juniper Mist wireless access points, Mist AI, Marvis Virtual Network Assistant, Junos OS, routers, switches,... 
    Local area
    Work from home
    Home office
    Monday to Friday
    Flexible hours

    Abercrombie & Fitch

    Columbus, OH
    2 days ago
  • $99k - $232k

     ...ApplicableSpecialismData, Analytics & AIManagement LevelManagerJob Description & SummaryThe OpportunityAs a Engineering Manager, Google Cloud AI/ML you will lead the design and delivery of Google Cloud AI and machine learning solutions within our Data & Analytics Engineering... 
    Full time
    H1b

    PwC

    Columbus, OH
    21 hours ago
  • $124k - $280k

     ...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Engineering Manager, Google Cloud AI/ML you will lead engineering efforts that design, build, and scale AI and machine learning solutions on Google Cloud, focusing on... 
    Full time
    H1b

    PwC

    Columbus, OH
    21 hours ago
  •  ...CloudWatch, Prometheus, DatadogExperience/Knowledge of writing Infrastructure-as-Code (IaC), using tools like CloudFormation or TerraformExperience...  ...tasks using Python or other languagesKnowledge in leveraging AI/LLM tools to enable self-service on diagnosing infrastructure... 

    JP Morgan Chase

    Columbus, OH
    1 day ago
  • $110.7k - $218.3k

     ...translate that operating knowledge into a future state vision. From there, they will work closely with technical teams, including agentic AI capabilities, to build it. You will define where the client is today, articulate where they need to go, and own the future state... 
    Local area

    Deloitte

    Columbus, OH
    4 days ago
  • $130k - $180k

     ...consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This...  ...across mission-critical services. Establish CI/CD, GitOps, Infrastructure as Code (IaC), automated testing, and deployment strategies for... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Columbus, OH
    more than 2 months ago
  •  ...activitiesSets the overall guidance and expectations for team output, practices, and collaborationLeads team adoption of enterprise-authorized AI-assisted engineering practices and SDLC/TLM automation to improve delivery speed, quality, and operational outcomes, while setting... 
    Immediate start

    JP Morgan Chase

    Columbus, OH
    3 days ago
  • $146.99k - $167.79k

     ...helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and... 
    Hourly pay
    Full time
    Live in
    Work at office
    Local area
    Flexible hours

    Accenture

    Columbus, OH
    3 days ago
  • $110k - $125k

     ...Organizations are racing to put data to work across analytics and AI, while AI copilots and agents are emerging as an entirely new...  ...responsible for the organization's AI platforms, endpoints, infrastructure, networks, SaaS applications, cloud platforms, IAM, and more.... 
    Full time
    Work at office
    Local area
    Worldwide
    3 days per week

    Immuta

    Columbus, OH
    5 days ago
  •  ..., tactical operations, and the execution and implementation of processes and procedures Sets direction and governance for agentic AI-enabled engineering and SDLC/TLM automation within a technical area to drive measurable improvements in speed, quality, and operational... 

    Chase

    Columbus, OH
    3 days ago
  •  ...secure and high-quality production code, and reviews and debugs code written by othersDrives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI... 

    JP Morgan Chase

    Columbus, OH
    3 days ago
  •  ...driving performance, reliability, and scalability across hybrid infrastructure environments. Key Responsibilities Architect, manage,...  ...infrastructure with organizational needs. Utilize automation and AI-enabled tools to improve troubleshooting, monitoring,... 

    Agility Partners

    Columbus, OH
    2 days ago
  • $61k - $101k

     ...as Bitbucket or GitHub. We expect practical cloud-native experience. We require hands-on experience using enterprise-authorized AI-assisted software development tools for coding, test creation, troubleshooting, or documentation, with the ability to critically... 
    Full time

    J.P. Morgan

    Columbus, OH
    3 days ago
  • $60 - $62 per hour

     ...Network Data Engineer With Good Experience in • Cisco data network infrastructure. • Good Experience in Data Centres • Good Experience in CISCO...  ...Onsite $60 - $62 an hour We may use artificial intelligence (AI) tools to support parts of the hiring process, such as... 

    Distro

    Columbus, OH
    2 days ago
  •  ...system. This platform supports the company’s robotics, controls, AI, and safety-critical applications.   The Platform Software...  ..., and maintain reusable frameworks, utilities, APIs, and core infrastructure used by other engineering teams. This is a strong fit for a hands... 

    MRINetwork Jobs

    Columbus, OH
    24 days ago
  • $100k - $150k

    Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Columbus, OH
    more than 2 months ago
  • $137.2k - $205.8k

    Senior Staff Infrastructure Engineer - IEB07BEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond...  ...will solve complex challenges, mentor engineers, and apply AI as a responsible productivity accelerator while retaining... 
    Full time
    Temporary work
    Work at office
    3 days per week

    The Hartford Financial Services Group

    Columbus, OH
    1 day ago
  •  ...With your expertise in delivering infrastructure solutions, you are a top-performer in your field. Come on board as a highly appreciated member...  ...were successfully met. Uses enterprise-authorized AI capabilities within the work environment to accelerate infrastructure... 

    JPMorgan Chase Bank, N.A.

    Columbus, OH
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!