Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of AI Infrastructure

Confidential

Head of AI Infrastructure

About the Company

Venture-backed energy technology company building a new kind of AI compute network.

Industry
Information Technology and Services

Type
Privately Held, VC-backed

About the Role

The Company is seeking a Head of AI Infrastructure to take on a pivotal role in the organization. This is a hands-on position that involves owning the AI platform end-to-end, from compute and memory to network, storage, orchestration, and field operations. The successful candidate will be responsible for bringing up, running, and benchmarking GPU pods in production, as well as continuously measuring and improving inference performance. The role also includes the safe and efficient rollout of frequent updates, designing for graceful failure, and operating a multi-tenant, bare-metal Kubernetes GPU platform. As the fleet expands, the Head of AI Infrastructure will be tasked with building and leading the infrastructure team, acting as the senior technical voice for customers, and setting the infrastructure roadmap. Applicants for the Head of AI Infrastructure position at the company should have a minimum of 12 years' experience in infrastructure, with a strong background in hands-on ownership of physical production compute at scale. Experience in a hyperscaler, GPU cloud, or neocloud environment is essential, as is practical knowledge of AI inference and depth in at least two of the specified technical areas. The role requires strong Linux skills, proficiency in Python or Go, and a proven track record of technical leadership. Nice-to-have qualifications include experience with edge or distributed-site infrastructure, large GPU clusters, and a background at a GPU, chip, or infrastructure vendor. The ideal candidate will be adept at running distributed or multi-site infrastructure and will have the ambition to build and manage a team as the company grows.

Hiring Manager Title
CTO

Functions

  • Engineering
Confidential
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Head of AI Infrastructure in Charlotte, NC vacancy
  • We are seeking a highly experienced Senior Manager to join our Infrastructure Advisory & Transformation practice. In this role, you will help...  ...infrastructure solutions.Support cloud transformation, automation, AI-enabled operations, resilience, and platform modernization... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Charlotte, NC
    3 days ago
  •  ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries....  ...transformation and modernization programs.Experience designing infrastructure to support AI, analytics, data-intensive, and high-performance... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Charlotte, NC
    3 days ago
  •  ...reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries....  ...effectively across teams to deliver reliable and future-ready infrastructure. They are also expected to build strong client relationships,... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Charlotte, NC
    3 days ago
  •  ...developing your skills to guide groundbreaking AI initiatives. If you’re looking for a...  ...for overseeing the end to end GenAI Infrastructure across exploration phase, build, deploy and...  ...ResponsibilitiesCloud Strategy Development - Work alongside Head of Cloud Engineering & Architecture to... 
    Suggested
    Full time
    Work at office

    American International Group (AIG)

    Charlotte, NC
    3 days ago
  •  ...implement, and support secure and scalable AWS cloud networking infrastructure. The ideal candidate will have strong hands-on experience with...  ...and provide solutions around cloud infrastructure, containers, AI, Client & Analytics and Automation. We have partnerships with SAS... 
    Suggested

    Stratacent

    Charlotte, NC
    1 day ago
  •  ...into business terms for executive stakeholdersConduct cloud and infrastructure security strategy, readiness and discovery assessments; be...  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Charlotte, NC
    4 days ago
  • $220k - $270k

     ...maximize the value of the technology and software our clients create through efficient, high-quality, and consistent service, incorporating AI tools and outcome-focused strategies across the product lifecycle. As a Director or Senior Director within our Cloud-Build capability... 
    Temporary work
    Local area

    Slalom

    Charlotte, NC
    14 hours ago
  • $245k - $275k

     ...platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help...  ...leave - Plus more! See benefits for additional details. Use of AI:We may use artificial intelligence (AI) tools to support parts... 
    Full time
    Work at office

    AHEAD

    Charlotte, NC
    14 hours ago
  • $180k - $355.5k

    Position Summary Associate VP, Network Engineering Our Enterprise Networks practice, part of Hybrid Cloud Infrastructure within AI & Engineering, helps clients architect, modernize, and operate the network foundation that underpins their digital and AI-driven ambitions... 
    Local area

    Deloitte

    Charlotte, NC
    6 hours ago
  •  ...cloud, on-premise, and application delivery infrastructure. This is not a traditional routing and...  .... - Use emerging tools, including AI-assisted development, to accelerate complex...  ...a pulse on where network technology is heading and make sure the organization is prepared... 
    Local area
    3 days per week

    RIT Solutions

    Charlotte, NC
    4 days ago
  •  ...deployment of enterprise wired, wireless, and cellular network infrastructure. The role will support network switches, wireless access points...  ...advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening  and hiring... 
    Hourly pay
    Local area

    Eliassen Group

    Charlotte, NC
    a month ago
  •  ...across North America. Our V-Track platform integrates GPS tracking, AI-powered video telematics, and real-time data to drive safety...  ....   Why Join Velocitor Solutions   You’ll own critical infrastructure and network outcomes in a high-availability environment where... 
    Work at office
    Remote work

    Velocitor Solutions

    Charlotte, NC
    a month ago
  • AI ANALYST (BPA/AI) REQUIREMENETS:Ideally possess 5+ years of professional experience working as a techno-functional Analyst throughout their career while possessing recent experience implementing AI tools into a call-center/contact-center environment.Knowledge of Large... 
    Contract work
    Local area
    Relocation

    Cedent Consulting

    Charlotte, NC
    2 days ago
  •  ...legacy of delivering for our clients while evolving to meet tomorrow's challenges. We equip our associates with future-focused skills and AI tools that enable us to advance our mission. Together, we are fighting to ensure a more secure financial future for all and for... 
    Full time
    Work at office

    Teachers Insurance and Annuity Association

    Charlotte, NC
    4 days ago
  • We are seeking an experienced Oracle EPM EPBCS Data Integration & AI Agent Specialist to support a multi‑year Finance Transformation initiative. This role will design, build, and optimize enterprise planning data flows, automate close & planning processes using Oracle... 
    Full time
    Work at office

    Teachers Insurance and Annuity Association

    Charlotte, NC
    1 day ago
  •  ...Vanguard's cloud environment.Drive adoption of automation and AI-enabled solutions to improve operational efficiency, engineering...  ...practices.Partner with Platform Engineering, Architecture, DevOps, Infrastructure, Application Development, and other stakeholders to design and... 
    Full time
    Work experience placement

    Vanguard

    Charlotte, NC
    2 days ago
  • $118.7k - $197.9k

     ...technical documentation. ·Support application integration, cloud infrastructure, networking, security, and migration activities. ·Test and...  ...deadlines ·Ability to provide clear guidance to others The Team AI & Engineering leverages cutting-edge engineering capabilities to... 
    Local area

    Deloitte

    Charlotte, NC
    6 hours ago
  •  ...helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Charlotte, NC
    14 hours ago
  • $149k - $185k

     ...platform engineering role supporting large-scale, multi-cloud GPU infrastructure. Success requires deep operational judgment, disciplined...  ...expands.• Coordinate daily with Networking, Storage, Security, and AI/ML platform teams to resolve cross-system dependencies and improve... 
    Temporary work
    Local area

    Slalom

    Charlotte, NC
    1 day ago
  • $140k - $160k

     ...The primary responsibilities of this role will focus on cloud infrastructure areas covering Azure Platform Operations & Reliability, Azure Kubernetes...  ..., Data Platform Support, FinOps and Cost Governance, and AI Enablement. We can only consider candidates for this position... 
    Full time
    Work at office
    Flexible hours

    Asset Mark

    Charlotte, NC
    3 days ago
  •  ...more information about CGS please visit: or contact: Email: ****@*****.***   #CJ We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying... 
    Full time
    Contract work
    For contractors
    Work at office
    Flexible hours

    Contact Government Services, LLC

    Charlotte, NC
    6 days ago
  • $118.65k - $160k

     ...communication skillsExperience with software testingExperience using AI for code generationPreferred:Master’s degree in computer...  ...Postgres, Dynamo, Nebula; as well as working knowledge of CI/CD and Infrastructure as code (IaC)Pursuant to various state Fair Pay Acts, below is... 
    Full time
    Work at office
    Remote work
    Monday to Friday

    RVO Health

    Charlotte, NC
    1 day ago
  •  ....How you’ll help move us forward:Help build, test, deploy, and maintain reusable workflows, automations, orchestration patterns, and AI-enabled or knowledge-driven solutions that reduce manual effort and improve consistency.Develop and maintain operational scripts, actions... 
    Full time
    Internship
    Flexible hours

    Pacific Life Insurance Company

    Charlotte, NC
    3 days ago
  • $167k - $203k

     ...including workforce management, quality management, recording policies, speech and text analytics, and evaluation forms· Implement Genesys AI capabilities, including bot flows, digital bot flows, Agent Copilot, and integrations with third-party intelligent virtual agent... 
    Temporary work
    Local area

    Slalom

    Charlotte, NC
    1 day ago
  •  ...Engineer is responsible for building and maintaining automation, AI, and machine learning capabilities that enable intelligent...  ...data (metrics, logs, events) as automation inputs. Exposure to Infrastructure as Code and CI/CD practices. Understanding of IT service management... 
    Contract work
    3 days per week

    Apex Systems

    Charlotte, NC
    3 days ago
  • $64.66 - $72.86 per hour

     ...GitHub, GitHub Actions, and CI/CD pipelines Expertise with Infrastructure as Code (e.g., Temporal, GitHub Actions HCL) Strong operational...  ...via APIs, e.g., using Apigee Strong exposure to AI-assisted engineering or AI-driven automation workflows What... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Motion Recruitment

    Charlotte, NC
    2 days ago
  • $98.59k - $173.58k

     ...GIS data and IT infrastructureKnowledge of digitalization strategies that include mobile, IoT, advanced analytics and data science (AI/ML), and imageryMaster’s degree in geography, computer science, or a related fieldExperience with Microsoft Azure or AWS cloud platforms... 

    ESRI

    Charlotte, NC
    4 days ago
  • $60 - $65 per hour

     ...:Role involves building, automating, and maintaining our cloud infrastructure, ensuring its reliability, scalability, and security. You will...  ...including Cloud SQL, GCS, Pub/Sub, Dataflow, BigQuery, and Vertex AI.Required Skills & QualificationsExtensive hands-on experience... 
    Hourly pay

    SRI Tech

    Charlotte, NC
    14 hours ago
  • $137.2k - $205.8k

     ...your goals - and to help others accomplish theirs, too. Join our team as we help shape the future. The Hartford’s Data Analytics and AI Office (DAIO) - and Data Platform Services (DPS) Team is seeking a Senior Staff Platform Engineer.The Hartford’s journey to Cloud is... 
    Full time
    Temporary work
    Work experience placement
    Work at office

    The Hartford Financial Services Group

    Charlotte, NC
    1 day ago
  •  ...results.2. Designs, builds, directs, and implements enterprise infrastructure technology platforms and systems across cloud, network, database...  ...initiatives at enterprise scale.Experience engineering with AI coding agents and assistants (e.g., GitLab Duo, GitHub Copilot,... 
    Full time
    Part time
    Shift work
    Day shift

    Truist

    Charlotte, NC
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of AI Infrastructure. Be the first to apply!