Head of GPU Cloud
Confidential
Head of GPU Cloud
About the Company
Building software foundation for next-generation accelerated computing platform for large-scale AI infrastructure
Industry
Computer Software
Type
Privately Held
About the Role
The Company is in search of a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a next-generation accelerated computing platform. The successful candidate will be instrumental in defining the architecture and operating model for large-scale AI inference services, with a direct impact on GPU utilization, platform economics, and customer experience. This role demands a leader with a strong technical background in software engineering, particularly in the areas of cloud platforms, distributed infrastructure, and HPC. The Head of GPU Cloud will be responsible for shaping the platform architecture, production inference, and engineering strategy, and must have a proven track record in leading engineering teams and making critical technical decisions. Key responsibilities for the Head of GPU Cloud include building and scaling the engineering organization, setting the architecture for efficient AI workload management, and leading the optimization of production model serving. The ideal candidate will have at least 12 years of software engineering experience, with a focus on large-scale model inference and a deep understanding of technologies such as vLLM, TensorRT LLM, and TGI. Advanced knowledge of Kubernetes, containerized infrastructure, and practical experience with GPU memory behavior and high-bandwidth networking is essential. The role also requires a leader with strong technical and leadership judgment, capable of balancing performance, reliability, security, and customer experience across multidisciplinary teams. Experience in GPU cloud, AI infrastructure, and a track record of improving accelerator utilization and compute economics are highly valued.
Functions
- Engineering
- ...Head of Channel About the Company Innovative provider of AI security solutions Industry Computer & Network Security Type... ...partner development, or ecosystem leadership in cybersecurity, cloud infrastructure, enterprise software, or a related field. A track...Cloud
$500 per month
...the reason most people first hear of us, and it is why ClickHouse Cloud fills with new users every day. As the database becomes a... ...Developer relations is how we hold up our end of that relationship. As Head of Developer Relations, you’ll own how developers discover...CloudLocal areaRemote workHome officeFlexible hours- ...Head of Partner Ecosystem About the Company Globally recognized provider of cloud-native IoT connectivity solutions Industry Telecommunications Type Privately Held Founded 2014 Employees 51-200 Categories Technology Information Technology...Cloud
- ...Head of GPU Cloud About the Company Developing software foundation for next-generation accelerated computing platform for large-scale AI infrastructure. Industry Information Technology and Services Type Privately Held About the Role The Company...Cloud
- ...Vibrant provider of cost optimization & automation solutions for cloud computing Industry Internet Type Privately Held, VC-backed... ...application automation and cloud native automation gpu infrastructure ai infrastructure kubernetes cost optimization...Cloud
- ...improvement, while partnering with engineering, construction, quality, and cloud operations teams. Candidates should have at least 12 years of... ...hyperscale, colocation, cloud, high-performance computing, or AI/GPU environments—including hands-on work with liquid-cooled, high-...Cloud
$160k - $190k
...Reply, we are hiring a Manager for the Data & AI team. The person will mainly focus on building modern data platforms using Microsoft cloud technologies, including Fabric and Databricks for our customers. As a technical leader, the person will assist with setting the...CloudFull time- ...Head of Growth Marketing About the Company Leading provider of cloud & infrastructure management solutions Industry Computer Software Type Privately Held, VC-backed Founded 2017 Employees 51-200 Funding $51-$75 million Categories Networking...Cloud
- ...the intersection of machine learning, computer vision, spatial AI, cloud infrastructure, and large-scale data engineering. You will work... ...Functions, Glue, and CloudWatch. Experience operating distributed GPU workloads and optimizing GPU utilization, scheduling, autoscaling...CloudHourly pay
$130k - $150k
...degree in Computer Science; Engineering or related field. • 6+ years of experience in data engineering, data platform development, or cloud data solutions • 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing...CloudFull time- ..., and production-ready AI solutions Roles and Responsibilities ·Build and support production-grade Agentic AI solutions using cloud-native AI platforms such as AWS Bedrock, Azure AI Foundry, or GCP Vertex AI. ·Design intelligent agents capable of tool use, workflow...CloudFull time
- ...$50 million Categories B2B Enterprise SAAS Information Technology & Services Technology Networking Cisco Cloud Computing Computer Networking Computer System Design Services Cybersecurity Internet Of Things Journalism Management...Cloud
- ...Head of Data About the Company Innovative provider of online legal services Industry Internet Type Privately Held... ...attorney fees making the law simple connecting with a lawyer cloud services and connecting with a lawyer Business...Cloud
- ...Privately Held Founded 2011 Employees 201-500 Specialties continuous integration continuous delivery saas cloud computing developer tools enterprise continuous deployment containers paas devops cicd ci/cd software delivery...Cloud
- ...$50 million Categories B2B Enterprise SAAS Information Technology & Services Technology Networking Cisco Cloud Computing Computer Networking Computer System Design Services Cybersecurity Internet Of Things Journalism Management...CloudWorldwide
- ...Head of Credit & Fraud About the Company Expanding financial technology (FinTech) & wealth management platform Industry Internet Type Privately Held, VC-backed Founded 2009 Employees 51-200 Funding $101-$200 million Categories Internet...
- ...Head of Power Origination About the Company An independent power producer managing wind, solar, and battery storage assets across U.S. markets Industry Renewables & Environment Type Privately Held About the Role The Company is seeking a Head of...Contract work
- ...Head of Actuarial About the Company Health insurer seeking actuarial leader to drive strategy, modeling, and C-suite insights. Industry Insurance Type Privately Held About the Role The Company is seeking a Head of Actuarial to play a pivotal role...
- ...Head of Funnel Conversion About the Company Innovative provider of weight loss & health products Industry Information Technology and Services Type Privately Held, VC-backed Founded 2021 Employees 51-200 Specialties obesity men's health...Full timeRemote work
- ...Vice President, Product Strategy, Technology Workflows About the Company Thriving cloud computing company offering custom management platforms Industry Computer Software Type Public Company Founded 2004 Employees 10,001+ Categories Information...CloudShift work
- ...Head of Marketplace About the Company Special Operations-inspired cognitive performance coaching for law enforcement professionals Industry Professional Training & Coaching Type Privately Held, VC-backed Founded 2023 Employees 11-50 Funding...
- ...Head of Structures About the Company Building an orbital-class launch vehicle designed for reuse Industry Defense & Space Type Privately Held, VC-backed About the Role The Company is seeking a Head of Structures to take on a pivotal role in the...
- ...Head of Sanctions About the Company Pioneering banking institution specializing in retail, corporate, and digital banking services Industry Financial Services Type Public Company Founded 1967 Employees 1001-5000 Categories Financial Services...
- ...Head of AI About the Company AI-native fintech building document intelligence SaaS for private market investors Industry Financial Services Type Privately Held, VC-backed About the Role The Company is seeking a Head of AI to lead its AI function...
- ...Head of Propulsion About the Company Startup building an orbital-class reusable launch vehicle with strong institutional backing Industry Aviation & Aerospace Type Privately Held About the Role The Company is seeking a Head of Propulsion to join...
- ...Head of Acquisition About the Company Innovative tech company focusing on cryptocurrency portfolios Industry Financial Services Type Privately Held, VC-backed Founded 2018 Employees 1-10 Funding $11-$25 million Categories Financial...
- ...Head of Inference About the Company Ambitious AI infrastructure provider Industry Information Technology and Services Type Privately Held, VC-backed About the Role The Company is seeking a Head of Inference to take ownership of model serving at...
- ...Head of Applied AI About the Company Innovative telehealth platform specializing in no-code software for DTC telehealth businesses Industry Internet Type Privately Held Founded 2021 Employees 51-200 About the Role The Company is seeking...
- ...Head of Solution Architecture About the Company Building infrastructure for digital financial services and crypto, backed by investors, recently Series B funded Industry Financial Services Type Privately Held, VC-backed About the Role The Company...
- ...Head of US Government Affairs About the Company Top developer of anti-money laundering software for Bitcoin-run businesses Industry Computer Software Type Privately Held, VC-backed Founded 2014 Employees 501-1000 Funding $200+ million...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of GPU Cloud. Be the first to apply!
- director of cloud Detroit, MI
- cloud admin Detroit, MI
- vp cloud Detroit, MI
- oracle cloud technical Detroit, MI
- cloud security Detroit, MI
- aws cloud Detroit, MI
- cloud administrator Detroit, MI
- junior cloud administrator Detroit, MI
- salesforce commerce cloud Detroit, MI
- senior cloud service delivery manager Detroit, MI




