Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of GPU Cloud

Confidential

Head of GPU Cloud

About the Company

Developing software foundation for next-generation accelerated computing platform for large-scale AI infrastructure

Industry
Information Technology and Services

Type
Privately Held

About the Role

The Company is in search of a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a next-generation accelerated computing platform. The successful candidate will be instrumental in defining the architecture and operating model for large-scale AI inference services, with a direct impact on GPU utilization, platform economics, and customer experience. This role demands a leader with a strong technical background in software engineering, particularly in the areas of cloud platforms, distributed infrastructure, and HPC. The Head of GPU Cloud will be responsible for scaling the engineering organization, setting the technical strategy, and ensuring the platform's reliability and performance. Close collaboration with cross-functional leaders is essential to align software decisions with the technical requirements of the infrastructure. Applicants for the Head of GPU Cloud position at the company should have a minimum of 12 years' of software engineering experience, with at least 5 years' in a leadership role. The ideal candidate will have a proven track record in operating large-scale model inference and a deep understanding of model serving optimization, Kubernetes, and containerized infrastructure. Experience in GPU cloud, AI infrastructure, and accelerated computing environments is highly valued. The role requires a leader with strong technical and leadership judgment, capable of balancing performance, reliability, security, and customer experience. Additional experience in areas such as elastic inference services, model customization workflows, and scaling engineering organizations in dynamic environments is a plus. The Head of GPU Cloud will be expected to establish engineering standards, lead the team in incident readiness, and recruit and develop senior technical talent.

Functions

  • Engineering
Confidential
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Head of GPU Cloud in Boston, MA vacancy
  •  ...Head of Channel About the Company Innovative provider of AI security solutions Industry Computer & Network Security Type...  ...partner development, or ecosystem leadership in cybersecurity, cloud infrastructure, enterprise software, or a related field. A track... 
    Cloud

    Confidential

    Boston, MA
    2 days ago
  •  ...Head of Partner Ecosystem About the Company Globally recognized provider of cloud-native IoT connectivity solutions Industry Telecommunications Type Privately Held Founded 2014 Employees 51-200 Categories Technology Information Technology... 
    Cloud

    Confidential

    Boston, MA
    2 days ago
  • $225k - $337.5k

     ...Chief Operating Officer and serving on the COO Leadership Team, the Head of Third-Party Management will work closely with the Chief Risk...  ...risks associated with outsourcing, technology providers, cloud services, data processors, sub-custodians and other critical suppliers... 
    Cloud
    Full time
    Temporary work
    Interim role
    Flexible hours
    Shift work

    State Street Bank

    Boston, MA
    4 days ago
  •  ...an accomplished senior engineering and transformation leader to head the Investment Solutions Group (Multi-Asset) technology organization...  ..., application programming interfaces, data integration and cloud-based solutions.Embed disciplined requirements, testing, release... 
    Cloud
    Full time
    Temporary work
    Flexible hours
    Shift work

    State Street Bank

    Boston, MA
    5 days ago
  • $131k - $250k

     ...Position Overview: Lead product strategy and roadmaps for cloud infrastructure, compute, and GPU platforms supporting AI, HPC, enterprise, and cloud workloads. Key Responsibilities: Define product vision, roadmap, requirements, and pricing. Partner with... 
    Cloud
    Relocation
    Visa sponsorship

    Voktio

    Cambridge, MA
    more than 2 months ago
  •  ...Job Description Job Description Senior Product Manager – GPU Products & AI Infrastructure Why This Opportunity? This is an opportunity...  ...to shape the future of AI and accelerated computing in the cloud. You will play a pivotal role in defining the GPU products,... 
    Cloud
    Remote job

    Globalchannelmanagement

    Cambridge, MA
    10 days ago
  •  ...Job Description Job Description Senior Product Manager – Next-Gen Cloud Infrastructure & GPU Platforms We are seeking a highly technical Senior Product Manager to lead the strategy and roadmap for our next-generation cloud infrastructure, compute, and GPU platforms... 
    Cloud
    Remote job

    Globalchannelmanagement

    Cambridge, MA
    10 days ago
  •  ...Vibrant provider of cost optimization & automation solutions for cloud computing Industry Internet Type Privately Held, VC-backed...  ...application automation and cloud native automation gpu infrastructure ai infrastructure kubernetes cost optimization... 
    Cloud

    Confidential

    Boston, MA
    4 days ago
  •  ...improvement, while partnering with engineering, construction, quality, and cloud operations teams. Candidates should have at least 12 years of...  ...hyperscale, colocation, cloud, high-performance computing, or AI/GPU environments—including hands-on work with liquid-cooled, high-... 
    Cloud

    Confidential

    Boston, MA
    1 day ago
  •  ...Job Description Job Description Head of Channel Remote – US-Based ABOUT THE ROLE: HiddenLayer is seeking a strategic and...  ...partner development, or ecosystem leadership within cybersecurity, cloud infrastructure, enterprise software, or a related field. ~ A... 
    Cloud
    Remote work
    Home office
    Flexible hours

    HiddenLayer

    Boston, MA
    a month ago
  • $10k

     ...Job Description Job Description Position: Varsity Softball Head Coach Department: Athletics Location: Milton Academy Campus...  ...in Google Workspace, Microsoft Office and Adobe Creative Cloud. Ability to work collaboratively with internal and external constituencies... 
    Cloud
    Part time
    Seasonal work
    Work at office
    Local area
    Immediate start

    Milton Academy

    Milton, MA
    16 days ago
  • $150k - $200k

     ...networks, gradient boosting, random forests, genetic algorithms, or ensemble learning GPU optimization and performance tuning experience Familiarity with Spark and/or Databricks Exposure to cloud environments such as AWS Interest in financial markets or quantitative investing... 
    Cloud
    Full time
    Remote work

    Motion Recruitment

    Boston, MA
    1 day ago
  •  ...to the best of my knowledge. Job Description About the role: We are seeking an experienced scientific leader to serve as Head of Discovery Scale-Up and Optimization on the Global Chemistry Leadership Team. In this role, the successful candidate will own chemistry... 
    Contract work

    Takeda Pharmaceutical

    Boston, MA
    5 days ago
  •  ..., which will create a fully automated, closed loop, AI-integrated, drug discovery platform. As part of this build, we are seeking a Head of Small Molecule In Vitro Pharmacology. This senior leader will drive the scientific vision and operational strategy across discovery... 

    Takeda Pharmaceutical

    Boston, MA
    5 days ago
  •  ...clarity across complex and fast-moving cost surfaces: compute and GPU infrastructure, LLM usage and API spend, data storage, and...  ...reporting engine leaders rely on, and shape resource allocation across cloud infrastructure and AI/ML workloads.What You'll Be BuildingServe as... 
    Cloud

    Lila Sciences

    Somerville, MA
    1 day ago
  •  ...others. We are looking for an Infrastructure Engineer to own the cloud infrastructure, research compute and engineering tools behind CI'...  ...Experience with Slurm or other batch compute systems, particularly for GPU training workloads. Experience building reliable LLM automation,... 
    Cloud

    Cellular Intelligence

    Boston, MA
    2 days ago
  • $184.9k - $250.2k

    We are looking for an exceptional software development leader to help revolutionize cloud file storage for workloads like GPU-heavy AI/ML workloads, high-performance computing (HPC), and enterprise applications. Launched in 2018, Amazon FSx for Lustre is an AWS service... 
    Cloud
    Flexible hours

    Amazon

    Boston, MA
    4 days ago
  •  ...model lifecycle management, including workflow orchestration, CI/CD, model registries, monitoring, version control, and deployment in cloud or high-performance computing environments. Experience building, maintaining, and searching ultra-large chemical databases using... 
    Cloud

    Takeda Pharmaceutical

    Boston, MA
    5 days ago
  •  ...software, Linux servers and Windows VDI environments, compute and GPU resources) for engineering courses and programs.Maintain...  ...course instruction.Evaluate resources (e.g., institutional platforms, cloud offerings, vendor tools) against course and program requirements... 
    Cloud
    Work experience placement
    Work at office

    Harvard University

    Allston, MA
    4 days ago
  • $135.66k

     ...Description This role sits within Amazon's Automated Reasoning and Formal Verification research horizon. Shape the Future of Cloud Computing. Are you a graduate student passionate about Automated Reasoning and its real-world applications? Join our team of innovators and... 
    Cloud
    Internship
    Relocation

    Amazon

    Boston, MA
    4 days ago
  • $153.6k - $207.8k

     ...complex, often ambiguous business challenges—showing customers how cloud adoption can fundamentally reshape their business outcomes and...  ...autonomous driving or robotics stacks—ROS, simulation pipelines, GPU-accelerated training, and HPC.Amazon is an equal opportunity employer... 
    Cloud
    Flexible hours
    Shift work

    AmazonWebServices

    Boston, MA
    1 day ago
  • $225k - $337.5k

    Who we are looking forThe Head of Enterprise Architecture owns the target-state design of...  ...technology blueprint across infrastructure, cloud, security, data and application domains;...  ...the crossover analysis between on-premise GPU, cloud instances and foundation-model API... 
    Cloud
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Quincy, MA
    2 days ago
  • $181.5k - $278.3k

     ...technical challenges, and takes pride in making things better.. Our technical space is broad: high-scale AI training & inference workloads, cloud infrastructure, Kubernetes, observability, distributed systems, and a bit of everything in between.The Opportunity:This role is... 
    Cloud
    Temporary work
    Relocation package

    PathAI

    Boston, MA
    2 days ago
  • $200k - $270k

     ...Description Who We Are TetraScience is the Scientific Data and AI Cloud company. We are catalyzing the Scientific AI revolution by...  ...workloads, including routing, batching, caching, concurrency control, GPU and accelerator capacity planning, handling of large binary... 
    Cloud
    Immediate start
    Remote work
    Flexible hours

    TetraScience

    Cambridge, MA
    4 days ago
  •  ...In this role, you will be the Lead on designing, implementing, and managing data architecture and cloud-based solutions with Microsoft Azure. Primary responsibilities include: Designing data integration solutions Developing an Azure Fabric data architecture... 
    Cloud

    3B Staffing LLC

    Boston, MA
    5 days ago
  •  ...Head of Growth Marketing About the Company Leading provider of cloud & infrastructure management solutions Industry Computer Software Type Privately Held, VC-backed Founded 2017 Employees 51-200 Funding $51-$75 million Categories Networking... 
    Cloud

    Confidential

    Boston, MA
    2 days ago
  •  ...accelerate analysis and decision-making, applying current AI-native approaches alongside established analytical methods.• Build on the cloud: Use cloud platforms such as Databricks, AWS, Snowflake, Azure, or comparable environments as the foundation for scalable and... 
    Cloud
    Full time

    AstraZeneca

    Boston, MA
    4 days ago
  • $183k - $265k

     ...deep technical expertise in modern public cloud platforms—with a focus on AI infrastructure...  ..., including C-level executives, Heads of Product and Engineering, and their engineering...  ...operationalizing ML models. Experience with GPU architecture, high performance Data Center... 
    Cloud
    Temporary work

    CompliancePoint

    Cambridge, MA
    2 days ago
  • $125.04k - $187.56k

     ...Preferred Qualifications: Experience in deploying models on azure cloud. Experience with cloud ML platforms. Experience deploying models...  ...infrastructure ( Azure Preferred) Experience training and serving models on GPU(s) Salary Range: $125,040 - $187,560 Actual compensation... 
    Cloud
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Peapod Digital Labs

    Quincy, MA
    2 days ago
  • $122.19k - $165.31k

     ...scientists, for scientists. Combined, we are now the world's largest cloud-based scientific research R&D platform. We need your help to keep...  ...for AI/ML and LLM-based workloads, including model serving, GPU-enabled clusters, and cost controls AI: Establish guardrails for... 
    Cloud
    Immediate start
    Remote work
    Flexible hours

    Dotmatics Limited

    Boston, MA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of GPU Cloud. Be the first to apply!