Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Engineering (GPU Infrastructure / HPC)

Full-time

Greylock Partners

Head of Engineering (GPU Infrastructure / HPC)

Investment Profile

Greylock-backed company in New York building a cloud simulation platform for robotics, autonomy, and physical AI.

The platform helps engineering teams develop and evaluate autonomous systems, generate synthetic data, and test thousands of scenarios before deploying changes to physical hardware. It combines calibrated digital twins, realistic environments, and AI agents to reduce dependence on expensive, slow, and incomplete real-world testing.

Summary

We’re looking for a highly technical engineering leader to own the core platform powering GPU-accelerated simulation at scale.

You’ll lead engineering across cloud infrastructure, backend, frontend, and developer experience. As a member of the leadership team, you’ll set technical direction, grow the team, and shape how engineering operates. You’ll also write substantial production code and build critical systems yourself.

The technical challenge spans GPU scheduling, distributed workload execution, large-scale data pipelines, storage, and networking. You’ll make these systems reliable and cost-efficient as usage grows, while preserving compatibility for customers who depend on the platform.

Strong candidates may come from ML training or inference infrastructure, GPU cloud platforms, high-performance computing, render farms, or large-scale simulation systems. Direct robotics experience is helpful, but hands-on experience operating GPU systems at scale is central to the role.

This role is based in New York City and requires working in person. Candidates willing to relocate are welcome.

What You’ll Own

  • Technical direction and delivery across the core platform, including personally implementing critical components
  • GPU scheduling and orchestration across compute pools and cloud providers
  • Distributed job execution, workload tracking, data pipelines, storage, and reproducible workflows
  • Dataset and artifact versioning for simulation, ML, and customer workloads
  • Reliability, observability, incident response, capacity planning, GPU utilization, and compute costs
  • Hiring and developing engineers who can own systems end to end
  • Engineering practices across architecture, code review, releases, planning, security, and compliance
  • Adoption of coding agents and agentic development tools across the engineering team

You’ll work closely with the founders, simulation and ML teams, and go-to-market leaders on product priorities. You’ll also engage directly with customers on deployments, integrations, and technical escalations.

What We’re Looking For

You likely have experience:

  • Building software for at least five years, including leading engineering teams at fast-growing companies
  • Building and operating GPU-accelerated cloud systems at scale
  • Working deeply with distributed systems, MLOps, Kubernetes, data pipelines, and compute scheduling tools such as Ray or Slurm
  • Making practical performance and cost decisions across GPU utilization, capacity, and cloud infrastructure
  • Writing production code regularly, with deep fluency in Python
  • Hiring and developing strong engineers and improving the hiring process
  • Using coding agents and agentic tooling with the engineering judgment to review, debug, and validate their output
  • Communicating clearly with engineers, customers, and company leadership

Experience with Rust, C++, or Go is a plus.

Other useful backgrounds include robotics or simulation, developer tools such as SDKs and CLIs, enterprise security and deployment requirements, and agent infrastructure such as MCP servers or evaluation harnesses.

We’re less interested in titles than in technical credibility, ownership, and the ability to lead through direct involvement in the work.

The environment favors urgency, initiative, and accountability. You should enjoy working through incomplete requirements, staying close to customers, and balancing engineering quality with what needs to ship now.

About Us

Greylock is an early-stage investor in hundreds of remarkable companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, Palo Alto Networks, among others. More can be found about us here:

How We Work

We are full-time, salaried employees of Greylock and provide free candidate referrals/introductions to our active investments. We will contact anyone who looks like a potential match to schedule an initial call.

Due to the selective nature of this service and the volume of applicants we typically receive from our job postings, a follow-up email will not be sent until a match is identified with one of our investments.

Please note: We are not recruiting for any roles within Greylock at this time. This job posting is for direct employment with a startup in our portfolio.

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Head of Engineering (GPU Infrastructure / HPC) in New York, NY vacancy
  • $200k - $300k

    Hudson River Trading’s High Performance Computing (HPC) Network Engineering team designs and engineers the low-latency communications infrastructure that underpins our incredibly large GPU and CPU compute clusters. Our mandate is to architect, optimize, and scale the high... 
    Suggested
    Work at office
    Local area
    Immediate start
    Worldwide

    Hudson River Trading

    New York, NY
    3 days ago
  • $180k - $220k

     ...and performance of Evergrid's AMD-only GPU compute clusters. You're the...  ...spans hardware operations, Linux systems engineering, distributed infrastructure, and ML workloads. It covers GPU bring...  .... What you bring ~5+ years in HPC, GPU cluster operations, Linux systems... 
    Suggested
    Full time
    Remote work
    Home office

    Evergrid

    New York, NY
    10 hours ago
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure...  ...that powers AI platforms, GPU-accelerated workloads, large-...  ...along with LLM inference engines (TensorRT-LLM), production...  ...1,000+ GPU clusters for AI, HPC, and agentic AI workloads with... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    5 days ago
  • Operating the Kubernetes GPU fleet and managing multi-tenancy, the full-time Senior Software Engineer, GPU Infrastructure will focus on maintaining large-scale experiments, ensuring fault tolerance, and enhancing platform security in a remote work environment. Key responsibilities... 
    Suggested
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    5 days ago
  •  ...Job Description Director of Engineering – Power Infrastructure \n \n A growing energy infrastructure business is looking for a senior engineering leader to support large-scale power projects for data centres and other high-demand customers. \n The role will... 
    Suggested

    Spencer Ogden

    New York, NY
    18 days ago
  • Boundless is coordinating GPU compute at scale as it becomes a leader in AI. As a Senior Infrastructure Engineer (GPU Compute), you'll build and operate the compute fabric powering our AI inference workloads across a large, heterogeneous GPU fleet including consumer RTX... 
    Remote job

    Boundless Corp

    New York, NY
    5 days ago
  • $275k - $350k

     ...of frictionless experiences.We are seeking a strategically-minded, technology-focused, and customer-centric Engineering Manager to lead one of our Infrastructure teams here. You will lead a team responsible for building, operating, and scaling the cloud infrastructure and... 
    Casual work
    Work at office
    Flexible hours

    Secure Identity

    New York, NY
    4 days ago
  • $296k

     ...may not be ready to pay just yet, and25 million+ paid memberships on Patreon today.We are looking for a Senior Engineering Manager to lead the Infrastructure & Developer Productivity teams, which are responsible for Patreon’s core infrastructure, developer productivity... 
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    2 days per week
    3 days per week

    Patreon

    New York, NY
    6 days ago
  •  ...delivering high-performance technology and infrastructure for mission-critical trading...  ...company is looking for a Senior Network Engineer to design, build, and scale high-performance...  ...and optimize large-scale data center and HPC network environments. Build and support... 
    Full time
    New York, NY
    more than 2 months ago
  • $190k - $300k

    Principal Observability Platform Engineer - Nscale About Nscale Nscale is the GPU cloud engineered for AI. We provide...  ...cost-effective, high-performance infrastructure for AI start-ups and large...  ...familiarity with GPU infrastructure or HPC environments (Slurm) is a strong... 
    Flexible hours

    Nscale

    New York, NY
    2 days ago
  • $147k - $237.5k

     ...innovative brands, including DoorDash, Affirm, and Zillow.One Org, Two Impact Areas:Our Infrastructure organization is scaling rapidly, and we are looking for world-class Principal Engineers to drive the future of our platform. We are actively hiring for two distinct... 
    Full time
    Remote work

    Palo Alto Networks

    New York, NY
    3 days ago
  • $190k - $270k

    Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed...  ...Staff Software Engineer, AI Research Infrastructure, you will be developing and running...  ...processing, and model training (e.g., HPC clusters, GPU fleets, or cloud‑based systems)Enable... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    7 days ago
  • $168k - $270.25k

     ...computing. An era in which our GPU acts as the brains of...  ...Experience (NVEX) Solutions Engineering team is looking for a senior...  ...that link GPUs and AI compute infrastructure. Candidates must have a software...  ...Background with AI infrastructure and HPC networkingExperience... 
    Full time
    Weekend work

    Nvidia

    New York, NY
    3 days ago
  • $229k - $412k

     .... Reliability, cost efficiency, and provable compliance are engineering requirements here rather than afterthoughts, and we are raising...  .... It builds platform-wide automation, tooling, and test infrastructure. It partners hands-on with individual data platform teams. And... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Shift work
    New York, NY
    7 days ago
  • $292k - $417.2k

     ...content understanding, and ads optimization that shape the future of streaming.We are seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure design. In this role, you will... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    New York, NY
    3 days ago
  • $190k - $325k

     ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...us!Why this role?The Data Infrastructure team at Cohere is responsible...  ...regions and backends, with GPU idle time and time-to-insight...  ...:Experience with parallel or HPC filesystems such as Weka, VAST... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    7 days ago
  •  ...Cetos Water is seeking a senior engineering leader to own how our TSSE technology translates into deployable industrial infrastructure. You will design, build, and iterate systems that operate in real customer brine under real load, directly shaping field deployments.... 

    Jobleads-US

    New York, NY
    3 days ago
  • $237.6k - $297k

    We are seeking a highly skilled Infrastructure Security Engineer to join our team. This role is integral to ensuring the security and integrity of our...  ...and Kubernetes.Experience with orchestrating and securing GPU clusters.Proficiency in infrastructure as code tools such... 
    Full time

    Scale AI

    New York, NY
    7 days ago
  • In this high-impact role, you can step up as a tech leader and innovator by providing your knowledge and mentorship to infrastructure engineers. Lead teams towards excellence and demonstrate your skills as a leader.As a Senior Manager of Infrastructure Engineering at JPMorganChase... 
    Shift work

    JP Morgan Chase

    New York, NY
    5 days ago
  • Partner with a company that's devoted to shaping the future of infrastructure in financial services. Let's collaborate to explore...  ...extraordinary feats together.As a Director of Infrastructure Engineering at JPMorganChase within the Core Engineering Solutions team,... 
    Temporary work
    Shift work

    JP Morgan Chase

    New York, NY
    7 days ago
  • $160k - $250k

     ...cybersecurity starts with you.About the Role:CrowdStrike is seeking a Sr Engineering Manager (L8) to lead a host of initiatives spanning 2-3 teams with coverage in MLOps & broader data infrastructure, as well as data analytics platform & data recovery initiatives.Your... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week

    CrowdStrike

    New York, NY
    3 days ago
  • $190k

     ...Principal Network Engineer Salary: Starting at $190k + bonus Location: New York, NY Hybrid: 4 days onsite, 1 day remote...  ...track record operating and evolving high-performance network infrastructure   ~ Deep expertise in low-latency and deterministic network... 
    Full time
    Immediate start
    Remote work
    Shift work

    Request Technology, LLC

    New York, NY
    3 days ago
  •  ...Financial Institution is currently seeking a Senior Network Security Engineer with strong Cisco and Palo Alto experience. Candidate will...  ...enterprise environments. The engineer will partner across infrastructure teams to ensure secure, highly available connectivity, while... 
    Permanent employment
    Full time
    Night shift

    Request Technology, LLC

    New York, NY
    3 days ago
  •  ...days onsite) Day to Day: We're seeking a hands-on Network Engineering leader to manage and mentor a team of engineers supporting...  ...the design, performance, and evolution of a global network infrastructure that supports mission-critical financial systems where reliability... 
    Full time

    Insight Global

    New York, NY
    4 days ago
  • $160k - $270k

     ...Technology is looking for a Director, Platform Engineering to build and lead a new team focused on...  ...engineering, DevOps, MLOps, or infrastructure engineering teams Strong understanding...  ...development Experience with GPU compute, local model training, inference... 
    Local area

    FOX Direct to Consumer

    New York, NY
    3 days ago
  • $180k - $240k

    Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/Onsite)Employment Type: Full-TimeCompensation: $180-$240k base plus...  ...for building secure, scalable, and resilient AI infrastructure that enables enterprise-wide adoption of AI capabilities... 

    Yoh

    New York, NY
    7 days ago
  • $250k - $300k

     ...industry.Job DescriptionSUMMARYWe are hiring a Principal Software Engineer and Engineering Manager to be the crew lead for our Cloud...  ...company in previous roles. Reporting RelationshipsGlobal Head of Infrastructure and Platform EngineeringCompensationThe anticipated base... 
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Ares Management

    New York, NY
    6 days ago
  •  ...entire trading book in minutes not ours Do you want to build the massivescale valuation engine that powers Citis nextgeneration risk platformCiti is seeking a visionary Cloud HPC Engineer to lead the development and operation of our global pricing grid This is the engine... 
    Full time
    Local area

    Capgemini

    New York, NY
    24 days ago
  • $180.63k - $233.75k

     ...together because what we do matters. We provide the financial infrastructure that powers the global economy. As a leading provider of...  ...office work model. Role OverviewThe Sr. Manager of Network Engineering is a senior technical leader responsible for leading a high-... 
    Full time
    Work at office
    Immediate start
    Remote work
    Shift work

    Cboe Exchange

    New York, NY
    7 days ago
  •  ...Manager, Network Engineering New York City, NY Our client, a leading Am 100 law firm, is currently seeking a Manager, Network...  ...team. This key role will involve leading the firm's network infrastructure strategy, design, and operations globally. The successful... 

    Veracity

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Engineering (GPU Infrastructure / HPC). Be the first to apply!