Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Head of Engineering (GPU Infrastructure / HPC)

Greylock Partners

Head of Engineering (GPU Infrastructure / HPC)

Investment Profile

Greylock-backed company in New York building a cloud simulation platform for robotics, autonomy, and physical AI.

The platform helps engineering teams develop and evaluate autonomous systems, generate synthetic data, and test thousands of scenarios before deploying changes to physical hardware. It combines calibrated digital twins, realistic environments, and AI agents to reduce dependence on expensive, slow, and incomplete real-world testing.

Summary

We’re looking for a highly technical engineering leader to own the core platform powering GPU-accelerated simulation at scale.

You’ll lead engineering across cloud infrastructure, backend, frontend, and developer experience. As a member of the leadership team, you’ll set technical direction, grow the team, and shape how engineering operates. You’ll also write substantial production code and build critical systems yourself.

The technical challenge spans GPU scheduling, distributed workload execution, large-scale data pipelines, storage, and networking. You’ll make these systems reliable and cost-efficient as usage grows, while preserving compatibility for customers who depend on the platform.

Strong candidates may come from ML training or inference infrastructure, GPU cloud platforms, high-performance computing, render farms, or large-scale simulation systems. Direct robotics experience is helpful, but hands-on experience operating GPU systems at scale is central to the role.

This role is based in New York City and requires working in person. Candidates willing to relocate are welcome.

What You’ll Own

  • Technical direction and delivery across the core platform, including personally implementing critical components
  • GPU scheduling and orchestration across compute pools and cloud providers
  • Distributed job execution, workload tracking, data pipelines, storage, and reproducible workflows
  • Dataset and artifact versioning for simulation, ML, and customer workloads
  • Reliability, observability, incident response, capacity planning, GPU utilization, and compute costs
  • Hiring and developing engineers who can own systems end to end
  • Engineering practices across architecture, code review, releases, planning, security, and compliance
  • Adoption of coding agents and agentic development tools across the engineering team

You’ll work closely with the founders, simulation and ML teams, and go-to-market leaders on product priorities. You’ll also engage directly with customers on deployments, integrations, and technical escalations.

What We’re Looking For

You likely have experience:

  • Building software for at least five years, including leading engineering teams at fast-growing companies
  • Building and operating GPU-accelerated cloud systems at scale
  • Working deeply with distributed systems, MLOps, Kubernetes, data pipelines, and compute scheduling tools such as Ray or Slurm
  • Making practical performance and cost decisions across GPU utilization, capacity, and cloud infrastructure
  • Writing production code regularly, with deep fluency in Python
  • Hiring and developing strong engineers and improving the hiring process
  • Using coding agents and agentic tooling with the engineering judgment to review, debug, and validate their output
  • Communicating clearly with engineers, customers, and company leadership

Experience with Rust, C++, or Go is a plus.

Other useful backgrounds include robotics or simulation, developer tools such as SDKs and CLIs, enterprise security and deployment requirements, and agent infrastructure such as MCP servers or evaluation harnesses.

We’re less interested in titles than in technical credibility, ownership, and the ability to lead through direct involvement in the work.

The environment favors urgency, initiative, and accountability. You should enjoy working through incomplete requirements, staying close to customers, and balancing engineering quality with what needs to ship now.

About Us

Greylock is an early-stage investor in hundreds of remarkable companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, Palo Alto Networks, among others. More can be found about us here:

How We Work

We are full-time, salaried employees of Greylock and provide free candidate referrals/introductions to our active investments. We will contact anyone who looks like a potential match to schedule an initial call.

Due to the selective nature of this service and the volume of applicants we typically receive from our job postings, a follow-up email will not be sent until a match is identified with one of our investments.

Please note: We are not recruiting for any roles within Greylock at this time. This job posting is for direct employment with a startup in our portfolio.

Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Head of Engineering (GPU Infrastructure / HPC) in New York, NY vacancy
  • $200k - $300k

    Hudson River Trading’s High Performance Computing (HPC) Network Engineering team designs and engineers the low-latency communications infrastructure that underpins our incredibly large GPU and CPU compute clusters. Our mandate is to architect, optimize, and scale the high... 
    Suggested
    Work at office
    Local area
    Immediate start
    Worldwide

    Hudson River Trading

    New York, NY
    2 days ago
  •  ...Job Title: HPC Network Engineer | High-Performance Infrastructure Location: New York or Chicago preferred | Other US locations considered (Flexible work arrangements...  .... Develop BGP-based connectivity supporting HPC/GPU infrastructure. Troubleshoot complex network... 
    Suggested
    Flexible hours

    Hamilton Barnes 🌳

    New York, NY
    2 hours ago
  •  ...Principal Network Engineer – AI InfrastructureThe Network Operations...  ..., supporting tightly coupled GPU clusters where network...  ...engineering, with deep focus on HPC, AI, or hyperscale data centre...  ...experience influencing platform or infrastructure strategy at scaleWhat We Can... 
    Suggested

    Nscale

    New York, NY
    3 days ago
  • HPC Network Engineer Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure...  ...workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed... 
    Suggested

    Mirantis

    New York, NY
    5 days ago
  • $152k - $241.5k

    Performance Engineer NVIDIA is leading the way in groundbreaking developments...  ...and Visualization. The GPU, our invention, serves as the...  ..., UCX for Deep Learning and HPC. We are looking for a...  ...performance data; build tools and infrastructure to visualize and analyze the... 
    Suggested

    NVIDIA

    New York, NY
    3 days ago
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure...  ...that powers AI platforms, GPU-accelerated workloads, large-...  ...along with LLM inference engines (TensorRT-LLM), production...  ...1,000+ GPU clusters for AI, HPC, and agentic AI workloads with... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  • $152.29k - $250.2k

    As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation...  ...standards, testing, CI/CD, infrastructure automation, incident response, SLOs,...  ...load testing, capacity planning, and GPU/CPU optimization where applicable.Experience... 
    Full time
    H1b
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    3 days ago
  • Join a high-growth infrastructure team operating Kubernetes platforms across...  ...protect thousands of GPU-hours from costly failures. EPAM...  ...growth Provision and manage HPC infrastructure through CI/CD...  ...experience in infrastructure engineering, cloud platforms, or high-performance... 

    EPAM Systems

    New York, NY
    1 day ago
  • $140k - $170k

     ...Job Title: AI Infrastructure Support Engineer Location: New York, NY Type - Hybrid 4 days Onsite Terms; Full Time Salary- $140000/yr -...  ...support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services. Support... 
    Full time
    Work at office

    Yoh, A Day & Zimmermann Company

    New York, NY
    2 hours ago
  •  ...Build and operate AWS-based HPC and enterprise application platforms...  ...(EKS/ECS) Automate infrastructure with Terraform, Ansible, and...  ...degree in Computer Science, Engineering, or a related field 5+ Years...  ...regulated industry experience, GPU computing, API development, GitLab... 
    Remote work
    Relocation package

    Philip Morris International

    New York, NY
    3 days ago
  • $296k

     ...may not be ready to pay just yet, and25 million+ paid memberships on Patreon today.We are looking for a Senior Engineering Manager to lead the Infrastructure & Developer Productivity teams, which are responsible for Patreon’s core infrastructure, developer productivity... 
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    2 days per week
    3 days per week

    Patreon

    New York, NY
    5 days ago
  •  ...industrial turbomachinery. Our platform lets engineers define a design as a parametric...  ...evaluated in parallel, across cloud, HPC, and on-prem infrastructure, feeding directly into AI-driven...  ...deployment across environments from GPU workstations to cloud-scale Kubernetes... 
    For contractors
    Shift work

    nTop

    New York, NY
    3 days ago
  • $199k - $270k

    Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed...  ...Staff Software Engineer, AI Research Infrastructure, you will be developing and running...  ...processing, and model training (e.g., HPC clusters, GPU fleets, or cloud‑based systems)Enable... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    2 days ago
  • $147k - $237.5k

     ...innovative brands, including DoorDash, Affirm, and Zillow.One Org, Two Impact Areas:Our Infrastructure organization is scaling rapidly, and we are looking for world-class Principal Engineers to drive the future of our platform. We are actively hiring for two distinct... 
    Full time
    Remote work

    Palo Alto Networks

    New York, NY
    2 days ago
  • $168k - $270.25k

     ...computing. An era in which our GPU acts as the brains of...  ...Experience (NVEX) Solutions Engineering team is looking for a senior...  ...that link GPUs and AI compute infrastructure. Candidates must have a software...  ...Background with AI infrastructure and HPC networkingExperience... 
    Full time
    Weekend work

    Nvidia

    New York, NY
    1 day ago
  •  ...Director of Engineering – Power Infrastructure A growing energy infrastructure business is looking for a senior engineering leader to support large-scale power projects for data centres and other high-demand customers. The role will lead engineering from early development... 

    Spencer Ogden

    New York, NY
    2 hours ago
  • $185.5k - $232k

     ...Engineering Manager, InfrastructureNew York, NY; Boston, MAAbout Formation BioFormation Bio is a tech and AI driven pharma company...  ...efficiently.About the PositionAs the Engineering Manager for Infrastructure at Formation Bio, you will lead the team responsible for the... 
    Work at office
    Local area
    Relocation
    3 days per week

    Formation Bio (Formerly TrailSpark)

    New York, NY
    3 days ago
  • $227.8k - $270k

     ...impact, scale, and the chance to help lead the patient revolution, come build with us.The RoleWe're looking for an Engineering Manager to lead Core Infrastructure. This role is for a hands-on engineering leader who can create leverage through managing people, own execution,... 
    Local area

    Modern Fertility

    New York, NY
    2 days ago
  •  ...Engineering Manager at StripeStripe is a financial infrastructure platform for businesses. Millions of companies, from the world's largest enterprises to the most ambitious startups, use Stripe to accept payments, grow their revenue, and accelerate new business opportunities... 
    Work at office
    Local area

    CapitalG

    New York, NY
    3 days ago
  • $160k - $240k

    Senior Software Engineer - Cloud Native Compute Infrastructure Core Location New York Business Area Engineering...  ...database platformsOn-premises GPU infrastructure supporting AI...  ...detection.Experience with GPU and HPC infrastructure, including hardware... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • $292k - $417.2k

     ...content understanding, and ads optimization that shape the future of streaming.We are seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure design. In this role, you will... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    New York, NY
    2 days ago
  • $165k - $242k

     ...CoreWeave combines superior infrastructure performance with deep technical...  ...’s IaaS organization as the Engineering Manager for the Launch & Sandboxes...  ...run code in isolated, GPU-enabled containers, and Launch...  ..., compute orchestration, and HPC schedulers.You’ll lead the engineering... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    New York, NY
    3 days ago
  • $190k - $325k

     ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...us!Why this role?The Data Infrastructure team at Cohere is responsible...  ...regions and backends, with GPU idle time and time-to-insight...  ...:Experience with parallel or HPC filesystems such as Weka, VAST... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    1 day ago
  • $237.6k - $297k

    We are seeking a highly skilled Infrastructure Security Engineer to join our team. This role is integral to ensuring the security and integrity of our...  ...and Kubernetes.Experience with orchestrating and securing GPU clusters.Proficiency in infrastructure as code tools such... 
    Full time

    Scale AI

    New York, NY
    1 day ago
  • $160k - $240k

     ...Description NO SPONSORSHIP - NO OPT \n \n PRINCIPAL NETWORK ENGINEER \n \n SALARY: $160k - $240k plus 15% bonus \n \n...  ...and SSH-based automation approaches \n Partner across infrastructure, security, application, and business teams to align network design... 

    Request Technology, LLC

    New York, NY
    25 days ago
  •  ...HPC Systems Engineer | NYC | Stealth Quant Fund One of the most low-key, high-firepower quant trading firms in the game is hiring - elite infra, elite people, and a research/trading stack that runs like a Swiss watch.... The Role You'll own performance and... 
    Remote work

    Hunter Bond

    New York, NY
    2 hours ago
  • $160k - $250k

     ...cybersecurity starts with you.About the Role:CrowdStrike is seeking a Sr Engineering Manager (L8) to lead a host of initiatives spanning 2-3 teams with coverage in MLOps & broader data infrastructure, as well as data analytics platform & data recovery initiatives.Your... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week

    CrowdStrike

    New York, NY
    2 days ago
  • $250k - $300k

     ...industry.Job DescriptionSUMMARYWe are hiring a Principal Software Engineer and Engineering Manager to be the crew lead for our Cloud...  ...company in previous roles. Reporting RelationshipsGlobal Head of Infrastructure and Platform EngineeringCompensationThe anticipated base... 
    Full time
    Temporary work
    Work experience placement
    Flexible hours

    Ares Management

    New York, NY
    5 days ago
  • WSP in New Jersey is seeking a Vice President, Structural Engineering to lead delivery for highway bridges, rail and transit structures, and other structural engineering services from the Lawrenceville, NJ office (with Morristown, NJ also considered). This hybrid role requires... 
    Work at office

    WSP

    New York, NY
    3 days ago
  • $180.63k - $233.75k

     ...together because what we do matters. We provide the financial infrastructure that powers the global economy. As a leading provider of...  ...office work model. Role OverviewThe Sr. Manager of Network Engineering is a senior technical leader responsible for leading a high-... 
    Full time
    Work at office
    Immediate start
    Remote work
    Shift work

    Cboe Exchange

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Head of Engineering (GPU Infrastructure / HPC). Be the first to apply!