Head of Engineering (GPU Infrastructure / HPC)
Greylock Partners
Head of Engineering (GPU Infrastructure / HPC)
Investment Profile
Greylock-backed company in New York building a cloud simulation platform for robotics, autonomy, and physical AI.
The platform helps engineering teams develop and evaluate autonomous systems, generate synthetic data, and test thousands of scenarios before deploying changes to physical hardware. It combines calibrated digital twins, realistic environments, and AI agents to reduce dependence on expensive, slow, and incomplete real-world testing.
Summary
We’re looking for a highly technical engineering leader to own the core platform powering GPU-accelerated simulation at scale.
You’ll lead engineering across cloud infrastructure, backend, frontend, and developer experience. As a member of the leadership team, you’ll set technical direction, grow the team, and shape how engineering operates. You’ll also write substantial production code and build critical systems yourself.
The technical challenge spans GPU scheduling, distributed workload execution, large-scale data pipelines, storage, and networking. You’ll make these systems reliable and cost-efficient as usage grows, while preserving compatibility for customers who depend on the platform.
Strong candidates may come from ML training or inference infrastructure, GPU cloud platforms, high-performance computing, render farms, or large-scale simulation systems. Direct robotics experience is helpful, but hands-on experience operating GPU systems at scale is central to the role.
This role is based in New York City and requires working in person. Candidates willing to relocate are welcome.
What You’ll Own
- Technical direction and delivery across the core platform, including personally implementing critical components
- GPU scheduling and orchestration across compute pools and cloud providers
- Distributed job execution, workload tracking, data pipelines, storage, and reproducible workflows
- Dataset and artifact versioning for simulation, ML, and customer workloads
- Reliability, observability, incident response, capacity planning, GPU utilization, and compute costs
- Hiring and developing engineers who can own systems end to end
- Engineering practices across architecture, code review, releases, planning, security, and compliance
- Adoption of coding agents and agentic development tools across the engineering team
You’ll work closely with the founders, simulation and ML teams, and go-to-market leaders on product priorities. You’ll also engage directly with customers on deployments, integrations, and technical escalations.
What We’re Looking For
You likely have experience:
- Building software for at least five years, including leading engineering teams at fast-growing companies
- Building and operating GPU-accelerated cloud systems at scale
- Working deeply with distributed systems, MLOps, Kubernetes, data pipelines, and compute scheduling tools such as Ray or Slurm
- Making practical performance and cost decisions across GPU utilization, capacity, and cloud infrastructure
- Writing production code regularly, with deep fluency in Python
- Hiring and developing strong engineers and improving the hiring process
- Using coding agents and agentic tooling with the engineering judgment to review, debug, and validate their output
- Communicating clearly with engineers, customers, and company leadership
Experience with Rust, C++, or Go is a plus.
Other useful backgrounds include robotics or simulation, developer tools such as SDKs and CLIs, enterprise security and deployment requirements, and agent infrastructure such as MCP servers or evaluation harnesses.
We’re less interested in titles than in technical credibility, ownership, and the ability to lead through direct involvement in the work.
The environment favors urgency, initiative, and accountability. You should enjoy working through incomplete requirements, staying close to customers, and balancing engineering quality with what needs to ship now.
About Us
Greylock is an early-stage investor in hundreds of remarkable companies including Airbnb, LinkedIn, Dropbox, Workday, Cloudera, Facebook, Instagram, Roblox, Coinbase, Palo Alto Networks, among others. More can be found about us here:
How We Work
We are full-time, salaried employees of Greylock and provide free candidate referrals/introductions to our active investments. We will contact anyone who looks like a potential match to schedule an initial call.
Due to the selective nature of this service and the volume of applicants we typically receive from our job postings, a follow-up email will not be sent until a match is identified with one of our investments.
Please note: We are not recruiting for any roles within Greylock at this time. This job posting is for direct employment with a startup in our portfolio.
$200k - $300k
Hudson River Trading’s High Performance Computing (HPC) Network Engineering team designs and engineers the low-latency communications infrastructure that underpins our incredibly large GPU and CPU compute clusters. Our mandate is to architect, optimize, and scale the high...SuggestedWork at officeLocal areaImmediate startWorldwide- ...Job Title: HPC Network Engineer | High-Performance Infrastructure Location: New York or Chicago preferred | Other US locations considered (Flexible work arrangements... .... Develop BGP-based connectivity supporting HPC/GPU infrastructure. Troubleshoot complex network...SuggestedFlexible hours
- ...Principal Network Engineer – AI InfrastructureThe Network Operations... ..., supporting tightly coupled GPU clusters where network... ...engineering, with deep focus on HPC, AI, or hyperscale data centre... ...experience influencing platform or infrastructure strategy at scaleWhat We Can...Suggested
- HPC Network Engineer Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure... ...workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed...Suggested
$152k - $241.5k
Performance Engineer NVIDIA is leading the way in groundbreaking developments... ...and Visualization. The GPU, our invention, serves as the... ..., UCX for Deep Learning and HPC. We are looking for a... ...performance data; build tools and infrastructure to visualize and analyze the...Suggested- We Are:The Global AI Infrastructure team is at the center of enabling infrastructure... ...that powers AI platforms, GPU-accelerated workloads, large-... ...along with LLM inference engines (TensorRT-LLM), production... ...1,000+ GPU clusters for AI, HPC, and agentic AI workloads with...Work experience placementLive inWork at officeLocal area
$152.29k - $250.2k
As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation... ...standards, testing, CI/CD, infrastructure automation, incident response, SLOs,... ...load testing, capacity planning, and GPU/CPU optimization where applicable.Experience...Full timeH1bLocal areaVisa sponsorshipWork visaFlexible hours- Join a high-growth infrastructure team operating Kubernetes platforms across... ...protect thousands of GPU-hours from costly failures. EPAM... ...growth Provision and manage HPC infrastructure through CI/CD... ...experience in infrastructure engineering, cloud platforms, or high-performance...
$140k - $170k
...Job Title: AI Infrastructure Support Engineer Location: New York, NY Type - Hybrid 4 days Onsite Terms; Full Time Salary- $140000/yr -... ...support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services. Support...Full timeWork at office- ...Build and operate AWS-based HPC and enterprise application platforms... ...(EKS/ECS) Automate infrastructure with Terraform, Ansible, and... ...degree in Computer Science, Engineering, or a related field 5+ Years... ...regulated industry experience, GPU computing, API development, GitLab...Remote workRelocation package
$296k
...may not be ready to pay just yet, and25 million+ paid memberships on Patreon today.We are looking for a Senior Engineering Manager to lead the Infrastructure & Developer Productivity teams, which are responsible for Patreon’s core infrastructure, developer productivity...Work at officeLocal areaRemote workWorldwideFlexible hours2 days per week3 days per week- ...industrial turbomachinery. Our platform lets engineers define a design as a parametric... ...evaluated in parallel, across cloud, HPC, and on-prem infrastructure, feeding directly into AI-driven... ...deployment across environments from GPU workstations to cloud-scale Kubernetes...For contractorsShift work
$199k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed... ...Staff Software Engineer, AI Research Infrastructure, you will be developing and running... ...processing, and model training (e.g., HPC clusters, GPU fleets, or cloud‑based systems)Enable...Local areaWorldwide$147k - $237.5k
...innovative brands, including DoorDash, Affirm, and Zillow.One Org, Two Impact Areas:Our Infrastructure organization is scaling rapidly, and we are looking for world-class Principal Engineers to drive the future of our platform. We are actively hiring for two distinct...Full timeRemote work$168k - $270.25k
...computing. An era in which our GPU acts as the brains of... ...Experience (NVEX) Solutions Engineering team is looking for a senior... ...that link GPUs and AI compute infrastructure. Candidates must have a software... ...Background with AI infrastructure and HPC networkingExperience...Full timeWeekend work- ...Director of Engineering – Power Infrastructure A growing energy infrastructure business is looking for a senior engineering leader to support large-scale power projects for data centres and other high-demand customers. The role will lead engineering from early development...
$185.5k - $232k
...Engineering Manager, InfrastructureNew York, NY; Boston, MAAbout Formation BioFormation Bio is a tech and AI driven pharma company... ...efficiently.About the PositionAs the Engineering Manager for Infrastructure at Formation Bio, you will lead the team responsible for the...Work at officeLocal areaRelocation3 days per week$227.8k - $270k
...impact, scale, and the chance to help lead the patient revolution, come build with us.The RoleWe're looking for an Engineering Manager to lead Core Infrastructure. This role is for a hands-on engineering leader who can create leverage through managing people, own execution,...Local area- ...Engineering Manager at StripeStripe is a financial infrastructure platform for businesses. Millions of companies, from the world's largest enterprises to the most ambitious startups, use Stripe to accept payments, grow their revenue, and accelerate new business opportunities...Work at officeLocal area
$160k - $240k
Senior Software Engineer - Cloud Native Compute Infrastructure Core Location New York Business Area Engineering... ...database platformsOn-premises GPU infrastructure supporting AI... ...detection.Experience with GPU and HPC infrastructure, including hardware...Temporary workFor contractorsWork experience placement$292k - $417.2k
...content understanding, and ads optimization that shape the future of streaming.We are seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure design. In this role, you will...Full timeTemporary workLocal areaFlexible hours$165k - $242k
...CoreWeave combines superior infrastructure performance with deep technical... ...’s IaaS organization as the Engineering Manager for the Launch & Sandboxes... ...run code in isolated, GPU-enabled containers, and Launch... ..., compute orchestration, and HPC schedulers.You’ll lead the engineering...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShift work$190k - $325k
...Cohere is a team of researchers, engineers, designers, and more, who are... ...us!Why this role?The Data Infrastructure team at Cohere is responsible... ...regions and backends, with GPU idle time and time-to-insight... ...:Experience with parallel or HPC filesystems such as Weka, VAST...Full timeWork at officeLocal areaRemote workHome office$237.6k - $297k
We are seeking a highly skilled Infrastructure Security Engineer to join our team. This role is integral to ensuring the security and integrity of our... ...and Kubernetes.Experience with orchestrating and securing GPU clusters.Proficiency in infrastructure as code tools such...Full time$160k - $240k
...Description NO SPONSORSHIP - NO OPT \n \n PRINCIPAL NETWORK ENGINEER \n \n SALARY: $160k - $240k plus 15% bonus \n \n... ...and SSH-based automation approaches \n Partner across infrastructure, security, application, and business teams to align network design...- ...HPC Systems Engineer | NYC | Stealth Quant Fund One of the most low-key, high-firepower quant trading firms in the game is hiring - elite infra, elite people, and a research/trading stack that runs like a Swiss watch.... The Role You'll own performance and...Remote work
$160k - $250k
...cybersecurity starts with you.About the Role:CrowdStrike is seeking a Sr Engineering Manager (L8) to lead a host of initiatives spanning 2-3 teams with coverage in MLOps & broader data infrastructure, as well as data analytics platform & data recovery initiatives.Your...Full timeWork experience placementWork at officeLocal areaRemote work2 days per week$250k - $300k
...industry.Job DescriptionSUMMARYWe are hiring a Principal Software Engineer and Engineering Manager to be the crew lead for our Cloud... ...company in previous roles. Reporting RelationshipsGlobal Head of Infrastructure and Platform EngineeringCompensationThe anticipated base...Full timeTemporary workWork experience placementFlexible hours- WSP in New Jersey is seeking a Vice President, Structural Engineering to lead delivery for highway bridges, rail and transit structures, and other structural engineering services from the Lawrenceville, NJ office (with Morristown, NJ also considered). This hybrid role requires...Work at office
$180.63k - $233.75k
...together because what we do matters. We provide the financial infrastructure that powers the global economy. As a leading provider of... ...office work model. Role OverviewThe Sr. Manager of Network Engineering is a senior technical leader responsible for leading a high-...Full timeWork at officeImmediate startRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of Engineering (GPU Infrastructure / HPC). Be the first to apply!
- senior director engineering New York, NY
- principal data engineer New York, NY
- principal security engineer New York, NY
- data center chief engineer New York, NY
- principal engineer New York, NY
- technical director engineering New York, NY
- director of product engineering New York, NY
- principal cloud engineer New York, NY
- associate director engineering New York, NY
- senior civil engineer project manager New York, NY




