Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Lead - GPU Infrastructure

Virtual Vocations Inc

Leading a distributed engineering team, the full-time Technical Lead - GPU Infrastructure will own the architecture and delivery of a GPU compute platform, focusing on building and operating a managed Slurm service and Kubernetes control plane, all while working remotely. Key responsibilities Own the end-to-end platform architecture, including design proposals and current baseline maintenance Lead and manage a distributed team across various engineering disciplines, ensuring adherence to engineering standards and performance growth Design, build, and operate a managed Slurm scheduling layer for research users, ensuring efficient resource allocation and system health Required qualifications Eight or more years of hands-on engineering experience, with at least three years in a leadership role building infrastructure platforms Proven experience with Slurm at scale, including operational management of HPC or GPU training clusters Deep knowledge of GPU fleet operation on bare metal, including NVIDIA driver and CUDA lifecycle management Strong background in production Kubernetes operations, including control plane management and multi-tenancy design Working fluency in JavaScript and Node.js for architecture decision-making and code review Virtual Vocations Inc

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Technical Lead - GPU Infrastructure in New York, NY vacancy
  • Operating the Kubernetes GPU fleet and managing multi-tenancy, the full-time Senior Software Engineer, GPU Infrastructure will focus on maintaining large-scale experiments, ensuring fault tolerance, and enhancing platform security in a remote work environment. Key responsibilities... 
    Suggested
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    4 days ago
  • $150k - $175k

     ...Scientific Computing Core (SCC) is the technical backbone of the Flatiron Institute. SCC...  ...develops, deploys and maintains computational infrastructure from supercomputers to desktop...  ...workflows used by neuroscience researchers.AI, GPU and Advanced Computing Experience (... 
    Suggested
    Full time
    Local area

    Simons Foundation

    New York, NY
    2 days ago
  • $220k - $260k

    Overview The Lead Infrastructure Engineer on the Mission Control team plays a critical role in setting technical direction and building, operating, and evolving the cloud infrastructure...  ..., data pipelines, vector databases, or GPU-enabled workloads A note to candidates... 
    Suggested
    Local area
    Remote work

    Bayview Asset Management

    New York, NY
    5 days ago
  •  ...can trust. As a Software Engineer, Infrastructure at Scaled Cognition you will: Design...  ...navigated projects with significant product and technical ambiguity, and you excel at the...  ...Prior experience designing and implementing GPU infrastructure / tooling. A strong... 
    Suggested

    Scaled Cognition

    New York, NY
    a month ago
  • GPU Kernel Engineer Baseten powers mission-critical inference for the world's most dynamic...  ...uniting applied AI research, flexible infrastructure, and seamless developer tooling, we...  ...intellectually stimulating environment where technical excellence is paramount and your... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    3 days ago
  • $204k - $259k

     ...Senior Software Engineer. You will: Develop high-performance GPU primitives and abstractions to enable Waymo to scale its accelerator...  ...onboard stack on new GPU platforms Contribute to testing infrastructure that enhances the CI/CD flow for GPUs, detects bugs early, and... 
    Full time
    Remote work

    Latent Logic

    New York, NY
    3 days ago
  • $80k - $107k

    GPU Software Engineer (CUDA) - Remote Bright Vision Technologies is a technology consulting and software development company delivering...  ..., FasterTransformer, or vLLM internals. Exposure to compiler infrastructure such as LLVM or MLIR. Open-source contributions to GPU or ML... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    New York, NY
    5 days ago
  • $160k - $180k

     ...take ownership of their cloud infrastructure across AWS and GCP. This...  ...builds against. You'll also lead a team of three offshore DevOps engineers, setting their technical direction and growing their capability...  ...for AI/ML workloads — GPU capacity, model serving,... 
    Full time
    Remote work
    Monday to Friday
    3 days per week

    Automated Industries

    New York, NY
    a month ago
  • $144.25k - $256.25k

     ...engineering, architecture, and infrastructure, providing 24x7 support to...  ...core enterprise platforms, and lead technology risk and...  ...agentic AI systems. The role sets technical direction, ensures scalable,...  ...AI infrastructure, including GPU platforms, accelerated compute... 
    Visa sponsorship

    American Express

    New York, NY
    3 hours ago
  • $224k - $356.5k

    Deep Learning Software Infrastructure Engineer NVIDIA has been transforming...  .... An era in which our GPU acts as the brains of computers...  ...researchers, infra engineers, product leads) and translate requirements...  ...skills as a hands-on technical authority, encouraging others... 

    NVIDIA

    New York, NY
    3 days ago
  • $220k - $292k

     ...monorepo health, developer environments, the infrastructure that model training and inference run on...  ...: GCP, Kubernetes, Temporal, the GPU fleet behind cloud export, and the deploy...  ...compromising quality. Raise the team's technical ambition. Provide architectural direction... 
    Work at office
    Remote work
    Flexible hours

    Descript

    New York, NY
    4 days ago
  • $180k - $250k

     ...and Senior Software Engineer, Infrastructure at Artemis, you'll own the...  ...time detection and analytics. Lead infrastructure-as-code practices...  .../ML and data teams - Support GPU workloads, model training...  ...Mentor engineers, contribute to technical roadmaps, and help define how... 

    Artemis Global Technologies, Inc

    New York, NY
    3 days ago
  • $300k - $350k

     ...build it. About the Role We're hiring a Software Engineer, Infrastructure to design and build the distributed systems that power our...  ...storage and data systems Experience operating large-scale GPU or TPU clusters Experience with container orchestration (e.... 
    Full time
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    New York, NY
    4 days ago
  •  ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series...  ...into cost and latency at scale. This is a deeply technical role for engineers who are comfortable working close to the... 
    Full time
    New York, NY
    more than 2 months ago
  • $153k - $204k

     ...scale AI with confidence. Trusted by leading AI labs, startups, and global...  ...enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate...  ...secure by design, from data centers and GPU fleets to the platform layers powering... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    10 days ago
  •  ...Engineer, Document Intelligence & Data Infrastructure New York City | Full-time | On-site in...  ...Datadog, and Microsoft. We are backed by leading institutional investors and trusted by...  ...and real-time processing across CPU and GPU workloads. End-to-end provenance, versioning... 
    Full time
    Work at office

    Unusual Ventures

    New York, NY
    13 days ago
  • Job Title AI Infrastructure Engineer Job Description We are seeking an AI Infrastructure Engineer...  ...and continuously enhance the Linux and GPU-based infrastructure that powers our AI...  ...-concepts, competitive evaluations, and technical sales efforts. Your work will play a key... 
    Worldwide
    Home office

    Edelman

    New York, NY
    4 days ago
  • $100k - $150k

    AI Infrastructure Engineer- Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud...  ...to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    New York, NY
    5 days ago
  • Job Title: AI Infrastructure Engineer Job Summary We are seeking an AI Infrastructure Engineer...  ...compute, storage, networking, and GPU resources. You will work closely with AI...  ..., compliance, and governance standards. Technical Skills Linux Python Bash Go (preferred)... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    5 days ago
  • $175k - $300k

     ...and Cornell with world-class technical staff and operators from companies...  .... The Role As a Cloud Infrastructure Engineer on Traversal's Infrastructure...  ...with our cloud security lead to improve Traversal's...  ...mesh (Envoy/Istio), Cilium/eBPF GPU workload operations, inference... 
    Full time
    Work at office
    Flexible hours

    Traversal

    New York, NY
    2 days ago
  •  ...of a high-performing team that delivers infrastructure and performance excellence. Your role will...  ...and most influential companies.As a Lead Infrastructure Engineer - Telecommunication...  ...; able to establish and participate in technical testing to industry best practices.Maintain... 
    For contractors
    Work at office

    JP Morgan Chase

    New York, NY
    1 day ago
  • Who are we? Cohere is the leading security-first enterprise AI company. We build cutting...  .... Join us! Why this role? The Data Infrastructure team at Cohere is responsible for the storage...  ...across regions and backends, with GPU idle time and time-to-insight as the measures... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  • Lead Infrastructure Engineer Company: Builder.io Work Type: Remote Employment: Full Time Location: US Seniority: Senior Level Technologies: Kubernetes, Terraform, TypeScript, Python, Go, Bash, Google Cloud Platform, Amazon Web Services, Azure, Networking Requirements: 7... 
    Full time
    Remote work

    Builder

    New York, NY
    4 days ago
  • $149k - $228k

    Lead Software Engineer- Infrastructure At Commerce, our mission is to empower businesses to innovate, grow, and thrive with our open, AI-driven commerce...  ...part of a team of bold builders, sharp thinkers, and technical trailblazers who shape the future of commerce, this is... 
    Work experience placement
    Work at office
    Local area
    Remote work
    3 days per week

    BigCommerce

    New York, NY
    3 days ago
  •  ...across defense, government, and critical infrastructure. Trusted by the U.S. Department of...  ...and the United States. We are hiring a Lead Infrastructure Engineer to help design,...  ...secure identity platform. This is a senior technical leadership role for someone who can own... 

    Lastwall

    New York, NY
    4 days ago
  • $160k - $240k

    Senior Software Engineer - RDF Infrastructure Location New York Business Area Engineering and CTO Ref # 10054258 Description & Requirements Our groupThe BQL and Semantic Platform group builds the core query and semantic infrastructure used to access... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $147k - $210k

     ...system development code.Participate in, or lead design reviews with peers and...  ...experience with developing large-scale infrastructure, distributed systems or networks, or experience...  ...degree or PhD in Computer Science or related technical fields.2 years of experience with... 

    Google

    New York, NY
    1 day ago
  • $155k - $270k

     ...technologies (specifically Docker, Kubernetes, Helm, and Tilt)A modern infrastructure operations/automation tools expert who enjoys server...  ...problem-solver who enjoys Capture the Flag or other technical puzzlesAn excellent verbal and written communicatorWhat you’ll... 
    Work at office
    Flexible hours

    Schrödinger

    New York, NY
    3 hours ago
  • $184k - $287.5k

     ...Team means contributing to the infrastructure that powers our innovative AI...  ...Science or a related technical field (or equivalent experience...  ...TensorFlow, JAX, and Ray NVIDIA leads the way in groundbreaking developments...  ..., and Visualization. The GPU, our invention, serves as the... 

    NVIDIA

    New York, NY
    5 days ago
  • $264k - $310k

     ...Expectations are high, and so are the rewards.The Developer Infrastructure org is the engine behind Robinhood's entire...  ...Engineer, Developer Infrastructure, you are the technical driver of this entire org — the Uber Tech Lead unifying DevX, TestX, Backend Platform, and... 
    Work at office
    Remote work
    Flexible hours
    Shift work
    3 days per week

    Robinhood Financial

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Lead - GPU Infrastructure. Be the first to apply!