Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Tech Lead Manager, GPU Infrastructure

Virtual Vocations Inc

Leading the infrastructure sub-team, the full-time salaried Tech Lead Manager, GPU Infrastructure will set the technical direction and roadmap for a remote team, manage platform architecture, and oversee the hiring and growth of senior engineers while ensuring the performance and fault tolerance of large-scale experiments. Key responsibilities Set the platform's technical direction and own its roadmap, including system operations and performance metrics Manage architecture, scheduling, and storage design while debugging failures across multiple layers Hire and mentor a small team of senior engineers, establishing project priorities and providing feedback Required qualifications 5+ years of experience in systems or infrastructure engineering, particularly with production Linux and GPU platforms Proven experience running production Kubernetes for GPU workloads, including batch processing Expertise in infrastructure as code and observability, utilizing tools like Terraform, Ansible, and Prometheus Strong programming skills in languages commonly used for infrastructure, such as Python, Go, Rust, or C++ Demonstrated leadership experience in managing engineers or technical teams, with a focus on setting direction and scoping projects Virtual Vocations Inc

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Tech Lead Manager, GPU Infrastructure in New York, NY vacancy
  • Leading a distributed engineering team, the full-time Technical Lead - GPU Infrastructure will own the architecture and delivery of a GPU compute platform, focusing on building and operating a managed Slurm service and Kubernetes control plane, all while working remotely... 
    Suggested
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    1 day ago
  • Operating the Kubernetes GPU fleet and managing multi-tenancy, the full-time Senior Software Engineer, GPU Infrastructure will focus on maintaining large-scale experiments, ensuring fault tolerance, and enhancing platform security in a remote work environment. Key responsibilities... 
    Suggested
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    1 day ago
  •  ...our team.KPMG is currently seeking an AI Tech Lead to join our Audit Technology Alliance...  ...engineering teamCollaborate closely with product managers, audit subject matter experts, and AI...  ...scalable applications on cloud infrastructure, specifically with Azure, Azure Kubernetes... 
    Suggested
    Local area

    KPMG

    New York, NY
    10 hours ago
  • $200k - $300k

     ...seeking a Software Engineer focused on GPU reliability to join our Systems...  ...Systems teams to provision, monitor, and manage HRT’s server and network infrastructure. In this role, your main focus will...  ...physics and engineering, media and tech. We’re a community of self-starters... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    4 days ago
  • $120k - $160k

     ...build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise...  ...product, and hardware teams to evolve our GPU performance testing platform to ensure we... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $150k - $175k

     ...develops, deploys and maintains computational infrastructure from supercomputers to desktop...  ...efficiency.Understanding of cloud resource management, security and cost-conscious use of compute...  ...used by neuroscience researchers.AI, GPU and Advanced Computing Experience (Experience... 
    Full time
    Local area

    Simons Foundation

    New York, NY
    11 hours ago
  •  ..., you can make a direct and meaningful impact. As a Senior Lead Infrastructure Engineer at JPMorganChase within the Corporate Sector’s Network...  ...banking, financial transaction processing and asset management. We offer a competitive total rewards package including base... 

    JP Morgan Chase

    New York, NY
    10 hours ago
  • $10k

     ...RampRamp is building the smart infrastructure for finance teams, embedded...  ...shape how companies move and manage billions, Ramp is the place to...  ...won't scale — that's ours to lead, regardless of where it lives...  ...just within your team.As a Tech Lead & Manager, you are a hands... 
    Full time
    Second job
    Work at office
    Remote work
    Home office
    Flexible hours
    Shift work

    Ramp

    New York, NY
    2 days ago
  • $200k - $230k

    SVP, Lead AI/MLOps Infrastructure Engineer - Full Time - HybridWe’re partnering with our client, a fast-growing...  ...: orchestration, compute (including GPU), storage, and model servingBuild and...  ...and data scientistsDesign and manage cloud-native AWS infrastructure using... 
    Full time
    Remote work

    Benchmark IT

    New York, NY
    2 days ago
  •  ...Infrastructure / DevOps Engineer About Discernis Discernis builds...  ...places: our cloud, customer managed cloud accounts, and customer...  ...both application services and GPU accelerated AI workloads Own...  ...distributed data systems Tech Environment Kubernetes and... 
    Full time

    Discernis

    New York, NY
    10 hours ago
  • Super Dispatch, Inc. seeks a Tech Lead Manager for the Platform squad. This hybrid leadership role combines deep technical ownership with...  ..., serving as the primary technical authority for platform infrastructure. You will own architecture, drive incidents, and contribute... 
    Remote job

    Super Dispatch, Inc.

    New York, NY
    1 day ago
  • To lead a small, high-ownership Site Reliability team, the full-time salaried Tech Lead Manager, Site Reliability will manage technical decision-making, people leadership, and...  ..., contributing to incident response and infrastructure automation Own technical debt and... 
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    1 day ago
  • $225k - $325k

    Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-...  ...engineering experience running production infrastructure at a large scaleExperience designing...  ...distributed systems with Kubernetes, and GPU workloads on those clustersExperience with... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    4 days ago
  • $190k - $270k

     ...a Staff Software Engineer, AI Research Infrastructure, you will be developing and running the...  ...and model training (e.g., HPC clusters, GPU fleets, or cloud‑based systems)Enable researchers...  ...productivity, such as experiment management systems, CI/testing infrastructure for research... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    3 days ago
  • $153k - $204k

     ...build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise...  ...secure by design, from data centers and GPU fleets to the platform layers powering our... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $160k - $240k

     ...Software Engineer - Cloud Native Compute Infrastructure Core Location New York Business...  ...database platformsOn-premises GPU infrastructure supporting AI training and...  ...our foundational infrastructure by safely managing OS, firmware, network policy, and configuration... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    12 hours ago
  • $215k - $350k

    We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering... 
    Worldwide
    Home office

    Fortinet

    New York, NY
    4 days ago
  • We Are:The Global AI Infrastructure team is at the center of...  ...that powers AI platforms, GPU-accelerated workloads,...  ...market, our team is leading the way in shaping how...  ...needsDeploy, configure, and manage XPU-based clusters (GPU...  ...Center Dr, ACN Tech; Cincinnati, 4th Street... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    1 day ago
  • $165k - $267.5k

     ...most innovative brands, including DoorDash, Affirm, and Zillow.About the roleWe are looking for an Engineering Manager to join our Developer Infrastructure team. You’ll be responsible for nurturing a strong existing team responsible for the process and technology that... 
    Full time
    Work experience placement
    Remote work

    Palo Alto Networks

    New York, NY
    4 days ago
  • $200k - $300k

     ...Tower Research Capital is a leading quantitative trading firm founded...  ...talent. We empower portfolio managers to build their teams and...  ...developing electronic trading infrastructure at a world class level. Our engineers...  ...potential. Summary Our GPU fleet is one of the fastest-... 
    Casual work
    Work at office

    Tradermath

    New York, NY
    9 hours ago
  • $144.25k - $256.25k

     ...technology engineering, architecture, and infrastructure, providing 24x7 support to ensure...  .... We also provide product management for core enterprise platforms, and lead technology risk and information...  ...of AI infrastructure, including GPU platforms, accelerated compute, workload... 
    Visa sponsorship

    American Express

    New York, NY
    4 days ago
  • $190k - $325k

    Who are we?Cohere is the leading security-first enterprise AI company...  ...us!Why this role?The Data Infrastructure team at Cohere is responsible...  ...across regions and backends, with GPU idle time and time-to-insight...  ...caching, and data lifecycle management.Strong coding ability. We... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  •  ...automation that enterprises can trust. As a Software Engineer, Infrastructure at Scaled Cognition you will: Design and improve inference...  ..., GCP, Azure). Prior experience designing and implementing GPU infrastructure / tooling. A strong sense for scalability... 

    Scaled Cognition

    New York, NY
    a month ago
  • Techx4u, Inc. is seeking a Marketing & Sales Executive to help generate awareness, leads, and new business opportunities for our managed IT, cybersecurity, cloud, infrastructure, and technology services. You will work across digital marketing, prospect research, social... 
    Remote job

    Techx4u, Inc

    New York, NY
    1 day ago
  • $290.4k - $363k

     ...quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and...  ...to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable... 
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $190k - $260k

    Who are we?Cohere is the leading security-first enterprise AI company...  ...systems that automate managing, deploying and operating services...  ...developers and influence the Infrastructure team’s roadmap based on their...  ...systems with Kubernetes, and GPU workloads on those clustersExperience... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    4 days ago
  •  ...'s most iconic financial institutions, where infrastructure is of paramount importance, you can play a pivotal role.As a Lead Infrastructure Engineer at JPMorgan Chase within...  ...a growing initiative and the ability to manage assigned tasks efficiently, seeking guidance... 

    JP Morgan Chase

    New York, NY
    10 hours ago
  • $153k - $204k

     ...build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise...  ...secure by design, from data centers and GPU fleets to the platform layers powering our... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    22 days ago
  • $229.9k - $262.4k

     ...Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are...  ...to deliver our industry leading capabilities with breakthrough...  ...scientists, technical program managers, and product managers to deliver...  ...across AI systems, tracking GPU utilization, model throughput... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    5 days ago
  • $200k - $240k

     ...BitGo (NYSE: BTGO) is the digital asset infrastructure company delivering custody, wallets,...  ...This is a player-coach role: you'll lead a small team of infrastructure engineers...  ...balancers, CNI plugins, network policy management) ~ Proficiency in at least one high-level... 
    Full time
    Work at office
    Worldwide
    Monday to Friday

    Linuxconfig

    New York, NY
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Tech Lead Manager, GPU Infrastructure. Be the first to apply!