Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Infrastructure Engineer

Prior Labs

Who we are Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables. We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level. We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun. In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years. About the Role We spend tens of millions per year on GPU compute to train tabular foundation models. That's not a target, it's what we're running today, and it's growing. The person who owns this infrastructure makes decisions worth millions of dollars: cluster architecture, scheduling efficiency, provider strategy, hardware selection. Today we run on Slurm across multiple clusters. We're scaling to multi-cluster, multi-provider infrastructure using SkyPilot and evaluating new hardware generations as they come online. You own the full stack, from cluster orchestration and cost optimization to CI/CD, automation, and the tooling that keeps researchers moving fast. You work directly with the research team and understand what they're doing well enough to make infrastructure decisions that actually help them. What you'll work on: Own and evolve multi-cluster GPU infrastructure, from Slurm and SkyPilot on GCP today to multi-provider orchestration and new GPU generations tomorrow. Drive architecture, automated provisioning, workload scheduling, reliability, cost optimization, and capacity planning against growing compute demands Build the developer productivity layer: CI/CD pipelines, automated testing, reproducible environments, experiment tracking, and internal tooling that keeps research iteration speed high Improve infrastructure reliability through monitoring, observability, infrastructure as code, and automation. Reduce operational toil and make complex systems easier to manage. Help guide compute spending decisions. You understand cost per FLOP across providers and hardware, and you hate wasted compute Tech stack: Slurm, SkyPilot, GCP (+ AWS and Azure to come), Docker, Terraform, GitHub Actions, Python, uv, wandb You may be a good fit if you have: 3+ years building and operating production infrastructure at scale, ideally involving compute clusters, distributed training systems, or HPC Hands-on experience with cluster management and workload orchestration systems such as Slurm, Kubernetes, or similar technologies. You've debugged scheduling failures and operated infrastructure where downtime has real cost Experience designing and maintaining CI/CD pipelines, automated testing, and reliable build and deployment workflows Strong systems engineering fundamentals: Linux, networking, storage, and distributed systems. You're comfortable debugging complex infrastructure problems across the stack. Strong Python skills and enough familiarity with training to profile a run and tell whether the bottleneck is data loading, communication, or compute Track record of making infrastructure decisions that measurably improved reliability, developer productivity, or cost efficiency Strong AI tooling skills. You use Claude Code, Cursor, or similar fluently to move fast without sacrificing quality Bonus: Familiarity with GPU infrastructure, PyTorch, GPU profiling, and distributed training Experience operating at tens-of-millions-scale compute spend Multi-cloud or hybrid HPC/cloud infrastructure experience Experience scaling from single cluster to multi-cluster orchestration Background building experiment tracking, model registries, or ML pipeline tooling Life at Prior Labs You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right. Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together. Our Commitments The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are. We care about how your data is handled - see our Recruiting Data Privacy page Prior Labs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Infrastructure Engineer in New York, NY vacancy
  •  ...to the organization and project commitments/deliverables ~ Understanding of the Incident Response life cycle is required as engineering may serve as an escalation point for Security Operations. ~ Working knowledge of Linux (RHEL) and Windows OSes required.... 
    Suggested

    Talent Groups

    New York, NY
    2 days ago
  • Senior IT Systems & Infrastructure Engineer Hinshaw & Culbertson LLP is a national law firm with over 500 attorneys across the United States. Founded in 1934 and headquartered in Chicago, we provide sophisticated legal counsel to clients in highly regulated industries,... 
    Suggested
    Work at office
    Remote work
    Flexible hours
    Night shift
    Weekend work
    Afternoon shift

    Hinshaw & Culbertson

    New York, NY
    2 days ago
  •  ...retail bank as they roll out a major network hardware deployment across locations in NY and AZ. We are hiring 8 Network Deployment Engineers to install, configure, and validate newly purchased network devices throughout the client's environment. This is a field-based... 
    Suggested
    Daily paid
    Full time
    Contract work
    Bank staff
    Local area
    Remote work
    Monday to Friday

    Trick Dog Technology

    New York, NY
    2 days ago
  •  ...to ingest digitized legacy records (PDFs, old databases) and surface them cleanly in the application. Own the Infrastructure: Help shape our engineering culture, best practices, deployment pipelines, and overall system architecture as we scale from prototype to enterprise... 
    Suggested
    Full time

    Airbase

    New York, NY
    1 day ago
  •  ...senior-level contract role on a W2 or C2C, can be based in either Warren, NJ, or NYC. We are seeking an experienced Senior Infrastructure Engineer to lead the operational support, monitoring, and deployment of our enterprise server and virtualization environments. In... 
    Suggested
    Contract work
    Worldwide

    The Connors Group

    New York, NY
    3 days ago
  • $130k - $150k

     ...Senior Critical Infrastructure Engineer | Commercial Office, NYC | $130k-$150k base Your New Company Hays have partnered with a leading FM service provider who are looking to hire a Senior Critical Infrastructure Engineer based in New York City. This position will... 
    Full time
    For contractors
    Work at office

    Hays

    New York, NY
    3 days ago
  •  ...Infrastructure Engineer We’re looking for a hands-on Senior Infrastructure Engineer with strong experience across both Azure and on-premises infrastructure. This is a project-focused engineering role rather than a management position, with responsibility for designing... 
    Full time

    Franklin Fitch

    New York, NY
    3 days ago
  •  ...About the job Build the infrastructure powering the next generation of prediction markets. We’re looking for a strong backend/quant engineer to build our prediction-market infrastructure from the ground up. You’ll integrate third-party market APIs, build our own... 

    Unlok

    New York, NY
    12 hours ago
  • $164k - $295k

     ...this pivotal role, you'll harness cutting-edge technologies to engineer robust backend services that seamlessly analyze massive data...  ...that integrate seamlessly with our platform ecosystem Infrastructure Design: Architect supporting systems including databases, real... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    New York, NY
    a month ago
  • $175k - $315k

     ...each other. Ready to join a mission that matters? The future of cybersecurity starts with you. The CrowdStrike Cloud Detection Engine (CDE) team is building a powerful, next-generation platform designed to be a force multiplier for security teams. Our platform empowers... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week
    New York, NY
    a month ago
  • Job-ID: 82508Category: Infrastructure Solution EngineeringLocation: New York, NY, United States; Jersey City, NJ, United StatesSchedule...  ...and be part of something extraordinary. We’re seeking Senior Engineering/Developer professional to join our RME/SMS team in NY/NJ.In... 
    Full time
    Work experience placement
    Immediate start
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    3 days ago
  • Job-ID: 82772Category: Infrastructure Solution EngineeringLocation: Jersey City, NJ, United States; New York, NY, United StatesSchedule...  ...and clearly communicate recommendations and architecture to engineering teams and stakeholders.To be successful in this role, we're... 
    Full time
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    3 days ago
  • $168k - $270.25k

     ...the world.The NVIDIA Enterprise Experience (NVEX) Solutions Engineering team is looking for a senior Computer or Software Engineer....  ...InfiniBand, NVLink, and Spectrum-X that link GPUs and AI compute infrastructure. Candidates must have a software development background in... 
    Full time
    Weekend work

    Nvidia

    New York, NY
    4 days ago
  • $136k - $245k

     ...reduces costs and results in more secure applications. Our engineers work with AI coding agents every day. We're looking for...  ...code critically. Hands-on experience with AWS, Azure or GCP, infrastructure-as-code (Terraform, CloudFormation, ARM/Bicep), and Docker/Kubernetes... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    3 days per week
    New York, NY
    5 days ago
  • $125k - $225k

     ...(CSPM) offering provides visibility into your entire cloud infrastructure, continuous monitoring for misconfigurations, and proactive...  ...increasing complexity. Relentlessly pursue quality by following engineering best practices including: Appropriate testing paradigms,... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    3 days per week
    New York, NY
    a month ago
  • $54 - $58 per hour

     ...We are looking for a hands-on Senior Network Test & Certification Engineer with strong enterprise networking, automation, Linux, and AI-assisted engineering experience. The engineer will be responsible for testing and certifying network hardware, software releases, patches... 
    Contract work

    Long Finch Technologies

    New York, NY
    3 days ago
  •  ...new products on crypto rails.Privy owns the abstractions and infrastructure layer above wallets, integrating across chains, third-party providers...  ...is trust. While we have a dedicated security team, every engineer brings security to their designs from the start.In practice,... 
    Flexible hours

    Stripe

    New York, NY
    4 days ago
  • $190k - $210k

     ...Boeing, and RTX Ventures, Axion is poised to lead the quality revolution in manufacturing.About the Role:We're seeking a Senior Infrastructure Engineer to play a key role in shaping and scaling our cloud infrastructure. You'll be responsible for designing, implementing, and... 
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    1 day ago
  • $175k - $250k

    Senior ‘Developer Infrastructure’ EngineerThe Systematic Platform Execution & Exchange Data (SPEED) Team is at the core of Millennium’s Equities...  ...time‑critical markets. As a Senior Developer Infrastructure Engineer on SPEED, you will own and evolve the build and CI/CD... 
    Remote work

    Millennium Management

    New York, NY
    4 days ago
  • Networking Solutions Engineer Join a leading technology organization delivering advanced networking, automation, and managed service...  ...Telecommunications, service provider, or large-scale infrastructure networks Location: Remote Travel: Moderate U.S. travel required... 
    Remote work

    Liberty Personnel Services, Inc.

    New York, NY
    2 days ago
  • $100.6k - $160.8k

     ...leader in high-speed connectivity, Ciena builds the critical infrastructure powering the AI era. We're a technology company shaping the future...  ...job. Connect with a career that matters. Network Solution Engineer (Optical Engineer) Work Location: Onsite at Scott AFB, IL (... 
    For contractors
    Local area

    Ciena

    New York, NY
    2 days ago
  •  ...Network Engineer Contract Duration: 12 Months Location: Midtown, New York, NY (Onsite 4 days/week) Overview Our direct client is in need of a Network Operations & Infrastructure Engineer who combines deep hands-on networking expertise with the ability to lead... 
    Full time
    Contract work
    Work at office
    Remote work

    Gotham Technology Group

    New York, NY
    3 days ago
  •  ...Job Title: HPC Network Engineer | High-Performance Infrastructure Location: New York or Chicago preferred | Other US locations considered (Flexible work arrangements) Salary: Up to $800,000 TC (Depending on experience) Do you want to join a global quantitative... 
    Flexible hours

    Hamilton Barnes 🌳

    New York, NY
    3 days ago
  • $208k - $333.5k

     ...NVIDIA is seeking a highly skilled Senior Network Deployment Engineer with 12+ years of progressive experience to lead complex, large...  ..., and optimization of complex cloud and WAN core network infrastructures. Manage and implement end-to-end site deployments, overseeing... 

    NVIDIA

    New York, NY
    2 days ago
  •  ...Network Engineer (2 openings) Location: New York, NY, onsite at the client's office. At least 3 days a week in the office, FTE...  ...Python and Ansible (Robot Framework is a plus), Git/GitHub and Infrastructure-as-Code ~ OSPF, BGP, IGMP and PIM ~ Cisco Catalyst and... 
    Full time
    Work at office
    Local area
    3 days per week

    Hallmark Global Solutions Ltd

    New York, NY
    8 days ago
  •  ...available – candidates must already have unrestricted US work authorization Please apply only if you have 15+ years of infrastructure engineering leadership experience with an active PE license This is an opportunity to take a high-profile regional leadership... 
    Contract work
    Local area

    Oculus Group

    New York, NY
    12 days ago
  • $150k - $190k

     ...Job Title: AI Infrastructure Support Engineer Location: New York, NY Type - Hybrid 4 days Onsite Terms; Full Time Salary- $150000/yr - $190000/yr Our client provides a range of financial products and services in the United States and internationally. It... 
    Full time
    Work at office

    Yoh, A Day & Zimmermann Company

    New York, NY
    5 days ago
  •  ...Title: Low Latency Network Engineer Location: New York or Chicago (4x per week onsite) Salary: Up to 250k base + bonus ($500...  ...technology business. You’ll influence architecture, deliver major infrastructure projects and help develop an experienced engineering team.... 
    Full time

    Hamilton Barnes 🌳

    New York, NY
    3 days ago
  •  ...Pearse Partners is working exclusively with a leading global infrastructure private equity platform on the hire of a Senior Analyst or Associate to join their New York team. About the Firm Our client is one of the world's leading infrastructure private equity platforms... 
    Full time

    Pearse Partners

    New York, NY
    1 day ago
  • $300k

     ...the firm always knows what’s happening on the wire, what changed and what broke. You’ll also move network configuration toward infrastructure-as-code, with changes version controlled, reviewed and repeatable. We’re looking for someone who has a few years under their... 
    Full time
    Work at office

    Saragossa

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Infrastructure Engineer. Be the first to apply!