Infrastructure Engineer
Prior Labs
Who we are Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables. We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level. We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun. In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years. About the Role We spend tens of millions per year on GPU compute to train tabular foundation models. That's not a target, it's what we're running today, and it's growing. The person who owns this infrastructure makes decisions worth millions of dollars: cluster architecture, scheduling efficiency, provider strategy, hardware selection. Today we run on Slurm across multiple clusters. We're scaling to multi-cluster, multi-provider infrastructure using SkyPilot and evaluating new hardware generations as they come online. You own the full stack, from cluster orchestration and cost optimization to CI/CD, automation, and the tooling that keeps researchers moving fast. You work directly with the research team and understand what they're doing well enough to make infrastructure decisions that actually help them. What you'll work on: Own and evolve multi-cluster GPU infrastructure, from Slurm and SkyPilot on GCP today to multi-provider orchestration and new GPU generations tomorrow. Drive architecture, automated provisioning, workload scheduling, reliability, cost optimization, and capacity planning against growing compute demands Build the developer productivity layer: CI/CD pipelines, automated testing, reproducible environments, experiment tracking, and internal tooling that keeps research iteration speed high Improve infrastructure reliability through monitoring, observability, infrastructure as code, and automation. Reduce operational toil and make complex systems easier to manage. Help guide compute spending decisions. You understand cost per FLOP across providers and hardware, and you hate wasted compute Tech stack: Slurm, SkyPilot, GCP (+ AWS and Azure to come), Docker, Terraform, GitHub Actions, Python, uv, wandb You may be a good fit if you have: 3+ years building and operating production infrastructure at scale, ideally involving compute clusters, distributed training systems, or HPC Hands-on experience with cluster management and workload orchestration systems such as Slurm, Kubernetes, or similar technologies. You've debugged scheduling failures and operated infrastructure where downtime has real cost Experience designing and maintaining CI/CD pipelines, automated testing, and reliable build and deployment workflows Strong systems engineering fundamentals: Linux, networking, storage, and distributed systems. You're comfortable debugging complex infrastructure problems across the stack. Strong Python skills and enough familiarity with training to profile a run and tell whether the bottleneck is data loading, communication, or compute Track record of making infrastructure decisions that measurably improved reliability, developer productivity, or cost efficiency Strong AI tooling skills. You use Claude Code, Cursor, or similar fluently to move fast without sacrificing quality Bonus: Familiarity with GPU infrastructure, PyTorch, GPU profiling, and distributed training Experience operating at tens-of-millions-scale compute spend Multi-cloud or hybrid HPC/cloud infrastructure experience Experience scaling from single cluster to multi-cluster orchestration Background building experiment tracking, model registries, or ML pipeline tooling Life at Prior Labs You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right. Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together. Our Commitments The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are. We care about how your data is handled - see our Recruiting Data Privacy page Prior Labs
- ...to the organization and project commitments/deliverables ~ Understanding of the Incident Response life cycle is required as engineering may serve as an escalation point for Security Operations. ~ Working knowledge of Linux (RHEL) and Windows OSes required....Suggested
- Senior IT Systems & Infrastructure Engineer Hinshaw & Culbertson LLP is a national law firm with over 500 attorneys across the United States. Founded in 1934 and headquartered in Chicago, we provide sophisticated legal counsel to clients in highly regulated industries,...SuggestedWork at officeRemote workFlexible hoursNight shiftWeekend workAfternoon shift
- ...retail bank as they roll out a major network hardware deployment across locations in NY and AZ. We are hiring 8 Network Deployment Engineers to install, configure, and validate newly purchased network devices throughout the client's environment. This is a field-based...SuggestedDaily paidFull timeContract workBank staffLocal areaRemote workMonday to Friday
- ...to ingest digitized legacy records (PDFs, old databases) and surface them cleanly in the application. Own the Infrastructure: Help shape our engineering culture, best practices, deployment pipelines, and overall system architecture as we scale from prototype to enterprise...SuggestedFull time
- ...senior-level contract role on a W2 or C2C, can be based in either Warren, NJ, or NYC. We are seeking an experienced Senior Infrastructure Engineer to lead the operational support, monitoring, and deployment of our enterprise server and virtualization environments. In...SuggestedContract workWorldwide
$130k - $150k
...Senior Critical Infrastructure Engineer | Commercial Office, NYC | $130k-$150k base Your New Company Hays have partnered with a leading FM service provider who are looking to hire a Senior Critical Infrastructure Engineer based in New York City. This position will...Full timeFor contractorsWork at office- ...Infrastructure Engineer We’re looking for a hands-on Senior Infrastructure Engineer with strong experience across both Azure and on-premises infrastructure. This is a project-focused engineering role rather than a management position, with responsibility for designing...Full time
- ...About the job Build the infrastructure powering the next generation of prediction markets. We’re looking for a strong backend/quant engineer to build our prediction-market infrastructure from the ground up. You’ll integrate third-party market APIs, build our own...
$164k - $295k
...this pivotal role, you'll harness cutting-edge technologies to engineer robust backend services that seamlessly analyze massive data... ...that integrate seamlessly with our platform ecosystem Infrastructure Design: Architect supporting systems including databases, real...Permanent employmentWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$175k - $315k
...each other. Ready to join a mission that matters? The future of cybersecurity starts with you. The CrowdStrike Cloud Detection Engine (CDE) team is building a powerful, next-generation platform designed to be a force multiplier for security teams. Our platform empowers...Permanent employmentWork experience placementWork at officeLocal area2 days per week3 days per week- Job-ID: 82508Category: Infrastructure Solution EngineeringLocation: New York, NY, United States; Jersey City, NJ, United StatesSchedule... ...and be part of something extraordinary. We’re seeking Senior Engineering/Developer professional to join our RME/SMS team in NY/NJ.In...Full timeWork experience placementImmediate startWorldwideFlexible hours
- Job-ID: 82772Category: Infrastructure Solution EngineeringLocation: Jersey City, NJ, United States; New York, NY, United StatesSchedule... ...and clearly communicate recommendations and architecture to engineering teams and stakeholders.To be successful in this role, we're...Full timeWorldwideFlexible hours
$168k - $270.25k
...the world.The NVIDIA Enterprise Experience (NVEX) Solutions Engineering team is looking for a senior Computer or Software Engineer.... ...InfiniBand, NVLink, and Spectrum-X that link GPUs and AI compute infrastructure. Candidates must have a software development background in...Full timeWeekend work$136k - $245k
...reduces costs and results in more secure applications. Our engineers work with AI coding agents every day. We're looking for... ...code critically. Hands-on experience with AWS, Azure or GCP, infrastructure-as-code (Terraform, CloudFormation, ARM/Bicep), and Docker/Kubernetes...Permanent employmentWork experience placementWork at officeLocal area3 days per week$125k - $225k
...(CSPM) offering provides visibility into your entire cloud infrastructure, continuous monitoring for misconfigurations, and proactive... ...increasing complexity. Relentlessly pursue quality by following engineering best practices including: Appropriate testing paradigms,...Permanent employmentWork experience placementWork at officeLocal area3 days per week$54 - $58 per hour
...We are looking for a hands-on Senior Network Test & Certification Engineer with strong enterprise networking, automation, Linux, and AI-assisted engineering experience. The engineer will be responsible for testing and certifying network hardware, software releases, patches...Contract work- ...new products on crypto rails.Privy owns the abstractions and infrastructure layer above wallets, integrating across chains, third-party providers... ...is trust. While we have a dedicated security team, every engineer brings security to their designs from the start.In practice,...Flexible hours
$190k - $210k
...Boeing, and RTX Ventures, Axion is poised to lead the quality revolution in manufacturing.About the Role:We're seeking a Senior Infrastructure Engineer to play a key role in shaping and scaling our cloud infrastructure. You'll be responsible for designing, implementing, and...Local areaWork from homeFlexible hoursNight shiftWeekend work$175k - $250k
Senior ‘Developer Infrastructure’ EngineerThe Systematic Platform Execution & Exchange Data (SPEED) Team is at the core of Millennium’s Equities... ...time‑critical markets. As a Senior Developer Infrastructure Engineer on SPEED, you will own and evolve the build and CI/CD...Remote work- Networking Solutions Engineer Join a leading technology organization delivering advanced networking, automation, and managed service... ...Telecommunications, service provider, or large-scale infrastructure networks Location: Remote Travel: Moderate U.S. travel required...Remote work
$100.6k - $160.8k
...leader in high-speed connectivity, Ciena builds the critical infrastructure powering the AI era. We're a technology company shaping the future... ...job. Connect with a career that matters. Network Solution Engineer (Optical Engineer) Work Location: Onsite at Scott AFB, IL (...For contractorsLocal area- ...Network Engineer Contract Duration: 12 Months Location: Midtown, New York, NY (Onsite 4 days/week) Overview Our direct client is in need of a Network Operations & Infrastructure Engineer who combines deep hands-on networking expertise with the ability to lead...Full timeContract workWork at officeRemote work
- ...Job Title: HPC Network Engineer | High-Performance Infrastructure Location: New York or Chicago preferred | Other US locations considered (Flexible work arrangements) Salary: Up to $800,000 TC (Depending on experience) Do you want to join a global quantitative...Flexible hours
$208k - $333.5k
...NVIDIA is seeking a highly skilled Senior Network Deployment Engineer with 12+ years of progressive experience to lead complex, large... ..., and optimization of complex cloud and WAN core network infrastructures. Manage and implement end-to-end site deployments, overseeing...- ...Network Engineer (2 openings) Location: New York, NY, onsite at the client's office. At least 3 days a week in the office, FTE... ...Python and Ansible (Robot Framework is a plus), Git/GitHub and Infrastructure-as-Code ~ OSPF, BGP, IGMP and PIM ~ Cisco Catalyst and...Full timeWork at officeLocal area3 days per week
- ...available – candidates must already have unrestricted US work authorization Please apply only if you have 15+ years of infrastructure engineering leadership experience with an active PE license This is an opportunity to take a high-profile regional leadership...Contract workLocal area
$150k - $190k
...Job Title: AI Infrastructure Support Engineer Location: New York, NY Type - Hybrid 4 days Onsite Terms; Full Time Salary- $150000/yr - $190000/yr Our client provides a range of financial products and services in the United States and internationally. It...Full timeWork at office- ...Title: Low Latency Network Engineer Location: New York or Chicago (4x per week onsite) Salary: Up to 250k base + bonus ($500... ...technology business. You’ll influence architecture, deliver major infrastructure projects and help develop an experienced engineering team....Full time
- ...Pearse Partners is working exclusively with a leading global infrastructure private equity platform on the hire of a Senior Analyst or Associate to join their New York team. About the Firm Our client is one of the world's leading infrastructure private equity platforms...Full time
$300k
...the firm always knows what’s happening on the wire, what changed and what broke. You’ll also move network configuration toward infrastructure-as-code, with changes version controlled, reviewed and repeatable. We’re looking for someone who has a few years under their...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Infrastructure Engineer. Be the first to apply!
- infrastructure automation engineer New York, NY
- entry level infrastructure engineer New York, NY
- principal infrastructure engineer New York, NY
- infrastructure engineering manager New York, NY
- infrastructure developer New York, NY
- security infrastructure engineer New York, NY
- associate infrastructure engineer New York, NY
- infrastructure engineer New York, NY
- lead infrastructure engineer New York, NY
- remote infrastructure engineer New York, NY







