Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, GPU Infrastructure

$175k - $300k

Fluidstack

About Fluidstack We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don’t share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it. We’re singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI. We hire people who care deeply about this problem space. If that is you, please apply! How We Operate Extreme ownership. Full autonomy. Own things end to end often taking on scope outside your core role without being asked to get things done. Velocity. We drive everything forward as fast as possible. First principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins. Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward. The Production Engineering Team Examples of key exciting problems the team is working on Build the repair pipeline that keeps pace with a 10 GW fleet: at our scale, a GPU failure isn’t a ticket. It’s a throughput problem. We’re building the automation that takes a chip from fault detection through triage, RMA, and return to service without human intervention. Qualify every new GPU generation inside a 6-month build window: our platform covers burn‑in, performance baselining, and NPI execution. It has to define “production-ready” before a site goes live, not after. New hardware gets certified at speeds unheard of in the industry. Migrate live compute at construction speed: we’re converting clusters across production sites simultaneously, bringing new sites online, and making Kubernetes‑orchestrated bare metal sustainable at the pace we’re building – multiple GW annually. See and own the entire fleet in real time, at any scale: build the observability and orchestration layer that makes hyperscale AI compute actually operable. Debug, tune, and performance‑test infrastructure that grows by another site every few months. Role Scope Own compute fleet health end to end. Build the metrics pipelines, alerting, and unified health view that tell you the true state of every GPU in production — across Kubernetes‑orchestrated workloads and bare metal, at scale. Turn deployment/repair into a pipeline, not a procedure. Build and own the automation that takes a compute failure from detection through triage, parts management, and return to service. No one‑off scripts, no heroics. Design and expand the GPU qualification platform. Burn‑in, performance baselining, and NPI execution for every new GPU generation. You define what “good” looks like before hardware goes into production. Own Redfish and BMC tooling. Firmware‑level telemetry, log collection at fleet scale, and the low‑level access layer that repair automation and health tooling depend on. Own end‑to‑end reliability, scalability, and operation of the compute fleet at‑scale. Fluidstack is building one of the largest GPU fleets in the world and that can only be accomplished with aggressive automation, tooling, and incident discipline. What We’re Looking For The below is a starting point. We always make space for exceptional people, so if you don’t fit this role exactly, tell us where you would. You treat toil as a bug. Manual steps in a repair workflow are a backlog item, not a job description. You have an instinct for hardware. You’re comfortable reasoning about failure modes at the firmware and silicon level, not just the software stack above it. You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else. You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise. You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on. You’re fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day. You’ve shipped production automation that other teams depend on, and you’re comfortable in any language using AI coding tools. Bonus: Hardware lifecycle management and RMA automation. BMC/Redfish or IPMI tooling. GPU qualification or burn‑in frameworks. Workflow and orchestration engines (Temporal, Cadence). Metrics and alerting pipelines (Prometheus, Grafana). Go or Python … Salary & Benefits Competitive total compensation package (salary + equity). Retirement or pension plan, in line with local norms. Health, dental, and vision insurance. Generous PTO policy, in line with local norms. The base salary range for this position is $175,000 - $300,000 per year, depending on experience, skills, qualifications, and location. This range represents our good faith estimate of the compensation for this role at the time of posting. Total compensation may also include equity in the form of stock options. We are committed to pay equity and transparency. Equal Employment Opportunity Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law. Compensation Range: $175K - $300K #J-18808-Ljbffr Fluidstack

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, GPU Infrastructure in New York, NY vacancy
  • $180k - $250k

     ...Our exceptionally strong team includes software engineers, AI researchers, security engineers,...  ...company and Senior Software Engineer, Infrastructure at Artemis, you'll own the backbone of...  ...Partner with AI/ML and data teams — Support GPU workloads, model training pipelines,... 
    Suggested

    Artemis Security

    New York, NY
    2 days ago
  • $280k

     ...Anthropic is seeking talented and experienced Infrastructure Engineers to join our team and support the...  ...large Kubernetes clusters with GPU/TPU/Tranium workloads. Observability:...  ...tradeoffs, keeping track of rapidly evolving software systems Deadline to apply: None.... 
    Suggested
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    Anthropic

    New York, NY
    2 days ago
  • $200k - $400k

     ...and grow as a team. About the Team The Infrastructure team builds and operates the foundations...  ...managed and on‑prem environments. ML Infra: GPU and model‑serving platforms for LLM...  ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Suggested
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    3 days ago
  • $180k - $360k

     ...Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies...  ...Capital, Greylock, and Conviction. The Role We’re seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration. In... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    2 days ago
  •  ...running the fully autonomous vehicle’s software stack To achieve our mission, we...  ...will report to a Senior Software Engineer Develop high-performance GPU primitives and abstractions to...  ...GPU platforms Contribute to testing infrastructure that enhances the CI/CD flow for GPUs... 
    Suggested
    Local area
    Remote work

    Waymo

    New York, NY
    1 day ago
  • $175k - $300k

     ...Whoever deploys frontier compute infrastructure fastest will decide whether...  ...teams spanning hardware and software. Speed and scale are our key...  ...forward. The Production Engineering Team Examples of key exciting...  ..., so every new site and GPU generation lands cleanly from... 
    Local area

    Fluidstack

    New York, NY
    2 days ago
  • Waymo is seeking a Senior Software Engineer to architect and implement high-performance GPU primitives and abstractions. You will work across the full GPU software...  ...validation. The role emphasizes testing infrastructure, CI/CD improvements for GPUs, and the development... 

    Waymo

    New York, NY
    3 days ago
  • $166k - $244k

    Senior Software Engineer, GPU Performance Apply X Note: By applying to this position you will have an opportunity to share your preferred...  ...rapidly expanding frontier within Google's machine learning infrastructure. GPUs are indispensable to Google’s ever-evolving... 
    Full time
    Worldwide

    Google Inc.

    New York, NY
    1 day ago
  • Waymo is seeking a GPU Software Engineer to advance the driverless platform. The role focuses on developing high-performance GPU primitives...  ...on new platforms. You will also contribute to testing infrastructure to strengthen CI/CD and create profiling tools for performance... 

    Waymo

    New York, NY
    4 days ago
  • A leading tech company in the United States is seeking an experienced Infrastructure GPU Engineer to build and support high-performance cloud infrastructure. This role involves optimizing resource allocation for GPU workloads, ensuring system reliability, and collaborating... 
    Remote job

    DevOpsChat

    New York, NY
    4 days ago
  • A leading AI Infrastructure company in New York City seeks a Staff Software Engineer to design and operate GPU-driven data centers for advanced AI workloads. The ideal candidate will lead infrastructure services, drive API development, and ensure operational excellence.... 

    CoreWeave

    New York, NY
    4 days ago
  • Nscale is seeking a Staff Observability Platform Engineer to enhance our observability platform for GPU clusters and AI workloads. This role requires a strong...  ...6 years of experience in relevant fields, strong software engineering skills in Go or Python, and familiarity... 

    Nscale

    New York, NY
    4 days ago
  • NVIDIA is seeking a seasoned Solution Engineer to collaborate with Cloud Partners in delivering cutting-edge GPU cloud solutions. You will work with SAs, Account Managers, Engineering and Product teams to align on strategy and drive opportunities with customers, guiding... 

    NVIDIA

    New York, NY
    4 days ago
  • $160k - $220k

     ...shipping in Summer '26. Join us in creating a new interface for self augmentation. About We’re looking for an experienced infrastructure engineer to help build Stream, a new conversational interface. You will be responsible for developing a highly scalable real-time production... 
    Summer work

    Sandbar Inc

    New York, NY
    2 days ago
  • $196k - $339.9k

     ...Software Engineer, Infrastructure (8+ YOE) San Francisco, CA; New York, NY; Remote - US (Seattle, WA only) Airtable is the no-code app platform that empowers people closest to the work to accelerate their most critical business processes. More than 500,000 organizations... 
    Remote work
    Relocation

    Airtable

    New York, NY
    2 days ago
  • $145k - $155k

     ...Company Palantir builds the world's leading software for data-driven decisions and...  ...children, and more. The Role Software Engineers at Palantir drive large-scale transformation...  ...transformation through data, AI and world-leading infrastructure that supports mission‑critical... 
    Work experience placement
    Work at office
    Remote work
    Work from home
    Worldwide
    Relocation package

    Palantir Technologies

    New York, NY
    3 days ago
  • $175k - $215k

     ...magic of frictionless experiences. We’re looking for a Senior Software Engineer to join our Network Engineering team to accelerate building...  ...platform. In this role, you will build the next-generation infrastructure that underpins all systems at CLEAR. The ideal candidate... 
    Casual work
    Work at office
    Flexible hours

    Clear

    New York, NY
    2 days ago
  • $184k - $259.44k

     ...Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer – enabling state‑of‑the‑art models, debugging the latest... 
    Full time
    Work at office
    3 days per week
    Early shift

    Scale AI

    New York, NY
    2 days ago
  • $209k - $283k

     ...administrative waste. The Role As a Staff Engineer at Candid Health, you’ll be empowered...  ...into our grittiest and most complex infrastructure challenges at Candid, building the critical...  ..., and develop the next generation of software engineers on advanced technical issues.... 

    Candid Health

    New York, NY
    3 days ago
  • $140k - $260k

    What You’ll Do Design and maintain core infrastructure across cloud environments Build infrastructure-as-code workflows to automate deployments and scaling Improve monitoring, logging, and alerting systems to maintain reliability Manage CI/CD pipelines to ensure seamless... 
    Work at office
    Visa sponsorship

    Profound

    New York, NY
    4 days ago
  • $140k - $250k

     ...fastest-growing and fastest-improving query engine on the planet. Unlike other databases,...  ...operations to bridge the gap between software and data engineering workflows. Our...  ...New York, and Amsterdam. MotherDuck’s infrastructure team builds the systems and tools that... 
    Work at office
    Local area
    Flexible hours

    MotherDuck

    New York, NY
    4 days ago
  • $160k - $220k

     ...continues to innovate with new products, software features, and new market expansion,...  ...Aura is often given as a gift, so our infrastructure must support rapid scalability on holidays...  ...Role You’ll join our small infrastructure engineering team in our NYC and SF offices, where... 
    Full time
    Part time
    Flexible hours

    Aura Home, Inc.

    New York, NY
    5 days ago
  •  ...team of world-class PhD researchers and engineers, Scaled Cognition advances the...  ...that enterprises can trust. As a Software Engineer, Infrastructure at Scaled Cognition you will: Design...  ...experience designing and implementing GPU infrastructure / tooling. A strong... 

    Scaled Cognition

    New York, NY
    22 days ago
  • $145k - $200k

     ...building an AI-native workflow orchestration engine looking for dedicated individuals to...  ...its growing team. Our goal is to make infrastructure simple for enterprises and public...  ...The Role We are looking for a skilled software engineer with a strong foundation in infrastructure... 

    Thread AI

    New York, NY
    4 days ago
  • $128.25k - $266.88k

     ...Platform team builds and operates critical infrastructure that powers Search reliability,...  .... We are a small but highly impactful engineering team responsible for foundational systems...  ...systems, automation tooling, and modern software development practices. Strong problem‑... 
    Work at office
    Flexible hours

    Yahoo Holdings Inc.

    New York, NY
    4 days ago
  • $185k - $235k

    Healthie is seeking exceptional Senior and Staff Software Engineers to enhance our platform's healthcare delivery solutions. You will develop new features, lead technical projects, and ensure high-quality production systems while working with Rails, React, and GraphQL.... 
    Full time

    Healthie

    New York, NY
    4 days ago
  • $123k - $165k

     ...Technology is a global organization of engineers, product developers, designers, technologists...  ..., and engineering best practices. The Software Engineer II plays a key role in...  ...designing, and implementing software and infrastructure solutions that support highly available... 
    Temporary work
    Work experience placement

    The Walt Disney Company

    New York, NY
    4 days ago
  •  ...computing and storage environment. Hadoop Infrastructure's mission is to provide a multi-tenant,...  ...you? You are a dedicated and motivated engineer interested in building and managing...  ...significant impact and contribute to open-source software. We’ll trust you to: Advance how... 
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • $200k - $230k

     ...Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. We’re looking for a Senior Software Engineer to join our Airflow Infra team, part of our flagship cloud platform. You’ll be building the... 

    ASTRONOMER INC

    New York, NY
    4 days ago
  • $260k - $330k

     ...together think and execute. About The Web Infrastructure Team The Web Infrastructure team’s mission is to empower Notion engineers with web frameworks that are easy-to-use, performant...  ...values, and enthusiastic about making software toolmaking ubiquitous, we want to hear from... 
    Local area

    Notion, LLC

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, GPU Infrastructure. Be the first to apply!