Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Compute (GPU)

FluidStack

Fluidstack Job Posting

We exist to make humanity more free. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.

We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.

We hire people who care deeply about this problem space. If that is you, please apply!

How We Operate
  • Extreme ownership. Full autonomy. Own things end to end often taking on scope outside your core role without being asked to get things done.
  • Velocity. We drive everything forward as fast as possible.
  • First principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins.
  • Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward.
The Production Engineering Team

Examples of key exciting problems the team is working on

  • Build the repair pipeline that keeps pace with a fleet of 10s to 100s of GWs: at our scale, a GPU failure isn't a ticket. It's a throughput problem. We're building the automation that takes a chip from fault detection through triage, RMA, and return to service without human intervention.
  • Qualify every new GPU generation inside a 6-month build window: our platform covers burn-in, performance baselining, and NPI execution. It has to define "production-ready" before a site goes live, not after. New hardware gets certified at speeds unheard of in the industry.
  • Migrate live compute at construction speed: we're converting clusters across production sites simultaneously, bringing new sites online, and making Kubernetes-orchestrated bare metal sustainable at the pace we're building – multiple GW annually.
  • See and own the entire fleet in real time, at any scale: build the observability and orchestration layer that makes hyperscale AI compute actually operable. Debug, tune, and performance-test infrastructure that grows by another site every few months.
Role Scope
  • Own compute fleet health end to end. Build the metrics pipelines, alerting, and unified health view that tell you the true state of every GPU in production — across Kubernetes-orchestrated workloads and bare metal, at scale.
  • Turn deployment/repair into a pipeline, not a procedure. Build and own the automation that takes a compute failure from detection through triage, parts management, and return to service. No one-off scripts, no heroics.
  • Design and expand the GPU qualification platform. Burn-in, performance baselining, and NPI execution for every new GPU generation. You define what "good" looks like before hardware goes into production.
  • Own Redfish and BMC tooling. Firmware-level telemetry, log collection at fleet scale, and the low-level access layer that repair automation and health tooling depend on.
  • Own end-to-end reliability, scalability, and operation of the compute fleet at-scale. Fluidstack is building one of the largest GPU fleets in the world and that can only be accomplished with aggressive automation, tooling, and incident discipline.
What We're Looking For

The below is a starting point. We always make space for exceptional people, so if you don't fit this role exactly, tell us where you would.

  • You treat toil as a bug. Manual steps in a repair workflow are a backlog item, not a job description.
  • You have an instinct for hardware. You're comfortable reasoning about failure modes at the firmware and silicon level, not just the software stack above it.
  • You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else.
  • You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise.
  • You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on.
  • You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day.
  • You've shipped production automation that other teams depend on, and you're comfortable in any language using AI coding tools.
  • Bonus: Hardware lifecycle management and RMA automation. BMC/Redfish or IPMI tooling. GPU qualification or burn-in frameworks. Workflow and orchestration engines (Temporal, Cadence). Metrics and alerting pipelines (Prometheus, Grafana). Go or Python...
Salary & Benefits
  • Competitive total compensation package (salary + equity).
  • Retirement or pension plan, in line with local norms.
  • Health, dental, and vision insurance.
  • Generous PTO policy, in line with local norms.

Total compensation may also include equity in the form of stock options.

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email View email address on click.appcast.io with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Compute (GPU) in New York, NY vacancy
  • $204k - $259k

     ...across 15+ U.S. states. Waymo's Compute Team is tasked with a critical...  ...the fully autonomous vehicle’s software stack. To achieve our mission, we...  ...report to a Senior Software Engineer. You will: Develop high-performance GPU primitives and abstractions to enable... 
    Suggested
    Full time
    Remote work

    Waymo

    New York, NY
    4 days ago
  • $200k - $300k

     ...environment with highly advanced CPU and GPU compute, storage, and networking technology. Our team thinks about the entire software stack, from the user-level API to optimizing...  ...performance. As a distributed compute engineer in a user-facing environment, you’ll develop... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    3 days ago
  • $200k - $300k

    Hudson River Trading (HRT) is seeking a Software Engineer focused on GPU reliability to join our Systems Development team. The Systems Development...  ...areas for improvementQualificationsRequired:BS and/or MS in computer science or a related field2+ years of relevant experience... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    3 days ago
  •  ...GPU Kernel Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications. You'll work in a fast... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    3 days ago
  • $153k - $242k

     ...expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017,...  ...Learn more at .About the RoleAs a Senior Software Engineer within our Compute Architecture...  ...lifecycle management across large-scale GPU data centers. The METALDEV team builds Go... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $180k - $250k

     ...Technical Advisor for AI & Advanced Computing Center Schmidt Sciences is...  ...Institute for Scientific Software (VISS), which seeks to...  ...efforts support experienced engineers who are tasked with building...  ...responsible for evaluating the complex GPU and AI/ML needs of world-... 
    Local area

    Schmidt Entities

    New York, NY
    3 days ago
  • $196k - $339.9k

     ...Airtable to transform how work gets done.The Compute Platform team is responsible for...  ...Airtable’s services at scale. We enable engineers across the company to build, deploy, and...  ...across AirtableWho You Are:8+ years of software engineering experience, with deep expertise... 
    Live in

    Airtable

    New York, NY
    3 days ago
  • $168k - $270.25k

    NVIDIA has been transforming computer graphics, PC gaming, and accelerated...  ...of computing. An era in which our GPU acts as the brains of computers,...  ...NVIDIA Experience (NVEX) Solutions Engineering team is looking for an experienced software engineer focused on customer... 
    Full time
    Weekend work

    Nvidia

    New York, NY
    3 days ago
  • $150k - $300k

    Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our...  ...collaborate with experts responsible for the compute, storage, operating systems, and...  ...supportTest and deploy new hardware and software, and partner with vendors to resolve complex... 
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    3 days ago
  • $165k - $242k

     ...deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded...  ...Learn more at .What You’ll Do:We are seeking a Senior Platform Engineer to join our Kubernetes Infrastructure team. This role involves... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $139k - $220k

     ...accelerate breakthroughs and turn compute into capability. Founded in 2...  ...workloads. Our team empowers engineers to understand, troubleshoot,...  ....About the role:As a Senior Software Engineer on the Observability...  ...to modern AI workloads and GPU-based infrastructure,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $139k - $242k

     ...expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017,...  ...Learn more at .What You’ll Do:The Runtime & GPU Systems team builds and operates secure,...  ...virtualization, GPU infrastructure, and Linux systems engineering. We partner closely with security,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $109k - $145k

     ...accelerate breakthroughs and turn compute into capability. Founded in 2...  ...team enables both internal engineers and customers to monitor,...  ...optimize AI workloads running on GPU-dense infrastructure at...  ...About the role: As a Software Engineer on the Observability... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    Coreweave

    New York, NY
    16 hours ago
  • $200k - $322k

    NVIDIA is looking for an experienced software engineer with infrastructure experience to become...  ...automation ecosystem supporting NVIDIA's GPU Cloud and NVIDIA SuperPod deployments....  ...utilizing best of breed high performance computing management solutions.Be a proactive... 
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  •  ...development out of the field and into software, Antioch drastically reduces...  ...for? We're hiring Platform Engineers to build the cloud...  ...: orchestration, scheduling, GPU pools, storage, and observability...  ...profile bottlenecks, reduce compute spend, and harden the system... 
    Full time
    Relocation

    Antioch

    New York, NY
    16 hours ago
  • $88k - $158k

     ...Security (AIS) is looking for talented Software Engineers to join our Cyber AI team. AIS’s Cyber...  ...optimize AI/ML models for constrained computing environments (e.g., embedded GPUs/NPUs)...  ...embedded or resource-constrained devices (GPU/CPU/NPU optimization, quantization,... 

    Assured Information Security

    New York, NY
    3 days ago
  • $182k - $242k

     ...expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017,...  ...seeking a passionate and innovative Senior Software Engineer of Network Services to lead the...  ...network services infrastructure for our GPU cloud services, including networking cloud... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $160k - $240k

    Senior Software Engineer - AI Inference Location New York Business Area Engineering...  ...oriented programming language. A degree in Computer Science, Electrical Engineering, or...  ...serving. Familiarity with PyTorch and GPU software stacks such as CUDA and NCCL.... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    3 days ago
  • $175k - $250k

    Forward Deployed Software Engineer - Equities TechnologyAbout MillenniumMillennium is a global,...  ...and GCP, DevOps, and high-performance computing. The team’s engagement model ranges from...  ...advanced use cases including distributed GPU training, large-scale data processing,... 
    Flexible hours

    Millennium Management

    New York, NY
    5 days ago
  • $152k - $241.5k

     ...application is built. We are seeking a Senior Software Engineer - AI Inference to advance open‑source...  ...guide optimization work.Improve multi‑GPU inference performance and reliability:...  ...PR discussions, code review).BS/MS in Computer Science, Computer Engineering, or... 
    Full time
    Remote work

    Nvidia

    New York, NY
    16 hours ago
  •  ...that can take an active, hands on role in the development of the software product, assist with the ongoing support of the firm’s...  ...development operations functions (DevOps) and participation in computing infrastructure maintenanceAn understanding of sound architecture... 

    alterDomus

    New York, NY
    3 days ago
  •  ...Compute And Cloud Ops Engineer This is Harsh from Jconnect INC. Below is the requirement with my client. Location: Manhattan, NY / Scarsdale, NY (Onsite) Duration: Full-time only Job Description Key Responsibilities: - Provide L2/L3 support for Windows... 
    Full time
    Immediate start
    Relocation

    JConnect Infotech

    New York, NY
    2 days ago
  • $174k - $253k

     ...and code reviews. Partner with engineering, UX, and research teams to...  ...generator, optimizing for TPU/GPU performance, network latency,...  ...qualifications:Bachelor’s degree in Computer Science, Mathematics, or...  ....5 years of experience with software development in programming... 

    Google

    New York, NY
    3 days ago
  • $175k - $350k

     ...technical problems and deliver elegant software solutions across the firm. Continuously...  ...trading applications. Collaborate across engineering, quantitative research, and trading teams...  ...skills. Bachelor's or Master's degree in Computer Science or equivalent practical... 
    Immediate start

    Citadel Securities

    New York, NY
    13 hours ago
  • $320k

     ...group of committed researchers, engineers, policy experts, and business...  ...and unattended. As a Software Engineer on the Launch Engineering...  ...into production across GPU, TPU, and Trainium fleets, unattended...  ...with traditional efforts in computer science. We're an extremely... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    16 hours ago
  •  ...outcome and a roadmap end to end. We hire engineers, not language specialists: we care that...  ...for the problem, and ship reliable software across the stack.As a Senior Full Stack...  ...front end lightweight by pushing complex computational logic, data modeling, and heavy... 
    Full time
    Local area

    Fyber

    New York, NY
    5 days ago
  •  ...founders and executives from Doordash, Assort Health, Tennr, Nourish, OpenAI, Applied Compute, Medallion, Formation Bio, and more. About the Role As a Full Stack Software Engineer, you’ll build end-to-end product experiences across Aviator’s patient-facing app and... 
    Full time
    Relocation
    Flexible hours

    Aviator, Inc

    New York, NY
    16 hours ago
  •  ...About the Role We’re looking for full stack and frontend engineers to help define and build the next generation of OpenAI’s developer...  ...the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return... 
    Full time
    Internship

    OpenAI

    New York, NY
    16 hours ago
  •  ...of your career.About the teamThe Stream Compute team at Stripe builds and operates the infrastructure...  ...scale. Partnering with infrastructure engineers, adjacent platform teams, and the...  ...infrastructure as a product • Strong software engineering skills and a passion for big... 
    Remote work

    Stripe

    New York, NY
    3 days ago
  • $105k - $115k

     ...industrial environments. Role Overview As a Full Stack Software Engineer, you will improve and expand CVector's web applications,...  ...professional experience demonstrating a strong foundation in computer science Experience developing software with Python and/or... 
    Full time
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    Cvector - Industrial Ai

    New York, NY
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Compute (GPU). Be the first to apply!