Software Engineer, AI Infra & GPU Fleet Orchestration
Kindredventures
fal is building the generative media ecosystem and is hiring a hands-on engineer to keep a large fleet of GPU servers healthy and productive. You will write systems for provisioning, health monitoring, error detection, and recovery, collaborating with partners to resolve issues at scale. You will develop Python tooling for fleet lifecycle management, implement OS-level security, and optimize storage and GPU driver stacks to support AI workloads. #J-18808-Ljbffr Kindredventures
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, AI Infra & GPU Fleet Orchestration in New York, NY vacancy
$175k - $300k
...Fluidstack Production Engineering Team Examples of key exciting... ...keeps pace with a 10 GW fleet: at our scale, a GPU failure isn't a ticket. It... ...online, and making Kubernetes-orchestrated bare metal sustainable at... ...that makes hyperscale AI compute actually operable....FleetLocal areaFluidStack
New York, NY4 days ago$166k - $244k
Senior Software Engineer, GPU Performance Apply X Note: By applying to this position you will have an... ...architectures (NVIDIA, AMD, or other AI accelerators), memory hierarchies, and... ...Influence the deployment of Google’s GPU fleet by working with various product teams across...FleetFull timeWorldwide- Overview: Spur is every company’s AI QA Engineer. Spur lets you test your website with natural... ...Manifesto: The Role As our founding infra/backend engineer, you’ll architect the... ...our entire stack end-to-end—you’ll orchestrate fleets of browsers and web agents in the cloud...FleetWork at officeLocal areaFlexible hours
- A leading AI Infrastructure company in New York City seeks a Staff Software Engineer to design and operate GPU-driven data centers for advanced AI workloads. The ideal candidate will lead infrastructure services, drive API development, and ensure operational excellence...Suggested
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred... ...equity (Series A-C / high-growth AI infra) About the Role We’re hiring... ...systems (Ray, MPI, NCCL, custom cluster orchestration, etc.) ~ Background in high-...SuggestedPermanent employment
- ...tasks. We use software and agents to "... ...analytics tools, and AI Agent... ...deficiencies Change Orchestration - Provide self-... ...As a Software Engineer on the Reliability... ...Databases, CPU/GPU Pools, Service... ...across the fleet (100K+ pods) You... ...efficient. Cloud/Infra Expertise: You’...FleetHourly payWork at officeLocal areaFlexible hours
$180k - $360k
...powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...Capital, Greylock, and Conviction. The Role We’re seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration. In this...Flexible hoursBaseten
New York, NY3 days ago- About Amperos Amperos is healthcare's first AI-native denial management and revenue recovery platform. Our... ...meet you. About The Role We’re looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You’ll get to own dev ops, dev...Work at officeFlexible hours
- Fluidstack is seeking an experienced engineer to own the observability platform and production control plane for its hyperscale fleet. You will build data pipelines, API surfaces, and... ...upon by other teams. Strong focus on AI tooling, distributed systems, and hardware...Fleet
$175k - $300k
...had to do. Powerful AI will be the... ...spanning hardware and software. Speed and scale are... .... The Production Engineering Team Examples of key... ...: integrate fleet state as a machine... ...every new site and GPU generation lands cleanly... .... Workflow and orchestration engines (Temporal,...FleetLocal areaFluidstack
New York, NY2 days ago$168k - $324.5k
...Type Hybrid Department Engineering Compensation $168K – $... .... There is no "infra team" and "product team... ...everything runs on: container orchestration, networking, load... ...Engineers at Ramp are full software engineers who happen... ...‑grade SLAs. Enable AI‑native engineering — as...Full timeSecond jobWork at officeRemote workHome officeRelocation packageFlexible hoursShift workRAMP
New York, NY1 day ago- ...located in New York, is seeking an Infrastructure Software Engineer for Fleet & Automation to join their AI Infrastructure Operations team. You will ensure... ...cutting-edge AI systems, focusing on automation and orchestration of workflows. The ideal candidate should have a...Fleet
- A pioneering technology firm in San Francisco seeks a Senior Cloud Infrastructure Engineer. This role involves designing and maintaining large-scale distributed systems for AI workloads. Ideal candidates have 5+ years of experience, are skilled in Python and have a strong...
$145k - $200k
...Thread AI Thread AI is focused on building an AI-native workflow orchestration engine looking for dedicated individuals to join its growing team. Our goal is to make infrastructure... ...innovative, scalable, and high‑performing software solutions that meet both the needs of our...Work experience placementThread AI
New York, NY3 days ago- Nominal in Los Angeles, CA, seeks a Software Engineer for Dev Infra to build the Internal AI Platform and drive infra across air-gapped, cloud, and on‑prem environments. You will collaborate with engineers to accelerate development, deploy AI tooling, and enable clients...
$150k - $215k
About Nscale Nscale is the GPU cloud engineered for AI. We provide cost‑effective, high‑performance... .... Overview As an Infrastructure Software Engineer for Fleet & Automation, you will be a... ...scale. Design and build workflow orchestration systems for hardware lifecycle management...FleetFlexible hours$110k - $135k
...Job Title: Software Engineer (Full Stack) Location: Atlanta, GA | NYC, NY | Remote, USA... ...Are Impiricus is the first and only AI-powered HCP Engagement Engine. In 2025,... ...workflows including prompt engineering, model orchestration, and backend/UX pipelines for...Full timeTemporary workWork at officeLocal areaRemote workFlexible hoursGrabJobs
New York, NY6 hours ago- ...tasks. We use software and agents to “... ...analytics tools, and AI Agent... ...deficiencies Change Orchestration - Provide self‑... ...As a Software Engineer on the Reliability... ...Databases, CPU/GPU Pools, Service... ...across the fleet (100K+ pods) As... ...Cloud Provider Infra and 3rd party vendor...FleetHourly payWork at officeFlexible hours
- ...rare opportunity to become the founding engineer for an AI-native company attacking a multi-... ...insurance more transparent, data-driven, and software-native. Largest pre-seed in insurtech... ...around modern data access, API orchestration, document reasoning, and agentic engineering...
Confidential
New York, NY2 days ago $132k - $150k
...real time economic optimization and AI prediction to every energy and... ...environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical... ...Implement message brokers and orchestration mechanisms for multi-stage learning...Work experience placementLive inWork at officeVisa sponsorshipFlexible hours- ...About Nucs AI Nucs AI is revolutionizing prostate cancer... ...The Opportunity Join our engineering team as a Full Stack Engineer... ...using Kubernetes for orchestration and deployment Event-driven... ...Experience in healthcare/medical software development Knowledge of regulatory...Worldwide
NUC S.A.I.
New York, NY32 minutes ago - ...of people every day. As a Forward Deployed Engineer, you will work directly with our customers... ...You will bridge the gap between frontier AI research and tangible physical impact for... ...their ships, helping the crew revolutionize fleet operations. We’re well funded from leading...Fleet
Sea12
New York, NY3 days ago $170k - $220k
...Merge Backend And Full Stack Engineer Merge is the leading provider... ...Handler, which empowers AI agents with secure access to... ...product engineering to runtime orchestration, with a heavy focus on our newest... ...~3-7+ years of full-time software engineering experience (*open...Full timeWork at officeHome officeMerge LLC
New York, NY3 days ago$150k - $250k
...team Mbodi builds the software layer that lets industrial... ..., distributed agent orchestration, and compiled neural... .... As one of our early engineers, you'll work on the core... ...across a distributed fleet Work closely with ML... ...learn like humans. Our AI software plugs into any...FleetWork at office3 days per weekMbodi
New York, NY3 days ago- ...We are looking for a Senior Software Engineer to join our core engineering... ...the services that connect our fleet of 600+ deployed SmartMast... ...streams from cameras, radar, SDR, AIS receivers, and GPS modules.... ...(Docker) and orchestration (Kubernetes or ECS); familiarity...FleetWork at officeFlexible hours
Quartermaster AI Inc
New York, NY3 days ago $120k - $160k
...New York. Learn more at The Role As a Software Engineer at Every Electric, you will build and operate... ...that controls our distributed battery fleet and dispatches it during utility demand... .... Development velocity: Use modern AI-assisted development tools to build and...FleetFlexible hoursEvery Electric
New York, NY4 days ago$180k - $225k
...NY; Washington, DC The Public Sector software engineers (SWEs) create the core product building... ...agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically... ...Federal customers using cloud-native AI infrastructure. Build features for...FleetFull timeScale AI
New York, NY19 hours ago- ...We are looking for a full-stack software engineer to build software to efficiently manage microgrids... ..., Gurobi) for generator dispatch and fleet-level maintenance scheduling, including... ...requirements We may use artificial intelligence (AI) tools to support parts of the hiring...FleetWork at office
SCALE INC
New York, NY3 days ago - ...building civilization-scale AI compute infrastructure and seeking a Production Engineer to own the compute fleet health end to end. You will... ...bare metal, enabling reliable GPU operations at scale. You... ...collaboration across hardware and software teams. #J-18808-Ljbffr...Fleet
- ...Garage Growth Engineering Role Garage powers the exchange of critical... ...runs on PDFs, phone calls, and software built in 2003, and we'd rather... ...the dealers, manufacturers, fleet operators, and government buyers... ..., internal tools, and AI-powered workflows that fill our...FleetLocal areaRelocation package
Garage
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, AI Infra & GPU Fleet Orchestration. Be the first to apply!
Related searches
- ngo software engineer New York, NY
- software developer New York, NY
- software developer internship no experience New York, NY
- software developer apprenticeship New York, NY
- junior software developer New York, NY
- part time software developer remote New York, NY
- financial software developer New York, NY
- senior software engineer ruby on rails New York, NY
- software engineer amazon New York, NY
- senior software design engineer New York, NY