Senior Software Engineer, GPU Infrastructure
Virtual Vocations Inc
Operating the Kubernetes GPU fleet and managing multi-tenancy, the full-time Senior Software Engineer, GPU Infrastructure will focus on maintaining large-scale experiments, ensuring fault tolerance, and enhancing platform security in a remote work environment. Key responsibilities Handle day-to-day operations of the Kubernetes GPU fleet, including capacity planning and node lifecycle management Design and implement batch scheduling and storage solutions for the GPU cluster, ensuring efficient resource allocation Collaborate directly with research teams to address infrastructure challenges and improve platform functionality Required qualifications 3+ years of experience in systems or infrastructure engineering on production Linux, specifically with GPU or large-scale batch platforms Proven experience managing production Kubernetes for GPU workloads, including batch layers and resource management Familiarity with infrastructure as code tools such as Terraform or Ansible, and monitoring solutions like Prometheus Strong programming skills in languages commonly used for infrastructure, such as Python, Go, Rust, or C++ Ability to write clear documentation for engineers, researchers, and providers, including design documents and incident reports Virtual Vocations Inc
$180k - $250k
...exceptionally strong team includes software engineers, AI researchers, security... ...Overview As an AI-first company and Senior Software Engineer, Infrastructure at Artemis, you'll own the backbone... ...with AI/ML and data teams - Support GPU workloads, model training pipelines...Senior$153k - $204k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...secure by design, from data centers and GPU fleets to the platform layers... ...enforcements rely on. About the Role As a Senior Software Engineer on the Security Infrastructure team,...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$160k - $240k
Senior Software Engineer - RDF Infrastructure Location New York Business Area Engineering and CTO Ref # 10054258 Description & Requirements Our groupThe BQL and Semantic Platform group builds the core query and semantic infrastructure used to access...SeniorTemporary workFor contractorsWork experience placement$174k - $252k
...experience testing, maintaining, or launching software products, and 1 year of experience with... ...of experience developing large-scale infrastructure, distributed systems or networks, or... ...leadership role. Google's software engineers develop the next-generation technologies...Senior$182k - $242k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...seeking a passionate and innovative Senior Software Engineer of Network Services to lead the architecture... ...services infrastructure for our GPU cloud services, including networking...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$200k - $250k
...Job Description Job Description Our Client is seeking a mid- to senior-level Software Infrastructure Engineer with strong C# development skills and experience building infrastructure and operating cloud-based systems on AWS. This role will focus on backend to middle...SeniorWork at office2 days per week- ...Client Our client is an established, venture-backed AI infrastructure and security company helping enterprises build, deploy,... ...foundation of modern AI platforms. They are seeking a Senior Backend Software Engineer to help design and develop the core systems that will...SeniorLocal area
$160k - $240k
...Senior Software Engineer - RDF Infrastructure Location New York Business Area Engineering and CTO Ref # 10054258 Description & Requirements Our group The BQL and Semantic Platform group builds the core query and semantic infrastructure used to access...SeniorTemporary workFor contractorsWork experience placement- ...shipping in Summer '26. Join us in creating technology that extends human thinking. About We're looking for an experienced infrastructure engineer to help build Stream, a new conversational interface. You will be responsible for developing a highly scalable real-time...SeniorSummer work
$200k - $300k
...former founders, MIT, Waterloo, GT, and engineers from Citadel Securities, Stripe,... ...Sigma, and Meta. Responsibilities Product infrastructure. Build and operate the infrastructure behind... ..., CI/CD, and observability. Real software engineering. Infrastructure at Probook...SeniorWork at officeLocal areaNight shift$100k - $300k
...experts from Wiz, Abnormal AI, Zscaler Preeminent research labs like Deepmind and SAIL About the Role We're hiring a Senior Storage Infrastructure Engineer on our Core Platform team to own how we store, protect, and operate data at scale. You'll build the backup,...Senior$150k - $250k
...carriers in North America. We’re looking for an experienced Software Engineer (Infrastructure) who wants to own core systems end‑to‑end, not just close... ...for real‑time decisioning. You’ll work in a small, senior team where you can actually shape architecture, tooling,...SeniorLocal area- Senior Software Engineer At Commure, we're building the AI Operating System for healthcare, the foundation that defines how care is delivered... ...the Role We're hiring a Senior Software Engineer on the Infrastructure team to own the foundational infrastructure and internal...SeniorLocal areaImmediate start
$224k - $356.5k
Deep Learning Software Infrastructure Engineer NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25... ...to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving...Senior- ...things done the right way, we want to build the future of wealth management with you. The Role We're looking for a Software Engineer, Test Infrastructure (SETI) to help build the systems that keep our TypeScript codebase fast to test, easy to trust, and safe to ship....Senior
- About HUD HUD is building infrastructure to create RL training data and evals for frontier AI agents, as well as a marketplace to... ...VCs and were YC W25. About the role We're looking for a Senior Software Engineer, Infrastructure who can own the reliability, scale,...SeniorFull timeWork at officeRemote workRelocationVisa sponsorship
$175k - $210k
Senior Software Engineer - Infrastructure New York Company Overview Arcesium is a global financial technology firm that solves complex data-driven challenges faced by some of the world's most sophisticated financial institutions. We constantly innovate our platform and...Senior$175k - $215k
...magic of frictionless experiences. We're looking for a Senior Software Engineer to join our Network Engineering team to accelerate building... .... In this role, you will build the next-generation infrastructure that underpins all systems at CLEAR. The ideal candidate...SeniorCasual workWork at officeFlexible hours$120k - $300k
Evertune AI Software Engineer Please note: At this time, we are only able to consider candidates who are authorized to work in the United... ...designing distributed systems, shaping our cloud and infrastructure patterns, optimizing AI integrations, and making architectural...SeniorPermanent employmentWork at officeLocal areaVisa sponsorship2 days per week3 days per week- ...Job Description Job Description Staff/Senior Software Engineer, Document Intelligence & Data Infrastructure New York City | Full-time | On-site in SoHo, five days... ...batch and real-time processing across CPU and GPU workloads. End-to-end provenance, versioning,...SeniorFull timeWork at office
$152k - $241.5k
...era of computing. An era in which our GPU acts as the brains of computers,... ...Join the Developer Tools team as a senior software engineer to work on profiling tools within the... ...accelerated computing. Today, our AI infrastructure powers global intelligence, transforming...SeniorFull timeRemote work$145k - $195k
...modern, cloud-native CAD environment with AI-powered engineering workflows, helping teams design, iterate, and... ...effective team player About The Role We're looking for a Senior Software Engineer, Cloud Infrastructure who can take ownership of the reliability, automation...SeniorLocal areaRemote work$180.5k - $236.91k
...Job Description Job Description Hi, we're Oscar. We're hiring a Senior Software Engineer, Cloud Infrastructure / SRE to join our Engineering team. Oscar is the first health insurance company built around a full stack technology platform and a relentless focus on...SeniorFull timeWork at officeFlexible hours$200k - $400k
...- shape how we work and grow as a team. About the Team The Infrastructure team builds and operates the foundations that power Decagon:... ...over cloud infrastructure, Kubernetes, and networking that let engineers ship without becoming infrastructure experts. Make sure it...SeniorFull timeWork at officeLocal areaShift work$165k - $225k
Senior Software Engineer, Network Platform Moonlite delivers high-performance AI infrastructure for organizations running intensive computational research, large-scale model training... ...high-performance connectivity for GPU clusters and distributed workloads. High-Performance...SeniorImmediate startFlexible hours$160k - $230k
Senior Software Engineer - Together Cloud Platform San Francisco About the Role Together AI is building... ...with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will... ...you'll work on: Work on a distributed GPU scheduling system for the on-demand...SeniorFull timeRemote work$144.25k - $256.25k
...responsible for the company’s technology engineering, architecture, and infrastructure, providing 24x7 support to ensure... ...on behalf of the company Senior Staff AI Engineer leads enterprise-... ...understanding of AI infrastructure, including GPU platforms, accelerated compute,...SeniorFull timeWork experience placementWork at officeLocal areaVisa sponsorshipFlexible hours$184k - $287.5k
...DGX Cloud AI Efficiency Team Software Engineer Joining NVIDIA's DGX Cloud... ...Team means contributing to the infrastructure that powers our innovative... ...availability of AI systems. As a senior DGX Cloud AI Infrastructure... ..., and Visualization. The GPU, our invention, serves as...Senior$182k - $242k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...Learn more at About the role A Software Engineer contributes to the design, implementation... ...product, and hardware teams to evolve our GPU performance testing platform to ensure...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$264k - $310k
...and so are the rewards.The Developer Infrastructure org is the engine behind Robinhood's entire... ...fundamentally transform Robinhood's software development lifecycle — making every... ...multiplier for the business.As the Senior Staff Software Engineer, Developer Infrastructure...SeniorWork at officeRemote workFlexible hoursShift work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, GPU Infrastructure. Be the first to apply!
- software engineer internship remote New York, NY
- senior software engineer ruby on rails New York, NY
- software developer positions New York, NY
- intermediate software engineer New York, NY
- agile software developer New York, NY
- software engineer intern New York, NY
- part time software developer New York, NY
- rust software engineer New York, NY
- software engineer no experience New York, NY
- software engineer internship New York, NY



