GPU Systems Engineer
$200k - $300kIceberg
New York | $200,000-$300,000 Base + Bonus I'm working with one of the world's leading trading firms on an interesting GPU Systems Engineer position. This is a hands-on infrastructure role working at scale, with large CPU and GPU clusters spanning thousands of nodes and hundreds of petabytes of storage. You'll be designing and scaling GPU infrastructure, profiling workloads, finding performance bottlenecks and building the automation needed to keep a huge fleet running with minimal human intervention. You'll be working across Linux, GPU infrastructure, GPUDirect RDMA, CUDA, C/C++, Python, networking and distributed systems, with the opportunity to get involved from hardware selection and architecture all the way through to production. I'm looking for someone with 5+ years working with large-scale Linux systems in HPC, AI or distributed infrastructure environments who genuinely enjoys getting into the weeds when something isn't performing as it should. Experience with NVIDIA, NCCL, NVLink or large-scale AI infrastructure would be a big plus. $200k-$300k base + bonus. If you're a systems engineer who likes working at scale and solving problems across hardware, software and networking, I'd love to speak. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GPU Systems Engineer in New York, NY vacancy
$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating...SuggestedWork at officeLocal areaImmediate start$200k - $300k
...the world’s best systematic trading and engineering talent. We empower portfolio managers to... ...responsible for the compute, storage, operating systems, and automation behind that work at... ...of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes. The...SuggestedWork experience placementCasual workWork at officeSocket
New York, NY2 days ago- ...skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like...Suggested
- Career Techniques in New York seeks an experienced infrastructure engineer to design, deploy, and scale large-scale GPU clusters for AI research. You will work across compute, storage, OS, and automation to support hundreds of petabytes and thousands of nodes. You will...Suggested
- ...focusing on the compute, storage, and automation behind large-scale trading workloads. You will join engineers responsible for hundreds of petabytes of storage and thousands of GPU-accelerated nodes, shaping architectures for AI clusters and performance profiling....Suggested
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation...Full timeNew York, NYmore than 2 months ago
- Tower Research Capital seeks an accomplished engineer to design, deploy, and scale distributed GPU clusters, building out hardware selection, production operations, and monitoring across thousands of nodes. You will diagnose bottlenecks across compute, storage, and network...
- Obsidian is seeking an MLOps Engineer to join their AI lab's cutting-edge GenAI team in New York. This full-time role involves training and... ...years of experience in ML infrastructure, with skills in custom GPU kernel optimization. This position offers a chance to be at the...Full time
$165k - $242k
...You’ll Do:CoreWeave is seeking a highly skilled and motivated Systems Kernel Engineer to join our HAVOCK Team, reporting into the Manager of... ...them where applicable (networking, storage, virtualization, GPU/DPU enablement).Stack-Wide Support - Ensure kernel support and...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$150k - $300k
Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally... ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We...Full timeWork at officeLocal areaImmediate startRemote workWorldwide- ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment.... ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial...
- ...platform. We built a serverless runtime that launches GPU-backed containers in less than 1 second and... ...to hire someone to help us with Platform Engineering work. We're working on lots of fun problems:Low-level systems development: working with container runtimes, OCI...
Beam
New York, NY4 days ago - ...Fluidstack Production Engineering TeamExamples of key exciting problems the team is working on... ...company, not a hundred scripts.Make the system's view of itself always match reality: integrate... ...-facing platforms, so every new site and GPU generation lands cleanly from day zero....Local area
Fluidstack
New York, NY4 days ago - ...Distributed Spectrum Job OpportunityDS creates systems that power the next generation of radio... ...embedding model architectures, custom GPU kernels, and much more.Joining DS means... ...higher or equivalent experience Electrical Engineering or Physics or similarNice to...Permanent employmentTemporary workWork at office
Distributed Spectrum
New York, NY4 days ago $182k - $242k
...publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the Linux kernel and host software stack underneath one of the largest GPU fleets in the world. When something breaks at the Kubernetes layer — a pod stuck...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$180k - $240k
...Senior Systems EngineerHouston; New York; San Francisco; Seattle; USAbout the RoleWe are... ...production and ongoing operationMentor and guide engineers, raising the technical bar across the... ...environmentsFamiliarity with server and GPU hardware architecture and system-level...Flexible hoursNscale
New York, NY4 days ago$112.9k - $155.24k
...individuals for their own use. SCOPE OF POSITION The Senior Systems Engineer is responsible for working directly with our customers and... ...AI/ML fabric architectures (scale-up / scale-out), including GPU/XPU cluster designs and optical I/O requirements This...Full timeWork experience placementCorning
New York, NYa month ago- ...Description ThisWay Global is looking for a Distributed Systems Engineer in a remote role within the United States. ThisWay Global, Inc. is... ...supporting accelerated deployment timelines and NVIDIA NVL72/GB300 GPU clusters. Amalgamy.ai — AI Orchestration Software: An...Full timeRemote work
GrabJobs
New York, NY3 days ago $112.9k - $155.24k
Senior Systems Engineer Co-Packaged Optics Locations: Santa Clara and Bay Area (West Coast) Company: Corning Requisition Number: 75530 The company... ...AI/ML fabric architectures (scale-up / scale-out), including GPU/XPU cluster designs and optical I/O requirements This position...Full timeWork experience placement- ...ofenabling human life on Mars. SR. HIGH PERFORMANCE COMPUTING (HPC) SYSTEMS ENGINEER SpaceX is looking for an HPC Systems Engineer with strong... ...) Familiarity with large scale AI training Familiarity with GPU usage in a compute cluster and Cuda Experience with...Permanent employmentFlexible hoursWeekend work
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its... ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...Full time$153k - $204k
...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly... ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into...Permanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours$198k - $273k
...their individual choices, employees are empowered to push boundaries and help us all evolve, together. Your CareerAs a Channel Systems Engineer, your role will involve providing leadership, technical expertise, and guidance to a Global Systems Integrator (GSI) partner,...Full timeRemote workVisa sponsorshipWork visaFlexible hours$105.4k - $124k
...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and...Full timeWork experience placementLocal area3 days per week$86k - $115k
Datadog’s Technical Solutions organization includes 1,200+ sales engineers, support engineers, post-sales experts, and solution architects... ...“TSO”) owns that ecosystem.We manage the full lifecycle of the systems TS depends on: Zendesk, Jira, Confluence, and a growing...Work at office$119k - $180k
...excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... ...driven networking and automation.What You’ll DoAs an Advisory Systems Engineer (ASE), you are positioned to sell Arista products in...- TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,puppet) Knowledge of LDAP concepts...Work experience placementShift work
- ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast... ...engineering and cloud/DevOps responsibilities. You will manage GPU clusters, optimize cloud spending, ensure security and compliance...Full timeWork at office
Basis
New York, NY2 days ago $97.5k - $164.4k
...from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSenior Systems Engineer (Tandem NonStop)About your role:We are seeking a Senior Systems Engineer to provide technical solutions in a highly visible,...Full timeRemote workNight shift$145k - $150k
Our client is a premier law firm seeking a Messaging Systems Engineer to support and enhance its global messaging infrastructure. This individual will lead the administration and support of Exchange, Microsoft 365, Entra ID, and mobile device management environments, ensuring...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!
Related searches
- senior windows systems engineer New York, NY
- software system engineer New York, NY
- entry level systems engineer New York, NY
- mission system engineer New York, NY
- healthcare systems engineer New York, NY
- operating system engineer New York, NY
- system engineer remote New York, NY
- application system engineer New York, NY
- advanced systems engineer New York, NY
- active directory systems engineer New York, NY