GPU Systems Engineer
Career Techniques
As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes. The role is broad by design. One week you might be shaping the architecture of a new AI cluster, the next profiling a training job that will not scale, the next writing automation that keeps the whole fleet healthy with minimal human intervention. Responsibilities: Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology through to production operation. Track down performance bottlenecks across the full stack: compute, storage, network, and the seams between them. Partner with researchers to profile and benchmark GPU workloads, then turn the findings into measurable speedups. Build the automation that lets a small team operate thousands of nodes: provisioning, monitoring, diagnostics, and self-healing. Own infrastructure projects end to end, from scope and design through implementation and long-term support. Qualify new generations of hardware and software, and work directly with vendors to root-cause complex issues. Qualifications: 5+ years engineering large-scale Linux systems in HPC, AI, or distributed-infrastructure environments. Deep Linux fundamentals: installation, performance tuning, and debugging, down to the kernel when the problem calls for it. Hands-on troubleshooting of distributed GPU workloads, with a strong mental model of GPU performance. Working experience with GPUDirect RDMA. You understand how data moves between GPUs and the network, and what to check when it does not. Solid Python for automation and tooling, plus CUDA or C/C++ experience. You can read, profile, and debug GPU code, not just operate the clusters it runs on. Familiarity with configuration management tools such as Salt, Ansible, Puppet, or Chef. Comfort diagnosing problems that cross hardware, OS, and network boundaries rather than stopping at one layer. Clear communication. You will work daily with researchers, engineers, and vendors. Comp: 200-300K + Bonus #J-18808-Ljbffr Career Techniques
$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating...SuggestedWork at officeLocal areaImmediate start- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation...SuggestedFull time
$150k - $300k
Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally... ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We...SuggestedFull timeWork at officeLocal areaImmediate startRemote workWorldwide- ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment.... ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial...Suggested
$153k - $204k
...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly... ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into...SuggestedPermanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours- ...the world’s best systematic trading and engineering talent. We empower portfolio managers to... ...the Linux server infrastructure Manage HPC systems to support trading operations and Condor... ...and best practices in HPC, storage, and GPU computing. Qualifications Experience in maintenance...Rotating shift
- ...matters to the world. The Production Engineering Team Examples of key exciting problems... ...company, not a hundred scripts. Make the system's view of itself always match reality:... ...-facing platforms, so every new site and GPU generation lands cleanly from day zero....Local area
$180k - $240k
...About the Role We are looking for a Senior Systems Developer to lead the design, development... ...ongoing operation Mentor and guide engineers, raising the technical bar across the... ...environments Familiarity with server and GPU hardware architecture and system-level...Full timeFlexible hours$141.4k - $234.5k
...ROLEEverpure (formerly Pure Storage) is hiring a Senior Pre-Sales Systems Engineer to support our Higher Education business, with a focus on R1... ...and imaging cores, AI and machine learning labs competing for GPU time, an academic medical center with its own rules and its...Contract workFlexible hours$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its... ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...Full time- We are looking for a Systems Engineer to support and enhance core financial applications used by a legal organization in New York, New York. This position focuses on maintaining reliable performance across Aderant or 3E-related environments, resolving user and system issues...
$105.4k - $124k
...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and...Full timeWork experience placementLocal area3 days per week- TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,puppet) Knowledge of LDAP concepts...Work experience placementShift work
$200k - $250k
The Senior Systems Engineer will play a crucial role in managing and optimizing our Microsoft 365 and Azure environments, ensuring secure and efficient operations. This role involves overseeing complex cross-tenant access scenarios, M&A integrations, and domain migrations...$115k - $135k
...Innovation) Team. This position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled platforms, GitHub-based... ...workloads, primarily within Microsoft Azure.The CCSI Systems Senior Engineer is a full-time role located in Southfield, MI,...Full timeWork at officeRemote workRelocation packageMonday to Friday$152k
About the roleWe are seeking an experienced Senior Systems Engineer to own our macOS platform and drive endpoint management and device trust standards across Chime’s IT ecosystem.As a Senior Systems Engineer, you will drive multi-system initiatives across our IT domains...Full timeWork at officeLocal areaRemote workShift work$97.5k - $164.4k
...from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSenior Systems Engineer (Tandem NonStop)About your role:We are seeking a Senior Systems Engineer to provide technical solutions in a highly visible,...Full timeRemote workNight shift- ...Systems EngineerOver 50,000 customers globally trust our end-to-end, cloud-driven networking solutions and rely on our top-rated services... ...America, Asia Pacific, and the Middle East.Extreme Systems Engineer provides technology and product consulting, technical sales support...Flexible hours
- ...Syndio is seeking a Revenue Systems & Operations Manager to own the systems powering go-to-market motions and the recurring operations that keep them running. You will administer Salesforce, manage the GTM tech stack, and automate repetitive processes to reduce manual...
- ...Jacobs Engineering Group Inc. is seeking a Senior Rail & Transit Systems Project Manager to lead multidisciplinary rail and transit projects, including rolling stock fleets and automated people movers. You will act as primary client contact, ensuring services and deliverables...
- ...Systems EngineerWe are looking for a highly motivated and detail-oriented Operational Support Engineer or an enthusiastic and quick-learning Enterprise Collaboration & Workflow Engineer to join our team. This role is crucial for maintaining and enhancing the smooth operation...
$88k - $120k
...Our Systems Engineering team owns the infrastructure that keeps a ~2,500-person global firm running around the clock: cloud (primarily AWS), Microsoft 365, Windows Server, identity platforms (Entra ID, Active Directory, SailPoint), and enterprise email flow. We are in...Full timeLocal areaFlexible hoursShift work- ...Tier 2 Systems EngineerThe Tier 2 Managed Services Engineer is responsible for handling escalated technical issues, advanced troubleshooting, and day-to-day support for our managed services customers. You will work closely with Tier 1 technicians, senior engineers, and...Remote workFlexible hoursShift work
- ...required as business needs arise. Potential for international travel. What will convince us Hold a Master's degree in a scientific or engineering discipline related to the biopharma industry Demonstrate 3+ years of successful experience in process development or process/...Work at officeLocal areaRemote workFlexible hours
$285k - $325k
...IT Systems Engineer, Mobile Client Platform EngineerBoston, MA; Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY; Washington, DCAbout AnthropicAnthropic's mission is to create reliable, interpretable, and steerable AI systems. We...Work at officeRemote workVisa sponsorshipFlexible hours- ...The Role We're hiring a GTM Systems Engineer to build and own the systems layer behind Rogo's revenue engine. This is not a conventional Salesforce Admin seat. You will need those skills, deeply, but the job is to question how companies use GTM technology today and...Contract workShift work
$145k - $165k
...organization offering tremendous career growth potential. Job Title: ML Systems Engineer Location: 100% Remote (U.S.) Position Type: Full-time, Direct... ..., including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship$200k - $300k
Hudson River Trading (HRT) is seeking a Software Engineer focused on GPU reliability to join our Systems Development team. The Systems Development team builds and maintains the platform that is shared by all Systems teams to provision, monitor, and manage HRT’s server and...Work at officeLocal areaImmediate start- ...Amazon is seeking a Senior Software Development Engineer to design, implement, and scale perception and state estimation software powering our robotics platforms. You will own the full software lifecycle—from architecture to deployment—ensuring real-time performance on...
$153k - $210.5k
...Windows devices, and every one of them is the front door to how each Harvey employee does their work. We're seeking a Senior Systems Engineer to own client engineering end to end - Jamf, Intune, Autopilot, Okta device trust, and more, and the automation that ties them...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!
- healthcare systems engineer New York, NY
- mission system engineer New York, NY
- senior linux systems engineer New York, NY
- senior staff systems engineer New York, NY
- system engineer remote New York, NY
- systems engineer New York, NY
- space systems engineer New York, NY
- systems engineer intern New York, NY
- software system engineer New York, NY
- director systems engineering New York, NY


