GPU Systems Engineer
$200k - $300k377 Tower Research Capital LLC
GPU Systems Engineer
Tower Research Capital is a leading quantitative trading firm founded in 1998. Tower has built its business on a high-performance platform and independent trading teams. We have a 25+ year track record of innovation and a reputation for discovering unique market opportunities. Tower is home to some of the world's best systematic trading and engineering talent. We empower portfolio managers to build their teams and strategies independently while providing the economies of scale that come from a large, global organization.
Engineers thrive at Tower while developing electronic trading infrastructure at a world class level. Our engineers solve challenging problems in the realms of low-latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing investment in top engineering talent and technology ensures our platform remains unmatched in terms of functionality, scalability and performance.
At Tower, every employee plays a role in our success. Our Business Support teams are essential to building and maintaining the platform that powers everything we do — combining market access, data, compute, and research infrastructure with risk management, compliance, and a full suite of business services. Our Business Support teams enable our trading and engineering teams to perform at their best.
At Tower, employees will find a stimulating, results-oriented environment where highly intelligent and motivated colleagues inspire each other to reach their greatest potential.
Summary: Trading and research at the firm run around the clock and across the globe, and they run on infrastructure this team designs, builds, and operates.
As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes.
The role is broad by design. One week you might be shaping the architecture of a new AI cluster, the next profiling a training job that will not scale, the next writing automation that keeps the whole fleet healthy with minimal human intervention.
Responsibilities:
- Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology through to production operation.
- Track down performance bottlenecks across the full stack: compute, storage, network, and the seams between them.
- Partner with researchers to profile and benchmark GPU workloads, then turn the findings into measurable speedups.
- Build the automation that lets a small team operate thousands of nodes: provisioning, monitoring, diagnostics, and self-healing.
- Own infrastructure projects end to end, from scope and design through implementation and long-term support.
- Qualify new generations of hardware and software, and work directly with vendors to root-cause complex issues.
Qualifications:
- 5+ years engineering large-scale Linux systems in HPC, AI, or distributed-infrastructure environments.
- Deep Linux fundamentals: installation, performance tuning, and debugging, down to the kernel when the problem calls for it.
- Hands-on troubleshooting of distributed GPU workloads, with a strong mental model of GPU performance.
- Working experience with GPUDirect RDMA. You understand how data moves between GPUs and the network, and what to check when it does not.
- Solid Python for automation and tooling, plus CUDA or C/C++ experience. You can read, profile, and debug GPU code, not just operate the clusters it runs on.
- Familiarity with configuration management tools such as Salt, Ansible, Puppet, or Chef.
- Comfort diagnosing problems that cross hardware, OS, and network boundaries rather than stopping at one layer.
- Clear communication. You will work daily with researchers, engineers, and vendors.
Nice to Have:
- Experience with the rest of the NVIDIA stack, such as NCCL and NVLink.
Anticipated annual base salary range $200,000-$300,000, plus eligible for discretionary bonus.
Tower's headquarters are in the historic Equitable Building, right in the heart of NYC's Financial District and our impact is global, with over a dozen offices around the world.
At Tower, we believe work should be both challenging and enjoyable. That is why we foster a culture where smart, driven people thrive – without the egos. Our open concept workplace, casual dress code, and well-stocked kitchens reflect the value we place on a friendly, collaborative environment where everyone is respected, and great ideas win.
Our benefits include:
- Generous paid time off policies
- Savings plans and other financial wellness tools available in each region
- Hybrid working opportunities
- Free breakfast, lunch, and snacks daily
- In-office wellness experiences and reimbursement for select wellness expenses (e.g., gym, personal training and more)
- Company-sponsored sports teams and fitness events (JPM Corporate Challenge, Cycle for Survival, Wall Street Rides FAR and more)
- Volunteer opportunities and charitable giving
- Social events, happy hours, treats, and celebrations throughout the year
- Workshops and continuous learning opportunities
At Tower, you'll find a collaborative and welcoming culture, a diverse team and a workplace that values both performance and enjoyment. No unnecessary hierarchy. No ego. Just great people doing great work – together.
Tower Research Capital is an equal opportunity employer.
- ...As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes. The role is broad by design...SuggestedWork experience placement
$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating...SuggestedWork at officeLocal areaImmediate start- CoreWeave is seeking a GPU & Runtime Systems Engineer to design, build, and evolve secure sandboxed runtime environments for Kubernetes workloads. You will integrate container runtimes, lightweight VMs, and virtualization technologies to support GPU-accelerated workloads...Suggested
- ...lead cross-team initiatives to integrate HPC systems with cloud-native APIs, driving reliability,... ...experience with Slurm in HPC environments using Go or Python, deep GPU infrastructure knowledge, and strong leadership across multiple engineering teams. #J-18808-Ljbffr NscaleSuggested
- NVIDIA is seeking a Sr. Systems Software Engineer to design and build platform software for container runtimes and Kubernetes. You’ll contribute to Rust and Go based systems, distributed design, and performance-focused internals across the stack. You’ll be part of a small...Suggested
$150k - $300k
Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally... ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We...Full timeWork at officeLocal areaImmediate startWorldwide- Systems Engineer, Servers/Cloud/DataLocation: Must be able to work onsite Tue, Wed, & Thursday out of one of these office locations: New York... ...environments and workflows, including resource scheduling, MPI, and GPU/accelerator management.Architect and troubleshoot distributed...Work at office
$153k - $204k
...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly... ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into...Permanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours- ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment.... ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial...
- ...and Suno. They rely on Modal for instant GPU access, sub‑second container starts, and... ...international olympiad medalists, and experienced engineering and product leaders with decades of... ...culture as they tackle complex systems challenges in distributed computing, large...
- ...Distributed Spectrum DS creates systems that power the next generation of radio spectrum... ...embedding model architectures, custom GPU kernels, and much more. Joining DS means... ...higher or equivalent experience Electrical Engineering or Physics or similar Nice to Have...Temporary workWork at officeFlexible hours
- ...matters to the world. The Production Engineering Team Examples of key exciting problems... ...company, not a hundred scripts. Make the system's view of itself always match reality:... ...-facing platforms, so every new site and GPU generation lands cleanly from day zero....Local area
$130k - $165k
...Systems Engineer II Tower Research Capital is a leading quantitative trading firm founded in 1998. Tower has built its business on a high... ...the latest technologies and best practices in HPC, storage, and GPU computing. Qualifications Experience in...Casual workWork at officeRotating shift$141.4k - $234.5k
...ROLEEverpure (formerly Pure Storage) is hiring a Senior Pre-Sales Systems Engineer to support our Higher Education business, with a focus on R1... ...and imaging cores, AI and machine learning labs competing for GPU time, an academic medical center with its own rules and its...Contract workFlexible hours- ...business in New York and hiring the founding engineering team. The architecture does not exist yet... ...would rather teach an exceptional systems engineer how exchanges work than teach a... ...bypass and RDMA, driver or firmware work, GPU kernels, or low-level optimisation in another...Full timeRelocation
$150.8k - $280k
...experienced infrastructure and platform engineer to help build and operate the AI Factory,... ...environments used to train, deploy, and run AI/ML systems.• Improving platform reliability through... ...Kubernetes Engine.• Familiarity with GPU computing, high-performance computing, or...Full timeTemporary workWork experience placementCasual workFlexible hours- ...to increase average basket size and systematically increase repeat purchases. About the role: AppCard is looking for a System Engineer to provide first and second-line support to our customers. If you are a hands-on operations expert, experienced in product operations...Full timeWork experience placementWork at officeWeekend work
- ...real latitude in how you meet them. This would be a chance to shape the company as it grows. It also means the person who designs a system is often the person who supports it. You'll architect client environments and answer support tickets. Our clients depend on us to...Full timeWork at office
$150k - $180k
...Senior Systems & Security Administrator A dynamic legal services organization dedicated to high-stakes litigation, regulatory compliance, and public interest advocacy seeks a Senior Systems & Security Administrator to lead the management and security of its cloud-first...Full timeWork at office- ...Exchange Engineer, Hybrid M365 and Email Security Hybrid New York, NY Our client runs a hybrid Exchange 2019 and Exchange Online environment, and they need a Tier 3 engineer to own it. This isn’t a generalist sysadmin seat. Mail is the job. You’ll run the hybrid...Full time
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its... ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...Full time- ...Senior / Individual Contributor The Opportunity A premier global financial services organization is seeking a Senior Systems Engineer to join its Enterprise Windows Systems team. This group is responsible for core enterprise server infrastructure, virtualization...Permanent employmentFull time
- ...Our client is looking for a Senior Windows Infrastructure Engineer who has spent most of their career owning enterprise Windows environments and has grown into hybrid and cloud infrastructure. This is an engineering role, not a pure administration role. We want someone...Full timeWork experience placement
$134.7k - $230k
This OpportunityWSP is currently initiating a search for a CBTC System Engineer to join our Transit and Rail/Systems Engineering Team in our New York Office located at MTA Headquarters.The CBTC System Engineer will serve as the technical authority for the review, coordination...Contract workWork at officeLocal areaFlexible hours- Job-ID21553203Reference22-10259TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,...Work experience placementShift work
- ...A global multi-strategy investment business is looking for an experienced Senior Systems Engineer to join their growing technology team in New York. You’ll be responsible for designing, maintaining, and improving highly available Linux-based infrastructure that supports...Full time
$105.4k - $124k
...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and...Full timeWork experience placementLocal area3 days per week$152k
About the roleWe are seeking an experienced Senior Systems Engineer to own our macOS platform and drive endpoint management and device trust standards across Chime’s IT ecosystem.As a Senior Systems Engineer, you will drive multi-system initiatives across our IT domains...Full timeWork at officeLocal areaRemote workShift work$172k - $355k
Senior Presales Systems EngineerThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who... ...resonating with customers worldwide. The Sr Presales Systems Engineer is a key role in the success of HPE Networking that enables HPE...Full timeWork experience placementLocal areaImmediate startRemote workWork from homeWorldwide$205k - $230k
The Senior Systems Engineer will play a pivotal role in our organization, leading virtualization projects and ensuring optimal performance and scalability of our systems. This role involves managing private cloud virtual estates, executing hypervisor refresh projects,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!
- data systems engineer New York, NY
- director systems engineering New York, NY
- active directory systems engineer New York, NY
- senior windows systems engineer New York, NY
- system design engineer New York, NY
- ground systems engineer New York, NY
- system engineer contract New York, NY
- system performance engineer New York, NY
- software system engineer New York, NY
- wireless systems engineer New York, NY




