GPU Systems Engineer
$200k - $300k377 Tower Research Capital LLC
GPU Systems Engineer
Tower Research Capital is a leading quantitative trading firm founded in 1998. Tower has built its business on a high-performance platform and independent trading teams. We have a 25+ year track record of innovation and a reputation for discovering unique market opportunities. Tower is home to some of the world's best systematic trading and engineering talent. We empower portfolio managers to build their teams and strategies independently while providing the economies of scale that come from a large, global organization.
Engineers thrive at Tower while developing electronic trading infrastructure at a world class level. Our engineers solve challenging problems in the realms of low-latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing investment in top engineering talent and technology ensures our platform remains unmatched in terms of functionality, scalability and performance.
At Tower, every employee plays a role in our success. Our Business Support teams are essential to building and maintaining the platform that powers everything we do — combining market access, data, compute, and research infrastructure with risk management, compliance, and a full suite of business services. Our Business Support teams enable our trading and engineering teams to perform at their best.
At Tower, employees will find a stimulating, results-oriented environment where highly intelligent and motivated colleagues inspire each other to reach their greatest potential.
Summary: Trading and research at the firm run around the clock and across the globe, and they run on infrastructure this team designs, builds, and operates.
As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes.
The role is broad by design. One week you might be shaping the architecture of a new AI cluster, the next profiling a training job that will not scale, the next writing automation that keeps the whole fleet healthy with minimal human intervention.
Responsibilities:
- Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology through to production operation.
- Track down performance bottlenecks across the full stack: compute, storage, network, and the seams between them.
- Partner with researchers to profile and benchmark GPU workloads, then turn the findings into measurable speedups.
- Build the automation that lets a small team operate thousands of nodes: provisioning, monitoring, diagnostics, and self-healing.
- Own infrastructure projects end to end, from scope and design through implementation and long-term support.
- Qualify new generations of hardware and software, and work directly with vendors to root-cause complex issues.
Qualifications:
- 5+ years engineering large-scale Linux systems in HPC, AI, or distributed-infrastructure environments.
- Deep Linux fundamentals: installation, performance tuning, and debugging, down to the kernel when the problem calls for it.
- Hands-on troubleshooting of distributed GPU workloads, with a strong mental model of GPU performance.
- Working experience with GPUDirect RDMA. You understand how data moves between GPUs and the network, and what to check when it does not.
- Solid Python for automation and tooling, plus CUDA or C/C++ experience. You can read, profile, and debug GPU code, not just operate the clusters it runs on.
- Familiarity with configuration management tools such as Salt, Ansible, Puppet, or Chef.
- Comfort diagnosing problems that cross hardware, OS, and network boundaries rather than stopping at one layer.
- Clear communication. You will work daily with researchers, engineers, and vendors.
Nice to Have:
- Experience with the rest of the NVIDIA stack, such as NCCL and NVLink.
Anticipated annual base salary range $200,000-$300,000, plus eligible for discretionary bonus.
Tower's headquarters are in the historic Equitable Building, right in the heart of NYC's Financial District and our impact is global, with over a dozen offices around the world.
At Tower, we believe work should be both challenging and enjoyable. That is why we foster a culture where smart, driven people thrive – without the egos. Our open concept workplace, casual dress code, and well-stocked kitchens reflect the value we place on a friendly, collaborative environment where everyone is respected, and great ideas win.
Our benefits include:
- Generous paid time off policies
- Savings plans and other financial wellness tools available in each region
- Hybrid working opportunities
- Free breakfast, lunch, and snacks daily
- In-office wellness experiences and reimbursement for select wellness expenses (e.g., gym, personal training and more)
- Company-sponsored sports teams and fitness events (JPM Corporate Challenge, Cycle for Survival, Wall Street Rides FAR and more)
- Volunteer opportunities and charitable giving
- Social events, happy hours, treats, and celebrations throughout the year
- Workshops and continuous learning opportunities
At Tower, you'll find a collaborative and welcoming culture, a diverse team and a workplace that values both performance and enjoyment. No unnecessary hierarchy. No ego. Just great people doing great work – together.
Tower Research Capital is an equal opportunity employer.
$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating...SuggestedWork at officeLocal areaImmediate start$200k - $300k
New York | $200,000-$300,000 Base + Bonus I'm working with one of the world's leading trading firms on an interesting GPU Systems Engineer position. This is a hands-on infrastructure role working at scale, with large CPU and GPU clusters spanning thousands of nodes and...Suggested- ...skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like...Suggested
- ...focusing on the compute, storage, and automation behind large-scale trading workloads. You will join engineers responsible for hundreds of petabytes of storage and thousands of GPU-accelerated nodes, shaping architectures for AI clusters and performance profiling....Suggested
- Career Techniques in New York seeks an experienced infrastructure engineer to design, deploy, and scale large-scale GPU clusters for AI research. You will work across compute, storage, OS, and automation to support hundreds of petabytes and thousands of nodes. You will...Suggested
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation...Full time
- Obsidian is seeking an MLOps Engineer to join their AI lab's cutting-edge GenAI team in New York. This full-time role involves training and... ...years of experience in ML infrastructure, with skills in custom GPU kernel optimization. This position offers a chance to be at the...Full time
$150k - $300k
Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally... ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We...Full timeWork at officeLocal areaImmediate startRemote workWorldwide$165k - $242k
...You’ll Do:CoreWeave is seeking a highly skilled and motivated Systems Kernel Engineer to join our HAVOCK Team, reporting into the Manager of... ...them where applicable (networking, storage, virtualization, GPU/DPU enablement).Stack-Wide Support - Ensure kernel support and...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment.... ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial...
- ...DS creates systems that power the next generation of radio spectrum intelligence. We collect... ...embedding model architectures, custom GPU kernels, and much more. Joining DS means... ...or equivalent experience Electrical Engineering or Physics or similar Nice to Have...Permanent employmentTemporary workWork at officeFlexible hours
- ...Fluidstack Production Engineering Team Examples of key exciting problems the team is working... ..., not a hundred scripts. Make the system's view of itself always match reality: integrate... ...-facing platforms, so every new site and GPU generation lands cleanly from day zero....Local area
$180k - $240k
...About the Role We are looking for a Senior Systems Developer to lead the design, development... ...ongoing operation Mentor and guide engineers, raising the technical bar across the team... ...Familiarity with server and GPU hardware architecture and system-level optimization...Flexible hours- ...and Suno. They rely on Modal for instant GPU access, sub-second container starts, and... ...international olympiad medalists, and experienced engineering and product leaders with decades of... ...building high-performance distributed systems at scale ~ Strong background in cloud infrastructure...
$182k - $242k
...publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the Linux kernel and host software stack underneath one of the largest GPU fleets in the world. When something breaks at the Kubernetes layer — a pod stuck...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$185k - $235k
...Staff/Senior Distributed Systems Engineer New York City | Full-time | On-site in SoHo, five days per week Reports to the CTO and works directly... ...backfill procedures. CPU-, memory-, disk-, network-, and GPU-aware scheduling, including workload classification, priority...Full timeWork at office$112.9k - $155.24k
...individuals for their own use. SCOPE OF POSITION The Senior Systems Engineer is responsible for working directly with our customers and... ...AI/ML fabric architectures (scale-up / scale-out), including GPU/XPU cluster designs and optical I/O requirements This...Full timeWork experience placement- ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast... ...engineering and cloud/DevOps responsibilities. You will manage GPU clusters, optimize cloud spending, ensure security and compliance...Full timeWork at office
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its... ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...Full time$86k - $115k
Datadog’s Technical Solutions organization includes 1,200+ sales engineers, support engineers, post-sales experts, and solution architects... ...“TSO”) owns that ecosystem.We manage the full lifecycle of the systems TS depends on: Zendesk, Jira, Confluence, and a growing...Work at office$119k - $180k
...excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... ...driven networking and automation.What You’ll DoAs an Advisory Systems Engineer (ASE), you are positioned to sell Arista products in...- TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,puppet) Knowledge of LDAP concepts...Work experience placementShift work
$105.4k - $124k
...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and...Full timeWork experience placementLocal area3 days per week$198k - $273k
...their individual choices, employees are empowered to push boundaries and help us all evolve, together. Your CareerAs a Channel Systems Engineer, your role will involve providing leadership, technical expertise, and guidance to a Global Systems Integrator (GSI) partner,...Full timeRemote workVisa sponsorshipWork visaFlexible hours$153k - $204k
...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly... ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into...Permanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours$180k - $200k
The Senior Systems Engineer will play a crucial role in managing and optimizing our Microsoft 365 and Azure environments, ensuring secure and efficient operations. This role involves overseeing complex cross-tenant access scenarios, M&A integrations, and domain migrations...$165k - $200k
...deep respect for our end users, listening closely to their feedback and needs. ABOUT THE JOB Radar is hiring a Senior Systems Engineer with end-to-end ownership of system-level inventory features. You will lead the problem solving process, analyze test data,...Full timeFlexible hours$115k - $135k
...Innovation) Team. This position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled platforms, GitHub-based... ...workloads, primarily within Microsoft Azure.The CCSI Systems Senior Engineer is a full-time role located in Southfield, MI,...Full timeWork at officeRemote workRelocation packageMonday to Friday$166k - $343k
Senior Presales, Systems EngineerThis role has been designed as ‘Hybrid’ with an expectation that you will work on average 2 days per... ...serve a wide range of customer segments.The Sr. Presales Systems Engineer plays a critical role in driving the success of HPE Networking...Full timeWork experience placementWork at officeLocal areaImmediate start2 days per week$166k - $343k
Senior Presales Systems Engineer (NYC)This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies...Full timeWork experience placementLocal areaImmediate startRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!
- system engineer remote New York, NY
- senior windows systems engineer New York, NY
- systems engineer intern New York, NY
- senior linux systems engineer New York, NY
- system safety engineer New York, NY
- ground systems engineer New York, NY
- advanced systems engineer New York, NY
- wireless systems engineer New York, NY
- senior staff systems engineer New York, NY
- mission system engineer New York, NY


