Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Systems Engineer

$200k - $300k

Tower Research Capital LLC

GPU Systems Engineer

Tower Research Capital is a leading quantitative trading firm founded in 1998. Tower has built its business on a high-performance platform and independent trading teams. We have a 25+ year track record of innovation and a reputation for discovering unique market opportunities. Tower is home to some of the world's best systematic trading and engineering talent. We empower portfolio managers to build their teams and strategies independently while providing the economies of scale that come from a large, global organization.

Engineers thrive at Tower while developing electronic trading infrastructure at a world class level. Our engineers solve challenging problems in the realms of low-latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing investment in top engineering talent and technology ensures our platform remains unmatched in terms of functionality, scalability and performance.

At Tower, every employee plays a role in our success. Our Business Support teams are essential to building and maintaining the platform that powers everything we do — combining market access, data, compute, and research infrastructure with risk management, compliance, and a full suite of business services. Our Business Support teams enable our trading and engineering teams to perform at their best.

At Tower, employees will find a stimulating, results-oriented environment where highly intelligent and motivated colleagues inspire each other to reach their greatest potential.

Summary: Trading and research at the firm run around the clock and across the globe, and they run on infrastructure this team designs, builds, and operates.

As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes.

The role is broad by design. One week you might be shaping the architecture of a new AI cluster, the next profiling a training job that will not scale, the next writing automation that keeps the whole fleet healthy with minimal human intervention.

Responsibilities:

  • Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology through to production operation.
  • Track down performance bottlenecks across the full stack: compute, storage, network, and the seams between them.
  • Partner with researchers to profile and benchmark GPU workloads, then turn the findings into measurable speedups.
  • Build the automation that lets a small team operate thousands of nodes: provisioning, monitoring, diagnostics, and self-healing.
  • Own infrastructure projects end to end, from scope and design through implementation and long-term support.
  • Qualify new generations of hardware and software, and work directly with vendors to root-cause complex issues.

Qualifications:

  • 5+ years engineering large-scale Linux systems in HPC, AI, or distributed-infrastructure environments.
  • Deep Linux fundamentals: installation, performance tuning, and debugging, down to the kernel when the problem calls for it.
  • Hands-on troubleshooting of distributed GPU workloads, with a strong mental model of GPU performance.
  • Working experience with GPUDirect RDMA. You understand how data moves between GPUs and the network, and what to check when it does not.
  • Solid Python for automation and tooling, plus CUDA or C/C++ experience. You can read, profile, and debug GPU code, not just operate the clusters it runs on.
  • Familiarity with configuration management tools such as Salt, Ansible, Puppet, or Chef.
  • Comfort diagnosing problems that cross hardware, OS, and network boundaries rather than stopping at one layer.
  • Clear communication. You will work daily with researchers, engineers, and vendors.

Nice to Have:

  • Experience with the rest of the NVIDIA stack, such as NCCL and NVLink.

Anticipated annual base salary range $200,000-$300,000, plus eligible for discretionary bonus.

Tower's headquarters are in the historic Equitable Building, right in the heart of NYC's Financial District and our impact is global, with over a dozen offices around the world.

At Tower, we believe work should be both challenging and enjoyable. That is why we foster a culture where smart, driven people thrive – without the egos. Our open concept workplace, casual dress code, and well-stocked kitchens reflect the value we place on a friendly, collaborative environment where everyone is respected, and great ideas win.

Our benefits include:

  • Generous paid time off policies
  • Savings plans and other financial wellness tools available in each region
  • Hybrid working opportunities
  • Free breakfast, lunch, and snacks daily
  • In-office wellness experiences and reimbursement for select wellness expenses (e.g., gym, personal training and more)
  • Company-sponsored sports teams and fitness events (JPM Corporate Challenge, Cycle for Survival, Wall Street Rides FAR and more)
  • Volunteer opportunities and charitable giving
  • Social events, happy hours, treats, and celebrations throughout the year
  • Workshops and continuous learning opportunities

At Tower, you'll find a collaborative and welcoming culture, a diverse team and a workplace that values both performance and enjoyment. No unnecessary hierarchy. No ego. Just great people doing great work – together.

Tower Research Capital is an equal opportunity employer.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the GPU Systems Engineer in New York, NY vacancy
  • $150k - $300k

    Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  •  ...As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes. The role is broad by design... 
    Suggested
    Work experience placement

    Career Techniques Inc

    New York, NY
    4 days ago
  •  ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation... 
    Suggested
    Full time
    New York, NY
    more than 2 months ago
  • Obsidian is seeking an MLOps Engineer to join their AI lab's cutting-edge GenAI team in New York. This full-time role involves training and...  ...years of experience in ML infrastructure, with skills in custom GPU kernel optimization. This position offers a chance to be at the... 
    Suggested
    Full time

    Obsidian

    New York, NY
    5 days ago
  • $150k - $300k

    Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally...  ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We... 
    Suggested
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide

    Hudson River Trading

    New York, NY
    2 days ago
  •  ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment....  ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial... 

    Madison Davis

    New York, NY
    2 days ago
  • $153k - $204k

     ...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly...  ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Live in
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • Systems Engineer, Servers/Cloud/DataLocation: Must be able to work onsite Tue, Wed, & Thursday out of one of these office locations: New York...  ...environments and workflows, including resource scheduling, MPI, and GPU/accelerator management.Architect and troubleshoot distributed... 
    Work at office

    CyberCoders

    New York, NY
    17 hours ago
  •  ...Distributed Spectrum DS creates systems that power the next generation of radio spectrum...  ...embedding model architectures, custom GPU kernels, and much more. Joining DS means...  ...higher or equivalent experience Electrical Engineering or Physics or similar Nice to Have... 
    Temporary work
    Work at office
    Flexible hours

    Distributed Spectrum

    New York, NY
    5 days ago
  •  ...the world’s best systematic trading and engineering talent. We empower portfolio managers to...  ...the Linux server infrastructure Manage HPC systems to support trading operations and Condor...  ...and best practices in HPC, storage, and GPU computing. Qualifications Experience in maintenance... 
    Rotating shift

    Tower Research Capital LLC

    New York, NY
    1 day ago
  • $180k - $240k

     ...About the Role We are looking for a Senior Systems Developer to lead the design, development...  ...ongoing operation Mentor and guide engineers, raising the technical bar across the...  ...environments Familiarity with server and GPU hardware architecture and system-level... 
    Full time
    Flexible hours

    Nscale

    New York, NY
    14 hours ago
  • $141.4k - $234.5k

     ...ROLEEverpure (formerly Pure Storage) is hiring a Senior Pre-Sales Systems Engineer to support our Higher Education business, with a focus on R1...  ...and imaging cores, AI and machine learning labs competing for GPU time, an academic medical center with its own rules and its... 
    Contract work
    Flexible hours

    Pure Storage

    New York, NY
    5 hours ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its...  ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team... 
    Full time

    Nvidia

    New York, NY
    4 days ago
  • $105.4k - $124k

     ...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and... 
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    New York, NY
    1 day ago
  • We are looking for a Systems Engineer to support and enhance core financial applications used by a legal organization in New York, New York. This position focuses on maintaining reliable performance across Aderant or 3E-related environments, resolving user and system issues... 

    Robert Half

    New York, NY
    4 days ago
  • We are looking for a Systems Engineer to support and enhance a secure hybrid infrastructure environment serving regulated business needs in Yonkers, New York. This Long-term Contract position will focus on designing, administering, and improving cloud and on-premises platforms... 
    Long term contract

    Robert Half

    New York, NY
    18 hours ago
  • TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,puppet) Knowledge of LDAP concepts...
    Work experience placement
    Shift work

    Intelliswift

    New York, NY
    2 days ago
  • $97.5k - $164.4k

     ...from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSenior Systems Engineer (Tandem NonStop)About your role:We are seeking a Senior Systems Engineer to provide technical solutions in a highly visible,... 
    Full time
    Remote work
    Night shift

    Fiserv

    New York, NY
    2 days ago
  • $152k

    About the roleWe are seeking an experienced Senior Systems Engineer to own our macOS platform and drive endpoint management and device trust standards across Chime’s IT ecosystem.As a Senior Systems Engineer, you will drive multi-system initiatives across our IT domains... 
    Full time
    Work at office
    Local area
    Remote work
    Shift work

    Chime

    New York, NY
    2 days ago
  • $115k - $135k

     ...Innovation) Team. This position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled platforms, GitHub-based...  ...workloads, primarily within Microsoft Azure.The CCSI Systems Senior Engineer is a full-time role located in Southfield, MI,... 
    Full time
    Work at office
    Remote work
    Relocation package
    Monday to Friday

    AlixPartners

    New York, NY
    5 hours ago
  • $200k - $250k

    The Senior Systems Engineer will play a crucial role in managing and optimizing our Microsoft 365 and Azure environments, ensuring secure and efficient operations. This role involves overseeing complex cross-tenant access scenarios, M&A integrations, and domain migrations... 

    Cantor Fitzgerald

    New York, NY
    3 days ago
  • $99.2k - $143.9k

     ...perspectives, turn inputs into actions, and uphold trust through integrity. Skills and Competencies 5 years in an engineering role, with a focus on AV systems and infrastructure Proven experience in AV design engineering, including implementation, build, and maintenance... 
    Full time

    Moody's

    New York, NY
    4 days ago
  • $50 - $58 per hour

     ...Our Client, a Global Financial Services Firm, is seeking a Systems Engineer in their New York, NY location. ABOUT THE JOB: Group Chief Operating Office (GCOO)'s vision is to enable best-in-class operational excellence across the Group leveraging on Technology... 
    Hourly pay
    Work at office

    Phyton Talent Advisors

    New York, NY
    5 days ago
  •  ...Distributed Systems Engineer Axiom is using zero-knowledge proofs to enable new types of verifiable and private software applications, starting with crypto and fintech. We are a small but incredibly strong team backed by the best investors in crypto. We're looking... 
    Contract work
    Work at office
    Remote work
    Flexible hours

    Axiom Global

    New York, NY
    3 days ago
  •  ...ANY VISA IS FINE! Job description: 4 month contract ONLY! ONSITE INTERVIEW REQUIRED GIS Systems Engineer (ArcGIS / ArcFM) - Utilities Location: Brooklyn, NY (Hybrid)- LOCAL TO NJ OR NY ONLY!! Overview We are seeking a GIS Systems Engineer with... 
    Contract work
    Local area

    3B Staffing LLC

    New York, NY
    15 hours ago
  •  ...Systems Engineer We are looking for a highly motivated and detail-oriented Operational Support Engineer or an enthusiastic and quick-learning Enterprise Collaboration & Workflow Engineer to join our team. This role is crucial for maintaining and enhancing the smooth... 

    Samprasoft

    New York, NY
    2 days ago
  • $198k - $273k

     ...their individual choices, employees are empowered to push boundaries and help us all evolve, together.Your CareerAs a Channel Systems Engineer, your role will involve providing leadership, technical expertise, and guidance to a Global Systems Integrator (GSI) partner,... 
    Full time
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Palo Alto Networks

    New York, NY
    3 days ago
  •  ...Systems EngineerOur client, who operates a vast network of transportation infrastructure spanning the New York City Metropolitan service...  ...segments of New Jersey and Connecticut, is seeking a Systems Engineer to join their growing team. This role will work within a group,... 
    Contract work

    Spruce Technology

    New York, NY
    3 days ago
  •  ...We’re seeking a well-rounded Systems Engineer with strong expertise in both on-premise and virtualized (VMware vSphere/ESXi) environments. Remote Roles - Must be currently living in NJ or NY Contract Duration: 6+Months with possibility of longer term extensions... 
    Contract work
    H1b
    Remote work

    Motion Recruitment

    New York, NY
    5 hours ago
  •  ...ROLE: NSX-T SYSTEMS ENGINEER ( VMware Certified Design Expert ) RATE: $95/+ C2C ROLE: SYSTEM ENGINEER for FDNY (WITH TOTAL OF 14 + YEARS OF EXP IS MUST) FULLY ONSITE FOR BROOKLYN, NY A successful candidate will be responsible for reviewing... 
    Local area

    3B Staffing LLC

    New York, NY
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!