Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Systems Engineer

$150k - $300k
Full-time

Hudson River Trading

Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating systems, and automation tools that enable our trading and research to run 24/7 across the globe. We design, grow, and operate infrastructure at a large scale, including triple-digit petabyte-scale storage and massive CPU and GPU clusters in globally distributed data centers. As such, this is a high-impact role with broad scope, from HPC/AI cluster design and performance tuning, to troubleshooting and automation for thousands of nodes. Responsibilities

  • Design, build, and optimize large-scale distributed GPU compute clusters
  • Identify and resolve GPU workloads’ performance bottlenecks across compute,
storage, and networking layers * Collaborate with research and development teams to profile, benchmark, and fine-tune GPU-based workloads * Automate system deployment, monitoring, and troubleshooting across thousands of nodes * Collaborate with research, and engineering teams to support evolving workloads * Own critical infrastructure projects — from concept to implementation and support * Test and deploy new hardware and software, and partner with vendors to resolve complex issues

QUALIFICATIONS

* 5+ years of experience in large-scale Linux systems engineering in HPC, AI or distributed infrastructure roles. * Extensive experience in Linux system installation, performance tuning, and troubleshooting
  • Expertise in troubleshooting distributed GPU workloads
  • Deep knowledge around GPU optimization and performance
  • Proficiency in Python scripting and automation frameworks
  • CUDA or C/C++ experience is a plus
  • Experience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect
RDMA, and NVLink * Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef) * Comfortable diagnosing complex system issues at the hardware, OS, and network levels * Strong communication and organizational skills; able to collaborate across diverse technical teams * Thrive in fast-paced environments and excited by high-impact work The estimated base salary range for this position is 150,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package. Culture Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office. Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you. Please be advised: Use of AI tools during interviews or assessments is strictly prohibited, unless otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that AI assistance was used during any stage of the hiring process, we reserve the right to immediately disqualify your candidacy or rescind any job offers extended.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GPU Systems Engineer in New York, NY vacancy
  •  ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation... 
    Suggested
    Permanent employment
    New York, NY
    more than 2 months ago
  •  ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast...  ...engineering and cloud/DevOps responsibilities. You will manage GPU clusters, optimize cloud spending, ensure security and compliance... 
    Suggested
    Full time
    Work at office

    Basis

    New York, NY
    24 minutes ago
  • $125k - $150k

     ...Systems Engineer BBR Partners is a boutique wealth management firm that provides customized investment strategies and bespoke advice to high‑net‑worth individuals and families. Founded in early 2000, the firm has cultivated a culture of talent, diversity, and community... 
    Suggested
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Chris Baily

    New York, NY
    1 day ago
  • $200k - $300k

     ...by Google Ventures (GV), and we’re intentionally building a small, but exceptional team. Blacksmith was founded by a team with deep systems and scaling experience, including building search/ads infrastructure at Faire, and operating large distributed systems at Cockroach... 
    Suggested
    Second job

    Blacksmith

    New York, NY
    2 days ago
  •  ...StrataBlue is seeking a Forward Deployed Engineer for a remote, high-autonomy role. You will transform vague client requests into concrete...  ...oversee an overseas development team to ensure delivery and system visibility. The ideal candidate has 3+ years shipping full-stack... 
    Suggested
    Remote work
    Overseas

    Jack & Jill

    New York, NY
    17 hours ago
  •  ...VetJobs seeks an AMI Systems Analyst to serve as the technical lead for the AMI platform, including MDM and MAM. The role demands knowledge of AMI tech, networking, and software, plus collaboration with IT teams to test systems and inform customers. The analyst drives... 

    VetJobs

    New York, NY
    18 hours ago
  • $50k

     ...Job Title: Systems EngineerThe TGI StoryA second-generation family-owned business for over 62 years, TGI Office Automation is a comprehensive...  ...environmentCustom Demo configurations – working with sales engineers to develop POCs and execute onsite trialsInstallation and... 
    Work at office

    TGI Office Automation

    New York, NY
    3 days ago
  •  ...As our AI GTM Systems Lead , you will own the AI-powered operating system at the heart of our commercial organisation. You’ll design...  ...decisions. Partner cross‑functionally with Sales, Marketing, Product, Engineering, and Finance to align data flows and ensure a single source of... 
    Casual work
    Work at office
    2 days per week

    Aily Labs GmbH

    New York, NY
    17 hours ago
  • $80k - $120k

     ...Job Description Description This position requires the Systems Engineer to work with limited supervision as part of the Traffic Flow Management System (TFMS) program team to provide operational and test support for maintaining the hardware and software... 
    For contractors
    Work at office

    Science Applications International Corporation

    Atlantic City, NJ
    2 days ago
  • A leading consulting firm is seeking a Systems Engineer for a remote position. The role involves deploying applications, troubleshooting issues, and constructing SQL queries. Candidates should have extensive knowledge of SQL and TSQL, problem-solving skills, and a degree... 
    Remote work

    Korn Ferry

    New York, NY
    18 hours ago
  •  ...Drive Capital is seeking a Senior Systems Engineer in New Jersey. This role involves supporting the sales of enterprise storage solutions, assisting customers with evaluations, and defining product requirements with R&D Engineering. The ideal candidate has at least 5... 

    Drive Capital

    New York, NY
    18 hours ago
  • $120k - $160k

     ...software, and AI‑powered analytics to continuously locate every product down to the fixture. About the Role Radar is hiring a Systems Engineer who will take end‑to‑end ownership of system‑level inventory features. The system includes custom RFID sensors with hardware,... 
    Flexible hours

    Doist

    New York, NY
    2 days ago
  •  ...MedReview Inc. is seeking a hands-on Systems Engineer to manage infrastructure in on-prem and cloud environments. This role is critical for maintaining system performance, security, and scalability. Responsibilities include managing enterprise infrastructure on Azure... 
    Remote work

    Med Review Inc

    New York, NY
    17 hours ago
  • Stepful, Inc. is seeking a Group Operations Manager for Surgical Services in New York. The ideal candidate will manage the entire lifecycle of the Surgical Tech program and ensure operational success across multiple partners. You'll build playbooks, align internal teams...

    Stepful, Inc.

    New York, NY
    18 hours ago
  • $140k - $165k

     ...challenging legal issues, most significant business transactions and most critical disputes. We are seeking a hands-on, detail-oriented Systems Engineer focused on IAM and hybrid infrastructure. This role is operationally focused, with primary responsibility for identity... 
    Work at office

    Cravath Swaine

    New York, NY
    3 days ago
  • $75k - $100k

     ...Preferred Bank in New York is seeking a System Engineer for designing and maintaining their infrastructure. Responsibilities include providing help-desk support, managing computer systems, and ensuring network reliability. The ideal candidate must have a strong understanding... 
    Full time

    Preferred Bank

    New York, NY
    18 hours ago
  • $75k - $100k

     ...Queens, NY, US 5 days ago Requisition ID: 1045 Salary Range: $75,000.00 To $100,000.00 Annually The primary responsibility of the System Engineer is to design, build, and maintain the Bank’s infrastructure such as internal systems, network and various banking-related... 
    Full time
    Bank staff
    Local area

    Preferred Bank

    New York, NY
    3 days ago
  •  ...Synonym is seeking a Senior Rust Engineer to join the Pubky team and contribute to core products like Pubky Core and Pubky Nexus. This fully remote role emphasizes quality, security, and scalable design within a cutting-edge, open-source ecosystem. You will collaborate... 
    Remote work

    Synonym

    New York, NY
    17 hours ago
  •  ...Overview MedReview is looking for a hands-on Systems Engineer who thrives in owning and optimizing infrastructure across both on-prem and cloud environments. This role is critical to maintaining the performance security, and scalability of our core systems. If you're... 
    Remote work

    Med Review Inc

    New York, NY
    2 days ago
  • $80k - $85k

     ...A leading IT services provider is seeking a Senior Application Support Developer to maintain legacy systems and contribute to new features. This role is 100% remote and requires extensive experience in Natural Programming, Visual Basic 6, and SQL. Ideal candidates will... 
    Remote work

    ACL Digital

    New York, NY
    18 hours ago
  • $60 per hour

     ...proficient programmers to work remotely from locations including the US and Canada. This role involves designing coding problems for AI systems, writing high-quality code, and evaluating AI-generated code. Ideal candidates will have fluency in English, experience in Kotlin,... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    17 hours ago
  •  ...Job Summary The Systems Engineer serves as the College's primary enterprise infrastructure professional, responsible for the design, implementation, security, maintenance, and lifecycle management of the institution's server, cloud, virtualization, storage, backup, and... 
    For contractors

    Lancaster Bible College | Capital Seminary & Graduate School

    New York, NY
    2 days ago
  •  ...Radix Trading is seeking a seasoned HPC Systems Engineer with a passion for Linux, HPC systems and research infrastructure to join us. This role requires the ability to quickly troubleshoot and resolve technical issues, navigate networking and system alerts, and collaborate... 

    Radix Trading Experienced Job Board

    New York, NY
    3 days ago
  • $120k - $160k

     ...We build with deep respect for our end users, listening closely to their feedback and needs. ABOUT THE JOB Radar is hiring a Systems Engineer who will take end-to-end ownership of system-level inventory features. Radar’s system consists of custom RFID sensors with complex... 
    Flexible hours

    RADAR

    New York, NY
    3 days ago
  •  ...The IT Systems Engineer is a global role reporting to the Technology Operations Manager and will be responsible for providing leadership in systems design, best practice, deployment, configuration and maintenance as part of a 24x7 global operation. The Systems Engineer... 
    Work at office

    Northstar Staffing Solutions

    New York, NY
    11 hours ago
  • $95k - $125k

     ...United States and enable clients to deliver content directly to decision makers and those who matter most to them. We are hiring a Systems Engineer in our New York City office. About The Role You will be responsible for Level1 and 2 Help Desk Support for Windows and Mac... 
    Remote work
    Work from home
    Monday to Friday
    Day shift

    Applecart

    New York, NY
    2 days ago
  •  ...Overview Supports and maintains MFT systems, handling configuration, troubleshooting, and client coordination. Responsibilities Configure and support SFG, Connect:Direct, and SFTP transmissions Monitor and resolve file transfer failures Troubleshoot protocol and connectivity... 

    Infinite Computer Solutions

    New York, NY
    2 days ago
  • $135k - $160k

     ...SupportFinity™ is seeking an operationally minded specialist to design and scale systems supporting our partner ecosystem in New York. This role involves owning processes, tools, and data for our partners while collaborating with cross-functional teams. The ideal candidate... 

    SupportFinity

    New York, NY
    18 hours ago
  • $110k - $135k

     ...offers a rewarding career, great benefits, and the chance to learn and work with ground-breaking technology and premier clients. SYSTEMS ENGINEER III Unlimited Technology is searching for a SYSTEMS ENGINEER III, located near the New York City area. POSITION SUMMARY... 
    For contractors
    Work experience placement
    Local area
    Shift work

    Unlimited Technology, Inc

    New York, NY
    2 days ago
  •  ...Responsibilities Independently monitor and troubleshoot production systems, applications, and infrastructure Lead incident response for...  ...and improve operational efficiency Mentor junior operations engineers on tools, processes, and best practices Requirements Bachelor’s... 

    Jobtailor

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!