Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Systems Engineer

$150k - $300k

Hudson River Trading

Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating systems, and automation tools that enable our trading and research to run 24/7 across the globe. We design, grow, and operate infrastructure at a large scale, including triple-digit petabyte-scale storage and massive CPU and GPU clusters in globally distributed data centers. As such, this is a high-impact role with broad scope, from HPC/AI cluster design and performance tuning, to troubleshooting and automation for thousands of nodes.ResponsibilitiesDesign, build, and optimize large-scale distributed GPU compute clustersIdentify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layersCollaborate with research and development teams to profile, benchmark, and fine-tune GPU-based workloadsAutomate system deployment, monitoring, and troubleshooting across thousands of nodesCollaborate with research, and engineering teams to support evolving workloadsOwn critical infrastructure projects — from concept to implementation and supportTest and deploy new hardware and software, and partner with vendors to resolve complex issuesQualifications 5+ years of experience in large-scale Linux systems engineering in HPC, AI or distributed infrastructure roles.Extensive experience in Linux system installation, performance tuning, and troubleshootingExpertise in troubleshooting distributed GPU workloadsDeep knowledge around GPU optimization and performance Proficiency in Python scripting and automation frameworks CUDA or C/C++ experience is a plusExperience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect RDMA, and NVLink Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)Comfortable diagnosing complex system issues at the hardware, OS, and network levelsStrong communication and organizational skills; able to collaborate across diverse technical teamsThrive in fast-paced environments and excited by high-impact workThe estimated base salary range for this position is 150,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package.CultureHudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.Please be advised: Use of AI tools during interviews or assessments is strictly prohibited, unless otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that AI assistance was used during any stage of the hiring process, we reserve the right to immediately disqualify your candidacy or rescind any job offers extended.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GPU Systems Engineer in New York, NY vacancy
  • $150k - $300k

    Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains exceptionally...  ...software, and development tools. We have incredibly large GPU and CPU compute clusters, larger than most national labs. We... 
    Suggested
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide

    Hudson River Trading

    New York, NY
    3 days ago
  • $165k - $242k

     ...You’ll Do:CoreWeave is seeking a highly skilled and motivated Systems Kernel Engineer to join our HAVOCK Team, reporting into the Manager of...  ...them where applicable (networking, storage, virtualization, GPU/DPU enablement).Stack-Wide Support - Ensure kernel support and... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $182k - $242k

     ...workloads and bare metal. We own the operating system, virtualization, runtime, and hardware interfaces that allow thousands of GPU servers to securely execute customer...  ...performance.About the role:As a Senior Software Engineer on HAVOCK's Runtime & Virtualization team, you... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  •  ...leading financial services organization is seeking a senior Storage Systems Engineer to support and modernize its core infrastructure environment....  ...environmentAzure infrastructure experienceExposure to AI or GPU-backed environmentsAutomation or scripting experienceFinancial... 
    Suggested

    Madison Davis

    New York, NY
    3 days ago
  • $182k - $242k

     ...publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the Linux kernel and host software stack underneath one of the largest GPU fleets in the world. When something breaks at the Kubernetes layer — a pod stuck... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  •  ...Distributed Spectrum Job Opportunity DS creates systems that power the next generation of radio...  ...embedding model architectures, custom GPU kernels, and much more. Joining DS...  ...or equivalent experience Electrical Engineering or Physics or similar Nice to Have... 
    Permanent employment
    Temporary work
    Work at office
    Flexible hours

    Distributed Spectrum

    New York, NY
    1 day ago
  •  ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series A-C / high-growth AI infra) About the Role We’re hiring a senior-level engineer to build and optimise next-generation... 
    Permanent employment
    New York, NY
    more than 2 months ago
  • $136.8k - $163.5k

     ...the most important work of your career, come join us! The Systems & Networking team is responsible for designing and maintaining...  ...comprehensive & secure self service functionalities that lets engineering teams move faster. * Design and build our tools for monitoring... 
    Full time
    Temporary work
    Shift work

    Yext

    New York, NY
    1 day ago
  • $152k - $241.5k

    NVIDIA is seeking a Senior GenAI Algorithms Engineer to advance the state of the art in...  ...design new algorithms, optimize existing systems, and contribute to NVIDIA's open-source AI...  ...Face Transformers along with experience in GPU performance optimization, distributed systems... 
    Full time
    Remote work

    Nvidia

    New York, NY
    8 hours ago
  • $264.8k - $331k

     ...enterprise clients. As an ML Sys Research Engineer, you'll work on building out the...  ...-the-art technologies to optimize our ML system. Your customer will be other MLREs and AAIs...  ...to operate the architecture of the modern GPU cluster Experience with multi-node LLM training... 
    Full time

    Scale AI

    New York, NY
    2 days ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its...  ...level performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team... 
    Full time

    Nvidia

    New York, NY
    4 days ago
  • $204k - $259k

     ...create high-performance custom silicon; we develop system-level compute architectures that push the boundaries...  ...hybrid role, you will report to a Senior Software Engineer. You will: Develop high-performance GPU primitives and abstractions to enable Waymo to scale... 
    Full time
    Remote work

    Waymo

    New York, NY
    4 days ago
  • $198k - $273k

     ...their individual choices, employees are empowered to push boundaries and help us all evolve, together. Your CareerAs a Channel Systems Engineer, your role will involve providing leadership, technical expertise, and guidance to a Global Systems Integrator (GSI) partner,... 
    Full time
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Palo Alto Networks

    New York, NY
    3 days ago
  •  ...On SiteJob Reference 0000020103Salary Type AnnuallyIndustry Managed Services ProviderSelling Points Advance your career as a Systems Engineer in a dynamic environment. Collaborate on innovative IT solutions and enhance system performance. Gain exposure to cutting-edge... 

    Green Key Resources

    New York, NY
    2 days ago
  • $150k - $225k

     ...offices throughout the world. These servers are highly automated and finely tuned to meet the growing demands of our business. Our Systems Engineers are responsible for designing, building, and supporting these servers, working with engineers across our global groups to... 
    Worldwide
    Shift work

    Virtu Financial

    New York, NY
    3 days ago
  • $119k - $180k

     ...excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life...  ...driven networking and automation.What You’ll DoAs an Advisory Systems Engineer (ASE), you are positioned to sell Arista products in... 

    Arista Networks

    New York, NY
    1 day ago
  • $139k - $204k

     ...traded company (Nasdaq: CRWV) in March 2025. Learn more at .What You’ll Do:CoreWeave is seeking a highly skilled and motivated Systems Engineer to join our People Systems team. In this role, you will be a key contributor to the design, implementation, maintenance, and... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    5 days ago
  •  ...for advertisers to reach deeply engaged audiences.Our TeamThe Decisioning & Optimization engineering team sits within the Ad Serving & Decisioning at Netflix Ads. We own the systems that power real-time ad decisioning, delivering relevant, high-quality ads while... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    New York, NY
    4 days ago
  • TypeContract Qualifications: Good understanding of application, middleware and database interactions and connectivity Experience supporting Web servers and applications Knowledge of scripting (ex: powershell, Unix Shell Scripting,ansible,puppet) Knowledge of LDAP concepts...
    Work experience placement
    Shift work

    Intelliswift

    New York, NY
    3 days ago
  • $86k - $115k

    Datadog’s Technical Solutions organization includes 1,200+ sales engineers, support engineers, post-sales experts, and solution architects...  ...“TSO”) owns that ecosystem.We manage the full lifecycle of the systems TS depends on: Zendesk, Jira, Confluence, and a growing... 
    Work at office

    Datadog

    New York, NY
    2 days ago
  • $105.4k - $124k

     ...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionU.S. Bank is seeking a z/OS Systems Programmer that has extensive experience in mainframe technologies with an emphasis on installation/upgrading, tuning, and... 
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    New York, NY
    2 days ago
  • $153k - $204k

     ...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Systems Engineering team owns the host software stack that turns a freshly...  ...real physical hardware before it reaches one of the largest GPU fleets in the world, and we're extending that framework into... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Live in
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  •  ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast...  ...engineering and cloud/DevOps responsibilities. You will manage GPU clusters, optimize cloud spending, ensure security and compliance... 
    Full time
    Work at office

    Basis

    New York, NY
    2 days ago
  • Senior Presales Systems EngineerThis role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Who...  ...and internal account teams.The Senior Presales Systems Engineer is a subject matter expert in their area of specialization and... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    New York, NY
    1 day ago
  • $166k - $343k

    Senior Presales, Systems EngineerThis role has been designed as ‘Hybrid’ with an expectation that you will work on average 2 days per...  ...serve a wide range of customer segments.The Sr. Presales Systems Engineer plays a critical role in driving the success of HPE Networking... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    New York, NY
    4 days ago
  • $145k - $150k

    Our client is a premier law firm seeking a Messaging Systems Engineer to support and enhance its global messaging infrastructure. This individual will lead the administration and support of Exchange, Microsoft 365, Entra ID, and mobile device management environments, ensuring... 

    Talener

    New York, NY
    1 day ago
  • $115k - $135k

     ...Innovation) Team. This position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled platforms, GitHub-based...  ...workloads, primarily within Microsoft Azure.The CCSI Systems Senior Engineer is a full-time role located in Southfield, MI,... 
    Full time
    Work at office
    Remote work
    Relocation package
    Monday to Friday

    AlixPartners

    New York, NY
    5 days ago
  • $180k - $200k

    The Senior Systems Engineer will play a crucial role in managing and optimizing our Microsoft 365 and Azure environments, ensuring secure and efficient operations. This role involves overseeing complex cross-tenant access scenarios, M&A integrations, and domain migrations... 

    Cantor Fitzgerald

    New York, NY
    4 days ago
  • $140k - $165k

     ...challenging legal issues, most significant business transactions and most critical disputes. We are seeking a hands-on, detail-oriented Systems Engineer focused on IAM and hybrid infrastructure. This role is operationally focused, with primary responsibility for identity... 
    Work at office

    Cravath Swaine

    New York, NY
    11 hours ago
  •  ...MedReview Inc. is seeking a hands-on Systems Engineer to manage infrastructure in on-prem and cloud environments. This role is critical for maintaining system performance, security, and scalability. Responsibilities include managing enterprise infrastructure on Azure... 
    Remote work

    Med Review Inc

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Systems Engineer. Be the first to apply!