Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - GPU reliability

$200k - $300k

Hudson River Trading

Hudson River Trading (HRT) is seeking a Software Engineer focused on GPU reliability to join our Systems Development team. The Systems Development team builds and maintains the platform that is shared by all Systems teams to provision, monitor, and manage HRT’s server and network infrastructure. In this role, your main focus will be to develop tools in Python to analyze the performance of GPU hardware and build creative solutions to improve observability, reliability, and efficiency of the fleet. You’ll work closely with other engineering teams to deeply understand research and trading workflows and ensure that GPU infrastructure is utilized optimally. Strong Python skills and development experience are required, along with Unix experience and a background of managing GPU hardware at scale.ResponsibilitiesThis role offers a unique opportunity to make a significant impact on a critical part of our existing and growing infrastructure. Your responsibilities may vary day to day, but will include:Building and maintaining tools and software features to automate systems engineering workflows related to GPU management, monitoring, metrics collection, maintenance, and network configurationTroubleshooting software and hardware bugs on a fleet of GPU devices, including application, network, operating system, and/or kernel issuesWorking across HRT’s engineering teams to tune workloads and processes to use GPUs more efficiently Analyzing GPU job statistics to identify trends and areas for improvementQualificationsRequired:BS and/or MS in computer science or a related field2+ years of relevant experience, including programming in Python and managing GPUsExperience using automation to solve problems and improve process efficiencyExperience working with, troubleshooting, tuning, and deploying various types of GPU hardwareStrong grasp of computer science fundamentals and software design patternsSolid understanding of Linux/UNIX operating systems Familiarity with open-source softwareAbility to debug and analyze problems quicklySkilled at balancing multiple tasks while maintaining meticulous attention to detailAbility to operate effectively as a team player and also work independently Ability to learn at a fast pace and apply new skills effectivelyPreferred:Understanding of Debian operating systemFamiliarity with systems configuration management and monitoring technologies Familiarity with continuous integration and continuous deployment tools and processesUnderstanding of networking protocolsThe estimated base salary range for this position is 200,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package which includes medical, dental, vision, basic life insurance, and enrollment in our company’s retirement savings plans. Employees will receive sick and parental leave, as well as other paid time off (including 20 vacation days and 10 paid holidays in the US). Please note that benefits and time off policies will vary across non-US locations.CultureHudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.Please be advised: Use of AI tools during interviews or assessments is strictly prohibited, unless otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that AI assistance was used during any stage of the hiring process, we reserve the right to immediately disqualify your candidacy or rescind any job offers extended.

Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer - GPU reliability in New York, NY vacancy
  •  ...teams spanning hardware and software. Speed and scale are our key...  ...frontier forward.The Production Engineering TeamExamples of key exciting...  ...100s of GWs: at our scale, a GPU failure isn't a ticket. It's...  ...tooling depend on.Own end-to-end reliability, scalability, and operation... 
    Suggested
    Local area

    Fluidstack

    New York, NY
    1 day ago
  • $113.1k - $232.3k

    Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI...  ...latency and output variance, and token/GPU cost anomalies. Translate reliability...  ...Product Engineering has modernized software and product delivery, creating a scalable... 
    Suggested
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    New York, NY
    14 hours ago
  •  ...GPU Kernel EngineerBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ..., and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.We're seeking a GPU Kernel Engineer... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    5 days ago
  • $204k - $259k

     ...responsible for running the fully autonomous vehicle's software stack. To achieve our mission, we architect and...  ...this hybrid role, you will report to a Senior Software Engineer.You will:Develop high-performance GPU primitives and abstractions to enable Waymo to scale... 
    Suggested
    Full time
    Remote work

    Latent Logic

    New York, NY
    1 day ago
  • $139k - $257.55k

     ...is seeking an outstanding Senior Site Reliability Engineer (SRE) to support innovation through machine...  ...energy with the resources of a large software company.What you'll doThis is a role...  ...inference infrastructure — model serving, GPU workloads, language model gateway and... 
    Suggested
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe Systems

    New York, NY
    2 days ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all...  ...building high-performance, scalable and reliable machine learning systems? Do you want to...  ...distributed systems with Kubernetes, and GPU workloads on those clustersExperience with... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    14 hours ago
  •  ...Site Reliability Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.... 
    Flexible hours

    Baseten

    New York, NY
    4 days ago
  • $139k - $257.55k

     ...is seeking an outstanding Senior Site Reliability Engineer (SRE) to support innovation through machine...  ...energy with the resources of a large software company. What you'll do This is...  ...infrastructure - model serving, GPU workloads, language model gateway and routing... 
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe

    New York, NY
    2 days ago
  •  ...innovators in this way. The RoleThe Director of Platform & Reliability Engineering will lead a critical engineering organization responsible for...  ..., and post-incident learning.Partner with product and software engineering leaders to create paved-road solutions that improve... 
    Work at office
    Local area
    2 days per week
    3 days per week

    Forge Global

    New York, NY
    1 day ago
  • $153k - $210k

    Senior Software Engineer, Site Reliability Engineering Reno, NV; San Ramon, CA; NYC - Hybrid Are you passionate about building resilient, highly available cloud platforms that enable engineering teams to move quickly and confidently? Do you enjoy automating complex operational... 

    Ridgeline

    New York, NY
    14 hours ago
  • $140k - $225k

     ...blackstone on LinkedIn, X, and Instagram.Role: Blackstone's Site Reliability Engineering team is responsible for improving the reliability of...  ...professional experience with either, Infrastructure Engineering, Software Engineering, DevOps Engineering or Platform Engineering.... 
    Full time
    Local area
    Flexible hours

    Blackstone Group

    New York, NY
    14 hours ago
  • $117.5k - $157.5k

    Job Posting Title:Software Engineer IIReq ID:10148551Job Description:Technology is at the heart...  ...Disney Streaming’s distributed systems are reliable, performant, and transparent. We build...  ...on time-series data, model training on GPU clusters, real-time inference pipelines... 
    Full time

    Hulu

    New York, NY
    9 hours ago
  • $140k - $215k

     ...intersection of our Core Platform and Embedded Reliability charters: building the foundational...  ...while embedding directly with product engineering teams and their leadership to drive...  ...the open source community; evangelize software engineering best practices, especially... 
    Full time
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week

    CrowdStrike

    New York, NY
    14 hours ago
  •  ...globally recognized firm and have a direct and significant effect in a realm tailored for top achievers in site reliability. As a Lead Site Reliability Engineer at JPMorgan Chase within the Commercial & Investment Bank, Production Management team, you hold a leadership... 

    JP Morgan Chase

    New York, NY
    3 days ago
  • $139k - $242k

     ...Learn more at .What You’ll Do:The Runtime & GPU Systems team builds and operates secure,...  ..., GPU infrastructure, and Linux systems engineering. We partner closely with security,...  ...diagnosing and resolving complex performance, reliability, or isolation issues across containers,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    14 hours ago
  • $165.3k - $219.68k

     ...insights to improve their business. Founded by engineers — and customer obsessed — we leap at...  ...Model APIs, to state a few.Improve reliability, latency, and efficiency of distributed...  ...real-time serving, ML infrastructure, or GPU orchestrationExposure to platforms like... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    1 day ago
  • $150k - $160k

    Front-End & AdTech Site Reliability Engineer (SRE)Haymarket Media, Inc. is seeking a Front-End & AdTech Site Reliability Engineer (SRE) to join the Engineering team. This position is located in our New York, NY office; three (3) days in office depending on business needs... 
    Work at office
    Local area

    Haymarket Media Group

    New York, NY
    14 hours ago
  • $182k - $250.8k

     ...Team at Okta is the backbone of our platform's reliability and operational excellence. We are a forward-thinking group of engineers and leaders who believe that great...  ...standards that embed observability, resilience, and software engineering rigor into all engineering... 
    Permanent employment
    Local area
    Remote work
    Worldwide
    Flexible hours
    Weekend work
    Weekday work

    Okta

    New York, NY
    9 hours ago
  • $152k - $241.5k

     ...world working for us. If you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent... 
    Full time
    Local area
    Remote work

    Nvidia

    New York, NY
    9 hours ago
  • $150k - $190k

    Senior Site Reliability Engineer, VPAt Morgan Stanley, we advise, originate, trade, manage and distribute capital for governments, institutions...  ...team or independently.Test and tune network, hardware, and software configurations to maximize performance needs.Troubleshoot... 
    Temporary work
    Worldwide
    Flexible hours
    Weekend work

    Morgan Stanley

    New York, NY
    14 hours ago
  • $145k - $182k

     ...re looking for a Senior AI/ML Engineer to design, build, and...  ...internal connector ecosystemEnsure reliability: Monitor pipeline performance...  ...efficiency.Collaborate with software engineers to integrate machine...  ...distributed training orchestration, GPU/TPU resource allocation, and... 
    Work at office
    Shift work
    3 days per week

    BlackLine

    New York, NY
    5 days ago
  • $170.8k - $234.8k

     ...accomplished Lead Applied AI Engineer who will architect and deliver...  ...logging, and tracing. Ensure reliable operation with graceful...  ...for AI workloads, including GPU availability, networking, data...  ...Over 7 years of experience in software engineering with a strong focus... 
    Bi-weekly pay
    Casual work
    Work at office
    Work from home

    Humana

    New York, NY
    5 days ago
  • $179.2k - $268.8k

     ...Senior Software Engineer - ML Performance Pittsburgh, PA, Palo Alto, CA, Detroit, MI Latitude AI...  ...Drive projects end-to-end and deliver reliable software through continuous integration...  ...relevant experience, or PhD) Expertise in GPU/DSP architecture and heterogeneous... 
    Permanent employment
    Full time
    Work at office
    Immediate start
    Visa sponsorship

    Latitude AI LLC

    New York, NY
    2 days ago
  • $180k - $250k

     ...Senior Software Engineer, InfrastructureArtemis is building the future of AI-driven defense - helping...  ...data stores, and AI workloads running reliably at scale — and you'll do it in an...  ...Partner with AI/ML and data teams — Support GPU workloads, model training pipelines,... 

    Artemis Security

    New York, NY
    14 hours ago
  • $182k - $242k

     ...seeking a passionate and innovative Senior Software Engineer of Network Services to lead the...  ...roadmap, drive innovation, and ensure the reliability, security, and scalability of the CoreWeave...  ...services infrastructure for our GPU cloud services, including networking cloud... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    14 hours ago
  • $195k - $275k

     ...Management, Capital Markets Application & Data Services, Deployment Planning & Release Management, and the Chief Operating Office.The Reliability Operations (RO) within WMT is responsible for providing swift, courteous, and knowledgeable customer service to end users of the... 
    Temporary work
    Work at office
    Worldwide
    Night shift

    Morgan Stanley

    New York, NY
    3 days ago
  • $120k - $142k

     ...making journalism so good that it’s worth paying for. Mission Overview & Responsibilities: At The New York Times, our Site Reliability Engineering (SRE) team is central to how we design, test, and operate the systems that support our most critical customer experiences.... 
    Local area
    Flexible hours

    The New York Times

    New York, NY
    1 day ago
  • Jobtailor is seeking an experienced engineer to provide technical leadership and operational oversight for a portfolio of enterprise applications. You will ensure reliability, performance, monitoring, reporting, and continuous delivery at scale. The role emphasizes rapid... 

    Jobtailor

    New York, NY
    14 hours ago
  • $110k - $120k

     ...expertise, scale, and technology.Job DescriptionJob Title: Site Reliability Engineer (SRE) / L3 Support EngineerGetting to know us:As a leading...  ...on SS&C for expertise, scale, and technology.Kick off your software engineering career on our Quality & Automation team. You... 
    Ongoing contract
    Full time
    Casual work
    Remote work
    Flexible hours

    SS&C Technologies

    New York, NY
    2 days ago
  • $200k - $250k

    Hudson River Trading (HRT) is seeking a Senior Site Reliability Engineer focused on storage to join our growing Enterprise SRE team. This team...  ...this stack, and are the principal drivers of growth for software and infrastructure practice within our larger Enterprise Technology... 
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - GPU reliability. Be the first to apply!