Software Engineer - GPU reliability
$200k - $300kHudson River Trading
Hudson River Trading (HRT) is seeking a Software Engineer focused on GPU reliability to join our Systems Development team. The Systems Development team builds and maintains the platform that is shared by all Systems teams to provision, monitor, and manage HRT’s server and network infrastructure. In this role, your main focus will be to develop tools in Python to analyze the performance of GPU hardware and build creative solutions to improve observability, reliability, and efficiency of the fleet. You’ll work closely with other engineering teams to deeply understand research and trading workflows and ensure that GPU infrastructure is utilized optimally. Strong Python skills and development experience are required, along with Unix experience and a background of managing GPU hardware at scale.ResponsibilitiesThis role offers a unique opportunity to make a significant impact on a critical part of our existing and growing infrastructure. Your responsibilities may vary day to day, but will include:Building and maintaining tools and software features to automate systems engineering workflows related to GPU management, monitoring, metrics collection, maintenance, and network configurationTroubleshooting software and hardware bugs on a fleet of GPU devices, including application, network, operating system, and/or kernel issuesWorking across HRT’s engineering teams to tune workloads and processes to use GPUs more efficiently Analyzing GPU job statistics to identify trends and areas for improvementQualificationsRequired:BS and/or MS in computer science or a related field2+ years of relevant experience, including programming in Python and managing GPUsExperience using automation to solve problems and improve process efficiencyExperience working with, troubleshooting, tuning, and deploying various types of GPU hardwareStrong grasp of computer science fundamentals and software design patternsSolid understanding of Linux/UNIX operating systems Familiarity with open-source softwareAbility to debug and analyze problems quicklySkilled at balancing multiple tasks while maintaining meticulous attention to detailAbility to operate effectively as a team player and also work independently Ability to learn at a fast pace and apply new skills effectivelyPreferred:Understanding of Debian operating systemFamiliarity with systems configuration management and monitoring technologies Familiarity with continuous integration and continuous deployment tools and processesUnderstanding of networking protocolsThe estimated base salary range for this position is 200,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package which includes medical, dental, vision, basic life insurance, and enrollment in our company’s retirement savings plans. Employees will receive sick and parental leave, as well as other paid time off (including 20 vacation days and 10 paid holidays in the US). Please note that benefits and time off policies will vary across non-US locations.CultureHudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.Please be advised: Use of AI tools during interviews or assessments is strictly prohibited, unless otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that AI assistance was used during any stage of the hiring process, we reserve the right to immediately disqualify your candidacy or rescind any job offers extended.
- ...teams spanning hardware and software. Speed and scale are our key... ...frontier forward.The Production Engineering TeamExamples of key exciting... ...100s of GWs: at our scale, a GPU failure isn't a ticket. It's... ...tooling depend on.Own end-to-end reliability, scalability, and operation...SuggestedLocal area
- ...GPU Kernel EngineerBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ..., and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.We're seeking a GPU Kernel Engineer...SuggestedFlexible hours
$204k - $259k
...responsible for running the fully autonomous vehicle's software stack. To achieve our mission, we architect and... ...this hybrid role, you will report to a Senior Software Engineer.You will:Develop high-performance GPU primitives and abstractions to enable Waymo to scale...SuggestedFull timeRemote work$113.1k - $232.3k
Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI... ...latency and output variance, and token/GPU cost anomalies. Translate reliability... ...Product Engineering has modernized software and product delivery, creating a scalable...SuggestedWork at officeLocal areaVisa sponsorshipFlexible hours3 days per week$139k - $257.55k
...is seeking an outstanding Senior Site Reliability Engineer (SRE) to support innovation through machine... ...energy with the resources of a large software company.What you'll doThis is a role... ...inference infrastructure — model serving, GPU workloads, language model gateway and...SuggestedFull timeTemporary workLocal areaRemote workWorldwide- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all... ...building high-performance, scalable and reliable machine learning systems? Do you want to... ...distributed systems with Kubernetes, and GPU workloads on those clustersExperience with...Full timeWork experience placementWork at officeLocal areaRemote workHome office
- ...Site Reliability Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management....Flexible hours
$139k - $257.55k
...is seeking an outstanding Senior Site Reliability Engineer (SRE) to support innovation through machine... ...energy with the resources of a large software company. What you'll do This is... ...infrastructure - model serving, GPU workloads, language model gateway and routing...Temporary workLocal areaRemote workWorldwide- ...innovators in this way. The RoleThe Director of Platform & Reliability Engineering will lead a critical engineering organization responsible for... ..., and post-incident learning.Partner with product and software engineering leaders to create paved-road solutions that improve...Work at officeLocal area2 days per week3 days per week
$153k - $210k
Senior Software Engineer, Site Reliability Engineering Reno, NV; San Ramon, CA; NYC - Hybrid Are you passionate about building resilient, highly available cloud platforms that enable engineering teams to move quickly and confidently? Do you enjoy automating complex operational...$117.5k - $157.5k
Job Posting Title:Software Engineer IIReq ID:10148551Job Description:Technology is at the heart... ...Disney Streaming’s distributed systems are reliable, performant, and transparent. We build... ...on time-series data, model training on GPU clusters, real-time inference pipelines...Full time$140k - $225k
...blackstone on LinkedIn, X, and Instagram.Role: Blackstone's Site Reliability Engineering team is responsible for improving the reliability of... ...professional experience with either, Infrastructure Engineering, Software Engineering, DevOps Engineering or Platform Engineering....Full timeLocal areaFlexible hours$140k - $215k
...intersection of our Core Platform and Embedded Reliability charters: building the foundational... ...while embedding directly with product engineering teams and their leadership to drive... ...the open source community; evangelize software engineering best practices, especially...Full timeWork experience placementWork at officeLocal area2 days per week3 days per week$139k - $242k
...Learn more at .What You’ll Do:The Runtime & GPU Systems team builds and operates secure,... ..., GPU infrastructure, and Linux systems engineering. We partner closely with security,... ...diagnosing and resolving complex performance, reliability, or isolation issues across containers,...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...globally recognized firm and have a direct and significant effect in a realm tailored for top achievers in site reliability. As a Lead Site Reliability Engineer at JPMorgan Chase within the Commercial & Investment Bank, Production Management team, you hold a leadership...
$165.3k - $219.68k
...insights to improve their business. Founded by engineers — and customer obsessed — we leap at... ...Model APIs, to state a few.Improve reliability, latency, and efficiency of distributed... ...real-time serving, ML infrastructure, or GPU orchestrationExposure to platforms like...Local areaWorldwide$150k - $160k
Front-End & AdTech Site Reliability Engineer (SRE)Haymarket Media, Inc. is seeking a Front-End & AdTech Site Reliability Engineer (SRE) to join the Engineering team. This position is located in our New York, NY office; three (3) days in office depending on business needs...Work at officeLocal area$182k - $250.8k
...Team at Okta is the backbone of our platform's reliability and operational excellence. We are a forward-thinking group of engineers and leaders who believe that great... ...standards that embed observability, resilience, and software engineering rigor into all engineering...Permanent employmentLocal areaRemote workWorldwideFlexible hoursWeekend workWeekday work$152k - $241.5k
...world working for us. If you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent...Full timeLocal areaRemote work$150k - $190k
Senior Site Reliability Engineer, VPAt Morgan Stanley, we advise, originate, trade, manage and distribute capital for governments, institutions... ...team or independently.Test and tune network, hardware, and software configurations to maximize performance needs.Troubleshoot...Temporary workWorldwideFlexible hoursWeekend work$145k - $182k
...re looking for a Senior AI/ML Engineer to design, build, and... ...internal connector ecosystemEnsure reliability: Monitor pipeline performance... ...efficiency.Collaborate with software engineers to integrate machine... ...distributed training orchestration, GPU/TPU resource allocation, and...Work at officeShift work3 days per week$170.8k - $234.8k
...accomplished Lead Applied AI Engineer who will architect and deliver... ...logging, and tracing. Ensure reliable operation with graceful... ...for AI workloads, including GPU availability, networking, data... ...Over 7 years of experience in software engineering with a strong focus...Bi-weekly payCasual workWork at officeWork from home$179.2k - $268.8k
...Senior Software Engineer - ML Performance Pittsburgh, PA, Palo Alto, CA, Detroit, MI Latitude AI... ...Drive projects end-to-end and deliver reliable software through continuous integration... ...relevant experience, or PhD) Expertise in GPU/DSP architecture and heterogeneous...Permanent employmentFull timeWork at officeImmediate startVisa sponsorship$180k - $250k
...Senior Software Engineer, InfrastructureArtemis is building the future of AI-driven defense - helping... ...data stores, and AI workloads running reliably at scale — and you'll do it in an... ...Partner with AI/ML and data teams — Support GPU workloads, model training pipelines,...$182k - $242k
...seeking a passionate and innovative Senior Software Engineer of Network Services to lead the... ...roadmap, drive innovation, and ensure the reliability, security, and scalability of the CoreWeave... ...services infrastructure for our GPU cloud services, including networking cloud...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$195k - $275k
...Management, Capital Markets Application & Data Services, Deployment Planning & Release Management, and the Chief Operating Office.The Reliability Operations (RO) within WMT is responsible for providing swift, courteous, and knowledgeable customer service to end users of the...Temporary workWork at officeWorldwideNight shift$110k - $120k
...expertise, scale, and technology.Job DescriptionJob Title: Site Reliability Engineer (SRE) / L3 Support EngineerGetting to know us:As a leading... ...on SS&C for expertise, scale, and technology.Kick off your software engineering career on our Quality & Automation team. You...Ongoing contractFull timeCasual workRemote workFlexible hours$200k - $250k
Hudson River Trading (HRT) is seeking a Senior Site Reliability Engineer focused on storage to join our growing Enterprise SRE team. This team... ...this stack, and are the principal drivers of growth for software and infrastructure practice within our larger Enterprise Technology...Work at officeLocal areaImmediate start- Jobtailor is seeking an experienced engineer to provide technical leadership and operational oversight for a portfolio of enterprise applications. You will ensure reliability, performance, monitoring, reporting, and continuous delivery at scale. The role emphasizes rapid...
$120k - $142k
...making journalism so good that it’s worth paying for. Mission Overview & Responsibilities: At The New York Times, our Site Reliability Engineering (SRE) team is central to how we design, test, and operate the systems that support our most critical customer experiences....Local areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - GPU reliability. Be the first to apply!
- cybersecurity software engineer New York, NY
- graduate software engineer New York, NY
- software developer fintech New York, NY
- new graduate software engineer New York, NY
- senior robotics software engineer New York, NY
- software engineer visa sponsorship New York, NY
- software qa engineer New York, NY
- network software engineer New York, NY
- software engineer remote New York, NY
- part time software developer New York, NY

