Senior GPU Systems Engineer: Large-Scale Inference & RL
Reflection
Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron. The position offers competitive compensation, comprehensive benefits, and a supportive work environment with daily meals and team activities. #J-18808-Ljbffr Reflection
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior GPU Systems Engineer: Large-Scale Inference & RL in New York, NY vacancy
- ...oriented platform by combining agentic systems with deep learning workloads. You will optimize GPU utilization and deliver a stable, scalable inference serving stack for researchers across... ..., latency, and fault-tolerance for large-scale experiments, enabling faster...SuggestedRemote jobFlexible hours
- ...scalable worker platform in NYC. We’re seeking engineers with 5+ years in software development and deep experience with distributed systems and performance tuning. You’ll work... ...building from first principles, enjoy operating large-scale bare-metal fleets, and are excited #J-18...Senior
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ...performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...SeniorFull time$182k - $242k
...innovators to build and scale AI with confidence.... ...We own the operating system, virtualization,... ...that allow thousands of GPU servers to securely execute... ....About the role:As a Senior Software Engineer on HAVOCK's Runtime &... ...latency-sensitive AI inference and training...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...Qumulo CoreDistributed data operating system]( Native Qumulo Exabyte-scale file data platform in the cloud](... ...( predictive caching and prefetch engine]( ransomware and malware... ...ComputingScalable storage for training, inference, and GPU workflows]( retention with instant...SeniorRemote work
- ...VAST Data is looking for a Senior Systems Engineer – Federal (DOE) to join our... ...analysis and AI training and inference. Designed from the ground up... ...Prospect, penetrate, and support large, complex federal accounts.... ...of HPC, AI/ML, and large-scale unstructured data workloads....Senior
VAST Data
New York, NYmore than 2 months ago $182k - $242k
...innovators to build and scale AI with confidence.... ...at .What You'll Do:The Systems Engineering team owns the Linux kernel... ...one of the largest GPU fleets in the world.... ...fix.About the role:As a Senior Software Engineer on... ....Background in HPC or large-scale distributed systems...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$180k - $240k
...Senior Systems EngineerHouston; New York; San Francisco; Seattle; USAbout... ..., and operation of large-scale distributed systems powering... ...ongoing operationMentor and guide engineers, raising the technical bar across... ...with server and GPU hardware architecture and system...SeniorFlexible hoursNscale
New York, NY3 days ago$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment.... ...globe. We design, grow, and operate infrastructure at a large scale, including triple-digit petabyte-scale storage and...Work at officeLocal areaImmediate start- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity... ...next-generation AI infrastructure powering large-scale model training and inference. This role sits at the intersection of GPU systems...Full timeNew York, NYmore than 2 months ago
$200k - $300k
...best systematic trading and engineering talent. We empower... ...providing the economies of scale that come from a large, global organization. Engineers... ...compute, storage, operating systems, and automation behind that... ...storage and large CPU and GPU clusters spanning thousands...Full timeWork experience placementCasual workWork at officeTower Research Capital
New York, NY2 days ago- NVIDIA seeks a Senior Software Engineer - AI Inference to advance open‑source LLM serving on GPUs and to improve the stack for high‑throughput, low‑latency inference at scale. You will contribute upstream to vLLM and SGLang, optimize runtime capabilities such as batching...Senior
- ...of experience to lead aesthetic, functional and usability development of large-scale fitness equipment through the full design process. You will collaborate with product management, engineering, UX testing and suppliers to deliver engaging equipment from concept to launch...Senior
$97.5k - $164.4k
...want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSenior Systems Engineer (Tandem NonStop)About your role:We are seeking a Senior Systems Engineer to provide... ...technical solutions in a highly visible, large enterprise environment. You'll...SeniorFull timeRemote workNight shift- Blink Health is seeking a Senior Design Systems Engineer II to shape and scale the visual and interaction foundations of Blink’s digital ecosystem. You’ll partner with Product Design, Software Engineering, and cross‑functional teams to evolve the shared frontend design...Senior
- Scale AI is hiring for a senior software engineer to design, build, and scale full‑stack systems powering our GenAI data engine. You will work across front-end, back-end, and infrastructure, using React, TypeScript, Node.js, Python and data stores like MongoDB, Elasticsearch...Senior
$139k - $257.55k
...seeking an outstanding Senior Site Reliability Engineer (SRE) to support... ..., containerized systems as we build the... ...resources of a large software company.... ...and operate large-scale, distributed,... ...migrationBuild and operate ML inference infrastructure — model serving, GPU workloads,...SeniorFull timeTemporary workLocal areaRemote workWorldwide- Senior Presales Systems EngineerThis role has been designated as ‘Remote/Teleworker... ...The Senior Presales Systems Engineer is a subject matter expert... ...advisor for assigned cloud-scale customers, with primary emphasis... ...in cloud, large enterprise, or distributed multi...SeniorFull timeWork experience placementWork at officeImmediate startRemote workWork from home
- Whatnot is hiring Senior Software Engineers across multiple pillars to design and... ...scalable product and platform systems powering one of the fastest-... ...sellers. Our teams rebuild large distributed systems for rapid... ..., and real-time commerce at scale. #J-18808-Ljbffr WhatnotSeniorRemote job
$130k - $150k
Senior Windows & Citrix Engineer - Global Fintech Leader Are you ready to take your Citrix expertise to the... ...direct influence on enterprise-wide systems, while continuing to grow your... ...PowerShell) to streamline processes across large-scale IT estates. Drive improvements in...SeniorWorldwide$153k - $204k
...innovators to build and scale AI with confidence.... ...at .What You'll Do:The Systems Engineering team owns the host software... ...one of the largest GPU fleets in the world,... ...stack.About the role:As a Senior Software Engineer on... ...) experience.HPC or large-cluster experience — InfiniBand...SeniorPermanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours- ...Senior Systems Engineer – M365 & Enterprise Collaboration | NYC (Hybrid) | Global Financial Services... ...Microsoft Teams, and OneDrive across a large multi-tenant M365 environment Leading cross... ...and Teams administration at enterprise scale Strong Entra ID / Azure AD skills...Senior
Cleartech Recruiting
New York, NY5 days ago $174k - $252k
Google is hiring software engineers to develop next-generation technologies for billions of users. You will design, develop, test, deploy, and maintain software across projects, with opportunities to switch teams. Labs focuses on incubating early-stage efforts to advance...SeniorFull time- ...VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity... ...data analysis and AI training and inference. Designed from the ground up to make AI... ...the sales of enterprise storage to large IT organizations Positive energy, optimism...SeniorTraineeship
VAST Data
New York, NY3 days ago - ...k+ vCPUs concurrently, and run a petabyte-scale Ceph cluster that we manage ourselves.We'... ...was founded by a team with deep systems and scaling experience, including building... ...ads infrastructure at Faire, and operating large distributed systems at Cockroach Labs. Our...SeniorSecond job
Blacksmith
New York, NY2 days ago - ...Description VAST Data is looking to hire a Senior Sales Engineer - Global Systems Integrators (GSI)to join our growing team! VAST Data is... ...power next-generation AI factories, autonomous agents, large-scale model training, and modern data platforms. Joining...Senior
VAST Data
New York, NY8 hours ago $150k - $250k
...Senior Systems EngineerTower Research Capital is a leading quantitative trading firm... ...world's best systematic trading and engineering talent. We empower portfolio managers... ...while providing the economies of scale that come from a large, global organization.Engineers thrive...SeniorCasual workWork at officeTower Research Capital LLC
New York, NY3 days ago$112.9k - $155.24k
...individuals for their own use. SCOPE OF POSITION The Senior Systems Engineer is responsible for working directly with our... ...Familiarity with AI/ML fabric architectures (scale-up / scale-out), including GPU/XPU cluster designs and optical I/O requirements...SeniorFull timeWork experience placementCorning
New York, NY23 days ago- ...Modal for instant GPU access, sub-second... ...serve low-latency inference, fine-tune models,... ...ready sandboxes at scale. We recently... ..., and experienced engineering and product leaders... ...distributed computing, large-scale data... ...performance distributed systems at scale ~...
Modal
New York, NY1 day ago - ProMach is seeking a Sr. Process Engineer in the United States to lead the sale and execution of large projects for customers. You will develop engineered solutions, prepare estimates, and collaborate with Business Development to drive growth and profitability. Ideal candidates...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU Systems Engineer: Large-Scale Inference & RL. Be the first to apply!
Related searches
- lead system engineer New York, NY
- distributed systems engineer New York, NY
- office 365 systems engineer New York, NY
- operations support system engineer New York, NY
- system performance engineer New York, NY
- unix linux systems engineer New York, NY
- microsoft systems engineer New York, NY
- mission system engineer New York, NY
- system engineer remote New York, NY
- application system engineer New York, NY