Senior GPU Systems Engineer: Large-Scale Inference & RL
Reflection
Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron. The position offers competitive compensation, comprehensive benefits, and a supportive work environment with daily meals and team activities. #J-18808-Ljbffr Reflection
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior GPU Systems Engineer: Large-Scale Inference & RL in New York, NY vacancy
- Career Techniques in New York seeks an experienced infrastructure engineer to design, deploy, and scale large-scale GPU clusters for AI research. You will work across compute, storage, OS, and automation to support hundreds of petabytes and thousands of nodes. You will...Senior
- ...scalable worker platform in NYC. We’re seeking engineers with 5+ years in software development and deep experience with distributed systems and performance tuning. You’ll work... ...building from first principles, enjoy operating large-scale bare-metal fleets, and are excited #J-18...Senior
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ...performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...SeniorFull time$180k - $240k
...Senior Systems EngineerWe are looking for a Senior Systems Developer to... ...development, and operation of large-scale distributed systems powering... ...operationMentor and guide engineers, raising the technical bar across... ...with server and GPU hardware architecture and system...SeniorFlexible hoursNscale
New York, NY2 days ago$150k - $300k
Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment.... ...globe. We design, grow, and operate infrastructure at a large scale, including triple-digit petabyte-scale storage and...SuggestedWork at officeLocal areaImmediate start- ...VAST Data is looking for a Senior Systems Engineer – Federal (DOE) to join our... ...analysis and AI training and inference. Designed from the ground up... ...Prospect, penetrate, and support large, complex federal accounts.... ...of HPC, AI/ML, and large-scale unstructured data workloads....Senior
VAST Data
New York, NYmore than 2 months ago - ...seeks an experienced Lead for Pricing Engine to architect and operate a massive-scale distributed compute grid on public... ...pricing models across vast CPU/GPU resources, ensuring speed, reliability... ...and 10+ years in distributed systems are required. #J-18808-Ljbffr CapgeminiSenior
$184k - $287.5k
...challenges in the field. RL requires inference, rollout... ...heterogeneous hardware at scale pushes the limits... ...what distributed systems can do. NVIDIA is... ...an RL Frameworks engineering team to develop... ...on a single GPU to production... ...contributing to large-scale distributed...Senior$165k - $200k
...complex, noisy environments - at fleet scale. RADAR is one of the best-funded companies... .... Join us if you want to work on a large, unsolved, technically challenging... ...needs. ABOUT THE JOB Radar is hiring a Senior Systems Engineer with end-to-end ownership of system-...SeniorFlexible hoursRADAR
New York, NY9 days ago- ...As part of R&D, you will join the engineers responsible for the compute, storage, operating systems, and automation behind that work at serious scale: hundreds of petabytes of storage and large CPU and GPU clusters spanning thousands of nodes. The role is broad by design...Work experience placement
Career Techniques Inc
New York, NY3 days ago $200k - $300k
...+ Bonus I'm working with one of the world's leading trading firms on an interesting GPU Systems Engineer position. This is a hands-on infrastructure role working at scale, with large CPU and GPU clusters spanning thousands of nodes and hundreds of petabytes of storage...Iceberg
New York, NY18 hours ago- NVE Experience Agency seeks an Executive Producer to lead large-scale experiential programs from concept through execution. This is a hands-on role; you will own production end to end, translating client briefs into scopes, budgets and timelines while directing internal...Senior
- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity... ...next-generation AI infrastructure powering large-scale model training and inference. This role sits at the intersection of GPU systems...Full timeNew York, NYmore than 2 months ago
$190k - $265k
Harvey, Inc in New York is seeking a Research Engineer to enhance their large-scale search and retrieval systems. This role is crucial for developing infrastructure and researching novel techniques combining traditional search with advanced machine learning algorithms....Senior- ...role sits in R&D, focusing on the compute, storage, and automation behind large-scale trading workloads. You will join engineers responsible for hundreds of petabytes of storage and thousands of GPU-accelerated nodes, shaping architectures for AI clusters and performance...
- Consigli Construction Co. is seeking a Senior Estimator in New York, NY to lead all estimating efforts on complex, large-scale projects. You will prepare time, cost, and labor... ...and subcontractors, and drive value engineering. The role requires 10+ years in construction...SeniorFor subcontractor
- ...to lead aesthetic, functional, and usability development for large-scale fitness equipment. You will drive end-to-end product development... ...concept exploration to launch, collaborating with product, engineering, UX, and external partners to bring ideas to life. The ideal...Senior
- Blink Health is seeking a Senior Design Systems Engineer II to shape and scale the visual and interaction foundations of Blink’s digital ecosystem. You’ll partner with Product Design, Software Engineering, and cross‑functional teams to evolve the shared frontend design...Senior
- ...to lead aesthetic, functional, and usability development of large-scale fitness equipment. You will drive end-to-end design from concept... ...with cross‑functional teams including product management, engineering, UX testing and software. Ideal candidates bring 8+ years of...Senior
$97.5k - $164.4k
...want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSenior Systems Engineer (Tandem NonStop)About your role:We are seeking a Senior Systems Engineer to provide... ...technical solutions in a highly visible, large enterprise environment. You'll...SeniorFull timeRemote workNight shift$139k - $257.55k
...seeking an outstanding Senior Site Reliability Engineer (SRE) to support... ..., containerized systems as we build the... ...resources of a large software company.... ...and operate large-scale, distributed,... ...migrationBuild and operate ML inference infrastructure — model serving, GPU workloads,...SeniorFull timeTemporary workLocal areaRemote workWorldwide- A dynamic technology firm in New York is seeking a talented Senior/Staff level Systems Engineer to develop and scale a dedicated cloud for CI workloads. The role offers an opportunity to solve complex systems problems and build a new CI cloud from the ground up. Candidates...Senior
$97.9k - $133.5k
Become a part of our caring communityWe are seeking a Senior Systems Engineer to support the integration of enterprise infrastructure platforms... ...project teams within assigned technology domains.Support large-scale infrastructure integration and transformation efforts...SeniorBi-weekly payFull timeTemporary workFor contractorsApprenticeshipWork at officeRemote workWork from homeHome office$174k - $252k
Google is hiring software engineers to develop next-generation technologies for billions of users. You will design, develop, test, deploy, and maintain software across projects, with opportunities to switch teams. Labs focuses on incubating early-stage efforts to advance...SeniorFull time$130k - $150k
Senior Windows & Citrix Engineer - Global Fintech Leader Are you ready to take your Citrix expertise to the... ...direct influence on enterprise-wide systems, while continuing to grow your... ...PowerShell) to streamline processes across large-scale IT estates. Drive improvements in...SeniorWorldwide$153k - $204k
...innovators to build and scale AI with confidence.... ...at .What You'll Do:The Systems Engineering team owns the host software... ...one of the largest GPU fleets in the world,... ...stack.About the role:As a Senior Software Engineer on... ...) experience.HPC or large-cluster experience — InfiniBand...SeniorPermanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours- ...learning function and hiring engineers to develop the distributed training and inference systems that take models from... ...What you'll do Build and scale distributed training systems for large models Develop low-latency... ...on a rapidly growing GPU footprint (low thousands...Flexible hours
- ...Senior Systems Engineer Sales New Jersey Full-time ID: VDT27560 Description VAST Data is looking for... ...time data analysis and AI training and inference. Designed from the ground up to make... ...supporting the sales of enterprise storage to large IT organizations Positive energy,...SeniorFull timeTraineeship
Drive Capital
New York, NY3 days ago $150k - $250k
...Senior Systems EngineerTower Research Capital is a leading quantitative trading firm... ...world's best systematic trading and engineering talent. We empower portfolio managers... ...while providing the economies of scale that come from a large, global organization.Engineers thrive...SeniorCasual workWork at officeTower Research Capital LLC
New York, NY3 days ago- ...Modal for instant GPU access, sub-second... ...serve low-latency inference, fine-tune models,... ...ready sandboxes at scale. We recently... ..., and experienced engineering and product leaders... ...distributed computing, large-scale data... ...performance distributed systems at scale ~...
Modal
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU Systems Engineer: Large-Scale Inference & RL. Be the first to apply!
Related searches
- senior staff systems engineer New York, NY
- application system engineer New York, NY
- system engineer contract New York, NY
- operations support system engineer New York, NY
- sr systems engineer New York, NY
- visual systems engineer New York, NY
- active directory systems engineer New York, NY
- system performance engineer New York, NY
- software system engineer New York, NY
- data systems engineer New York, NY