Staff Engineer, Large-Scale GPU Inference & RL Infra
Reflection AI
Reflection AI is seeking an engineer to design, build, and operate large-scale GPU infrastructure for high-throughput model inference and mid-training workloads. You will support synthetic data generation and RL pipelines, building platforms that serve thousands of GPUs and optimize throughput. You will collaborate with researchers on distributed RL workloads and model evaluation infrastructure, tackling kernel-level optimizations and low-level performance issues across GPU and networking layers. #J-18808-Ljbffr Reflection AI
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Large-Scale GPU Inference & RL Infra in New York, NY vacancy
- Google Inc. is seeking a Staff Software Engineer focused on GPU Performance in New York, NY. The ideal candidate will have deep expertise in software development and experience with modern GPU architectures. Responsibilities include maintaining benchmarks for LLM training...Suggested
- ...an experienced professional to build and scale distributed training systems for frontier... ...work closely with research teams to design large-scale training runs and optimize training... ...strong debugging skills, and familiarity with GPU communication libraries. The company...Suggested
$275k
Quadrillion Labs in New York, NY, is seeking individuals to build infrastructure for model training, develop advanced RL techniques, and construct evaluations for complex tasks. The company offers generous benefits including covered meals. Join a startup fueled by top...Suggested- ...infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-... ...experience in writing high-quality code and familiarity with Nvidia GPU architecture and ML frameworks. This role offers opportunities...Suggested
- ...that covers the entire life of an LLM—from training to deployment and observation. We seek a research‑leaning engineer with a systems background to own inference bets, optimize autoscaling, and ship ideas back into production. Work in person in NYC or San Francisco,...Suggested
$175k - $250k
...urgency, who believe in the scale of our ambition and thrive... ...is seeking a Sr. to Senior Staff level Solutions Engineer to work closely with our most... ...Crusoe’s high-performance GPU infrastructure. This is a... ...Kubernetes—especially for inference and model training workflows...Temporary work- ...team of registered architects, engineers, and city planners to deliver... ...and operate agents securely at scale with session isolation, long-... ...systems (Python/TypeScript), cloud infra (AWS), containers (ECS/EKS),... ...isolation, 8-hour sessions, large payloads), Memory, Gateway,...Full timeSummer workWork at officeFlexible hours
GreenLite Technologies, Inc.
New York, NY1 day ago $200k - $280k
...Senior/Staff Engineer Location: San Francisco, CA or New York, NY Compensation: $200,000 –... ...1M payees. The company focuses on high-scale, high-throughput backend systems to enable... ...engineers, and building systems that handle large amounts of financial data reliably....Full timeH1bVisa sponsorshipFuku
New York, NY2 days ago$146.44k - $271.96k
...can thrive. Your New Role : The Staff Engineer reports to the Director Linear Systems.... ...reliable, performant, and cloud-optimized for scale. Your Role Accountabilities: % Time... ...frameworks (Spark, Kafka) to handle large-scale datasets. 10% Qualifications &...Temporary workLocal areaWarner Bros. Discovery
New York, NY1 day ago- ...Staff-level engineering role focused on architecting and owning a greenfield trading and brokerage platform in a regulated financial environment... ...services Strong Scala/JVM experience (Go a plus) Kafka or large-scale event-streaming expertise Thrives in high-ownership, fast-...
Salt Digital Recruitment
New York, NY7 hours ago - Blink Health, based in New York City, seeks a Staff Design Systems Engineer to shape and scale the visual and interaction foundations of its digital products. This hands-on role requires expertise in UI engineering and design quality. Ideal candidates will have over 7...
$159k - $208.95k
...opening with your name on it As a Staff Infrastructure Engineer, you'll own the design, operation, and... ...adopt patterns that work reliably at our scale. You're a hands-on builder who... ...related work. You've built and operated large systems and shipped real things. ~ Deep...Temporary workLocal areaWorldwideFanDuel
New York, NY4 days ago$200k - $225k
...lead it. About the Role We are hiring a Staff Engineer to own the architecture, design, and... ...engineering role for someone who can take large language models, tool‑use patterns, and... ...architecture to support these capabilities at scale. Tech Stack & Environment Cloud -...For contractors$220k - $260k
...yearly Job Description We are seeking a Deep Learning Engineer with experience manipulating large 2D and 3D media datasets. In this role, you will... ...translate customer requirements into technical milestones. Scaling & Deployment: Interact with remote machines via a Unix...Remote work$150k
...maintaining quality management records. The ideal candidate should have at least 3 years of relevant experience, a degree in civil engineering or construction management, and proficiency in inspection procedures. The estimated starting salary for this position is $150k,...Flexible hours- ...systems that turn the open web and other large-scale data sources into reliable, well-... ...model performance. This role is ideal for engineers who love building robust distributed systems... ...tightly across functions: researchers, infra, operations, and external partners. Enjoy...Work at officeVisa sponsorship
- ...Staff Machine Learning Engineer We are seeking an exceptional Staff Machine Learning Engineer to lead the design and development of the next... ...-driven fraud detection platform. You will architect large-scale ML systems that detect and prevent fraud in real time combining...
AppGate
New York, NY3 days ago - ...Staff Fiber Network Engineer Anthropic is building Anternet — a private, global dark-fiber backbone connecting... ...hyperscaler, dark-fiber provider, or large enterprise backbone Demonstrated... ...cohesive team on just a few large-scale research efforts. And we value impact...Work at officeVisa sponsorshipFlexible hoursNight shift
Colorwave Inc
New York, NY3 days ago - ...vCPUs concurrently, and run a petabyte-scale Ceph cluster that we manage ourselves.... ...infrastructure at Faire, and operating large distributed systems at Cockroach Labs.... ...background coding agent on top of it. The Staff Product Engineer at Blacksmith We are looking for a...
Blacksmith Software Inc
New York, NY4 days ago $227.5k - $324.99k
...distributed across the platform. As the scale and diversity of content continues to... ...at global scale. We're seeking a Staff Machine Learning Engineer to build and scale foundational ML... ...scalability, and performance across large datasets Who You Are You have experience...Work from homeWorldwideFlexible hoursSpotify
New York, NY2 days ago$175k - $255k
...Utilize ML infrastructure to serve model inferences in real time using live data streams... ...culture of collaboration and learning across engineering, product, and design through mentoring,... ...and operating production ML systems at scale, including experimentation, deployment,...Full timeWork at officeLocal areaCharlie Health Outreach
New York, NY3 days ago$180k - $238.1k
...But, many fail when they try to scale. We're different. CockroachDB... ...We are hiring performance engineers to expand our ongoing investment... ...workloads, and more. You will have a large impact on shaping the... ...experience level ranges from mid to staff level. At a minimum, this role...Local areaRemote workWorldwideFlexible hoursCockroach Labs
New York, NY4 days ago- Reflection AI is seeking researchers/engineers to transform pre-trained models into aligned agents... ...of post-training, data curation, and large-scale optimization. You will develop data generation pipelines, reward models, RL algorithms, and scaling techniques while collaborating...
$188k - $275k
...innovators to build and scale AI with confidence.... ...is seeking a Staff AI Security Engineer to define and operationalize... ...pipelines, data ingestion, inference environments, and... ...and securing large-scale distributed systems... ...high-performance or GPU-centric environments...Permanent employmentTemporary workCasual workWork at officeFlexible hours- ...good data” into concrete, measurable standards that scale across large data campaigns. We’re looking for engineers who combine strong engineering fundamentals with a... ...understanding of how data quality impacts training (SFT and RL) and evaluation, with the ability to translate...Work at officeVisa sponsorship
- ...the role We’re looking for a top‑tier Staff Backend Engineer to join our tech team. You’ll wear many... ...responsibilities will be to: Design internet‑scale, high‑performance infrastructure Build... ...and drive key technical decisions Own large cross‑functional initiatives from...Remote workFlexible hours
Linkup Inc
New York, NY4 days ago - ...Staff Backend Engineer We’re looking for a Staff-level Backend Engineer to help design, build, and operate the core... ...engineering practices Partner closely with product, infra, and leadership to balance speed, quality, and scale What We’re Looking For Prior Lead IC experience...
MERIT Beauty
New York, NY1 day ago $150k - $200k
...feel at home. About the Role We’re looking for a Staff Backend Engineer to lead the architecture, development, and scaling of backend systems that power the Made Card and... .... Proven track record building reliable, large-scale backend services and RESTful APIs. Proficiency...Local areaFlexible hoursMade Card
New York, NY7 hours ago- ...trends, and activate their communities at scale. We're a high-growth, venture-backed... ...operate at the intersection of applied AI and large-scale data systems, turning millions of... ...'ll join a small but mighty team where engineers own systems end-to-end - not tickets. You...
Plot Technologies, Inc
New York, NY4 days ago $207k - $259k
...that's reshaping the way value flows on the internet. As a Staff Backend Engineer, you will play a pivotal role in shaping the architecture... ...ideation and design to deployment. Design and build resilient, large-scale systems from the ground up with a focus on reliability,...Full timeRemote workHome officeUniswap
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Large-Scale GPU Inference & RL Infra. Be the first to apply!
Related searches
- assistant chief engineer New York, NY
- technology administrator New York, NY
- project engineer assistant project manager New York, NY
- staff security engineer New York, NY
- engineering aide New York, NY
- senior staff systems engineer New York, NY
- staff design engineer New York, NY
- research assistant engineering New York, NY
- staff data engineer New York, NY
- assistant engineering manager New York, NY