Senior Distributed Systems Engineer - AI Inference Factory
$168k - $270.25kNVIDIA
NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments, collaborate with teams to enhance infrastructure efficiency, and define metrics for improvements. The ideal candidate has extensive experience in distributed systems, microservices, and strong programming skills. A compensation range between $168,000 and $270,250 is offered based on experience, alongside equity and benefits. #J-18808-Ljbffr NVIDIA
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Distributed Systems Engineer - AI Inference Factory in New York, NY vacancy
$320k
Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to...Senior- Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates...SeniorWorldwide
- Quartermaster AI Inc. is seeking a Senior Software Engineer to join the core engineering team and help build the distributed platform powering Quartermaster’s global sensing network. The... ...to the web portal and analytics systems. You will own complex technical problems...Senior
- ...company in New York is seeking a Mid-Senior level engineer to migrate and enhance a sophisticated... ...field, and a strong background in distributed systems. This position offers competitive pay... ...and the chance to work on cutting-edge AI features in a fast-paced environment....Senior
$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering in the technology space? Do you enjoy solving... ...committed to pioneering and responsibly implementing AI/ML across Capital One. We achieve this by building...SeniorFull timePart timeInternshipLocal areaCapital One
New York, NY1 hour ago- Senior Lead Software Engineer, Back‑End Distributed Systems (AWS, Go, Kubernetes, MCP, Lua, Python) Do you love building and pioneering in the technology space? Do... ...ML platform Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities...SeniorInternship
- ...entertainment such as gaming and live events. Engineering teams within Netflix work hard every... ...resilient, high‑scale, low‑latency, distributed microservices in production... ...architecting, building, and operating distributed systems with high availability, fault tolerance...Senior
MaziCTools
New York, NY1 day ago $200.8k - $251k
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning... ...for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch...Full time- Gen is seeking a Senior Principal Product Manager to spearhead ecosystem strategy and partnership... ...across external platforms and emerging distribution channels, while ensuring product safety and performance in a rapidly evolving AI landscape. The ideal candidate has...Senior
- ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and...Senior
$260k - $270k
..., post supervisors, pipeline engineers, and IT teams running editorial... ...across post and distribution Build credibility with technical... ...customer-facing technical role (Systems Engineer, Solutions Architect... ...workflows, remote collaboration, and AI-assisted content creation...SeniorLocal areaRemote workFlexible hoursMadrona Venture Labs
New York, NY2 days ago- Talos is looking for a Senior Software Engineer to join the Core team in New York, NY. You will focus... ...includes developing low-latency messaging systems and API layers. This role requires expertise in backend engineering and distributed systems, as you will tackle complex...Senior
- VAST Data is looking for a Senior Systems Engineer - Federal (DOE) to join our growing Federal team.... ...is the data platform company for the AI era. We are building the enterprise software... ...data analysis and AI training and inference. Designed from the ground up to make...Senior
$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning... ...years of software engineering experience, expertise in distributed systems, and a strong understanding of performance...Senior$160k - $210k
...We Are Lightning AI is the company behind... ...and deploying AI systems—designed to take... ...a neocloud and AI Factory, Lightning AI combines... ..., and production inference, with security,... ...’re looking for a Senior Product Manager focused... ...across product, engineering, design, and data...SeniorWork at officeWork from homeFlexible hours2 days per week- Datadog is seeking distributed systems engineers in New York, NY to design, implement, and run the core platforms that process real-time, huge-scale event streams. You will build fault-tolerant, scalable data pipelines and own components of our service in a fast-growing...Senior
- Blueface Ltd is seeking a C++ Engineer to design and support their innovative video advertising platform. This role involves substantial experience with C/C++, distributed systems, and problem-solving, along with leading development efforts and mentoring team members. The...Senior
- A leading market intelligence firm in New York is seeking an experienced engineer for their search platform. This role involves building distributed systems that optimize handling of vast documents while ensuring exceptional performance and reliability. Ideal candidates...Senior
- Unity's Technical Fellow Office is seeking a senior engineer to solve hard, ambiguous problems at scale, bridging large-scale distributed systems with agentic AI. You will lead design reviews, ship production-ready AI workflows, and mentor teams while shaping platform...Work at office
$160k - $220k
...Lightning AI is the company behind... ...deploying AI systems—designed to take... ...neocloud and AI Factory, Lightning AI... ...and production inference, with security,... ...an experienced Senior Technical Program... ...closely with engineering, operations, and... ...infrastructure, cloud, or distributed systems...SeniorWork from homeFlexible hoursShift workLightning AI
New York, NY2 hours ago$180k - $250k
...cutting-edge cybersecurity company in New York is seeking a Distributed Systems Software Engineer for building an exceptional data platform. The role... ...systems, optimizing data storage, and collaborating with AI/ML teams. Ideal candidates must have experience with cloud...$320k
Staff + Senior Software Engineer, Inference About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The team is a rapidly growing group of researchers,... ...Design, build, and maintain distributed systems serving Claude worldwide...SeniorWorldwideVisa sponsorship- ...VAST Data is looking for a Senior Systems Engineer to join our growing team! This... ...platform company for the AI era. We are building the... ...analysis and AI training and inference. Designed from the ground up... ...on storage products, distributed storage architectures, file...SeniorTraineeship
VAST Data
New York, NY3 days ago $117.2k - $313.7k
Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software Engineer posting,... ...prompts and cultivate the system context that makes AI outputs reliable, secure, and production‑ready....Senior- A growing infrastructure company is seeking a Senior Systems Engineer to support the Department of Energy. This role involves guiding national labs... ...technical presentation skills and understanding of HPC and AI/ML are crucial. Join us for this pivotal opportunity at the...Senior
$320k
Anthropic is searching for a Software Engineer for the Launch Engineering team based in New York. This role involves managing deployment... ...to ensure automated and efficient movements of validated inference builds into production. Successful candidates will have strong...Senior- ...Senior Presales, Systems Engineer - NYC Metro This role has been designated as 'Remote/Teleworker', which means you will primarily work from home.... ...HPE Networking is transforming enterprise networking with AI-driven solutions that power modern campuses, branches, data...SeniorRemote workWork from home
$180k - $200k
The Senior Systems Engineer will play a crucial role in managing and optimizing our Microsoft 365 and Azure environments, ensuring secure and efficient... ...collaborate effectively with stakeholders. Enthusiasm for AI tooling and automation, with a willingness to explore and...Senior- ...feature enhancements Champion innovation and automation through AI and other intelligent solutions Create clear and concise... ...Requirements Bachelor's degree in Computer Science, Information Systems, or related field or equivalent experience 5+ years of hands‑on...Senior
$80k - $128k
Responsibilities The Senior Systems Engineer will drive the design, development... ...around cutting‑edge AI, owning the architecture and... ...skills and experience with distributed compute or GPU‑accelerated... ...Experience optimizing model inference through quantization, model...SeniorContract workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Distributed Systems Engineer - AI Inference Factory. Be the first to apply!
Related searches
- ground systems engineer New York, NY
- advanced systems engineer New York, NY
- expert systems engineer New York, NY
- active directory systems engineer New York, NY
- distributed systems engineer New York, NY
- microsoft systems engineer New York, NY
- computer system validation engineer New York, NY
- mission system engineer New York, NY
- senior staff systems engineer New York, NY
- software system engineer New York, NY