Senior Staff Software Engineer — AI Inference Systems
Anthropic
Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates should have a Bachelor's degree and significant software engineering experience, particularly with distributed systems. The position offers a hybrid work model allowing flexibility while ensuring collaboration and productivity. #J-18808-Ljbffr Anthropic
$320k
Staff + Senior Software Engineer, Inference About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The team is a rapidly growing group of researchers, engineers, policy experts, and business leaders working together to build...SeniorWorldwideVisa sponsorship$320k
Staff + Senior Software Engineer, Inference Deployment About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group...SeniorVisa sponsorshipShift work$168k - $270.25k
NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments... ...experience in distributed systems, microservices, and strong...Senior$320k
Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to...Senior$320k
Anthropic is seeking a Staff + Senior Software Engineer to design and build deployment infrastructure for inference code. You'll work with a team to ensure rapid, safe production of AI systems. The role requires 5+ years of experience in deployment infrastructure and proficiency...Suggested$405k
Staff+ Software Engineer, Inference Runtime Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle,... ...reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...every accelerator builds on. This is a senior IC role with broad technical ownership...Remote jobVisa sponsorship$405k
...is seeking an exceptional Senior Staff Software Engineer to join the Claude Developer... ...companies of all sizes to build AI applications with our... ...technical direction for the systems that make Claude accessible... ...partnering closely with Research, Inference, Platform, Infrastructure,...SeniorVisa sponsorship$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications... ...engineering experience, expertise in distributed systems, and a strong understanding of performance optimization...Senior$272k - $340k
...platform in the world for engineers to understand and scale their systems, applications, and teams... ...Opportunity Datadog’s Senior Staff Engineers are technical... ...demonstrated ability to use AI coding tools in day‑to‑... ...of how AI can improve software engineering best practices...Senior- ...network of business professionals with AI-powered research tools to deliver... .... About The Role We are looking for a Senior Staff Software Engineer with deep expertise in React on the frontend... ...CSS/SCSS Experience building scalable systems (race conditions, idempotency,...SeniorImmediate startFlexible hours
$208k - $289.5k
...community of 'Builder catalysts' as a Senior Staff Software Engineer and help us power prosperity around the... ..., customer research, and execution. AI-native experiences are designed from the... ...10+ years of experience developing systems/software for large business environments...SeniorTemporary workWork experience placementWork at office3 days per week$225k - $265k
...network for trusted trade. Our AI-powered product network... ...The Opportunity at Altana The Engineering team is responsible for building... ...customer base; it is a complex system that will stretch engineering... ...back end or data-driven software in demanding environments. You...SeniorFull timeTemporary workWork experience placementRemote workFlexible hours$180k - $250k
...early-stage, venture-backed AI healthcare startup transforming... ...that combines modern software engineering with AI to streamline complex... ...team, they're looking for a Staff Software Engineer to play a key... ...engineering. Design scalable, reliable systems used in high‑trust, real‑...Senior$237k - $337k
...experience. 5 years of experience with software development in one or more... .... Experience in Generative AI (Large Language Models, Multi-... ...the job Google's software engineers develop the next-generation technologies... ...computing, large-scale system design, networking and data...SeniorFull time- ...on our careers page. The Role Engineers at Brilliant work in small,... ...powered content agent, and our AI tutor, with every possible configuration... ...experience in web‑focused software engineering, ideally with... ...maintainable, AI‑interoperable software systems that drive user and business...SeniorInternshipHome officeFlexible hours
$200k - $300k
...entertainment company and the leader in AI music. We are backed by... ...of our Android team at the Senior and Staff levels. These aren’t... ...features end-to-end, drive engineering quality, and contribute to architectural... ...features, and real‑time AI inference all live on this platform....SeniorWork at officeLocal areaWorldwide- About Mandrel Mandrel is building the AI-native ERP for physical goods. Today,... ...role We’re hiring a highly motivated Staff / Senior Software Engineer to join our team in New York. and... ...technical standards, and ship high‑impact systems end‑to‑end—from initial concept and...SeniorRelocation package
$185k - $235k
Senior/ Staff Software Engineer (Ruby/Full-Stack)- hybrid Job type: Full Time · Department: Core Engineering... ...have been afterthoughts, as these systems have bolted on non-API-first solutions... ...healthcare outcomes. At Healthie, we are AI-enabled and AI-accelerated in how we...SeniorFull timeWork at officeRemote work3 days per week$262k - $365k
...experience testing, and launching software products. 3 years of... ...Experience integrating Generative AI tools or LLM interfaces into... ...Master’s degree or PhD in Engineering, Computer Science, or a related... ...distributed computing, large-scale system design, networking and data...Senior$262k - $365k
Senior Staff Software Engineer, Search Evaluation Infrastructure Development Note: By applying to this position... ...agentic architectures, and generative AI evaluation methodologies. Experience... ..., distributed computing, large-scale system design, networking and data storage,...SeniorEarly shift- ...technology company in New York is seeking a Mid-Senior level engineer to migrate and enhance a sophisticated... ...and a strong background in distributed systems. This position offers competitive pay and the chance to work on cutting-edge AI features in a fast-paced environment. #J...Senior
- ...the last few years making production LLM systems actually work - not prototyping, not... ...want to do that at a company where the AI is the product, this is worth reading. We... ...infrastructure behind the product and hiring a senior engineer to help lead that. This is not a...Senior
- Boosted.ai is seeking a Senior Software Engineer to design and build advanced software for its finance analytics platform. You will lead end-to-end development... ...strong CS fundamentals, and a track record in scalable systems. We value problem-solving, communication, and a bias...Senior
- ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and...Senior
$320k
Anthropic is searching for a Software Engineer for the Launch Engineering team based in New York. This role involves managing deployment orchestration... ...to ensure automated and efficient movements of validated inference builds into production. Successful candidates will have...Senior$117.2k - $313.7k
Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software Engineer posting... ...prompts and cultivate the system context that makes AI outputs reliable, secure, and production‑ready. Your...Senior$230k - $350k
Fractional AI, based in New York and San Francisco, seeks an engineering leader to work on AI products. In this high-impact role, you'll collaborate closely with... ...engineering experience is required, with a focus on AI systems. You'll enjoy competitive compensation ranging...Senior- Integral Ad Science is seeking a Senior Manager, Engineering in New York, NY to lead technical solutions in AI. You'll guide and mentor a team of... ...candidate has extensive experience in software development, team leadership, and AI systems. A competitive benefits package...Senior
- An innovative AI startup in New York City is looking for a Senior Software Engineer to lead the development of AI-driven systems. The role involves architecting scalable solutions and integrating AI technologies to enhance enterprise software. Ideal candidates should have...Senior
- A health tech company is seeking an AI Engineer to build systems for AI experiences, particularly in LLM-driven workflows and orchestration layers. The role involves designing AI patterns, maintaining orchestration layers, and creating data pipelines to enhance interactions...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Software Engineer — AI Inference Systems. Be the first to apply!
- ground systems engineer New York, NY
- advanced systems engineer New York, NY
- expert systems engineer New York, NY
- active directory systems engineer New York, NY
- distributed systems engineer New York, NY
- microsoft systems engineer New York, NY
- computer system validation engineer New York, NY
- mission system engineer New York, NY
- senior staff systems engineer New York, NY
- software system engineer New York, NY

