Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff Software Engineer — AI Inference Systems

Anthropic

Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates should have a Bachelor's degree and significant software engineering experience, particularly with distributed systems. The position offers a hybrid work model allowing flexibility while ensuring collaboration and productivity. #J-18808-Ljbffr Anthropic

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Staff Software Engineer — AI Inference Systems in New York, NY vacancy
  • $320k

    Staff + Senior Software Engineer, Inference About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. The team is a rapidly growing group of researchers, engineers, policy experts, and business leaders working together to build... 
    Senior
    Worldwide
    Visa sponsorship

    Anthropic

    New York, NY
    1 day ago
  • $320k

    Staff + Senior Software Engineer, Inference Deployment About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group... 
    Senior
    Visa sponsorship
    Shift work

    Anthropic

    New York, NY
    1 day ago
  • $168k - $270.25k

    NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments...  ...experience in distributed systems, microservices, and strong... 
    Senior

    NVIDIA

    New York, NY
    1 day ago
  • $320k

    Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to... 
    Senior

    Anthropic

    New York, NY
    1 day ago
  • $320k

    Anthropic is seeking a Staff + Senior Software Engineer to design and build deployment infrastructure for inference code. You'll work with a team to ensure rapid, safe production of AI systems. The role requires 5+ years of experience in deployment infrastructure and proficiency... 
    Suggested

    Anthropic

    New York, NY
    1 day ago
  • $405k

    Staff+ Software Engineer, Inference Runtime Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle,...  ...reliable, interpretable, and steerable AI systems. We want AI to be safe and...  ...every accelerator builds on. This is a senior IC role with broad technical ownership... 
    Remote job
    Visa sponsorship

    Anthropic

    New York, NY
    1 day ago
  • $405k

     ...is seeking an exceptional Senior Staff Software Engineer to join the Claude Developer...  ...companies of all sizes to build AI applications with our...  ...technical direction for the systems that make Claude accessible...  ...partnering closely with Research, Inference, Platform, Infrastructure,... 
    Senior
    Visa sponsorship

    Anthropic

    New York, NY
    1 day ago
  • $160k - $240k

    Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications...  ...engineering experience, expertise in distributed systems, and a strong understanding of performance optimization... 
    Senior

    Bloomberg

    New York, NY
    4 days ago
  • $272k - $340k

     ...platform in the world for engineers to understand and scale their systems, applications, and teams...  ...Opportunity Datadog’s Senior Staff Engineers are technical...  ...demonstrated ability to use AI coding tools in day‑to‑...  ...of how AI can improve software engineering best practices... 
    Senior

    Visa Hunt

    New York, NY
    3 days ago
  •  ...network of business professionals with AI-powered research tools to deliver...  .... About The Role We are looking for a Senior Staff Software Engineer with deep expertise in React on the frontend...  ...CSS/SCSS Experience building scalable systems (race conditions, idempotency,... 
    Senior
    Immediate start
    Flexible hours

    NewtonX

    New York, NY
    3 days ago
  • $208k - $289.5k

     ...community of 'Builder catalysts' as a Senior Staff Software Engineer and help us power prosperity around the...  ..., customer research, and execution. AI-native experiences are designed from the...  ...10+ years of experience developing systems/software for large business environments... 
    Senior
    Temporary work
    Work experience placement
    Work at office
    3 days per week

    Intuit Inc

    New York, NY
    1 day ago
  • $225k - $265k

     ...network for trusted trade. Our AI-powered product network...  ...The Opportunity at Altana The Engineering team is responsible for building...  ...customer base; it is a complex system that will stretch engineering...  ...back end or data-driven software in demanding environments. You... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    ALTANA

    New York, NY
    6 hours ago
  • $180k - $250k

     ...early-stage, venture-backed AI healthcare startup transforming...  ...that combines modern software engineering with AI to streamline complex...  ...team, they're looking for a Staff Software Engineer to play a key...  ...engineering. Design scalable, reliable systems used in high‑trust, real‑... 
    Senior

    Magnitude Consulting

    New York, NY
    1 day ago
  • $237k - $337k

     ...experience. 5 years of experience with software development in one or more...  .... Experience in Generative AI (Large Language Models, Multi-...  ...the job Google's software engineers develop the next-generation technologies...  ...computing, large-scale system design, networking and data... 
    Senior
    Full time

    Google

    New York, NY
    1 day ago
  •  ...on our careers page. The Role Engineers at Brilliant work in small,...  ...powered content agent, and our AI tutor, with every possible configuration...  ...experience in web‑focused software engineering, ideally with...  ...maintainable, AI‑interoperable software systems that drive user and business... 
    Senior
    Internship
    Home office
    Flexible hours

    Brilliant.org

    New York, NY
    1 day ago
  • $200k - $300k

     ...entertainment company and the leader in AI music. We are backed by...  ...of our Android team at the Senior and Staff levels. These aren’t...  ...features end-to-end, drive engineering quality, and contribute to architectural...  ...features, and real‑time AI inference all live on this platform.... 
    Senior
    Work at office
    Local area
    Worldwide

    Menlo Ventures

    New York, NY
    2 days ago
  • About Mandrel Mandrel is building the AI-native ERP for physical goods. Today,...  ...role We’re hiring a highly motivated Staff / Senior Software Engineer to join our team in New York. and...  ...technical standards, and ship high‑impact systems end‑to‑end—from initial concept and... 
    Senior
    Relocation package

    Mandrel, LLC

    New York, NY
    3 days ago
  • $185k - $235k

    Senior/ Staff Software Engineer (Ruby/Full-Stack)- hybrid Job type: Full Time · Department: Core Engineering...  ...have been afterthoughts, as these systems have bolted on non-API-first solutions...  ...healthcare outcomes. At Healthie, we are AI-enabled and AI-accelerated in how we... 
    Senior
    Full time
    Work at office
    Remote work
    3 days per week

    Neara

    New York, NY
    17 hours ago
  • $262k - $365k

     ...experience testing, and launching software products. 3 years of...  ...Experience integrating Generative AI tools or LLM interfaces into...  ...Master’s degree or PhD in Engineering, Computer Science, or a related...  ...distributed computing, large-scale system design, networking and data... 
    Senior

    Google

    New York, NY
    1 day ago
  • $262k - $365k

    Senior Staff Software Engineer, Search Evaluation Infrastructure Development Note: By applying to this position...  ...agentic architectures, and generative AI evaluation methodologies. Experience...  ..., distributed computing, large-scale system design, networking and data storage,... 
    Senior
    Early shift

    Google

    New York, NY
    1 day ago
  •  ...technology company in New York is seeking a Mid-Senior level engineer to migrate and enhance a sophisticated...  ...and a strong background in distributed systems. This position offers competitive pay and the chance to work on cutting-edge AI features in a fast-paced environment. #J... 
    Senior

    Andiamo

    New York, NY
    1 day ago
  •  ...the last few years making production LLM systems actually work - not prototyping, not...  ...want to do that at a company where the AI is the product, this is worth reading. We...  ...infrastructure behind the product and hiring a senior engineer to help lead that. This is not a... 
    Senior

    HartleyCo

    New York, NY
    1 day ago
  • Boosted.ai is seeking a Senior Software Engineer to design and build advanced software for its finance analytics platform. You will lead end-to-end development...  ...strong CS fundamentals, and a track record in scalable systems. We value problem-solving, communication, and a bias... 
    Senior

    Boosted.ai

    New York, NY
    1 day ago
  •  ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and... 
    Senior

    Reflection

    New York, NY
    3 days ago
  • $320k

    Anthropic is searching for a Software Engineer for the Launch Engineering team based in New York. This role involves managing deployment orchestration...  ...to ensure automated and efficient movements of validated inference builds into production. Successful candidates will have... 
    Senior

    Anthropic

    New York, NY
    1 day ago
  • $117.2k - $313.7k

    Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software Engineer posting...  ...prompts and cultivate the system context that makes AI outputs reliable, secure, and production‑ready. Your... 
    Senior

    salesforce.com, inc.

    New York, NY
    1 day ago
  • $230k - $350k

    Fractional AI, based in New York and San Francisco, seeks an engineering leader to work on AI products. In this high-impact role, you'll collaborate closely with...  ...engineering experience is required, with a focus on AI systems. You'll enjoy competitive compensation ranging... 
    Senior

    Fractional AI

    New York, NY
    1 day ago
  • Integral Ad Science is seeking a Senior Manager, Engineering in New York, NY to lead technical solutions in AI. You'll guide and mentor a team of...  ...candidate has extensive experience in software development, team leadership, and AI systems. A competitive benefits package... 
    Senior

    Integral Ad Science

    New York, NY
    3 days ago
  • An innovative AI startup in New York City is looking for a Senior Software Engineer to lead the development of AI-driven systems. The role involves architecting scalable solutions and integrating AI technologies to enhance enterprise software. Ideal candidates should have... 
    Senior

    Standard Template Labs

    New York, NY
    1 day ago
  • A health tech company is seeking an AI Engineer to build systems for AI experiences, particularly in LLM-driven workflows and orchestration layers. The role involves designing AI patterns, maintaining orchestration layers, and creating data pipelines to enhance interactions... 
    Senior

    Blooming Health

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff Software Engineer — AI Inference Systems. Be the first to apply!