Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff Engineer, AI Inference Systems

$320k

Anthropic

Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform, Claude. This position emphasizes maximizing compute efficiency and requires collaboration with a dynamic team to contribute to next-generation AI systems. The ideal candidate will have experience with machine learning infrastructure, distributed systems, and optimizing performance in a high-scale environment. The role requires a Bachelor’s degree and offers a competitive salary range of $320,000 to $485,000 per year. #J-18808-Ljbffr Anthropic

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Staff Engineer, AI Inference Systems in New York, NY vacancy
  • $168k - $270.25k

    NVIDIA is seeking a Senior Engineer in New York to design and build automation for NVIDIA Inference Microservices. You will create pipelines for AI models validated across cloud and on-prem environments...  ...experience in distributed systems, microservices, and strong... 
    Senior

    NVIDIA

    New York, NY
    3 days ago
  • Anthropic is looking for an experienced engineer to join the Inference Team in New York. The role involves designing and maintaining systems that serve Claude to millions of users worldwide, emphasizing distributed systems and machine learning infrastructure. Candidates... 
    Senior
    Worldwide

    Anthropic

    New York, NY
    3 days ago
  • $237k - $337k

    Google is seeking a Senior Staff Engineer to lead the development of products in their data and analytics portfolio in New York. The role involves...  ...in software development, specifically in Generative AI and machine learning. The position offers a base salary range... 
    Senior

    Google

    New York, NY
    3 days ago
  • A leading global e-commerce platform is seeking a Senior Staff Software Engineer, Machine Learning, to drive AI/ML strategies that enhance the connection between buyers and sellers. The role involves both technical leadership and mentorship within a research-focused team... 
    Senior
    Flexible hours

    Etsy

    New York, NY
    3 days ago
  • $180k - $350k

    Hume AI is seeking talented researchers and engineers interested in working with our AI research team to build state-of-the-art speech...  ...this role, you will build out software systems that support distributed model training, inference, and benchmarking as well as massive-... 
    Senior
    Visa sponsorship
    Work visa

    Hume AI

    New York, NY
    3 days ago
  • $227.2k - $417k

    Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning and Product teams to enhance their inference platforms. Candidates should have experience... 
    Flexible hours

    Tubi

    New York, NY
    3 days ago
  •  ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and... 
    Senior

    Reflection

    New York, NY
    5 days ago
  • $268k - $368.5k

     ...automation that lets product engineers build securely by default, without...  ...the data; and iterate. As a Senior Staff Software Engineer, Product...  ...leaders to influence system design, threat models, and architecture...  ...the latest enterprise AI tools, to help you work smarter... 
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    New York, NY
    3 days ago
  • Magnitude Consulting is seeking a Staff Software Engineer for an innovative AI healthcare startup in New York City. This position offers the opportunity...  ...for AI solutions. The role includes developing scalable systems and AI-powered workflows, with a competitive equity... 
    Senior

    Magnitude Consulting

    New York, NY
    3 days ago
  • $160k - $240k

    Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications...  ...engineering experience, expertise in distributed systems, and a strong understanding of performance optimization... 
    Senior

    Bloomberg

    New York, NY
    1 day ago
  • Ember Grey is seeking a Senior Staff Mechanical Engineer in New York, NY to work on advanced manufacturing technologies. This senior-level role involves designing and implementing high-precision machine systems while collaborating with multidisciplinary teams across various... 
    Senior

    Ember Grey

    New York, NY
    3 days ago
  • $180k - $220k

     ...network of outstanding restaurants. As a Senior Backend Engineer, you’ll be responsible for designing,...  ...aligned with business goals Contribute to system architecture and implement scalable,...  ...Experience productionizing generative AI features (e.g. retrieval-augmented generation... 
    Senior
    Full time
    Live out
    Flexible hours

    blackbird-labs-inc

    New York, NY
    2 days ago
  • $155k - $225k

     ...The Role We’re looking for a seasoned Senior/Staff Backend Engineer to join us as we continue to build Fora...  ...-facing website, content and supplier systems, internal admin tools, and external...  ...industry faces. We believe advancements in AI, bold investments in our platforms,... 
    Senior
    Full time
    Part time
    Work at office
    Work from home

    Fora Travel

    New York, NY
    2 days ago
  • Capital One seeks a Senior Lead AI Engineer to help build Gen AI platform services and responsible AI systems. You will collaborate with engineers, researchers, and product managers...  ...foundation model training and large model inference. You will leverage AWS, Huggingface,... 
    Senior

    Energy Jobline ZR

    New York, NY
    3 days ago
  • $214.2k - $252k

     ...understanding in healthcare. Our AI‑powered platform was purpose‑...  ...of AI across health systems. We are a growing team of practicing...  ..., technologists, and engineers working together to empower people...  ...experienced and highly motivated Senior or Staff Infrastructure Security... 
    Senior
    Hourly pay
    Full time
    Flexible hours

    Abridge

    New York, NY
    3 days ago
  • $200k - $240k

     ...business owners are the primary engine of wealth creation in the...  ...visibility into the business, and a system for acting on what they see....  ...to power our backend and AI infrastructure. Our core systems...  ...at least 10 years, given the seniority of the position). You should come... 
    Senior
    Remote work
    Home office
    Day shift

    Brillian

    New York, NY
    3 days ago
  • $200k - $300k

     ...geofencing SDKs, maps APIs, and AI-enabled solutions for...  ...role We're looking for Product Engineers to build features across backend...  ...two molds, technically: either Staff level expertise in one stack,...  ...code screen, coding round, and system design round. If those go well... 
    Senior
    Full time
    Work at office
    Remote work

    Radar

    New York, NY
    3 days ago
  •  ...in New York, NY is seeking a Staff Engineer to solve cross-team technical...  ...lead execution, and champion AI-augmented development practices...  ...own delivery of high-impact systems, set coding standards, drive AI tool adoption, and mentor senior engineers while partnering... 

    Alaffia Health

    New York, NY
    3 days ago
  •  ...in life, and the American healthcare system is completely broken - poor outcomes,...  ...led metabolic health clinic. We’re an AI‑native digital health system matching...  ...reward it. About the Role We are hiring a Senior or Staff Data Engineer to become the first dedicated data... 
    Senior
    Full time
    Work at office
    Remote work
    2 days per week
    3 days per week

    Nourish Inc

    New York, NY
    1 day ago
  • Scale AI is seeking a Senior Staff Forward Deployed AI Engineer based in New York City. You will act as a technical bridge between Scale AI's AI capabilities and...  ...in the successful integration and deployment of AI systems in production environments. #J-18808-Ljbffr Scale... 
    Senior

    Scale AI

    New York, NY
    3 days ago
  • $225k - $350k

    About Hypha Hypha is an AI-native platform transforming asset management across...  ...inefficiencies Role Overview As a Senior / Staff Frontend Engineer at Hypha, you’ll own the experience layer...  ...helping define the standards and systems that keep the frontend fast, cohesive... 
    Senior

    Hypha

    New York, NY
    3 days ago
  • $160k - $270k

     ...Role As a key member of our engineering team, you will have a significant...  ...of applications and systems we build across multiple platforms...  ...use artificial intelligence (AI) tools to support parts of the...  ...processed, please contact us. Seniority level Not Applicable... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    FOL Management

    New York, NY
    1 day ago
  • $241k - $338k

     ...large-scale initiative bringing frontier AI models, massive compute, and frontier experimental...  ...roof. We're building a general‑purpose system to accelerate scientific discovery,...  ...our compute capacity, AI research and engineering, and state‑of‑the‑art technology for measuring... 
    Senior
    Worldwide
    Relocation package

    Biohub

    New York, NY
    1 day ago
  • $175k - $250k

     .... As the only vertically integrated AI infrastructure company built from the...  ...Crusoe Cloud is seeking a Sr. to Senior Staff level Solutions Engineer to work closely with our most strategic...  ...) on Kubernetes—especially for inference and model training workflows. Hands... 
    Senior
    Full time
    Temporary work
    Work at office

    Crusoe

    New York, NY
    5 days ago
  • $218k - $273k

    Scale AI is the data foundation for AI, helping organizations build and deploy...  ...into reliable, production-grade systems that drive real economic value. Our...  ...many customers. About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General Agents team, you... 
    Senior
    Full time
    Contract work
    For contractors
    For subcontractor
    Work at office

    Scale AI

    New York, NY
    3 days ago
  • A prominent AI organization is seeking a Senior Staff Software Engineer to shape the technical direction of its Claude API. This high-impact role involves leading...  ...experience with strong expertise in distributed systems and a proven ability to influence and lead technical... 
    Senior
    Flexible hours

    anthropic

    New York, NY
    3 days ago
  • $248.4k - $310.5k

    A leading AI technology firm is seeking a Staff Software Engineer for their Enterprise GenAI platform. The ideal candidate will have over 7 years of experience...  ...-versed in software engineering and large-scale systems. Responsibilities include owning new product areas... 
    Senior

    Scale AI

    New York, NY
    4 days ago
  • Stripe in New York, NY, is seeking a Senior Staff Engineer for the Merchant Experience team. This role...  ..., ensuring quality and integration of AI technologies. Ideal candidates have 10-...  ...knowledge of both frontend and backend systems. This position supports hybrid work,... 
    Senior

    Stripe

    New York, NY
    3 days ago
  • $288k - $321k

    Gusto is seeking a Staff Machine Learning Engineer (MLE) in New York City to design and develop a scalable AI platform. The role involves leading technical strategy, collaborating...  ...have over 12 years of experience in AI/ML systems deployment, strong Python skills, and a... 
    Senior
    Remote job

    Gusto

    New York, NY
    3 days ago
  • A leading AI infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal candidates will have over 5 years of experience in writing high-quality code and familiarity with... 

    Modal

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff Engineer, AI Inference Systems. Be the first to apply!