Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Inference Systems at Scale

$300k

Anthropic

A forward-thinking AI company in San Francisco is seeking an experienced software engineer to join their Inference team. The role focuses on building and optimizing systems for AI model deployment, with a strong emphasis on technical excellence and societal impact. Candidates should possess solid software engineering experience, particularly in distributed systems, and be eager to work in a collaborative environment. Competitive salary range of $300,000 to $485,000 USD and hybrid work policy are offered. #J-18808-Ljbffr Anthropic

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Inference Systems at Scale in San Francisco, CA vacancy
  • Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related frameworks to push the bleeding edge of AI performance. This... 
    Suggested

    Vast.ai Inc.

    San Francisco, CA
    1 day ago
  • $300k

    # Staff + Sr. Software Engineer, InferenceJob Type / Location: San FranciscoExperience...  ..., and steerable AI systems. We want AI to be safe and...  ...systems.About the roleOur Inference team is responsible for building...  ...with:High-performance, large-scale distributed systemsImplementing... 
    Suggested
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $300k

     ...and steerable AI systems. We want AI to be...  ...committed researchers, engineers, policy experts,...  ...the role Our Inference team is responsible...  ...Have significant software engineering experience...  ...performance, large-scale distributed...  ...Currently, we expect all staff to be in one of... 
    Suggested
    Full time
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $320k

     ...and steerable AI systems. We want AI to be...  ...committed researchers, engineers, policy experts,...  ...is to make inference deployment boring...  ...unattended. As a Software Engineer on Launch...  ...strategies for large-scale deployments across...  ...Currently, we expect all staff to be in one of... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    1 day ago
  • $405k

     ...and steerable AI systems. We want AI to be...  ...committed researchers, engineers, policy experts,...  ...Role Anthropic's Inference organization serves...  ...are looking for a Staff Engineer to be a...  ...spanning serving, scaling, and accelerator teams...  ...Have significant software engineering... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $228k - $290k

     ...time, integrating deeply with EMR systems. Role Overview Abridge’s services and engineering team are in hyperscale mode. We are looking for experienced software engineers to help improve the...  ...engineering enablement and software scaling. Back‑end engineering experience... 
    Hourly pay
    Full time
    Flexible hours

    Abridge

    San Francisco, CA
    1 day ago
  •  ...deployment of AI across health systems. We are a growing team of...  ...creatives, technologists, and engineers working together to empower people...  ...are looking for experienced software engineers to join our team...  ...security, will be under tremendous scale, and presents many... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $225k

    Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems...  ...engineering fundamentals and experience with large-scale systems. Compensation includes a competitive salary... 

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  • $300k

     ...interpretable, and steerable AI systems. We want AI to be...  ...researchers, engineers, policy experts, and...  ...About The Role The Cloud Inference team scales and optimizes Claude...  ...You Have significant software engineering...  ...Currently, we expect all staff to be in one of our offices... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is looking for an experienced Engineering Manager to lead the Cloud Inference team for AWS. In this role, you will manage the end-to-end product...  ...over 10 years of experience in high-scale software development and at least 5 years in... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance for ML...  ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • Gravity Engineering Services Pvt Ltd. is seeking a Staff + Sr. Software Engineer for its San Francisco office. You will be integral...  ...to building and maintaining the systems that support our AI models, focusing on high-performance inference and distributed systems. The... 
    Work at office

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $208.45k - $364.8k

    Pinterest is seeking an experienced Backend Engineer to join the Cache Infra team in San Francisco. The role involves leading a high-performing team to build and maintain large-scale caching systems critical to the company's operations. Candidates should have a bachelor... 
    Work at office

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is seeking a Staff Software Engineer to enhance its messaging infrastructure...  ...reliability and performance of systems, promoting event-driven architectures....  ...engineering, particularly in internet-scale applications. The position offers comprehensive... 
    Flexible hours

    Flawless Youth

    San Francisco, CA
    1 day ago
  • $235k - $275k

     ...rapidly growing tech company in San Francisco is seeking a Staff Software Engineer to enhance the connection between students and...  ...include leading the development of consumer features, scaling distributed systems, and mentoring team members. The ideal candidate has over... 

    Handshake

    San Francisco, CA
    1 day ago
  • $253.9k - $298.7k

     ...Payments strategy, focusing on technical and operational excellence in large-scale distributed systems. The role involves enhancing the Payments platform's efficiency while mentoring engineers and ensuring high levels of service reliability. With an expected background... 

    Coinbase

    San Francisco, CA
    1 day ago
  • Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply adding more hardware isn't the answer. We're partnering...  ...inference that's faster, more efficient and built to scale. You’ll be: Building and optimising high-performance... 

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  •  ...deliver, and govern AI at scale. DataRobot empowers...  ...’s Fleet team is the engine behind how our platform...  ...you come in. As a Staff Software Engineer, you’ll be responsible...  ...our control plane systems, influence cross‑team...  ...for training and inference. Why Join the Fleet Management... 
    Worldwide
    Flexible hours

    DataRobot

    San Francisco, CA
    5 hours ago
  • $235k - $275k

     ...025, we tripled our ARR at scale. Why Join Handshake Now Shape...  ...About The Role As a Staff Software Engineer on the Consumer Experience...  ...Architect and scale distributed systems to support millions of users...  ...entity resolution and real‑time inference Experience building AI‑... 
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    1 day ago
  • $265k

     ...make better decisions, and scale with precision. With $300B+...  ...of the time. Senior Staff Software Engineer Location: Americas (preferably...  ...and evolution of the core systems that power Juniper Square —...  ...AI workloads, from inference pipelines to agent fleets... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    GrabJobs

    San Francisco, CA
    4 days ago
  •  ...AI is seeking a Lead Research Engineer in San Francisco to optimize...  ...infrastructure for training and inference workloads. This role involves...  ...improvements across ML systems and collaborating with cross-...  ...substantial experience with large-scale workloads. The position... 
    Flexible hours

    Lightning AI

    San Francisco, CA
    1 day ago
  • Who are we? Our mission is to scale intelligence to serve...  ...enterprises who are building AI systems to power magical experiences...  ...looking for a Site Reliability Engineer to join the Model Serving team...  ...influence latency and throughput of inference. Strong understanding or... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    1 day ago
  •  ...information from complex documents at scale. We have a breakthrough...  ...small, fast-growing team of engineers in San Francisco powering...  ...low-latency, high-throughput inference for OCR and multimodal models...  ...performance engineering or ML systems Strong Python, plus C++ or CUDA... 
    Work at office
    Visa sponsorship
    Relocation package

    Trypulse

    San Francisco, CA
    1 day ago
  • $310k

    About the Team OpenAI's Inference team powers the...  ..., fast-moving team of engineers focused on delivering...  ...Role We're looking for a software engineer to help us serve...  ...multimodal models at scale. You'll be part of a small...  ...and optimize the systems that let users generate... 

    OpenAI

    San Francisco, CA
    1 day ago
  • $180k - $360k

     ...powers mission‑critical inference for the world’s most...  ...help build the platform engineers turn to to ship AI...  ...runtime that powers large‑scale LLM inference across...  ...intersection of distributed systems, model performance,...  ...ease of use. As a Software Engineer on the Inference... 
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  • Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates... 
    Full time

    Vast.ai

    San Francisco, CA
    1 day ago
  • Senior Staff Engineers — Multiple Tracks Series A ($120M)...  ...next generation of AI systems. Having recently closed...  ...Series A, we’re scaling our team rapidly across...  ...supporting AI training and inference workloads. Implement...  ...of professional software engineering experience... 
    Remote job

    Incendia Partners

    San Francisco, CA
    1 day ago
  • $405k

     ...and steerable AI systems. We want AI to be...  ...committed researchers, engineers, policy experts,...  ...team and help scale our privacy infrastructure...  ...AI training and inference systems handling...  ...experience in a Software Engineer role, building...  ..., we expect all staff to be in one of... 
    Internship
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    1 day ago
  • $248.4k - $310.5k

    Staff Software Engineer, Enterprise GenAI Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative...  ...provides APIs for knowledge retrieval, inference, evaluation, and more. We are...  ...experience with large-scale distributed systems. You will be responsible for... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $405k

     ...broadly. We're looking for a Staff+ Engineer to anchor our Enterprise...  ...Claude enterprise-ready at scale. When a Fortune 500 company...  ...Claude to 100,000 employees, the systems and products that you design...  ...Partner other teams such as Inference and Platform for... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Inference Systems at Scale. Be the first to apply!