Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, ML Inference & Scale

$425k

Anthropic

A leading AI company in San Francisco is seeking an Engineering Manager to lead engineering efforts on performance and scaling teams. You will oversee day-to-day execution, improve model performance, and support team members' growth. Ideal candidates have management experience in a technical environment and a strong background in machine learning. This role offers competitive compensation, including an annual salary range of $425,000—$560,000 USD. #J-18808-Ljbffr Anthropic

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, ML Inference & Scale in San Francisco, CA vacancy
  • $200k - $300k

     .... We tear down complexity, latency, and scale barriers that have traditionally constrained ML capabilities. Our platform combines Rust...  ...founders, you'll lead a team of exceptional engineers building our platform for real-time inference at scale. This role is a unique... 
    Suggested
    Work at office
    Flexible hours

    CHALK INC

    San Francisco, CA
    14 hours ago
  • Engineering Manager, GPU (ML Accelerator) About Anthropic Anthropic’s mission is to create reliable, interpretable...  ...the role Anthropic’s performance and scaling teams focus on making the most...  ...use of our compute resources, be it inference or training. As an Engineering... 
    Suggested
    Visa sponsorship

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...About the Role We are seeking an experienced Engineering Manager to lead the Cloud Inference team for AWS. You will lead your team to scale and optimize Claude to serve the massive audiences of developers and enterprise companies using AWS. You will own the end-to-end... 
    Suggested

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    14 hours ago
  • $405k

     ...committed researchers, engineers, policy experts, and business...  ...As the Engineering Manager for Data Architecture,...  ...training and complex inference workloads across all cloud...  ...that handle petabyte‑scale datasets with high reliability...  ...: Partner with ML, Product, and Legal teams... 
    Suggested
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours

    job-boards.greenhouse.io- JobBoard

    San Francisco, CA
    2 days ago
  • Join to apply for the Senior Engineering Manager, AI role at Jobright.ai 1 day ago Be among the first...  ...in software engineering or AI/ML development, with at least 3 years in a...  ...chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical... 
    Suggested
    Full time
    H1b

    Jobright.ai

    San Francisco, CA
    5 days ago
  • $224k - $280k

     .... The Opportunity We're looking for an Engineering Manager to lead Grow's newly formed AI Enablement...  ...hands‑on experience building AI/ML infrastructure, LLM‑powered systems, or...  ...move fast, and build systems designed to scale beyond your direct involvement You're a... 
    Full time
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours
    Day shift

    Grow Therapy

    San Francisco, CA
    2 days ago
  •  ...combination of inventive research, design, and engineering. Our organization is very flat, and our...  ...for how we train and evaluate models at scale, stay close enough to the code to debug...  ...that trains, evaluates, or serves ML models in production. You have strong infrastructure... 

    Cursor

    San Francisco, CA
    2 days ago
  • $223k - $307k

     ...Location Type Hybrid Department Engineering Compensation San Francisco: $...  ...an experienced Engineering Manager to lead our AI Game Engine team...  ...team of software and ML engineers building the systems...  ...impactful features. Build and scale systems and services to enable... 
    Full time
    Work at office
    Work from home
    Relocation
    Visa sponsorship
    Flexible hours

    Volley

    San Francisco, CA
    2 days ago
  •  ...signature company in San Francisco seeks a Director of Engineering for Search. You will architect the discovery engine for critical agreements, managing a high-performing engineering team while ensuring advanced ML features integrate seamlessly. The role requires over 1... 
    Work at office
    Remote work

    Docusign

    San Francisco, CA
    5 days ago
  • $165k - $330k

     ...powers mission‑critical inference for the world's most...  ...help build the platform engineers turn to to ship AI products...  ...Role As an Engineering Manager for Baseten's Platform...  ...experience at scale. Excellent developer tool...  ...Exposure to a variety of ML startups, offering unparalleled... 
    Flexible hours

    Baseten

    San Francisco, CA
    2 days ago
  • A prominent delivery logistics company seeks an Engineering Manager to lead the AI/ML team in New York. The manager will be responsible for driving the design and deployment of AI solutions that enhance merchant experiences. Candidates should have 7+ years in machine learning... 

    DoorDash USA

    San Francisco, CA
    2 days ago
  • $220k - $250k

    Join to apply for the Senior Engineering Manager, Multimodal AI Editors role at Labelbox 2 days ago...  ...to produce high-quality training data at scale Frontier Data Labeling Service: Specialized...  ...00 2 weeks ago Director of Engineering, ML Infrastructure Mountain View, CA $222,77... 
    Full time
    Work at office
    Flexible hours
    2 days per week

    Labelbox

    San Francisco, CA
    5 days ago
  • $220k - $240k

     ...experienced group of data scientists, engineers, and product managers to build highly available and scalable...  ...blockchain transaction activity at petabyte scale, and ultimately work to build a safer...  ...: ability to leverage modern AI/ML tools and workflows to accelerate engineering... 
    Immediate start
    Remote work
    Worldwide

    TRM Labs

    San Francisco, CA
    1 day ago
  •  ...learning systems reliably and at scale — from feature stores and...  ...deployment frameworks and inference tooling. We are in the midst...  ...establishing a standardized ML Ops “golden path.” Our mission...  ...experiences. As the Engineering Manager for Machine Learning Infrastructure... 
    Shift work

    Plaid

    San Francisco, CA
    more than 2 months ago
  • $126k - $216k

     ...Senior Manager, Engineering As a Senior Manager, Engineering, you will provide technical leadership...  ...a proven track record of building and scaling AI systems from the ground up. You are...  ..., non-public education records, and inferences drawn from your PI. We collect your PI... 
    Full time

    Integral Ad Science

    San Francisco, CA
    4 days ago
  • $185k - $210k

     ...Engineering Manager, Buying & Optimization Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help transform the antiquated...  ...campaign reliability—solving complex, real-world problems at scale in a fast-moving AdTech environment. You will be accountable... 
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    14 hours ago
  •  ...Jobs is seeking a Principal Machine Learning Engineer to set the technical standard for ML systems across training, inference, evaluation and deployment. This 100% remote...  ...and production pipelines. You will own large‑scale ML systems, optimize GPU memory and latency,... 
    Remote job

    Ginas Tech Jobs

    San Francisco, CA
    2 days ago
  • $122.4k - $228k

     ...Cloud, AI & Data Security Engineer role who wants to...  ...across AWS, Azure, and AI/ML platforms . We need...  ..., provide assurance to management and auditors, and ensure...  ...training environments, and inference endpoints Knowledge...  ...management for large-scale data environments... 
    Contract work
    Part time
    Local area

    BMO Financial Group

    San Francisco, CA
    3 days ago
  • $220k - $240k

     ...team collaborates with data scientists, engineers, and product managers to build highly available and scalable...  ...transaction activity at petabyte scale and work to build a safer financial system...  ...: ability to leverage modern AI/ML tools and workflows to accelerate engineering... 

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  •  ...technology firm in San Francisco is seeking a VP of Engineering to lead its technical organization through rapid scaling. The ideal candidate will have 10-15 years of...  ...in fintech, and a strong background in managing high-performing engineering teams. Responsibilities... 
    Flexible hours

    Kody Group

    San Francisco, CA
    1 day ago
  • Doximity, the leading healthcare network, seeks a Senior Data Engineer to build and scale data pipelines, collaborate with product and ML teams, and drive data-driven insights across the organization. You will oversee a team of engineers, balance hands-on work with mentoring... 
    Remote job

    Doximity

    San Francisco, CA
    1 day ago
  •  ...Title: Principal Infrastructure Engineer San Francisco, CA - Hybrid...  ...operated across environments-primarily managed Kubernetes, often in customer-...  ...experience building and operating large-scale distributed systems, including data and ML infrastructure, to help deliver a... 

    SWITS DIGITAL Private Limited

    San Francisco, CA
    4 days ago
  • $2,000 per month

     ...implementing this at Enterprise scale. We're here to make it a...  ...is to build a world where AI/ML and analytics are powered by decentralized...  ...a Principal Infrastructure Engineer , you will help lead and...  ...automation for provisioning and managing the Nextdata OS in multiple... 

    NextData

    San Francisco, CA
    2 days ago
  • Baseten is looking for an Engineering Manager (Player & Coach) to lead and mentor a team of Forward Deployed Engineers. This role entails building, scaling, and optimizing LLM inference workloads. Responsibilities include technical ownership, team management, and collaboration... 

    Baseten

    San Francisco, CA
    2 days ago
  • Join to apply for the Engineering Manager role at Heidi Health Join to apply for the Engineering...  ...As we expand our global reach, we’re scaling our enterprise capabilities to serve large...  ...of interviewing at Heidi Health by 2x Inferred from the description for this job... 
    Full time
    Local area
    Flexible hours

    Heidi Health

    San Francisco, CA
    5 days ago
  • $237k - $288k

     ...urgency, who believe in the scale of our ambition and thrive on...  ...with us at Crusoe. Senior Engineering Manager, Compute San Francisco, Sunnyvale...  ...HPC projects. AI/ML Workload Expertise: Direct experience...  ...Model (LLM) training and inference at scale. Benefits... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $232k - $319k

     ...Workflows Runtime builds the services and engine that empower our customers to execute billions...  ...GoLang, Typescript and Node.js on a large-scale, multi-cloud (AWS and GCP) Kubernetes environment. The Opportunity As the Sr. Manager of Engineering for Workflows Runtime, you... 
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    2 days ago
  • $237.6k - $288k

    About this role As an Engineering Manager on the Managed AI team at Crusoe, you will play a critical role in leading and scaling a team of engineers building our next-generation platform...  ...with CPU & GPU performance, inference frameworks, or LLM systems is a strong... 
    Work at office

    Crusoe Energy Systems

    San Francisco, CA
    2 days ago
  • Join to apply for the Senior Engineering Manager, Visitors role at Jobright.ai 1 day ago Be among the first 25 applicants Join to apply for...  ...increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical insurance Vision insurance... 
    16 hours
    Full time
    H1b
    Work at office

    Jobright.ai

    San Francisco, CA
    16 hours ago
  • $250.8k - $286.2k

     ...our applications of AI & ML are bringing humanity...  ...class applied science and engineering teams to deliver our...  ...scientists, technical program managers, and product managers...  ..., large language model inference, similarity search,...  ...throughput — of large-scale production AI systems.... 
    Full time
    Part time
    Local area

    Capital One

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, ML Inference & Scale. Be the first to apply!