Engineering Manager, ML Inference & Scale
$425kAnthropic
A leading AI company in San Francisco is seeking an Engineering Manager to lead engineering efforts on performance and scaling teams. You will oversee day-to-day execution, improve model performance, and support team members' growth. Ideal candidates have management experience in a technical environment and a strong background in machine learning. This role offers competitive compensation, including an annual salary range of $425,000—$560,000 USD. #J-18808-Ljbffr Anthropic
$200k - $300k
.... We tear down complexity, latency, and scale barriers that have traditionally constrained ML capabilities. Our platform combines Rust... ...founders, you'll lead a team of exceptional engineers building our platform for real-time inference at scale. This role is a unique...SuggestedWork at officeFlexible hours- Engineering Manager, GPU (ML Accelerator) About Anthropic Anthropic’s mission is to create reliable, interpretable... ...the role Anthropic’s performance and scaling teams focus on making the most... ...use of our compute resources, be it inference or training. As an Engineering...SuggestedVisa sponsorship
- ...About the Role We are seeking an experienced Engineering Manager to lead the Cloud Inference team for AWS. You will lead your team to scale and optimize Claude to serve the massive audiences of developers and enterprise companies using AWS. You will own the end-to-end...Suggested
$405k
...committed researchers, engineers, policy experts, and business... ...As the Engineering Manager for Data Architecture,... ...training and complex inference workloads across all cloud... ...that handle petabyte‑scale datasets with high reliability... ...: Partner with ML, Product, and Legal teams...SuggestedWork at officeImmediate startVisa sponsorshipFlexible hours- Join to apply for the Senior Engineering Manager, AI role at Jobright.ai 1 day ago Be among the first... ...in software engineering or AI/ML development, with at least 3 years in a... ...chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical...SuggestedFull timeH1b
$224k - $280k
.... The Opportunity We're looking for an Engineering Manager to lead Grow's newly formed AI Enablement... ...hands‑on experience building AI/ML infrastructure, LLM‑powered systems, or... ...move fast, and build systems designed to scale beyond your direct involvement You're a...Full timeWork at officeLocal areaRemote workHome officeFlexible hoursDay shift- ...combination of inventive research, design, and engineering. Our organization is very flat, and our... ...for how we train and evaluate models at scale, stay close enough to the code to debug... ...that trains, evaluates, or serves ML models in production. You have strong infrastructure...
$223k - $307k
...Location Type Hybrid Department Engineering Compensation San Francisco: $... ...an experienced Engineering Manager to lead our AI Game Engine team... ...team of software and ML engineers building the systems... ...impactful features. Build and scale systems and services to enable...Full timeWork at officeWork from homeRelocationVisa sponsorshipFlexible hours- ...signature company in San Francisco seeks a Director of Engineering for Search. You will architect the discovery engine for critical agreements, managing a high-performing engineering team while ensuring advanced ML features integrate seamlessly. The role requires over 1...Work at officeRemote work
$165k - $330k
...powers mission‑critical inference for the world's most... ...help build the platform engineers turn to to ship AI products... ...Role As an Engineering Manager for Baseten's Platform... ...experience at scale. Excellent developer tool... ...Exposure to a variety of ML startups, offering unparalleled...Flexible hours- A prominent delivery logistics company seeks an Engineering Manager to lead the AI/ML team in New York. The manager will be responsible for driving the design and deployment of AI solutions that enhance merchant experiences. Candidates should have 7+ years in machine learning...
$220k - $250k
Join to apply for the Senior Engineering Manager, Multimodal AI Editors role at Labelbox 2 days ago... ...to produce high-quality training data at scale Frontier Data Labeling Service: Specialized... ...00 2 weeks ago Director of Engineering, ML Infrastructure Mountain View, CA $222,77...Full timeWork at officeFlexible hours2 days per week$220k - $240k
...experienced group of data scientists, engineers, and product managers to build highly available and scalable... ...blockchain transaction activity at petabyte scale, and ultimately work to build a safer... ...: ability to leverage modern AI/ML tools and workflows to accelerate engineering...Immediate startRemote workWorldwide- ...learning systems reliably and at scale — from feature stores and... ...deployment frameworks and inference tooling. We are in the midst... ...establishing a standardized ML Ops “golden path.” Our mission... ...experiences. As the Engineering Manager for Machine Learning Infrastructure...Shift work
$126k - $216k
...Senior Manager, Engineering As a Senior Manager, Engineering, you will provide technical leadership... ...a proven track record of building and scaling AI systems from the ground up. You are... ..., non-public education records, and inferences drawn from your PI. We collect your PI...Full time$185k - $210k
...Engineering Manager, Buying & Optimization Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help transform the antiquated... ...campaign reliability—solving complex, real-world problems at scale in a fast-moving AdTech environment. You will be accountable...Work at office2 days per week- ...Jobs is seeking a Principal Machine Learning Engineer to set the technical standard for ML systems across training, inference, evaluation and deployment. This 100% remote... ...and production pipelines. You will own large‑scale ML systems, optimize GPU memory and latency,...Remote job
$122.4k - $228k
...Cloud, AI & Data Security Engineer role who wants to... ...across AWS, Azure, and AI/ML platforms . We need... ..., provide assurance to management and auditors, and ensure... ...training environments, and inference endpoints Knowledge... ...management for large-scale data environments...Contract workPart timeLocal area$220k - $240k
...team collaborates with data scientists, engineers, and product managers to build highly available and scalable... ...transaction activity at petabyte scale and work to build a safer financial system... ...: ability to leverage modern AI/ML tools and workflows to accelerate engineering...- ...technology firm in San Francisco is seeking a VP of Engineering to lead its technical organization through rapid scaling. The ideal candidate will have 10-15 years of... ...in fintech, and a strong background in managing high-performing engineering teams. Responsibilities...Flexible hours
- Doximity, the leading healthcare network, seeks a Senior Data Engineer to build and scale data pipelines, collaborate with product and ML teams, and drive data-driven insights across the organization. You will oversee a team of engineers, balance hands-on work with mentoring...Remote job
- ...Title: Principal Infrastructure Engineer San Francisco, CA - Hybrid... ...operated across environments-primarily managed Kubernetes, often in customer-... ...experience building and operating large-scale distributed systems, including data and ML infrastructure, to help deliver a...
$2,000 per month
...implementing this at Enterprise scale. We're here to make it a... ...is to build a world where AI/ML and analytics are powered by decentralized... ...a Principal Infrastructure Engineer , you will help lead and... ...automation for provisioning and managing the Nextdata OS in multiple...- Baseten is looking for an Engineering Manager (Player & Coach) to lead and mentor a team of Forward Deployed Engineers. This role entails building, scaling, and optimizing LLM inference workloads. Responsibilities include technical ownership, team management, and collaboration...
- Join to apply for the Engineering Manager role at Heidi Health Join to apply for the Engineering... ...As we expand our global reach, we’re scaling our enterprise capabilities to serve large... ...of interviewing at Heidi Health by 2x Inferred from the description for this job...Full timeLocal areaFlexible hours
$237k - $288k
...urgency, who believe in the scale of our ambition and thrive on... ...with us at Crusoe. Senior Engineering Manager, Compute San Francisco, Sunnyvale... ...HPC projects. AI/ML Workload Expertise: Direct experience... ...Model (LLM) training and inference at scale. Benefits...Full timeTemporary work$232k - $319k
...Workflows Runtime builds the services and engine that empower our customers to execute billions... ...GoLang, Typescript and Node.js on a large-scale, multi-cloud (AWS and GCP) Kubernetes environment. The Opportunity As the Sr. Manager of Engineering for Workflows Runtime, you...Local areaWorldwideFlexible hours$237.6k - $288k
About this role As an Engineering Manager on the Managed AI team at Crusoe, you will play a critical role in leading and scaling a team of engineers building our next-generation platform... ...with CPU & GPU performance, inference frameworks, or LLM systems is a strong...Work at office- Join to apply for the Senior Engineering Manager, Visitors role at Jobright.ai 1 day ago Be among the first 25 applicants Join to apply for... ...increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical insurance Vision insurance...16 hoursFull timeH1bWork at office
$250.8k - $286.2k
...our applications of AI & ML are bringing humanity... ...class applied science and engineering teams to deliver our... ...scientists, technical program managers, and product managers... ..., large language model inference, similarity search,... ...throughput — of large-scale production AI systems....Full timePart timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, ML Inference & Scale. Be the first to apply!
- data engineer machine learning San Francisco, CA
- machine learning San Francisco, CA
- machine learning intern San Francisco, CA
- internship machine learning San Francisco, CA
- machine learning researcher San Francisco, CA
- machine learning part time San Francisco, CA
- artificial intelligence - machine learning intern San Francisco, CA
- intern - quantum machine learning for quantum computing San Francisco, CA
- machine learning remote San Francisco, CA
- machine learning scientist San Francisco, CA

