Engineering Manager, Foundation Model Inference (FMAPI)
Databricks Inc.
Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems — from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks.The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads.Databricks is looking for an Engineering leader to lead part of our Foundation Model Inference organization. We are seeking a leader who can build strong teams, uphold a high technical bar, and drive execution on large multi-quarter initiatives in a fast-moving AI infrastructure environment.The impact you will haveLead and grow a team of talented, product-minded infrastructure Engineers working on Databricks Foundation Model Inference and Foundation Model API; The teams owns the systems powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama).Help shape the roadmap for products spanning real-time inference, provisioned throughput, and batch inference use cases.Partner closely with product and engineering leadership to deliver the right capabilities with strong reliability, quality, and service health.Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.Maintain a deep understanding of your team’s technical area and uphold a strong bar for architecture, implementation quality, and operational excellence.What we look forExperience managing and growing high-performing software engineering teams.Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services, with the ability to maintain quality even in areas you have not worked on personally.A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.Excellent communication, coaching, and hiring skills.BS in Computer Science or related field. Pay Range TransparencyDatabricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.Zone 1 Pay Range$190,000—$261,250 USDAbout DatabricksDatabricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn, X, YouTube, and Instagram.BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.Our Commitment to Diversity and InclusionAt Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.ComplianceIf access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.Applicant Privacy Notice
$190k - $265k
...their business. Founded by engineers — and customer-obsessed — we... ...from data apps, AI agents, model training, model serving, and... ...Engineering org, including the FMAPI (Foundation Model APIs) team — the... ...across real-time and batch inference, powering model inference at...FoundationLocal areaWorldwide- ...is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join... ...to deliver end-to-end experiences and shape the FMAPI product roadmap with direct engagement with #J-1...Foundation
$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams...Foundation$298k - $368k
...diverse set of sensors, enabling engineers like you to (1) develop... ...real-world data, to (2) develop models and model training at scale,... ...development (LLM, VLM, or similar foundation models). ~ Proven expertise in low-latency on-device inference techniques and a deep...FoundationFull timeRemote work- ...and run AI agents and models directly in their workflows... .... AI fluency is the foundation we build on; it's core... .... As a full-stack engineer on the team, you’ll... ...infrastructure for model inference that is fast, reliable... ...engineers, product managers, and scientists to bring...FoundationFull timeWork at officeLocal areaMonday to FridayShift work
$172.43k - $230.95k
...Role:The Senior Software Engineer for the AI Model Lifecycle team will play a... ...building a comprehensive managed platform for the entire application... ...-tuning systems for large foundation models (SFT, PEFT, LoRA,... ...on GPU systems and inference frameworks.Benefits:Competitive...FoundationTemporary work$166k - $225k
...business. Databricks’ Model Serving product provides... ...to deploy and manage AI/ML models — from traditional... ...-time, low-latency inference, governance, monitoring... ....As a Senior Engineer, you’ll play a critical... ...product experience and the foundational infrastructure of Model...FoundationLocal areaWorldwide$349k - $431k
...The mission of the Waymo AI Foundations team is to develop machine... ...demonstration, generative modeling, Bayesian inference, hierarchical learning,... ...help lead a team of research engineers to build the data flywheel... ...techniques. Focus on managing a team of scientists that...FoundationFull timeRemote work$192k - $260k
...data insights to improve their business. Foundation Model Serving is the API Product for hosting and serving frontier AI model inference for open source models like Llama, Qwen,... ...experience is necessary. We’re looking for engineers who have owned high scale operational...FoundationLocal areaWorldwide- ...About the Team Our Inference team brings OpenAI’s most capable research... ...our start-of-the-art AI models, allowing them to do things that... ...We are looking for an engineer who wants to take the world's... ...researchers, engineers, and product managers to bring our latest...Full time
$249.5k - $273.5k
...Empathetic.Your RoleAs a Tech Lead Manager on our Agentic AI... ...Applied Research, Design, and Engineering leadership, you will lead a... ...emerging agent frameworks, inference optimization techniques, retrieval... ....Systems Background: Strong foundations in scaling distributed...FoundationWork at office$220k - $320k
Help us make inference blazingly fast. If you love squeezing... ...specialized language models for companies that... ...ten‑person team of engineers who work in‑person in... ...continuous batching, KV cache management) Experience with... ...apply here on Ashby. #J-18808-Ljbffr SOLANA FOUNDATIONFoundationWork at office- ...Amsterdam.Description of the teamThe Dashboard Foundations team is the product platform team that... ...to build the platform of every product engineer’s dreams, with rich tooling,... ...level engineer before transitioning into management.1+ years of engineering management experienceDeep...FoundationWork experience placementLocal area
$240k - $300k
...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables... ...support you need to grow your career.Engineering at BrexEngineering at Brex is about... ...feature velocity with a durable technical foundation.Foster a people-centered culture on a...FoundationWork at officeRemote workWork from home$2,000 per month
...& TeamWe’re looking for an Engineering Manager to lead the Data Infrastructure... ...science and statistical foundation who can connect advances in... ...discussing causal inference and statistical power with... ...inference, causal effects modeling, or heterogeneous treatment...FoundationHome office$176.6k - $239k
...partner some of the world’s leading AI model providers companies, AWS Sales, and several... ...development, cloud computing, systems engineering, infrastructure, security, networking, data... ..., exercise sound judgment, effectively manage stress and work safely and respectfully...FoundationLocal areaWorldwideFlexible hours$199k
...systems, and the roadmap from scratch.We are hiring a hands-on Engineering Manager to lead this team. This is a player-coach role: you will... ...raise your own and your team's leverageA strong technical foundation and the ability to guide architecture and review technical...FoundationFull timeWork at officeLocal areaRemote work$190k - $253.75k
...insights to improve their business. Founded by engineers — and customer obsessed — we leap at... ...organization builds and operates the foundation that runs all Data, AI and stateful workloads... ....We are looking for an Engineering Manager to lead a team responsible for critical...FoundationLocal areaImmediate startWorldwide$228.6k - $297.12k
...and fine-tuning deep learning and LLM models with on-demand GPUs. Whether it's a transformer... ...for drug discovery or a fine-tuned foundation model, customers use this team's... ...of-the-art frontier models.As a Senior Engineering Manager, you will lead the team owning both...FoundationLocal areaWorldwide$212k - $318k
...first experience Hinge Health. As the Engineering Manager for Enrollment, you’ll lead the mobile... ...Health starts from a strong, trusted foundation. You’ll own the Enrollment surface end... ...member data.Location & Hybrid Working Model — San FranciscoThis role is based in our...FoundationWork at officeLocal areaRemote workWorldwideFlexible hours3 days per week- ...its core, Workato provides the trusted foundation for organizations to automate with confidence... ...is seeking a VP of Engineering, Developer Products & Platforms to lead... ...platform services.Partner with Product Management and executive leadership to shape platform...FoundationRemote workFlexible hours
$275k - $400k
...Job Description Job Description The Role As an Engineering Manager at Triumph, you'll lead and grow the team building the systems behind... ...management and hiring accountability ~ Strong technical foundation — you've built backend, mobile, or full-stack systems and...Foundation- ...the first time ever, you can manage and automate every part of... ...technical and product-minded Engineering Manager (M7) to lead our Time... ...Management team. This is a foundational product area that sits at the... ...range of policies, accrual models, approval workflows, and regulatory...FoundationWork at officeFlexible hours3 days per week
$280k - $410k
...Family. These values are the foundation of our work, and we are committed... ...of Google's earliest product managers and co-creator of Google Maps... ...to manage and grow a team of engineers, all while building highly... ...are compatible, and we model it in our actions and processes...FoundationFull timeFlexible hours- ...work, we'd love to meet you. About the Role As an early Engineering Manager at Unify GTM, you'll be stepping into a rare opportunity:... ...to bring bold ideas to life. You'll also help set the foundation for how we scale: our culture, our systems, and our standards...Foundation
- ...what creation looks like when models can move from an ambiguous... ...work spans full-stack product engineering, model integration, rendering... ...About the RoleAs Engineering Manager, Artifacts, you will lead and... ...building this product and technical foundation. You will manage a team of...Foundation
$208.59k - $429.45k
...abilities, we’ll explore your foundational skills and how you... ...hiring, coaching, and developing engineers.Raise the bar on engineering... ...technologies.5+ years of engineering management experience leading strong... ...more about our working model.In-Office Requirement Statement...FoundationWork at officeLocal areaRelocationRelocation package- ...focused on AI Safet y. The company is building next-generation open-weight foundation models with a mission to make advanced AI broadly accessible. Their team includes researchers, engineers, and operators from some of the world's leading AI labs and technology companies...Foundation
$405k
About the Role As the Engineering Manager for Data Architecture, you will... ...architect systems that support model training with customer... ...passionate about building foundational systems that enable a frontier... ...model training and complex inference workloads across all cloud...FoundationImmediate startVisa sponsorshipFlexible hours$252k - $315k
About Scale AIScale AI is the data foundation for AI, helping organizations build and deploy... ...Role OverviewAs a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the... ...AI workflowsDeploy and configure AI models and agents within customer security...FoundationFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Foundation Model Inference (FMAPI). Be the first to apply!
- nonprofit foundation San Francisco, CA
- foundation relations San Francisco, CA
- education foundation San Francisco, CA
- foundation manager San Francisco, CA
- private foundation San Francisco, CA
- family foundation San Francisco, CA
- national science foundation San Francisco, CA
- director of foundation relations San Francisco, CA
- foundation program officer San Francisco, CA
- foundation program manager San Francisco, CA



