Engineering Manager, Foundation Model Inference (FMAPI)
Databricks Inc.
Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems — from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks.The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads.Databricks is looking for an Engineering leader to lead part of our Foundation Model Inference organization. We are seeking a leader who can build strong teams, uphold a high technical bar, and drive execution on large multi-quarter initiatives in a fast-moving AI infrastructure environment.The impact you will haveLead and grow a team of talented, product-minded infrastructure Engineers working on Databricks Foundation Model Inference and Foundation Model API; The teams owns the systems powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama).Help shape the roadmap for products spanning real-time inference, provisioned throughput, and batch inference use cases.Partner closely with product and engineering leadership to deliver the right capabilities with strong reliability, quality, and service health.Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.Maintain a deep understanding of your team’s technical area and uphold a strong bar for architecture, implementation quality, and operational excellence.What we look forExperience managing and growing high-performing software engineering teams.Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services, with the ability to maintain quality even in areas you have not worked on personally.A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.Excellent communication, coaching, and hiring skills.BS in Computer Science or related field. Pay Range TransparencyDatabricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.Zone 1 Pay Range$190,000—$261,250 USDAbout DatabricksDatabricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.Our Commitment to Diversity and InclusionAt Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.ComplianceIf access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
$190k - $265k
...their business. Founded by engineers — and customer-obsessed — we... ...from data apps, AI agents, model training, model serving, and... ...Engineering org, including the FMAPI (Foundation Model APIs) team — the... ...across real-time and batch inference, powering model inference at...FoundationLocal areaWorldwide$166k - $225k
...business. Databricks’ Model Serving product provides... ...to deploy and manage AI/ML models — from traditional... ...-time, low-latency inference, governance, monitoring... ....As a Senior Engineer, you’ll play a critical... ...product experience and the foundational infrastructure of Model...FoundationLocal areaWorldwide$172.43k - $230.95k
...Role:The Senior Software Engineer for the AI Model Lifecycle team will play a... ...building a comprehensive managed platform for the entire application... ...-tuning systems for large foundation models (SFT, PEFT, LoRA,... ...on GPU systems and inference frameworks.Benefits:Competitive...FoundationTemporary work$298k - $368k
...diverse set of sensors, enabling engineers like you to (1) develop... ...real-world data, to (2) develop models and model training at scale,... ...development (LLM, VLM, or similar foundation models). ~ Proven expertise in low-latency on-device inference techniques and a deep...FoundationFull timeRemote work- ...and run AI agents and models directly in their workflows... .... AI fluency is the foundation we build on; it's core... .... As a full-stack engineer on the team, you’ll... ...infrastructure for model inference that is fast, reliable... ...engineers, product managers, and scientists to bring...FoundationFull timeWork at officeLocal areaMonday to FridayShift work
$192k - $260k
...data insights to improve their business. Foundation Model Serving is the API Product for hosting and serving frontier AI model inference for open source models like Llama, Qwen,... ...experience is necessary. We’re looking for engineers who have owned high scale operational...FoundationLocal areaWorldwide$249.5k - $273.5k
...Empathetic.Your RoleAs a Tech Lead Manager on our Agentic AI... ...Applied Research, Design, and Engineering leadership, you will lead a... ...emerging agent frameworks, inference optimization techniques, retrieval... ....Systems Background: Strong foundations in scaling distributed...FoundationWork at office- ...access our start-of-the-art AI models, allowing them to do things... ...performant and efficient model inference, as well as accelerating... ...Role We are looking for an engineer who wants to take the world's... ...researchers, engineers, and product managers to bring our latest...Full time
$220k - $320k
Help us make inference blazingly fast. If you love squeezing... ...specialized language models for companies that... ...ten‑person team of engineers who work in‑person in... ...continuous batching, KV cache management) Experience with... ...apply here on Ashby. #J-18808-Ljbffr SOLANA FOUNDATIONFoundationWork at office$58 - $63 per hour
...Research Intern, Model Shaping (Fall 2026) San Francisco, Amsterdam About The Role... ...) Robust and reliable evaluation of foundation model capabilities The Model... ...degree in Computer Science, Electrical Engineering, or a related field Strong knowledge...FoundationHourly payInternshipWork at office- ...Amsterdam.Description of the teamThe Dashboard Foundations team is the product platform team that... ...to build the platform of every product engineer’s dreams, with rich tooling,... ...level engineer before transitioning into management.1+ years of engineering management experienceDeep...FoundationWork experience placementLocal area
$240k - $300k
...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables... ...support you need to grow your career.Engineering at BrexEngineering at Brex is about... ...feature velocity with a durable technical foundation.Foster a people-centered culture on a...FoundationWork at officeRemote workWork from home$199k
...systems, and the roadmap from scratch.We are hiring a hands-on Engineering Manager to lead this team. This is a player-coach role: you will... ...raise your own and your team's leverageA strong technical foundation and the ability to guide architecture and review technical...FoundationFull timeWork at officeLocal areaRemote work$190k - $253.75k
...insights to improve their business. Founded by engineers — and customer obsessed — we leap at... ...organization builds and operates the foundation that runs all Data, AI and stateful workloads... ....We are looking for an Engineering Manager to lead a team responsible for critical...FoundationLocal areaImmediate startWorldwide$228.6k - $297.12k
...and fine-tuning deep learning and LLM models with on-demand GPUs. Whether it's a transformer... ...for drug discovery or a fine-tuned foundation model, customers use this team's... ...of-the-art frontier models.As a Senior Engineering Manager, you will lead the team owning both...FoundationLocal areaWorldwide$212k - $318k
...first experience Hinge Health. As the Engineering Manager for Enrollment, you’ll lead the mobile... ...Health starts from a strong, trusted foundation. You’ll own the Enrollment surface end... ...member data.Location & Hybrid Working Model — San FranciscoThis role is based in our...FoundationWork at officeLocal areaRemote workWorldwideFlexible hours3 days per week$2,000 per month
...& TeamWe’re looking for an Engineering Manager to lead the Data Infrastructure... ...science and statistical foundation who can connect advances in... ...discussing causal inference and statistical power with... ...inference, causal effects modeling, or heterogeneous treatment...FoundationHome office$176.6k - $239k
...partner some of the world’s leading AI model providers companies, AWS Sales, and several... ...development, cloud computing, systems engineering, infrastructure, security, networking, data... ..., exercise sound judgment, effectively manage stress and work safely and respectfully...FoundationLocal areaWorldwideFlexible hours- ...its core, Workato provides the trusted foundation for organizations to automate with confidence... ...is seeking a VP of Engineering, Developer Products & Platforms to lead... ...platform services.Partner with Product Management and executive leadership to shape platform...FoundationRemote workFlexible hours
- ...the first time ever, you can manage and automate every part of... ...technical and product-minded Engineering Manager (M7) to lead our Time... ...Management team. This is a foundational product area that sits at the... ...range of policies, accrual models, approval workflows, and regulatory...FoundationWork at officeFlexible hours3 days per week
- ...Engineering Manager As an Engineering Manager at Triumph, you'll lead and grow the team building the systems behind Triumph Arcade and... ...management and hiring accountability ~ Strong technical foundation — you've built backend, mobile, or full-stack systems and can...Foundation
$208.59k - $429.45k
...abilities, we’ll explore your foundational skills and how you... ...hiring, coaching, and developing engineers.Raise the bar on engineering... ...technologies.5+ years of engineering management experience leading strong... ...more about our working model.In-Office Requirement Statement...FoundationWork at officeLocal areaRelocationRelocation package$11 per hour
...massive scale of this market, most businesses manage their trading relationships and commerce... ..., we are looking to bring in an Engineering Manager . As an Engineering Manager at... ...ideas to life. You'll also help set the foundation for how we scale: our culture, our systems...Foundation- ...Senior Engineering Manager The products we build are used every day by radiologists making critical decisions with diagnoses that determine... ...production software at scale. ~ A strong engineering foundation where you started as a hands-on engineer and are still comfortable...FoundationFull timeFlexible hours
$220k - $250k
...that direct, respectful feedback is the foundation of trust and progress. We value... ...capitalized with many years of runway. The engineering team isn't siloed off from the rest of... ...~2 or more years of experience managing a team of software engineers (leading both...Foundation$252k - $315k
About Scale AIScale AI is the data foundation for AI, helping organizations build and deploy... ...Role OverviewAs a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the... ...AI workflowsDeploy and configure AI models and agents within customer security...FoundationFull time$260k - $325k
...an open source programming model that can simplify code, make... ...mission to be the reliable foundation of every developer’s toolbox... ...voice for Temporal in the AI engineering community. You’ll earn developers... ...and observability, and inference in real systems, including working...FoundationFull timeTemporary workPart timeWork at officeRemote workWork from homeHome office- ...computers. For the first time ever, you can manage and automate every part of the employee... ...Payroll Calculations team is the engine at the heart of payroll, responsible for... ...migrations, and motivate a team to build the foundation for our next phase of growth. You'll...FoundationTemporary workWork at officeWorldwideFlexible hoursShift work3 days per week
- ...healthcare needsAbout the RoleWe are seeking an experienced Engineering Manager to lead the development of the Sync Core. Synchronizer... ...of record and NexHealth’s harmonized central database. This foundation enables healthcare innovators to focus on improving patient...FoundationLive in
$257.5k
...deeply experienced software engineering executive to lead our cross-... ...engineering owns the shared foundation across Salesforce applications... ...leadership: engineering management, principal architects, shared... ...Availability & Reliability Operating Model: Defining availability SLAs,...FoundationFull timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Foundation Model Inference (FMAPI). Be the first to apply!
- foundation program manager San Francisco, CA
- foundation relations San Francisco, CA
- nonprofit foundation San Francisco, CA
- education foundation San Francisco, CA
- private foundation San Francisco, CA
- foundation manager San Francisco, CA
- executive director foundation San Francisco, CA
- national science foundation San Francisco, CA
- family foundation San Francisco, CA
- director of foundation relations San Francisco, CA


