Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Foundation Model Inference (FMAPI)

Databricks Inc.

Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems — from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks.The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads.Databricks is looking for an Engineering leader to lead part of our Foundation Model Inference organization. We are seeking a leader who can build strong teams, uphold a high technical bar, and drive execution on large multi-quarter initiatives in a fast-moving AI infrastructure environment.The impact you will haveLead and grow a team of talented, product-minded infrastructure Engineers working on Databricks Foundation Model Inference and Foundation Model API; The teams owns the systems powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama).Help shape the roadmap for products spanning real-time inference, provisioned throughput, and batch inference use cases.Partner closely with product and engineering leadership to deliver the right capabilities with strong reliability, quality, and service health.Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.Maintain a deep understanding of your team’s technical area and uphold a strong bar for architecture, implementation quality, and operational excellence.What we look forExperience managing and growing high-performing software engineering teams.Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services, with the ability to maintain quality even in areas you have not worked on personally.A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.Excellent communication, coaching, and hiring skills.BS in Computer Science or related field. Pay Range TransparencyDatabricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.Zone 1 Pay Range$190,000—$261,250 USDAbout DatabricksDatabricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn, X, YouTube, and Instagram.BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.Our Commitment to Diversity and InclusionAt Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.ComplianceIf access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.Applicant Privacy Notice

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Foundation Model Inference (FMAPI) in San Francisco, CA vacancy
  • $190k - $265k

     ...their business. Founded by engineers — and customer-obsessed — we...  ...from data apps, AI agents, model training, model serving, and...  ...Engineering org, including the FMAPI (Foundation Model APIs) team — the...  ...across real-time and batch inference, powering model inference at... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  •  ...is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join...  ...to deliver end-to-end experiences and shape the FMAPI product roadmap with direct engagement with #J-1... 
    Foundation

    Databricks

    San Francisco, CA
    2 days ago
  • $192k - $260k

    A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams... 
    Foundation

    Databricks Inc.

    San Francisco, CA
    13 hours ago
  • $298k - $368k

     ...diverse set of sensors, enabling engineers like you to (1) develop...  ...real-world data, to (2) develop models and model training at scale,...  ...development (LLM, VLM, or similar foundation models). ~ Proven expertise in low-latency on-device inference techniques and a deep... 
    Foundation
    Full time
    Remote work

    Waymo

    San Francisco, CA
    13 hours ago
  •  ...and run AI agents and models directly in their workflows...  .... AI fluency is the foundation we build on; it's core...  .... As a full-stack engineer on the team, you’ll...  ...infrastructure for model inference that is fast, reliable...  ...engineers, product managers, and scientists to bring... 
    Foundation
    Full time
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    13 hours ago
  • $172.43k - $230.95k

     ...Role:The Senior Software Engineer for the AI Model Lifecycle team will play a...  ...building a comprehensive managed platform for the entire application...  ...-tuning systems for large foundation models (SFT, PEFT, LoRA,...  ...on GPU systems and inference frameworks.Benefits:Competitive... 
    Foundation
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $166k - $225k

     ...business. Databricks’ Model Serving product provides...  ...to deploy and manage AI/ML models — from traditional...  ...-time, low-latency inference, governance, monitoring...  ....As a Senior Engineer, you’ll play a critical...  ...product experience and the foundational infrastructure of Model... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $349k - $431k

     ...The mission of the Waymo AI Foundations team is to develop machine...  ...demonstration, generative modeling, Bayesian inference, hierarchical learning,...  ...help lead a team of research engineers to build the data flywheel...  ...techniques. Focus on managing a team of scientists that... 
    Foundation
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  • $192k - $260k

     ...data insights to improve their business. Foundation Model Serving is the API Product for hosting and serving frontier AI model inference for open source models like Llama, Qwen,...  ...experience is necessary. We’re looking for engineers who have owned high scale operational... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  •  ...About the Team Our Inference team brings OpenAI’s most capable research...  ...our start-of-the-art AI models, allowing them to do things that...  ...We are looking for an engineer who wants to take the world's...  ...researchers, engineers, and product managers to bring our latest... 
    Full time

    OpenAI

    San Francisco, CA
    13 hours ago
  • $249.5k - $273.5k

     ...Empathetic.Your RoleAs a Tech Lead Manager on our Agentic AI...  ...Applied Research, Design, and Engineering leadership, you will lead a...  ...emerging agent frameworks, inference optimization techniques, retrieval...  ....Systems Background: Strong foundations in scaling distributed... 
    Foundation
    Work at office

    Dialpad

    San Francisco, CA
    2 days ago
  • $220k - $320k

    Help us make inference blazingly fast. If you love squeezing...  ...specialized language models for companies that...  ...ten‑person team of engineers who work in‑person in...  ...continuous batching, KV cache management) Experience with...  ...apply here on Ashby. #J-18808-Ljbffr SOLANA FOUNDATION
    Foundation
    Work at office

    SOLANA FOUNDATION

    San Francisco, CA
    2 days ago
  •  ...Amsterdam.Description of the teamThe Dashboard Foundations team is the product platform team that...  ...to build the platform of every product engineer’s dreams, with rich tooling,...  ...level engineer before transitioning into management.1+ years of engineering management experienceDeep... 
    Foundation
    Work experience placement
    Local area

    Plaid Financial

    San Francisco, CA
    1 day ago
  • $240k - $300k

     ...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables...  ...support you need to grow your career.Engineering at BrexEngineering at Brex is about...  ...feature velocity with a durable technical foundation.Foster a people-centered culture on a... 
    Foundation
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    2 days ago
  • $2,000 per month

     ...& TeamWe’re looking for an Engineering Manager to lead the Data Infrastructure...  ...science and statistical foundation who can connect advances in...  ...discussing causal inference and statistical power with...  ...inference, causal effects modeling, or heterogeneous treatment... 
    Foundation
    Home office

    Amplitude

    San Francisco, CA
    4 days ago
  • $176.6k - $239k

     ...partner some of the world’s leading AI model providers companies, AWS Sales, and several...  ...development, cloud computing, systems engineering, infrastructure, security, networking, data...  ..., exercise sound judgment, effectively manage stress and work safely and respectfully... 
    Foundation
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    2 days ago
  • $199k

     ...systems, and the roadmap from scratch.We are hiring a hands-on Engineering Manager to lead this team. This is a player-coach role: you will...  ...raise your own and your team's leverageA strong technical foundation and the ability to guide architecture and review technical... 
    Foundation
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    2 days ago
  • $190k - $253.75k

     ...insights to improve their business. Founded by engineers — and customer obsessed — we leap at...  ...organization builds and operates the foundation that runs all Data, AI and stateful workloads...  ....We are looking for an Engineering Manager to lead a team responsible for critical... 
    Foundation
    Local area
    Immediate start
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $228.6k - $297.12k

     ...and fine-tuning deep learning and LLM models with on-demand GPUs. Whether it's a transformer...  ...for drug discovery or a fine-tuned foundation model, customers use this team's...  ...of-the-art frontier models.As a Senior Engineering Manager, you will lead the team owning both... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $212k - $318k

     ...first experience Hinge Health. As the Engineering Manager for Enrollment, you’ll lead the mobile...  ...Health starts from a strong, trusted foundation. You’ll own the Enrollment surface end...  ...member data.Location & Hybrid Working Model — San FranciscoThis role is based in our... 
    Foundation
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    Hinge Health

    San Francisco, CA
    1 day ago
  •  ...its core, Workato provides the trusted foundation for organizations to automate with confidence...  ...is seeking a VP of Engineering, Developer Products & Platforms to lead...  ...platform services.Partner with Product Management and executive leadership to shape platform... 
    Foundation
    Remote work
    Flexible hours

    Workato

    San Francisco, CA
    1 day ago
  • $275k - $400k

     ...Job Description Job Description The Role As an Engineering Manager at Triumph, you'll lead and grow the team building the systems behind...  ...management and hiring accountability ~ Strong technical foundation — you've built backend, mobile, or full-stack systems and... 
    Foundation

    Triumph

    San Francisco, CA
    more than 2 months ago
  •  ...the first time ever, you can manage and automate every part of...  ...technical and product-minded Engineering Manager (M7) to lead our Time...  ...Management team. This is a foundational product area that sits at the...  ...range of policies, accrual models, approval workflows, and regulatory... 
    Foundation
    Work at office
    Flexible hours
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  • $280k - $410k

     ...Family. These values are the foundation of our work, and we are committed...  ...of Google's earliest product managers and co-creator of Google Maps...  ...to manage and grow a team of engineers, all while building highly...  ...are compatible, and we model it in our actions and processes... 
    Foundation
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    1 day ago
  •  ...work, we'd love to meet you. About the Role As an early Engineering Manager at Unify GTM, you'll be stepping into a rare opportunity:...  ...to bring bold ideas to life. You'll also help set the foundation for how we scale: our culture, our systems, and our standards... 
    Foundation

    Unify

    San Francisco, CA
    4 days ago
  •  ...what creation looks like when models can move from an ambiguous...  ...work spans full-stack product engineering, model integration, rendering...  ...About the RoleAs Engineering Manager, Artifacts, you will lead and...  ...building this product and technical foundation. You will manage a team of... 
    Foundation

    OpenAI

    San Francisco, CA
    4 days ago
  • $208.59k - $429.45k

     ...abilities, we’ll explore your foundational skills and how you...  ...hiring, coaching, and developing engineers.Raise the bar on engineering...  ...technologies.5+ years of engineering management experience leading strong...  ...more about our working model.In-Office Requirement Statement... 
    Foundation
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    2 days ago
  •  ...focused on AI Safet y. The company is building next-generation open-weight foundation models with a mission to make advanced AI broadly accessible. Their team includes researchers, engineers, and operators from some of the world's leading AI labs and technology companies... 
    Foundation

    Xcede

    San Francisco, CA
    4 days ago
  • $405k

    About the Role As the Engineering Manager for Data Architecture, you will...  ...architect systems that support model training with customer...  ...passionate about building foundational systems that enable a frontier...  ...model training and complex inference workloads across all cloud... 
    Foundation
    Immediate start
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  • $252k - $315k

    About Scale AIScale AI is the data foundation for AI, helping organizations build and deploy...  ...Role OverviewAs a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the...  ...AI workflowsDeploy and configure AI models and agents within customer security... 
    Foundation
    Full time

    Scale AI

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Foundation Model Inference (FMAPI). Be the first to apply!