Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Foundation Model Inference (FMAPI)

Databricks Inc.

Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems — from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks.The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads.Databricks is looking for an Engineering leader to lead part of our Foundation Model Inference organization. We are seeking a leader who can build strong teams, uphold a high technical bar, and drive execution on large multi-quarter initiatives in a fast-moving AI infrastructure environment.The impact you will haveLead and grow a team of talented, product-minded infrastructure Engineers working on Databricks Foundation Model Inference and Foundation Model API; The teams owns the systems powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama).Help shape the roadmap for products spanning real-time inference, provisioned throughput, and batch inference use cases.Partner closely with product and engineering leadership to deliver the right capabilities with strong reliability, quality, and service health.Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.Maintain a deep understanding of your team’s technical area and uphold a strong bar for architecture, implementation quality, and operational excellence.What we look forExperience managing and growing high-performing software engineering teams.Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services, with the ability to maintain quality even in areas you have not worked on personally.A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.Excellent communication, coaching, and hiring skills.BS in Computer Science or related field. Pay Range TransparencyDatabricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.Zone 1 Pay Range$190,000—$261,250 USDAbout DatabricksDatabricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.Our Commitment to Diversity and InclusionAt Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.ComplianceIf access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Foundation Model Inference (FMAPI) in San Francisco, CA vacancy
  • $190k - $265k

     ...their business. Founded by engineers — and customer-obsessed — we...  ...from data apps, AI agents, model training, model serving, and...  ...Engineering org, including the FMAPI (Foundation Model APIs) team — the...  ...across real-time and batch inference, powering model inference at... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    13 hours ago
  • $166k - $225k

     ...business. Databricks’ Model Serving product provides...  ...to deploy and manage AI/ML models — from traditional...  ...-time, low-latency inference, governance, monitoring...  ....As a Senior Engineer, you’ll play a critical...  ...product experience and the foundational infrastructure of Model... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $172.43k - $230.95k

     ...Role:The Senior Software Engineer for the AI Model Lifecycle team will play a...  ...building a comprehensive managed platform for the entire application...  ...-tuning systems for large foundation models (SFT, PEFT, LoRA,...  ...on GPU systems and inference frameworks.Benefits:Competitive... 
    Foundation
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $298k - $368k

     ...diverse set of sensors, enabling engineers like you to (1) develop...  ...real-world data, to (2) develop models and model training at scale,...  ...development (LLM, VLM, or similar foundation models). ~ Proven expertise in low-latency on-device inference techniques and a deep... 
    Foundation
    Full time
    Remote work

    Waymo

    San Francisco, CA
    17 hours ago
  •  ...and run AI agents and models directly in their workflows...  .... AI fluency is the foundation we build on; it's core...  .... As a full-stack engineer on the team, you’ll...  ...infrastructure for model inference that is fast, reliable...  ...engineers, product managers, and scientists to bring... 
    Foundation
    Full time
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    17 hours ago
  • $192k - $260k

     ...data insights to improve their business. Foundation Model Serving is the API Product for hosting and serving frontier AI model inference for open source models like Llama, Qwen,...  ...experience is necessary. We’re looking for engineers who have owned high scale operational... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $249.5k - $273.5k

     ...Empathetic.Your RoleAs a Tech Lead Manager on our Agentic AI...  ...Applied Research, Design, and Engineering leadership, you will lead a...  ...emerging agent frameworks, inference optimization techniques, retrieval...  ....Systems Background: Strong foundations in scaling distributed... 
    Foundation
    Work at office

    Dialpad

    San Francisco, CA
    1 day ago
  •  ...access our start-of-the-art AI models, allowing them to do things...  ...performant and efficient model inference, as well as accelerating...  ...Role We are looking for an engineer who wants to take the world's...  ...researchers, engineers, and product managers to bring our latest... 
    Full time

    OpenAI

    San Francisco, CA
    17 hours ago
  • $220k - $320k

    Help us make inference blazingly fast. If you love squeezing...  ...specialized language models for companies that...  ...ten‑person team of engineers who work in‑person in...  ...continuous batching, KV cache management) Experience with...  ...apply here on Ashby. #J-18808-Ljbffr SOLANA FOUNDATION
    Foundation
    Work at office

    SOLANA FOUNDATION

    San Francisco, CA
    1 day ago
  • $58 - $63 per hour

     ...Research Intern, Model Shaping (Fall 2026) San Francisco, Amsterdam About The Role...  ...) Robust and reliable evaluation of foundation model capabilities The Model...  ...degree in Computer Science, Electrical Engineering, or a related field Strong knowledge... 
    Foundation
    Hourly pay
    Internship
    Work at office

    Together AI

    San Francisco, CA
    1 day ago
  •  ...Amsterdam.Description of the teamThe Dashboard Foundations team is the product platform team that...  ...to build the platform of every product engineer’s dreams, with rich tooling,...  ...level engineer before transitioning into management.1+ years of engineering management experienceDeep... 
    Foundation
    Work experience placement
    Local area

    Plaid Financial

    San Francisco, CA
    13 hours ago
  • $240k - $300k

     ...cards and banking with intuitive spend management, bill pay, and travel software, Brex enables...  ...support you need to grow your career.Engineering at BrexEngineering at Brex is about...  ...feature velocity with a durable technical foundation.Foster a people-centered culture on a... 
    Foundation
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    1 day ago
  • $199k

     ...systems, and the roadmap from scratch.We are hiring a hands-on Engineering Manager to lead this team. This is a player-coach role: you will...  ...raise your own and your team's leverageA strong technical foundation and the ability to guide architecture and review technical... 
    Foundation
    Full time
    Work at office
    Local area
    Remote work

    Chime

    San Francisco, CA
    13 hours ago
  • $190k - $253.75k

     ...insights to improve their business. Founded by engineers — and customer obsessed — we leap at...  ...organization builds and operates the foundation that runs all Data, AI and stateful workloads...  ....We are looking for an Engineering Manager to lead a team responsible for critical... 
    Foundation
    Local area
    Immediate start
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $228.6k - $297.12k

     ...and fine-tuning deep learning and LLM models with on-demand GPUs. Whether it's a transformer...  ...for drug discovery or a fine-tuned foundation model, customers use this team's...  ...of-the-art frontier models.As a Senior Engineering Manager, you will lead the team owning both... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    13 hours ago
  • $212k - $318k

     ...first experience Hinge Health. As the Engineering Manager for Enrollment, you’ll lead the mobile...  ...Health starts from a strong, trusted foundation. You’ll own the Enrollment surface end...  ...member data.Location & Hybrid Working Model — San FranciscoThis role is based in our... 
    Foundation
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    Hinge Health

    San Francisco, CA
    13 hours ago
  • $2,000 per month

     ...& TeamWe’re looking for an Engineering Manager to lead the Data Infrastructure...  ...science and statistical foundation who can connect advances in...  ...discussing causal inference and statistical power with...  ...inference, causal effects modeling, or heterogeneous treatment... 
    Foundation
    Home office

    Amplitude

    San Francisco, CA
    2 days ago
  • $176.6k - $239k

     ...partner some of the world’s leading AI model providers companies, AWS Sales, and several...  ...development, cloud computing, systems engineering, infrastructure, security, networking, data...  ..., exercise sound judgment, effectively manage stress and work safely and respectfully... 
    Foundation
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    1 day ago
  •  ...its core, Workato provides the trusted foundation for organizations to automate with confidence...  ...is seeking a VP of Engineering, Developer Products & Platforms to lead...  ...platform services.Partner with Product Management and executive leadership to shape platform... 
    Foundation
    Remote work
    Flexible hours

    Workato

    San Francisco, CA
    13 hours ago
  •  ...the first time ever, you can manage and automate every part of...  ...technical and product-minded Engineering Manager (M7) to lead our Time...  ...Management team. This is a foundational product area that sits at the...  ...range of policies, accrual models, approval workflows, and regulatory... 
    Foundation
    Work at office
    Flexible hours
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  •  ...Engineering Manager As an Engineering Manager at Triumph, you'll lead and grow the team building the systems behind Triumph Arcade and...  ...management and hiring accountability ~ Strong technical foundation — you've built backend, mobile, or full-stack systems and can... 
    Foundation

    Triumph

    San Francisco, CA
    1 day ago
  • $208.59k - $429.45k

     ...abilities, we’ll explore your foundational skills and how you...  ...hiring, coaching, and developing engineers.Raise the bar on engineering...  ...technologies.5+ years of engineering management experience leading strong...  ...more about our working model.In-Office Requirement Statement... 
    Foundation
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $11 per hour

     ...massive scale of this market, most businesses manage their trading relationships and commerce...  ..., we are looking to bring in an Engineering Manager . As an Engineering Manager at...  ...ideas to life. You'll also help set the foundation for how we scale: our culture, our systems... 
    Foundation

    Nuvo

    San Francisco, CA
    1 day ago
  •  ...Senior Engineering Manager The products we build are used every day by radiologists making critical decisions with diagnoses that determine...  ...production software at scale. ~ A strong engineering foundation where you started as a hands-on engineer and are still comfortable... 
    Foundation
    Full time
    Flexible hours

    Rad AI

    San Francisco, CA
    3 days ago
  • $220k - $250k

     ...that direct, respectful feedback is the foundation of trust and progress. We value...  ...capitalized with many years of runway. The engineering team isn't siloed off from the rest of...  ...~2 or more years of experience managing a team of software engineers (leading both... 
    Foundation

    Verse Medical

    San Francisco, CA
    17 hours ago
  • $252k - $315k

    About Scale AIScale AI is the data foundation for AI, helping organizations build and deploy...  ...Role OverviewAs a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the...  ...AI workflowsDeploy and configure AI models and agents within customer security... 
    Foundation
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • $260k - $325k

     ...an open source programming model that can simplify code, make...  ...mission to be the reliable foundation of every developer’s toolbox...  ...voice for Temporal in the AI engineering community. You’ll earn developers...  ...and observability, and inference in real systems, including working... 
    Foundation
    Full time
    Temporary work
    Part time
    Work at office
    Remote work
    Work from home
    Home office

    Temporal Technologies

    San Francisco, CA
    13 hours ago
  •  ...computers. For the first time ever, you can manage and automate every part of the employee...  ...Payroll Calculations team is the engine at the heart of payroll, responsible for...  ...migrations, and motivate a team to build the foundation for our next phase of growth. You'll... 
    Foundation
    Temporary work
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Rippling

    San Francisco, CA
    2 days ago
  •  ...healthcare needsAbout the RoleWe are seeking an experienced Engineering Manager to lead the development of the Sync Core. Synchronizer...  ...of record and NexHealth’s harmonized central database. This foundation enables healthcare innovators to focus on improving patient... 
    Foundation
    Live in

    NexHealth

    San Francisco, CA
    2 days ago
  • $257.5k

     ...deeply experienced software engineering executive to lead our cross-...  ...engineering owns the shared foundation across Salesforce applications...  ...leadership: engineering management, principal architects, shared...  ...Availability & Reliability Operating Model: Defining availability SLAs,... 
    Foundation
    Full time
    Work at office

    Salesforce

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Foundation Model Inference (FMAPI). Be the first to apply!