Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI Infra Engineer, Foundation Model Inference

Neon

Databricks is hiring across multiple AI Engineering teams to build the platforms and products that power data apps, AI agents, model training, model serving, and vector search. Join a high-agency team delivering scalable AI infrastructure for enterprise-scale workloads. The FMAPI team will drive roadmap-to-execution work, collaborating with platform, infra, and ML groups to deliver end-to-end experiences for developers and data scientists building AI applications. #J-18808-Ljbffr Neon

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff AI Infra Engineer, Foundation Model Inference in San Francisco, CA vacancy
  • $250k - $320k

    (Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a...  ...inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled... 
    Suggested
    Permanent employment
    Full time

    Together Computer Inc

    San Francisco, CA
    10 hours ago
  • $190k - $265k

     ...about enabling data and AI teams to solve the...  ...business. Founded by engineers — and customer-obsessed...  ...apps, AI agents, model training, model serving...  ...generation of AI.The Foundation Model Inference team is the backbone...  ...workloadsCollaborate with platform, infra, and ML teams to... 
    Foundation
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    5 days ago
  • $190k - $265k

     ...about enabling data and AI teams to solve the...  ...business. Founded by engineers — and customer-obsessed...  ...apps, AI agents, model training, model serving...  ...generation of AI. The Foundation Model Inference team is the backbone...  ...with platform, infra, and ML teams to deliver... 
    Foundation
    Local area
    Worldwide

    Databricks Inc.

    San Francisco, CA
    1 day ago
  •  ...seeks highly autonomous backend/infrastructure engineers to power enterprise-scale model inference on the Mosaic AI platform. You will build and optimize LLM infrastructure...  ...latency at scale. Collaborate with platform, infra, and ML teams to deliver end-to-end experiences,... 
    Foundation

    Databricks

    San Francisco, CA
    1 day ago
  • Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and...  ...You will collaborate across platform, infra, and ML teams to deliver seamless end...  ...data scientists and developers building AI applications on Databricks. This role... 
    Suggested

    Databricks Inc.

    San Francisco, CA
    1 day ago
  •  ...next generation of enterprise AI infrastructure. As a Staff AI Infrastructure Engineer, you will design, build, and operate...  ...evaluation, and deployment of foundation models and autonomous AI agents. You...  ..., high‑performance inference, and enterprise AI platforms to... 
    Foundation

    Seekr

    San Francisco, CA
    1 day ago
  • Code Metal's engineering teams are building AI-driven code transpilation...  ...modernization, optimization, modeling and simulation...  .... They require foundations: models to serve,...  ...results to measure. As a Staff AI Platform...  ...enablement stack—from GPU inference serving through... 
    Foundation

    Code Metal, Inc.

    San Francisco, CA
    2 days ago
  • DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine...  ...inference fleets. Bring 5+ years of HPC or AI infra experience, deep Gen AI knowledge, and hands-on CUDA/Triton... 
    Remote job

    DigitalOcean

    San Francisco, CA
    1 day ago
  • Valerie Health is seeking a founding engineer in San Francisco to help shape the technical foundation of a healthcare AI startup. You will build a robust backend, integrate AI models across modalities, and craft polished user experiences that scale from inception to growth... 
    Foundation

    Valerie Health

    San Francisco, CA
    1 day ago
  • $192k - $260k

    A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams... 
    Foundation

    Databricks Inc.

    San Francisco, CA
    2 days ago
  •  ...building the human layer of AI. Our mission is to...  ...in multimodal AI for modeling human-to-human...  ...authenticity, we're creating the foundation for the next...  ...experienced Research Scientist/Engineer with a focus on model...  ...understanding of inference performance and GPU/accelerator... 
    Foundation
    Remote job
    Full time
    Relocation package
    Flexible hours

    Tavus

    San Francisco, CA
    24 days ago
  •  ...trillion-dollar Voice AI economy, providing real...  ...’s voice-native foundation models are accessed through cloud...  ...for a Senior Software Engineer - Model Evaluation & AI...  ...Partner with DevOps/Infra to stand up *ephemeral...  ...Research, model training, inference, and product teams to... 
    Foundation

    Deepgram

    San Francisco, CA
    4 days ago
  •  ...generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build,...  ..., and deployment of foundation models and autonomous AI agents...  ...infrastructure, high-performance inference, and enterprise AI...  ...services Strong production ML infra experience, executes... 
    Foundation
    Permanent employment
    Work experience placement
    Flexible hours

    Seekr

    San Francisco, CA
    1 day ago
  • Deepgram is seeking an experienced Platform Engineer to build and operate the hybrid infrastructure foundation for AI/ML research and product development. You will architect...  ..., enabling teams to train and deploy complex models at scale. You’ll collaborate with AI... 
    Foundation

    Deepgram

    San Francisco, CA
    4 days ago
  • $204k - $216k

     ...Job Description About Sapience AI Sapience AI is the collective intelligence...  ...at scale. You build and run the inference infrastructure that turns the models and reasoning behind MINERVA and...  ...AI, research, and platform engineering, and you make the difference between... 

    Sapience AI Corporation

    San Francisco, CA
    14 days ago
  • $188k - $275k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...Description Of The Team The Inference team is responsible for delivering high-performance model serving capabilities that meet...  ...are looking for an Applied AI Engineer to help us understand, measure,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    1 day ago
  • $215k - $260k

     ...the only vertically integrated AI infrastructure company built...  ...time making large language models run faster, cheaper, and more...  ...production. That means owning the inference stack end to end: profiling...  ...work directly with customer engineering teams to tailor deployments... 
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  • $270k - $325k

     ...organization specializing in advanced AI solutions that help...  ..., it is investing in the engineering foundations required to support reliable...  ...frameworks that coordinate language model requests, external tool...  ...foundation models, inference platforms, AI service providers... 
    Foundation

    Goliath Partners Inc.

    San Francisco, CA
    10 hours ago
  • $91.1k - $179.5k

     ...our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and...  ...pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT... 
    Foundation
    Local area

    Deloitte

    San Francisco, CA
    6 days ago
  • $122k - $240.5k

     ...our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and...  ...pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT... 
    Foundation
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    1 day ago
  • $230k - $390k

     ...platform for customer-facing AI agents, working with...  .... These values are the foundation of our work, and we are...  ...agents depend on foundation models to reason and act in real time. The Inference team builds the systems...  ...at scale.As a Software Engineer on Inference, you’ll... 
    Foundation
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    4 days ago
  •  ...contracting. Our technology is engineered from the ground up to...  ...-Language-Action models, foundation models, imitation...  ...pipelines for physical AI Taking recent research...  ...and fleet At Staff level, you'll also help...  ...Jetson / TensorRT / edge inference ~ Isaac Sim or other... 
    Foundation
    Immediate start
    Worldwide

    Civ Robotics inc.

    San Francisco, CA
    2 days ago
  • $197.3k - $225.1k

     ...AI Engineer 4 At Capital One, we are creating responsible and reliable...  ...: The Intelligent Foundations and Experiences (IFX) team is...  ...millions of customers. Our AI models and platforms empower teams...  ...training, large language model inference, agents and multi-agent workflows... 
    Foundation
    Full time
    Part time
    Local area

    Capital One

    San Francisco, CA
    1 day ago
  • Retool is seeking an AI Engineer to own model-driven behavior in production across product surfaces, shaping prompts, retrieval, routing, and tool...  ..., trustworthy AI features, collaborating with product and infra teams in a fast-paced environment. You’ll work with... 

    Retool

    San Francisco, CA
    1 day ago
  • Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms. You should... 

    CloudFlare

    San Francisco, CA
    3 days ago
  •  ...developing advanced GPU cloud infrastructure designed for large scale AI training and inference workloads. As one of the organization's early infrastructure engineers, you will play a foundational role in architecting and operating the systems that enable cutting edge... 

    Blue Signal Search

    San Francisco, CA
    1 day ago
  •  ...Devices seeks an Operating Systems Engineer focused on on-device inference to design, develop, and ship the OS...  ...reliable, responsive, and energy-efficient AI on consumer devices. You will...  ...inference runtimes, and research to adapt models to device constraints and production... 

    OpenAI

    San Francisco, CA
    1 day ago
  • $150k - $250k

    # Founding AI Infrastructure EngineerRemote (US)...  ...bringing on exceptional engineers to build the infrastructure...  ...ll own the engineering foundations for taking AI-powered...  .../runtime, data/model pipelines, APIs, observability...  ...in backend/platform/infra roles (or equivalent depth... 
    Foundation
    Full time

    Harden

    San Francisco, CA
    1 day ago
  • $231k - $340k

     ...combining frontier agentic AI, an enterprise-grade...  ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll...  ...operational excellence for AI inference. Design and improve Harvey...  ...build the infrastructure foundation for future model evaluation... 
    Foundation

    Harvey

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...help them hire. Founding AI Engineer Location San Francisco...  ...AI layer end-to-end - from models, prompting, retrieval, and...  ...scale. Optimize inference, latency, and infrastructure...  ...reliability. Establish technical foundations that can support future AI engineers... 
    Foundation
    Full time
    Work at office
    Immediate start
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI Infra Engineer, Foundation Model Inference. Be the first to apply!