Staff AI Infra Engineer, Foundation Model Inference
Neon
Databricks is hiring across multiple AI Engineering teams to build the platforms and products that power data apps, AI agents, model training, model serving, and vector search. Join a high-agency team delivering scalable AI infrastructure for enterprise-scale workloads. The FMAPI team will drive roadmap-to-execution work, collaborating with platform, infra, and ML groups to deliver end-to-end experiences for developers and data scientists building AI applications. #J-18808-Ljbffr Neon
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a... ...inference team declare what they need, a cluster, a model deployment, a capacity change, and get it reconciled...SuggestedPermanent employmentFull time$190k - $265k
...about enabling data and AI teams to solve the... ...business. Founded by engineers — and customer-obsessed... ...apps, AI agents, model training, model serving... ...generation of AI.The Foundation Model Inference team is the backbone... ...workloadsCollaborate with platform, infra, and ML teams to...FoundationLocal areaWorldwide$190k - $265k
...about enabling data and AI teams to solve the... ...business. Founded by engineers — and customer-obsessed... ...apps, AI agents, model training, model serving... ...generation of AI. The Foundation Model Inference team is the backbone... ...with platform, infra, and ML teams to deliver...FoundationLocal areaWorldwide- ...seeks highly autonomous backend/infrastructure engineers to power enterprise-scale model inference on the Mosaic AI platform. You will build and optimize LLM infrastructure... ...latency at scale. Collaborate with platform, infra, and ML teams to deliver end-to-end experiences,...Foundation
- Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and... ...You will collaborate across platform, infra, and ML teams to deliver seamless end... ...data scientists and developers building AI applications on Databricks. This role...Suggested
- ...next generation of enterprise AI infrastructure. As a Staff AI Infrastructure Engineer, you will design, build, and operate... ...evaluation, and deployment of foundation models and autonomous AI agents. You... ..., high‑performance inference, and enterprise AI platforms to...Foundation
- Code Metal's engineering teams are building AI-driven code transpilation... ...modernization, optimization, modeling and simulation... .... They require foundations: models to serve,... ...results to measure. As a Staff AI Platform... ...enablement stack—from GPU inference serving through...Foundation
- DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine... ...inference fleets. Bring 5+ years of HPC or AI infra experience, deep Gen AI knowledge, and hands-on CUDA/Triton...Remote job
- Valerie Health is seeking a founding engineer in San Francisco to help shape the technical foundation of a healthcare AI startup. You will build a robust backend, integrate AI models across modalities, and craft polished user experiences that scale from inception to growth...Foundation
$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams...Foundation- ...building the human layer of AI. Our mission is to... ...in multimodal AI for modeling human-to-human... ...authenticity, we're creating the foundation for the next... ...experienced Research Scientist/Engineer with a focus on model... ...understanding of inference performance and GPU/accelerator...FoundationRemote jobFull timeRelocation packageFlexible hours
- ...trillion-dollar Voice AI economy, providing real... ...’s voice-native foundation models are accessed through cloud... ...for a Senior Software Engineer - Model Evaluation & AI... ...Partner with DevOps/Infra to stand up *ephemeral... ...Research, model training, inference, and product teams to...Foundation
- ...generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build,... ..., and deployment of foundation models and autonomous AI agents... ...infrastructure, high-performance inference, and enterprise AI... ...services Strong production ML infra experience, executes...FoundationPermanent employmentWork experience placementFlexible hours
- Deepgram is seeking an experienced Platform Engineer to build and operate the hybrid infrastructure foundation for AI/ML research and product development. You will architect... ..., enabling teams to train and deploy complex models at scale. You’ll collaborate with AI...Foundation
$204k - $216k
...Job Description About Sapience AI Sapience AI is the collective intelligence... ...at scale. You build and run the inference infrastructure that turns the models and reasoning behind MINERVA and... ...AI, research, and platform engineering, and you make the difference between...$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...Description Of The Team The Inference team is responsible for delivering high-performance model serving capabilities that meet... ...are looking for an Applied AI Engineer to help us understand, measure,...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$215k - $260k
...the only vertically integrated AI infrastructure company built... ...time making large language models run faster, cheaper, and more... ...production. That means owning the inference stack end to end: profiling... ...work directly with customer engineering teams to tailor deployments...Temporary work$270k - $325k
...organization specializing in advanced AI solutions that help... ..., it is investing in the engineering foundations required to support reliable... ...frameworks that coordinate language model requests, external tool... ...foundation models, inference platforms, AI service providers...Foundation$91.1k - $179.5k
...our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and... ...pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT...FoundationLocal area$122k - $240.5k
...our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and... ...pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT...FoundationLocal areaVisa sponsorship$230k - $390k
...platform for customer-facing AI agents, working with... .... These values are the foundation of our work, and we are... ...agents depend on foundation models to reason and act in real time. The Inference team builds the systems... ...at scale.As a Software Engineer on Inference, you’ll...FoundationFull timeFlexible hours- ...contracting. Our technology is engineered from the ground up to... ...-Language-Action models, foundation models, imitation... ...pipelines for physical AI Taking recent research... ...and fleet At Staff level, you'll also help... ...Jetson / TensorRT / edge inference ~ Isaac Sim or other...FoundationImmediate startWorldwide
$197.3k - $225.1k
...AI Engineer 4 At Capital One, we are creating responsible and reliable... ...: The Intelligent Foundations and Experiences (IFX) team is... ...millions of customers. Our AI models and platforms empower teams... ...training, large language model inference, agents and multi-agent workflows...FoundationFull timePart timeLocal area- Retool is seeking an AI Engineer to own model-driven behavior in production across product surfaces, shaping prompts, retrieval, routing, and tool... ..., trustworthy AI features, collaborating with product and infra teams in a fast-paced environment. You’ll work with...
- Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms. You should...
- ...developing advanced GPU cloud infrastructure designed for large scale AI training and inference workloads. As one of the organization's early infrastructure engineers, you will play a foundational role in architecting and operating the systems that enable cutting edge...
- ...Devices seeks an Operating Systems Engineer focused on on-device inference to design, develop, and ship the OS... ...reliable, responsive, and energy-efficient AI on consumer devices. You will... ...inference runtimes, and research to adapt models to device constraints and production...
$150k - $250k
# Founding AI Infrastructure EngineerRemote (US)... ...bringing on exceptional engineers to build the infrastructure... ...ll own the engineering foundations for taking AI-powered... .../runtime, data/model pipelines, APIs, observability... ...in backend/platform/infra roles (or equivalent depth...FoundationFull time$231k - $340k
...combining frontier agentic AI, an enterprise-grade... ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll... ...operational excellence for AI inference. Design and improve Harvey... ...build the infrastructure foundation for future model evaluation...Foundation$200k - $400k
...help them hire. Founding AI Engineer Location San Francisco... ...AI layer end-to-end - from models, prompting, retrieval, and... ...scale. Optimize inference, latency, and infrastructure... ...reliability. Establish technical foundations that can support future AI engineers...FoundationFull timeWork at officeImmediate startRemote workVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Infra Engineer, Foundation Model Inference. Be the first to apply!
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA



