Senior Foundation Model API Engineer — Scale AI Inference
Databricks
Databricks Mosaic AI is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join a high-visibility team connected to research, product, and enterprise use cases, helping thousands of customers democratize AI within their organizations. You will collaborate across platform, infra, and ML teams to deliver end-to-end experiences and shape the FMAPI product roadmap with direct engagement with #J-18808-Ljbffr Databricks
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Foundation Model API Engineer — Scale AI Inference in San Francisco, CA vacancy
$325k
A leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal candidate has over 5 years of software engineering experience, strong familiarity with ML architectures, and experience...Senior$166k - $225k
...best data and AI infrastructure... ...business. Databricks’ Model Serving product... ..., low-latency inference, governance,... ...models at scale with strong SLAs... ...efficiency.As a Senior Engineer, you’ll play a... ...experience and the foundational infrastructure... ...core systems and APIs that power...SeniorFoundationLocal areaWorldwide$190k - $265k
...enabling data and AI teams to solve... ...business. Founded by engineers — and customer-... ...interfacing with data to scaling our services and... ...apps, AI agents, model training, model... ...the FMAPI (Foundation Model APIs) team — the unified... ...-time and batch inference, powering model inference...FoundationLocal areaWorldwide$172.43k - $230.95k
...vertically integrated AI infrastructure... ...who believe in the scale of our ambition and... ...About This Role:The Senior Software Engineer for the AI Model Lifecycle team will... ...systems for large foundation models (SFT, PEFT,... ...on GPU systems and inference frameworks.Benefits...SeniorFoundationTemporary work$165k - $200k
...vertically integrated AI infrastructure... ..., who believe in the scale of our ambition and thrive... ...RoleWe’re seeking a Senior API Integration Engineer to serve as a strategic... ...understanding of HR data models, compliance... ...PIIBonus PointsWorkato Foundations or Integration Developer...SeniorFoundationTemporary work$224.5k - $251.5k
...DialpadDialpad is the AI platform for... ...an AI-native engineering culture.This... ...directly to our Senior Director of Engineering... ....Build & Scale: Design and... ...reasoning, and secure API tool execution... ..., LLM inference optimization, advanced... ...: Strong foundations in scaling distributed...SeniorFoundationWork at office$298k - $368k
...set of sensors, enabling engineers like you to (1) develop... ...continuously learning from large scale real-world data, to (2) develop models and model training at... ...(LLM, VLM, or similar foundation models). ~ Proven... ...in low-latency on-device inference techniques and a deep understanding...SeniorFoundationFull timeRemote workWaymo
San Francisco, CA20 hours ago$176.6k - $239k
...some of the world’s leading AI model providers companies, AWS Sales... ...strong understanding of large-scale accelerated computing... ...build deep relationships with senior technical individuals within... ...development, cloud computing, systems engineering, infrastructure, security,...SeniorFoundationLocal areaWorldwideFlexible hours- Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a passion... ...the premier data and AI infrastructure platform,... ...enables our customers to serve, scale, and optimize frontier... .... Our Foundation Model APIs provide a unified platform...FoundationWorldwide
- ...re partnering with a frontier AI research company on a search... ...next-generation open-weight foundation models with a mission to make advanced... ...team includes researchers, engineers, and operators from some of the... ...experience building large-scale ML systems or automated evaluation...SeniorFoundation
$190k - $265k
...enabling data and AI teams to solve... ...business. Founded by engineers — and customer-... ...interfacing with data to scaling our services and... ...apps, AI agents, model training, model... ...of AI. The Foundation Model Inference team is the... ...Foundation Model APIs provide a unified...FoundationFull timeLocal areaWorldwide$161k - $242k
# Senior Software Engineer, Production EngineeringHarvey AI·San Francisco, CA·$161k - $241kfull-timeseniorPosted... ...support. We’re scaling fast and defining a... ...infrastructure is the foundation that powers every customer... ...interaction, every model inference, and every production...SeniorFoundation- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...Senior
- ...biotech for the AI era. When a... ...AI agents and models directly in their... ...fluency is the foundation we build on; it... ...a full-stack engineer on the team, you... ...scalable platform, APIs, and user... ...RESPONSIBILITIES Build and scale our scientific... ...for model inference that is fast,...FoundationFull timeWork at officeLocal areaMonday to FridayShift work
Benchling
San Francisco, CA20 hours ago - ...applications, processes, and AI into a single, governed... ...‑time orchestration at scale. With enterprise-grade... ...provides the trusted foundation for organizations to... ...exceptional Staff Software Engineer to help define and... ...real-time integrations, APIs, gateways, and platform...SeniorFoundationImmediate startRemote workFlexible hours
$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams to...Foundation- ...partnering across the enterprise, and scaling what works.The Senior Manager, R&D leads a versatile team of engineers responsible for shaping the R... ...-concepts (e.g., generative AI, digital assets, emerging... ...teams.Strong technical foundation in modern architectures, cloud...SeniorFoundationFull timeWork at office
$140k - $200k
...future of Physical AI. Our advanced... ...Infrastructure / Quality Engineering role will play a... ...will build the foundation for scalable pipelines... ..., and production-scale releaseExperience... ...sensor data ingestion, model/data/label... ...performance GPU cloud inference services, with...SeniorFoundationWork experience placementLocal area$192k - $260k
...world's best data and AI infrastructure platform... ...improve their business. Foundation Model Serving is the API Product for hosting and... ...serving frontier AI model inference for open source models... .... We’re looking for engineers who have owned high scale operational sensitive systems...FoundationLocal areaWorldwide- ...powers mission-critical inference for the world's most dynamic AI companies, like... ...bring cutting-edge models into production. We'... ...build the platform engineers turn to to ship AI products... ...’ll focus on Model API's — the... ...interact with AI models at scale. RESPONSIBILITIES...Full timeFlexible hours
Baseten
San Francisco, CA20 hours ago $216k - $270k
About Scale AIScale AI is the data foundation for AI, helping organizations build and deploy reliable... ...faster than ever. New foundation models, reasoning techniques, agent... ...problems remains one of the hardest engineering challenges.As a Senior Frontier Agent Engineer (...SeniorFoundationFull time- ...is the pioneering Causal AI platform. We help the world... ...Capital, and Accenture. Our models run on our own NVIDIA DGX... ...perform under real-world scale, reliability, and security... ...and we're looking for an engineer who wants to own the foundation it runs on. This isn't a traditional...SeniorFoundation
$152.5k - $205k
...platform companies, building the foundation of a more open, global... ...to power trusted, internet-scale financial innovation. Learn... ...ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team,... ...behind critical digital-assets, AI, and application workloads....SeniorFoundationFlexible hours$155k
...Team The Quality Engineering team builds the... ...are looking for a Senior Software Engineer,... ...Engineering to own and scale the quality... ...implementing how AI reshapes quality engineering... ...test ownership models so teams can... ...experiences create a foundation for the best ideas...SeniorFoundationFull timeContract workLocal areaHome officeFlexible hoursShift workEarly shiftScribd, Inc.
San Francisco, CA20 hours ago- ...company is seeking a talented software engineer to join their dynamic Inference team. This role involves... ...implementing infrastructure for large-scale multimodal models, focusing on high-performance... ...teams to push the boundaries of AI technology, ensuring reliable production...
$215k - $275k
...accelerate the progress of AI applications out into the real... ...or data scientist can scale an ML application from their... ...:Anyscale is looking for a Senior Site Reliability Engineer to join the Infrastructure... ...low-level operating system foundations (Linux kernel, file systems...SeniorFoundationWork at office- Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers...Foundation
$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans... ....Software Quality Senior Member of... ...of our software engineering. While AI is... ...apart at enterprise scale. We are looking for... ...strong engineering foundation, a passion for AI/... ...Human-in-the-Loop & Model Evaluation:...SeniorFoundationFull timeWorldwide- Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open...
$300 per month
...the only vertically integrated AI infrastructure company built... ...urgency, who believe in the scale of our ambition and thrive on... ...cloud platform — and Production Engineering sits at the heart of that... ...strengthening the operational foundation of Crusoe’s cloud while helping...SeniorFoundationTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Foundation Model API Engineer — Scale AI Inference. Be the first to apply!
Related searches
- senior operations associate San Francisco, CA
- senior safety specialist San Francisco, CA
- senior technology project manager San Francisco, CA
- remote senior business analyst San Francisco, CA
- senior director fp&a San Francisco, CA
- senior manager clinical operations San Francisco, CA
- senior supervisor San Francisco, CA
- senior researcher San Francisco, CA
- senior leadership San Francisco, CA
- senior title examiner San Francisco, CA