AI Engineer
LiteLLM AI Gateway
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.
What you will be working on Skills: Python, LLM APIs, FastAPI As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:- System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
- Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
- Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
$175k - $215k
...relevant. About the RoleMost companies are experimenting with AI in their GTM motion. We are not experimenting. We are building... ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablementWrite documentation and run enablement...SuggestedFull timeSamba TV
San Francisco, CA3 days ago$91.1k - $179.5k
...transforms technology platforms, drives innovation, and helps make a significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics. You will work...SuggestedLocal areaDeloitte
San Francisco, CA3 days ago$180k - $250k
About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical... ..., and the board-members of 20+ F500s. What We Are Looking ForAI Engineers build and operate production AI systems that deliver business...SuggestedWork at office3 days per weekDistyl AI
San Francisco, CA3 days ago$220k - $259k
...WRITERWRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through... ...create a better future of work with AI. About the roleAs an AI engineer at WRITER, you'll be at the forefront of shaping how enterprises...SuggestedFull timeWork at officeLocal areaWriter
San Francisco, CA2 days ago$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to production, and organizations everywhere are racing to figure... ...how to build it responsibly and at scale. We're growing a team of engineers who want to work at the center of that shift: designing and...SuggestedWork at officeLocal areaVisa sponsorshipShift workDeloitte
San Francisco, CA1 day ago$216k - $240k
...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual... ...resources, and support you need to grow your career.AI at BrexAI Engineering at Brex is redefining how businesses run their finances by building...Work at officeRemote workWork from homeBrex
San Francisco, CA2 days ago- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...Work at office
Harnham
San Francisco, CA3 days ago $122k - $240.5k
...transforms technology platforms, drives innovation, and helps make a significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics. You will work...Local areaVisa sponsorshipDeloitte
San Francisco, CA3 days ago- ...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you'll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic...Permanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per week
DocuSign
San Francisco, CA2 days ago - ...brings together distributed backend services, data flows, and machine learning and AI capabilities to make member communication more relevant, timely, and actionable.As an AI Engineer, you’ll build and operate the backend systems that bring AI-powered product capabilities...Full timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA3 days ago $175k - $215k
...Samba TV AI Revenue Architect Samba is a media intelligence company. We know what the world is watching, reading, and thinking... ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablement Write documentation and run...Samba TV
San Francisco, CA3 days ago- ...AI Engineer at Fathom As an AI Engineer at Fathom, you'll be hands-on with LLMs, prototyping and refining our features. Your work will directly shape our product by generating practical specifications that steer our engineering team towards impactful updates and novel...Work at officeRemote work3 days per week
Fathom
San Francisco, CA1 day ago - ...About the Role Socure is looking for an AI Enablement Engineer to accelerate AI adoption across engineering by turning standards, tooling patterns, and proven workflows into repeatable day-to-day practice. This role sits at the intersection of AI tooling enablement...Work at officeImmediate start
Socure Inc
San Francisco, CA5 days ago $200k - $350k
...Travel / $200k-$350k + early stage equity My client is looking for a Forward Deployed Engineer to sit at the intersection of engineering and customer delivery, building production AI systems directly with enterprise clients. You'll spend your time in customer...Scalr Inc
San Francisco, CA3 days ago$180k - $300k
...About the role You'll own the core AI systems that power Gamma: the models, prompts, and pipelines behind text, image, and... ...latency, and cost across our AI stack. You'll work closely with engineering and product to ship improvements that millions of users feel immediately...Full timeWork at officeImmediate startWork from homeGamma
San Francisco, CA15 hours ago$200k - $250k
...Our mission is simple: place the best people in the right roles to drive long-term success for both clients and candidates. AI Engineer Location: San Francisco, CA Company Stage of Funding: Early-Stage AI Infrastructure Company Office Type: Onsite...Work at officeRecruiting from Scratch
San Francisco, CA4 days ago- ...are committed to assembling a world-class team of exceptional problem solvers, combining expert engineering talent with deep experience in National Security. We build AI for the most important problem in defense - making sure the force is ready to fight. Our software...
Pytho AI, Inc
San Francisco, CA3 days ago $168k - $235k
...AI Engineer Pi.Security • San Francisco, CA • Full-time • Onsite, 5 days a week About Pi.Security Pi is building an agentic product security platform for teams that need to secure software at the speed they build it. Modern development is accelerating,...Full timeWork at officeFlexible hoursPI Security LLC
San Francisco, CA15 hours ago- ...AI Engineer Your role, should you choose to join us, will be an AI Engineer on our founding team. You're the right person for this role if you're excited to work at the frontier of applied AI, training and iterating advanced models that work in the real world. You...
Vooma
San Francisco, CA1 day ago - ...A high-growth AI-native startup is hiring an AI Engineer in San Francisco to design, build and ship LLM-powered product features and agentic workflows into production. This is a build role focused on the applied AI stack: prompts, retrieval, tools, agents, evals and the...Work at office
Digital Waffle
San Francisco, CA1 day ago - ...AI Forward Deployed Engineer Enduring Ventures | Remote | Contract-to-Hire | Reports to the Chief Technology Officer Individual contributor role. This is not a people-management position. COMPANY DESCRIPTION Enduring Ventures is a permanent capital holding...Permanent employmentFull timeContract workFor contractorsRemote work
Enduring Ventures
San Francisco, CA4 days ago - ...AI Engineer Opportunity at Goodfin Goodfin is an AI-native investment platform giving accredited investors access to pre-IPO and alternative assets — with intelligent systems that don't just surface data, but reason, act, and iterate. We're building agentic AI that...
goodfin
San Francisco, CA1 day ago - ...AI ENGINEER AT CYVL Cyvl has one of the largest proprietary datasets of US infrastructure: LiDAR and imagery from hundreds of cities. As an AI Engineer, you'll turn that data into intelligence, from computer vision models that detect and assess assets to LLM-powered...Work at officeRemote work
CYVL
San Francisco, CA4 days ago - ...Flam is building the next generation of interactive media through its content format. We are an AI-native technology company transforming how brands and consumers interact through immersive, interactive content. Our technology enables rich, app-less experiences that can...
Flam
San Francisco, CA15 hours ago - # Agentic AI EngineerBenchlingSan Francisco, United StatesPosted 8 Aug 2026Benchling is looking for a founding engineer to join their Intelligence Engineering & Enablement team to build agentic AI systems for the R&D cloud. You will define the foundational architecture...
Grapevine Round1 AI
San Francisco, CA3 days ago - ...LiteLLM Backend LLM Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product. What You Will Be...Immediate start
BerriAI
San Francisco, CA15 hours ago - ...Notion is seeking an AI Engineer to build intelligent features that help teams organize knowledge and collaborate more effectively. You will develop AI-powered search, summarization, Q&A, and writing assistance features integrated into the Notion workspace. Requirements...Remote workHome officeFlexible hours
Best AI Tools Wiki
San Francisco, CA4 hours ago - ...~ We're looking for an AI Engineer who possesses a deep understanding of large-scale information retrieval systems, deep learning, databases, and RAG architectures. The ideal candidate will have expertise in developing and optimizing search algorithms, implementing efficient...
Renaissance Academy
San Francisco, CA1 day ago $180k - $250k
...AI Engineer We're hiring a full-time AI Engineer to own the prompts, agents, evals, and pipelines behind user-facing features that ship to users. You'll take product requirements and turn them into working prompts, agents, and pipelines. You'll evaluate them rigorously...Full timeWork at officeRemote workRelocationFluency Corp
San Francisco, CA2 days ago- ...Agentic Ai Engineer At Kargo, our mission is to build a connective tissue between the physical world of freight and the digital ecosystem used to manage it. We believe that advancements in smart infrastructure are critical to enabling a safer and more efficient future...Local area
Kargo
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- azure ai engineer
- machine learning ai engineer