AI Engineer
BerriAI
LiteLLM Backend LLM Engineer
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
What You Will Be Working On
Skills: Python, LLM APIs, FastAPI
As the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
- System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
- Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
- Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
The tech stack includes Python, FastAPI, Redis, Postgres.
Who We Are Looking For
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
Why Join LiteLLM?
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions—not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
- ...promised to change everything across a business—until generative AI. Today, AI is the number one driver of business reinvention. And... ...and help lead that change.You Are:As a Snowflake Advanced AI Engineer, you will design, build, and operationalize artificial intelligence...SuggestedFull timeWork experience placementLive inWork at officeLocal areaShift work
$115k - $175k
Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and... ...lean, fast-moving team with high executive visibility.As a GTM AI Engineer, you'll design, build, and ship AI-powered infrastructure, tools...SuggestedRemote workWork from homeFlexible hours$120k - $200k
...into real products, and you “get stuff done” end-to-end. You use AI to work smarter and solve problems faster. Here, you’ll tackle... ...cutting-edge AI tooling across the spectrum: from prompt engineering and in-context learning to fine-tuned models and agentic systems...SuggestedTemporary workLocal areaWorldwide- We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits. Getting a molecule from discovery to patients... ...software to modern science.Benchling is building Intelligence Engineering & Enablement, a small autonomous team within our Security & IT...SuggestedWork at officeLocal areaRemote workRelocationRelocation packageFlexible hours3 days per week
$150k - $250k
About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical... ..., and the board-members of 20+ F500s. What We Are Looking ForAI Engineers build and operate production AI systems that deliver business...SuggestedWork at office3 days per week$171k - $240k
...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual... ...resources, and support you need to grow your career.AI at BrexAI Engineering at Brex is redefining how businesses run their finances by building...Work at officeRemote workWork from homeShift work$150k - $210k
AI Engineer - Agentic AutomationLocation: RemoteCompensation: $150,000 - $210,000Join a rapidly growing company disrupting the trucking industry! Cargomatic is the #1 technology platform and digital marketplace for powering world-class, local trucking. Take a look around...Local areaImmediate start$186.5k - $328.5k
...WRITERWRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through... ...create a better future of work with AI. About the roleAs an AI engineer at WRITER, you'll be at the forefront of shaping how enterprises...Full timeWork at officeLocal area$171k - $240k
...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual... ...resources, and support you need to grow your career.AI at BrexAI Engineering at Brex is redefining how businesses run their finances by building...Work at officeRemote workWork from home$150k - $250k
About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical... ...improving, and trusting AI behavior in production.AI Evaluation Engineers focus on designing and implementing the evaluation systems that...Work at office3 days per week- Job Description:This is a fullstack engineering role with a strong frontend emphasis. You’ll have ownership across the product stack, from users interfaces to infrastructure supporting AI models. Location: New York, NY or Boston, MA or San Francisco, CA (3 days/week)Salary...3 days per week
$175k - $215k
...relevant. About the RoleMost companies are experimenting with AI in their GTM motion. We are not experimenting. We are building... ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablementWrite documentation and run enablement...Full time- ...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you'll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic...Permanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per week
- ...AI Engineer (US) New York, USA; Philadelphia, Pennsylvania, United States; San Francisco, California, United States We are investing in agentic AI and need a Senior AI Engineer to lead the design and delivery of these systems. This is a foundational hire: you will...
Lynx Analytics
San Francisco, CA21 hours ago - ...AI Engineer Join our team as an AI Engineer at Campfire, where you'll design and implement AI-driven solutions that supercharge our accounting platform. From automating financial workflows to building intelligent features that provide real-time insights, you'll be at...
Campfire
San Francisco, CA3 days ago $155k - $180k
...AI Engineer Arbital Health is a rapidly growing healthcare technology and actuarial leader that centralizes, measures, and adjudicates value-based care contracts at scale. We enable payers and providers to design, measure, and execute value-based agreements with greater...Contract workWork at officeRemote workFlexible hours2 days per weekArbital Health
San Francisco, CA3 days ago$180k - $250k
...AI Engineer We're hiring a full-time AI Engineer to own the prompts, agents, evals, and pipelines behind user-facing features that ship to users. You'll take product requirements and turn them into working prompts, agents, and pipelines. You'll evaluate them rigorously...Full timeWork at officeRemote workRelocationFluency Corp
San Francisco, CA4 days ago- ...Agentic Ai Engineer At Kargo, our mission is to build a connective tissue between the physical world of freight and the digital ecosystem used to manage it. We believe that advancements in smart infrastructure are critical to enabling a safer and more efficient future...Local area
Kargo
San Francisco, CA4 days ago - ...The Revolution Needs You Every AI app needs agentic tools that let AI models take real actions. Without tools, AI can only chat... ...going to be huge. The Challenge You'll report to the Engineering Manager for Tools and Growth. The Tools team owns Arcade's tool...Shift work
Arcade
San Francisco, CA1 day ago $80k - $90k
Benefits: ~401(k) ~ Bonus based on performance ~ Training & development Role:- AI Engineer Key Responsibilities Apply AI/ML technologies such as machine learning models, LLMs, embeddings, and basic agentic or RAG workflows under guidance from senior engineers...InternshipTriunity Software
San Francisco, CA4 days ago- ...AI Engineer Opportunity at Goodfin Goodfin is an AI-native investment platform giving accredited investors access to pre-IPO and alternative assets — with intelligent systems that don't just surface data, but reason, act, and iterate. We're building agentic AI that...
Goodfin
San Francisco, CA3 days ago $7.5k
...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical AI Engineer to own the brand feel of the company and the movement they're building...Work at officeEql Tech
San Francisco, CA21 hours ago- TL;DR: If you: have a demonstrated track record of turning ambitious AI ideas into products people actually use; move effortlessly between research and engineering; have shipped something extraordinary, at work or outside of it; are relentlessly curious about...Relocation package
P-1 Ai
San Francisco, CA1 day ago - ...We are committed to assembling a world-class team of exceptional problem solvers, combining expert engineering talent with deep experience in National Security. We build AI for the most important problem in defense - making sure the force is ready to fight. Our software...
Pytho AI, Inc
San Francisco, CA9 hours ago $150k - $200k
...Influur Job Opportunity We're building the world's first viral agent. An AI purpose built for influencer marketing. Not a tool. Not a platform. An autonomous agent that goes from "I need this campaign to break" to "50 influencers live next week" with minimal human...Influur
San Francisco, CA3 days ago$180k - $300k
...About The Role You'll own the core AI systems that power Gamma: the models, prompts, and pipelines behind text, image, and layout... ..., and cost across our AI stack. You'll work closely with engineering and product to ship improvements that millions of users feel immediately...Full timeWork at officeImmediate startWork from homeGamma
San Francisco, CA2 days ago- ...Magical AI Engineer Opportunity Magical is redefining how work gets done. Our agentic AI platform brings "AI employees" into the workplace to take over the repetitive, soul-crushing workflows that slow teams down. The result: organizations move faster, with sharper...RelocationShift work
latitude
San Francisco, CA1 day ago $119.1k - $184.7k
...agreements with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you'll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying...Permanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA1 day ago- ...AI Engineer Opportunity at Arnata At Arnata, we're building the world's first AI Logistics Manager — an AI Worker that autonomously runs logistics operations at scale. YC-backed, great traction, $1T+ market and great team. What You'll Do as an AI Engineer Build...
Arnata
San Francisco, CA10 hours ago $269.1k - $307.2k
Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments...Full timePart timeLocal areaCapital One
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!
Related searches
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- gen ai developer
- entry level ai ml engineer