Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer

LiteLLM AI Gateway

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

What you will be working on

Skills: Python, LLM APIs, FastAPI

As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
  • System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
  • Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
  • Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

Who we are looking for
  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and help solve real problems
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
  • $175k - $215k

     ...relevant. About the Role Most companies are experimenting with AI in their GTM motion. We are not experimenting. We are building...  ...the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablement Write documentation and run enablement... 
    Suggested

    SAMBA

    San Francisco, CA
    5 days ago
  •  ...About the Role Socure is looking for an AI Enablement Engineer to accelerate AI adoption across engineering by turning standards, tooling patterns, and proven workflows into repeatable day-to-day practice. This role sits at the intersection of AI tooling enablement... 
    Suggested
    Work at office
    Immediate start

    Socure Inc

    San Francisco, CA
    5 days ago
  •  ...Generative Ai Engineer Chima is seeking highly skilled generative AI engineers to join our team. As an AI application engineer, you will be responsible for designing, developing, and deploying cutting-edge AI models to solve enterprises' biggest problems. What You... 
    Suggested

    Chima Inc

    San Francisco, CA
    15 hours ago
  •  ...Who we are: Cooper is an AI coworker for the insurance industry. Getting a business insured involves mountains of paperwork:...  ...insurance industry. About the role: We're hiring the Founding Engineering team for a new hyper-growth AI business unit. You’ll build AI... 
    Suggested

    Cooper

    San Francisco, CA
    4 days ago
  •  ...AI Engineer Hilbert is a scalable, data science-first growth engine that gives B2C teams predictive clarity into user behavior, revenue drivers, and the actions that drive sustainable growth. Fully agentic by design, Hilbert shrinks months-long decision cycles to minutes... 
    Suggested
    Full time
    Night shift
    Weekend work

    Hilbert's Ai

    San Francisco, CA
    14 hours ago
  • $180k - $250k

     ...About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect...  ...and the board-members of 20+ F500s. What We Are Looking For AI Engineers build and operate production AI systems that deliver business value... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Distyl AI

    San Francisco, CA
    15 hours ago
  •  ...AI Engineer Your role, should you choose to join us, will be an AI Engineer on our founding team. You're the right person for this role if you're excited to work at the frontier of applied AI, training and iterating advanced models that work in the real world. You... 

    Vooma

    San Francisco, CA
    14 hours ago
  • $180k - $220k

     ...the full revenue stack — every interaction, every signal, in sequence. On top of that foundation, we built Nex-lm, a purpose-built AI engine that compiles natural language into deterministic agent workflows. The result is a platform that can extract the revenue blueprint... 
    Immediate start

    HockeyStack, Inc

    San Francisco, CA
    3 days ago
  • $7.5k

     ...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical AI Engineer to own the brand feel of the company and the movement they're... 
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    EQL Tech

    San Francisco, CA
    3 days ago
  • $197.3k - $225.1k

    AI Engineer 4 At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    San Francisco, CA
    4 days ago
  • $80k - $90k

     ...Benefits: ~401(k) ~ Bonus based on performance ~ Training & development Role:- AI Engineer Key Responsibilities Apply AI/ML technologies such as machine learning models, LLMs, embeddings, and basic agentic or RAG workflows under guidance... 
    Internship

    Triunity Software

    San Francisco, CA
    2 days ago
  •  ...A growing early-stage startup are looking for an AI Engineer. The startup uses AI to Draft and Develop war plans for their Aerospace/Defense partners. They're on a mission to ensure warfighters are prepared for every challenge they face. They build AI-native software for... 

    Craigslist

    San Francisco, CA
    15 hours ago
  • $150k - $210k

     ...AI Engineer Location: San Francisco, CA, in-office Compensation: 150,000 - $210,000 Company: Cargomatic, Inc. Disruptive, groundbreaking, transformative company is changing an industry. Join a rapidly growing company disrupting the trucking industry! Cargomatic... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Argo AI

    San Francisco, CA
    5 days ago
  •  ...Founding AI Engineer We founded Bild AI to tackle the mess that is blueprint reading, cost estimation, and permit applications in construction. It's a tough technical problem that requires the newest CV and AI approaches, and we’re impact-driven to make it more efficient... 
    Full time
    Work at office
    Relocation

    Bild AI

    San Francisco, CA
    5 days ago
  •  ...AI Engineer Opportunity at Arnata At Arnata, we're building the world's first AI Logistics Manager — an AI Worker that autonomously runs logistics operations at scale. YC-backed, great traction, $1T+ market and great team. What You'll Do as an AI Engineer Build... 

    Arnata

    San Francisco, CA
    3 days ago
  • $180k - $400k

     ...About the Role Join a fast-moving, pre-seed-backed AI startup building the next generation of agentic systems that automate complex...  ..., legal, fintech, logistics, and compliance. As a mid-level AI Engineer on the core product team, you'll own production LLM-based... 

    CLERA

    San Francisco, CA
    5 days ago
  • $119.1k - $184.7k

     ...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you’ll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    15 hours ago
  •  ...document portals. Legacy players are struggling to adapt to an AI-native age, while lenders and brokers are constrained by manual...  ...production software. The Role We're looking for a founding AI/ML engineer to build the intelligent systems at the heart of our product.... 
    Live in

    Andreessen Horowitz

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...Our mission is simple: place the best people in the right roles to drive long-term success for both clients and candidates. AI Engineer Location: San Francisco, CA Company Stage of Funding: Early-Stage AI Infrastructure Company Office Type: Onsite... 
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  •  ...customers come to us with business problems they want to solve through AI: increasing revenue, reducing cost, transforming customer...  ...solutions that deliver business value.  As a Forward Deployed AI Engineer , you'll play a leading role in building and shipping AI... 
    Remote work

    HTEC Group Inc

    San Francisco, CA
    14 hours ago
  • $157.5k - $210k

     ...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor to Walden's internal agent platform. This is a hybrid role for an AI-native operator who builds modern agentic systems with extreme... 
    Contract work
    Work from home
    Flexible hours

    Walden Robotics

    San Francisco, CA
    2 days ago
  •  ...powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma...  ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products. The Role Baseten's Compute org is... 
    Flexible hours

    Baseten

    San Francisco, CA
    4 days ago
  •  ...About Braven We build AI for the specialty insurance industry, one of the biggest markets in the world, still running on email...  ...top of it. The role You'll report directly to our Head of Engineering. This role is about your potential. We're not hiring you for... 

    Sytrex

    San Francisco, CA
    5 days ago
  • $168k - $235k

     ...AI Engineer Pi.Security • San Francisco, CA • Full-time • Onsite, 5 days a week About Pi.Security Pi is building an agentic product security platform for teams that need to secure software at the speed they build it. Modern development is accelerating,... 
    Full time
    Work at office
    Flexible hours

    PI Security LLC

    San Francisco, CA
    5 days ago
  • $180k

     ...fast. We are looking for extremely hungry people. We are only looking for new grads. Base is $180K. What You Will Do Build AI-powered application features end to end for technicians, sales teams, and operators Design agentic workflows, RAG pipelines, and... 
    Full time

    Noso Labs Inc.

    San Francisco, CA
    5 days ago
  •  ...This role is for a hands‑on engineer who improves the models and agents behind an AI testing product. The work covers fine‑tuning, building training and evaluation datasets from real usage, and tuning prompts and context for reliability, speed and cost. A strong candidate... 

    present of AI

    San Francisco, CA
    5 days ago
  •  ...AI Engineer Opportunity at Goodfin Goodfin is an AI-native investment platform giving accredited investors access to pre-IPO and alternative assets — with intelligent systems that don't just surface data, but reason, act, and iterate. We're building agentic AI that... 

    goodfin

    San Francisco, CA
    15 hours ago
  • $225k - $255k

     ...About the Role We're a small, product-focused team building an AI-powered B2B pricing platform that helps companies continuously...  ...time deal guidance and discount governance. As our Founding AI Engineer , you'll own the evaluation systems, feedback loops, and LLM infrastructure... 
    Relocation

    CLERA

    San Francisco, CA
    5 days ago
  • $158k - $215k

     ...About Collate Collate is an AI document generation platform for life sciences. We automate paperwork with AI, helping our customers...  ...at Y Combinator and founder of Lever. Our AI researchers, engineers, and designers have worked at Google, Nvidia, Meta, Netflix, Amazon... 

    Collate

    San Francisco, CA
    3 days ago
  • $154k - $257k

     ...hybrid setup is also available.About SuperhumanSuperhuman is the AI productivity platform on a mission to unlock the superhuman...  ...and adored: see what our customers sayOn the Mail team, our AI Engineers build the platform behind our intelligent, agentic experiences,... 
    Remote work
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!