Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer

LiteLLM AI Gateway

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

What you will be working on

Skills: Python, LLM APIs, FastAPI

As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
  • System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
  • Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
  • Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

Who we are looking for
  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and help solve real problems
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
  • $175k - $275k

     ...Description About the company Our client is a seed-stage AI company building the data and infrastructure layer that improves...  ...learning, context and verification. The role As AI Engineer, RL & Evals, you will build reinforcement learning environments,... 
    Suggested
    Full time
    H1b
    Work at office

    Raydar

    San Francisco, CA
    6 days ago
  •  ...York is preferred. Candidates on West Coast or Central time are not a fit. We are helping a venture backed Series A AI startup hire AI engineers. The company builds custom AI systems that carry approved, high stakes work across the systems a large regulated enterprise... 
    Suggested
    Full time
    Work at office
    Remote work
    Overseas

    Rise Talent Advisors

    San Francisco, CA
    7 days ago
  • $145k - $240k

     ...-capitalized, venture-backed startup (founded 2025) building an AI platform for the commercial insurance industry. Their product automates...  ...is only beginning to adopt AI. You would be one of the first engineers on a small team, shaping the product from the ground up.... 
    Suggested
    Full time
    H1b
    Immediate start
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    3 days ago
  • $120k - $180k

     ...Job Description Job Description About the Role This is a founding engineering role at a seed-stage AI startup building the intelligence layer for the construction industry. The company's platform transforms messy blueprints, permits, and construction documents into... 
    Suggested
    Full time
    Work at office
    Relocation

    Clera

    San Francisco, CA
    19 days ago
  •  ...Job Description Job Description About This Role Twenty80 is partnering with a fast-moving technology company to find an AI Engineer to build and ship LLM-powered applications. Our client is looking for someone to own new AI workflows from prototype to production... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Remote work

    twenty80.io

    San Francisco, CA
    1 day ago
  •  ...future of identity with a team that holds a high bar for itself — keep reading. About the Role We are looking for an AI Enablement Engineer to accelerate AI adoption across engineering by turning standards, tooling patterns, and proven workflows into repeatable day... 
    Work at office
    Immediate start

    Emerald Development Managers

    San Francisco, CA
    4 days ago
  • $180k - $400k

     ...Description About the Role Join a fast-moving, pre-seed-backed AI startup building the next generation of agentic systems that...  ...healthcare, legal, fintech, logistics, and compliance. As a mid-level AI Engineer on the core product team, you'll own production LLM-based... 

    Clera

    San Francisco, CA
    17 days ago
  • $158k - $215k

     ...Description Job Description About Collate Collate is an AI document generation platform for life sciences. We automate paperwork...  ...at Y Combinator and founder of Lever. Our AI researchers, engineers, and designers have worked at Google, Nvidia, Meta, Netflix, Amazon... 

    Collate

    San Francisco, CA
    7 days ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a AI Engineer , you will be a core contributor to Zyphra’s Agentic Systems and Interaction projects. You will be at the forefront of building... 
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  • $175k - $215k

     ...relevant. About the Role Most companies are experimenting with AI in their GTM motion. We are not experimenting. We are building...  ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablement Write documentation and run... 
    Full time

    Samba TV

    San Francisco, CA
    4 days ago
  •  ...on redefining how next-generation technology teams are built for AI-driven companies. The organization combines advanced AI systems...  ...connect YC-backed and early-stage AI startups with high-caliber engineers, machine learning specialists, and product leaders. HyperBlu Labs... 
    Remote work

    HyperBlu Labs

    San Francisco, CA
    3 days ago
  • $180k

     ...fast. We are looking for extremely hungry people. We are only looking for new grads. Base is $180K. What You Will Do Build AI-powered application features end to end for technicians, sales teams, and operators Design agentic workflows, RAG pipelines, and... 
    Full time

    Noso Labs Inc.

    San Francisco, CA
    3 days ago
  • $115k - $200k

     ...Forward Deployed AI Engineer San Francisco, California, United States Jenn Nguyen and Friends Or refer someone About the Job Forward Deployed AI Engineer Forward Deployed AI Engineer (ML / Full Stack) Compensation: $115K–$200K base (varies by level and interview... 
    Work at office
    Visa sponsorship
    2 days per week

    Jenn Nguyen and Friends

    San Francisco, CA
    1 day ago
  •  ...AI Engineer Opportunity at Arnata At Arnata, we're building the world's first AI Logistics Manager — an AI Worker that autonomously runs logistics operations at scale. YC-backed, great traction, $1T+ market and great team. What You'll Do as an AI Engineer Build... 

    Arnata

    San Francisco, CA
    1 day ago
  • $119.1k - $184.7k

     ...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you’ll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  •  ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual...  ...resources, and support you need to grow your career. AI at Brex AI Engineering at Brex is redefining how businesses run their finances by... 
    Work at office
    Remote work
    Work from home
    Shift work

    EngineersOfAI

    San Francisco, CA
    11 hours ago
  • $7.5k

     ...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical AI Engineer to own the brand feel of the company and the movement they're... 
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    EQL Tech

    San Francisco, CA
    1 day ago
  • $157.5k - $210k

     ...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor to Walden's internal agent platform. This is a hybrid role for an AI-native operator who builds modern agentic systems with extreme... 
    Contract work
    Work from home
    Flexible hours

    Walden Robotics

    San Francisco, CA
    10 hours ago
  •  ...This role is for a hands‑on engineer who improves the models and agents behind an AI testing product. The work covers fine‑tuning, building training and evaluation datasets from real usage, and tuning prompts and context for reliability, speed and cost. A strong candidate... 

    present of AI

    San Francisco, CA
    3 days ago
  •  ...document portals. Legacy players are struggling to adapt to an AI-native age, while lenders and brokers are constrained by manual...  ...production software. The Role We're looking for a founding AI/ML engineer to build the intelligent systems at the heart of our product.... 
    Live in

    Andreessen Horowitz

    San Francisco, CA
    1 day ago
  • $197.3k - $225.1k

    AI Engineer 4 At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology... 
    Full time
    Part time
    Local area

    Capital One

    San Francisco, CA
    2 days ago
  • $225k - $255k

     ...About the Role We're a small, product-focused team building an AI-powered B2B pricing platform that helps companies continuously...  ...time deal guidance and discount governance. As our Founding AI Engineer , you'll own the evaluation systems, feedback loops, and LLM infrastructure... 
    Relocation

    Clera

    San Francisco, CA
    3 days ago
  •  ...AI Engineer Opportunity at Goodfin Goodfin is an AI-native investment platform giving accredited investors access to pre-IPO and alternative assets — with intelligent systems that don't just surface data, but reason, act, and iterate. We're building agentic AI that... 

    goodfin

    San Francisco, CA
    4 days ago
  • $180k - $250k

     ...About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect...  ...and the board-members of 20+ F500s. What We Are Looking For AI Engineers build and operate production AI systems that deliver business value... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Distyl AI

    San Francisco, CA
    4 days ago
  •  ...AI Engineer Your role, should you choose to join us, will be an AI Engineer on our founding team. You're the right person for this role if you're excited to work at the frontier of applied AI, training and iterating advanced models that work in the real world. You... 

    Vooma

    San Francisco, CA
    4 days ago
  •  ...Founding AI Engineer We founded Bild AI to tackle the mess that is blueprint reading, cost estimation, and permit applications in construction. It's a tough technical problem that requires the newest CV and AI approaches, and we’re impact-driven to make it more efficient... 
    Full time
    Work at office
    Relocation

    Bild AI

    San Francisco, CA
    3 days ago
  • $180k - $220k

     ...the full revenue stack — every interaction, every signal, in sequence. On top of that foundation, we built Nex-lm, a purpose-built AI engine that compiles natural language into deterministic agent workflows. The result is a platform that can extract the revenue blueprint... 
    Immediate start

    HockeyStack, Inc

    San Francisco, CA
    1 day ago
  •  ...Generative Ai Engineer Chima is seeking highly skilled generative AI engineers to join our team. As an AI application engineer, you will be responsible for designing, developing, and deploying cutting-edge AI models to solve enterprises' biggest problems. What You... 

    Chima Inc

    San Francisco, CA
    4 days ago
  •  ...Who we are: Cooper is an AI coworker for the insurance industry. Getting a business insured involves mountains of paperwork:...  ...insurance industry. About the role: We're hiring the Founding Engineering team for a new hyper-growth AI business unit. You’ll build AI... 

    Cooper

    San Francisco, CA
    2 days ago
  • $80k - $90k

     ...Benefits: ~401(k) ~ Bonus based on performance ~ Training & development Role:- AI Engineer Key Responsibilities Apply AI/ML technologies such as machine learning models, LLMs, embeddings, and basic agentic or RAG workflows under guidance... 
    Internship

    Triunity Software

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!