Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer

LiteLLM AI Gateway

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

What you will be working on

Skills: Python, LLM APIs, FastAPI

As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
  • System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
  • Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
  • Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

Who we are looking for
  • 1-2 years of backend/full-stack experience with production systems
  • Passion for open source and user engagement
  • Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
  • Strong work ethic and ability to thrive in small teams
  • Eagerness to talk to users and help solve real problems
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
  • $120k - $180k

     ...Job Description Job Description About the Role This is a founding engineering role at a seed-stage AI startup building the intelligence layer for the construction industry. The company's platform transforms messy blueprints, permits, and construction documents into... 
    Suggested
    Full time
    Work at office
    Relocation

    Clera

    San Francisco, CA
    a month ago
  • $120k - $200k

    Our client, an AI-driven legal tech company, is hiring a Founding AI Engineer to join the team in San Francisco, CA. The successful candidate will design and deploy production-grade LLM systems for a next-generation legal technology platform, while also transforming complex... 
    Suggested
    Full time

    Alldus International Consulting Ltd

    San Francisco, CA
    a month ago
  •  ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a AI Engineer , you will be a core contributor to Zyphra’s Agentic Systems and Interaction projects. You will be at the forefront of building... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    a month ago
  • $175k - $215k

     ...About the Role   Most companies are experimenting with AI in their GTM motion. We are not experimenting. We are building...  ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablement Write documentation and run enablement... 
    Suggested

    Samba

    San Francisco, CA
    a month ago
  • $155k - $190k

     ...About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot...  .... That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform , empowering AI engineers... 
    Suggested
    Full time
    Remote work

    Arizeai

    San Francisco, CA
    5 days ago
  • $120k - $180k

     ...Job Description Job Description About the Role This is a founding AI engineering role at a seed-stage construction technology company building an intelligence layer that transforms messy blueprints, permits, and construction documents into actionable insights — making... 
    Full time
    Work at office
    Remote work
    Relocation

    Clera

    San Francisco, CA
    a month ago
  • $130k - $220k

     ...** Disponibile caso per caso **About Artificial Analysis** Artificial Analysis is the leading independent AI benchmarking and insights company. They help engineers, enterprises, investors, media, and policymakers understand AI capabilities and make critical decisions about... 
    Full time
    Worldwide

    Aurora Jobs ApS

    San Francisco, CA
    more than 2 months ago
  • $160k - $200k

     ...A seed-stage company (founded 2025) on the frontier of agentic AI for the built world, building the technical leader in AI that checks...  ...more affordable. It's one of very few places in tech where an engineer can work directly on housing, and that mission — shared by its... 
    Full time
    Visa sponsorship
    Weekend work

    Thomas Talent Network

    San Francisco, CA
    a month ago
  •  ...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you'll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    a month ago
  •  ...Job Description Job Description Hiring: Applied AI / Product AI Engineer — San Francisco Early-stage AI startup building long-running autonomous agents that can pursue complex objectives over time. Looking for engineers who can: • Own 0→1 AI products end... 

    AccrueTalent

    San Francisco, CA
    24 days ago
  • $180k - $300k

     ...About the Company Our client is a Series A company building an AI platform that automates the operational drudgery inside the...  ...Software Development The Role This is a hands-on, customer-facing engineering role at the intersection of AI, product, and implementation.... 
    Full time
    H1b
    Immediate start
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    4 days ago
  • $145k - $240k

     ...-capitalized, venture-backed startup (founded 2025) building an AI platform for the commercial insurance industry. Their product automates...  ...is only beginning to adopt AI. You would be one of the first engineers on a small team, shaping the product from the ground up.... 
    Full time
    H1b
    Immediate start
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    20 days ago
  • $160k - $200k

     ...Job Description Job Description San Francisco, CA | Onsite | Full-Time We're seeking a highly autonomous Founding AI Engineer to join a seed-stage agentic AI company applying multimodal AI to construction and architecture. Its agents analyze blueprints to determine... 
    Full time
    Visa sponsorship

    JeffreyM Consulting

    San Francisco, CA
    11 days ago
  •  ...Logical Intelligence, we're revolutionizing software development with AI-powered formal verification. We've developed groundbreaking...  ...is provably correct. About the role Join our team as an AI Engineer and help us push the boundaries of what's possible in logical reasoning... 
    Contract work

    Logical Intelligence

    San Francisco, CA
    26 days ago
  • $180k - $300k

     ...You work directly with enterprise customers and ship end-to-end AI automations that show up immediately in their workflows no...  ...that matter. Dealbreaker Work experience Customer-facing engineering experience on post-sales sidescoping problems, building solutions... 
    Full time
    Work experience placement
    H1b
    Work at office
    Immediate start
    Visa sponsorship

    The SeventhHire LLC

    San Francisco, CA
    7 days ago
  • $120k - $190k

     ...Job Description Job Description About the Role We’re looking for a hands-on AI Engineer / Member of Technical Staff to build and own production AI systems in healthcare. You’ll work across AI engineering, software development, infrastructure, and customer implementation... 
    Full time
    H1b
    Visa sponsorship

    JeffreyM Consulting

    San Francisco, CA
    4 days ago
  •  ...About the Role You'll own the patient-facing AI conversation loop end-to-end at Doctours, diagnosing and fixing failures when our...  ...to eight people, founded by Girum Tihtina (ex-Meta payments engineering), Maurice Landers III (CTO, Harvey Mudd CS, design-engineer), and... 
    Full time
    Visa sponsorship
    Work visa

    Doctours

    San Francisco, CA
    11 days ago
  • $158k - $215k

     ...Description Job Description About Collate Collate is an AI document generation platform for life sciences. We automate paperwork...  ...at Y Combinator and founder of Lever. Our AI researchers, engineers, and designers have worked at Google, Nvidia, Meta, Netflix, Amazon... 

    Collate

    San Francisco, CA
    6 days ago
  •  ...Baseten Compute Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling... 
    Flexible hours

    Baseten

    San Francisco, CA
    3 days ago
  •  ...TLDR: We're looking for an AI Red Team Engineer to break LLM-powered systems responsibly, automate the repetitive attacks, and turn their findings into clear evidence that powers customer demos, security reviews, and sales conversations. You'll own hands-on adversarial... 
    Flexible hours

    Moonfire

    San Francisco, CA
    20 hours ago
  • $225k - $255k

     ...should evolve as products, markets, or sales motions change. Our AI-native platform equips companies to bring that pricing...  ...thrive. We have assembled our team of 8 (pricing experts and engineers) to deliver that capability. Our main hubs are San Francisco and... 
    Work experience placement
    Immediate start
    Visa sponsorship

    Mondrio

    San Francisco, CA
    2 days ago
  • $7.5k

     ...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical AI Engineer to own the brand feel of the company and the movement they're... 
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    EQL Tech

    San Francisco, CA
    2 days ago
  • $157.5k - $210k

     ...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor to Walden's internal agent platform. This is a hybrid role for an AI-native operator who builds modern agentic systems with extreme... 
    Contract work
    Work from home
    Flexible hours

    Walden Robotics

    San Francisco, CA
    1 day ago
  •  ...About Us Coach is building the AI coach for the physical world. Starting with in-person sales. For centuries, field organizations...  ...personalized coaching from dataset construction and feature engineering to validation and monitoring. Production infrastructure.... 
    Visa sponsorship
    Relocation package

    RiseMe

    San Francisco, CA
    1 day ago
  •  ...As a Backend/AI Engineer at Emanate, you'll work on the core infrastructure that powers our AI revenue engine for companies that are building the backbone of the physical economy. You'll integrate cutting-edge LLMs, optimize data pipelines, and build the systems that make... 

    Emanate

    San Francisco, CA
    1 day ago
  •  ...Generative Ai Engineer Chima is seeking highly skilled generative AI engineers to join our team. As an AI application engineer, you will be responsible for designing, developing, and deploying cutting-edge AI models to solve enterprises' biggest problems. What You... 

    Chima Inc

    San Francisco, CA
    20 hours ago
  • $120k - $200k

     ...Recruitment Consultant, building out and scaling top start‑up teams $120,000 - $200,000 + 0.5‑2% Equity + Flexible PTO Are you an AI engineer who wants to build and own the core agentic systems powering an AI platform used by Fortune 500 companies, transforming manual... 
    Full time
    Immediate start
    Flexible hours

    Rise Technical

    San Francisco, CA
    2 days ago
  •  ...WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence...  ...better future of work with AI. About the role As an AI engineer at WRITER, you'll be at the forefront of shaping how enterprises... 
    Full time
    Work at office
    Local area
    Flexible hours

    Writer Corporation

    San Francisco, CA
    3 days ago
  •  ...and Langchain. What You'll Do Build and experiment with AI systems for code understanding, vulnerability detection, and...  ...training, and experimentation Work closely with product and engineering teams to integrate AI capabilities into Corridor's platform... 

    Corridor Security Inc

    San Francisco, CA
    3 days ago
  •  ...Founding Engineers: Build the AI That Builds AI Full-time · Founding Team · Engineering · On-site (India or US) What We're Building We're tackling one of the biggest constraints in modern artificial intelligence: AI is still built through slow, manual engineering... 
    Full time

    Amadeus Search

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!