AI Engineer
LiteLLM AI Gateway
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.
What you will be working on Skills: Python, LLM APIs, FastAPI As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:- System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
- Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
- Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in San Francisco, CA vacancy
$175k - $275k
...Description About the company Our client is a seed-stage AI company building the data and infrastructure layer that improves... ...learning, context and verification. The role As AI Engineer, RL & Evals, you will build reinforcement learning environments,...SuggestedFull timeH1bWork at office- ...York is preferred. Candidates on West Coast or Central time are not a fit. We are helping a venture backed Series A AI startup hire AI engineers. The company builds custom AI systems that carry approved, high stakes work across the systems a large regulated enterprise...SuggestedFull timeWork at officeRemote workOverseas
$145k - $240k
...-capitalized, venture-backed startup (founded 2025) building an AI platform for the commercial insurance industry. Their product automates... ...is only beginning to adopt AI. You would be one of the first engineers on a small team, shaping the product from the ground up....SuggestedFull timeH1bImmediate startVisa sponsorship$120k - $180k
...Job Description Job Description About the Role This is a founding engineering role at a seed-stage AI startup building the intelligence layer for the construction industry. The company's platform transforms messy blueprints, permits, and construction documents into...SuggestedFull timeWork at officeRelocation- ...Job Description Job Description About This Role Twenty80 is partnering with a fast-moving technology company to find an AI Engineer to build and ship LLM-powered applications. Our client is looking for someone to own new AI workflows from prototype to production...SuggestedFull timeWork experience placementWork at officeRemote work
- ...future of identity with a team that holds a high bar for itself — keep reading. About the Role We are looking for an AI Enablement Engineer to accelerate AI adoption across engineering by turning standards, tooling patterns, and proven workflows into repeatable day...Work at officeImmediate start
$180k - $400k
...Description About the Role Join a fast-moving, pre-seed-backed AI startup building the next generation of agentic systems that... ...healthcare, legal, fintech, logistics, and compliance. As a mid-level AI Engineer on the core product team, you'll own production LLM-based...$158k - $215k
...Description Job Description About Collate Collate is an AI document generation platform for life sciences. We automate paperwork... ...at Y Combinator and founder of Lever. Our AI researchers, engineers, and designers have worked at Google, Nvidia, Meta, Netflix, Amazon...- ...Description Job Description Zyphra is an artificial intelligence company based in San Francisco, California. The Role: As a AI Engineer , you will be a core contributor to Zyphra’s Agentic Systems and Interaction projects. You will be at the forefront of building...Work at officeRelocation package
$175k - $215k
...relevant. About the Role Most companies are experimenting with AI in their GTM motion. We are not experimenting. We are building... ...across the Revenue Org: best practices, MCP architecture, prompt engineering standards, and enablement Write documentation and run...Full time- ...on redefining how next-generation technology teams are built for AI-driven companies. The organization combines advanced AI systems... ...connect YC-backed and early-stage AI startups with high-caliber engineers, machine learning specialists, and product leaders. HyperBlu Labs...Remote work
$180k
...fast. We are looking for extremely hungry people. We are only looking for new grads. Base is $180K. What You Will Do Build AI-powered application features end to end for technicians, sales teams, and operators Design agentic workflows, RAG pipelines, and...Full time$115k - $200k
...Forward Deployed AI Engineer San Francisco, California, United States Jenn Nguyen and Friends Or refer someone About the Job Forward Deployed AI Engineer Forward Deployed AI Engineer (ML / Full Stack) Compensation: $115K–$200K base (varies by level and interview...Work at officeVisa sponsorship2 days per week- ...AI Engineer Opportunity at Arnata At Arnata, we're building the world's first AI Logistics Manager — an AI Worker that autonomously runs logistics operations at scale. YC-backed, great traction, $1T+ market and great team. What You'll Do as an AI Engineer Build...
$119.1k - $184.7k
...with solutions created by the #1 company in e-signature and contract lifecycle management (CLM). What you’ll do As an AI Agentic Engineer on the Platform AI Engineering team, you will drive the next wave of automation in IT operations by designing and deploying agentic...Permanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per week- ...gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual... ...resources, and support you need to grow your career. AI at Brex AI Engineering at Brex is redefining how businesses run their finances by...Work at officeRemote workWork from homeShift work
$7.5k
...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high-growth technology startup to appoint a mission-critical AI Engineer to own the brand feel of the company and the movement they're...Work at officeRelocationVisa sponsorshipRelocation package$157.5k - $210k
...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor to Walden's internal agent platform. This is a hybrid role for an AI-native operator who builds modern agentic systems with extreme...Contract workWork from homeFlexible hours- ...This role is for a hands‑on engineer who improves the models and agents behind an AI testing product. The work covers fine‑tuning, building training and evaluation datasets from real usage, and tuning prompts and context for reliability, speed and cost. A strong candidate...
- ...document portals. Legacy players are struggling to adapt to an AI-native age, while lenders and brokers are constrained by manual... ...production software. The Role We're looking for a founding AI/ML engineer to build the intelligent systems at the heart of our product....Live in
$197.3k - $225.1k
AI Engineer 4 At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology...Full timePart timeLocal area$225k - $255k
...About the Role We're a small, product-focused team building an AI-powered B2B pricing platform that helps companies continuously... ...time deal guidance and discount governance. As our Founding AI Engineer , you'll own the evaluation systems, feedback loops, and LLM infrastructure...Relocation- ...AI Engineer Opportunity at Goodfin Goodfin is an AI-native investment platform giving accredited investors access to pre-IPO and alternative assets — with intelligent systems that don't just surface data, but reason, act, and iterate. We're building agentic AI that...
$180k - $250k
...About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect... ...and the board-members of 20+ F500s. What We Are Looking For AI Engineers build and operate production AI systems that deliver business value...Full timeWork at officeFlexible hours3 days per week- ...AI Engineer Your role, should you choose to join us, will be an AI Engineer on our founding team. You're the right person for this role if you're excited to work at the frontier of applied AI, training and iterating advanced models that work in the real world. You...
- ...Founding AI Engineer We founded Bild AI to tackle the mess that is blueprint reading, cost estimation, and permit applications in construction. It's a tough technical problem that requires the newest CV and AI approaches, and we’re impact-driven to make it more efficient...Full timeWork at officeRelocation
$180k - $220k
...the full revenue stack — every interaction, every signal, in sequence. On top of that foundation, we built Nex-lm, a purpose-built AI engine that compiles natural language into deterministic agent workflows. The result is a platform that can extract the revenue blueprint...Immediate start- ...Generative Ai Engineer Chima is seeking highly skilled generative AI engineers to join our team. As an AI application engineer, you will be responsible for designing, developing, and deploying cutting-edge AI models to solve enterprises' biggest problems. What You...
- ...Who we are: Cooper is an AI coworker for the insurance industry. Getting a business insured involves mountains of paperwork:... ...insurance industry. About the role: We're hiring the Founding Engineering team for a new hyper-growth AI business unit. You’ll build AI...
$80k - $90k
...Benefits: ~401(k) ~ Bonus based on performance ~ Training & development Role:- AI Engineer Key Responsibilities Apply AI/ML technologies such as machine learning models, LLMs, embeddings, and basic agentic or RAG workflows under guidance...Internship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai agent engineer
- ai civil engineering


