Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Engineer

LiteLLM AI Gateway

Product Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role

This isn't a traditional product management role, and it isn't a traditional software engineering role.

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM's second major product.
What We're Looking For
  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership-you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.
Bonus Points
  • Experience at an early-stage startup.
  • Experience building developer tools or infrastructure products.
  • Open source contributions.
  • You've built and launched your own product.
  • Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Engineer in San Francisco, CA vacancy
  • $255k

     ...move from experimenting with agents to using them reliably in production. That means solving challenging problems in cloud...  ...initiative, close relationships with customers, and exceptional engineering craft. We take ownership, learn quickly, and communicate directly... 
    Suggested
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago
  • $197.3k - $313.7k

     ...right place! Agentforce is the future of AI, and you are the future of Salesforce.About the TeamThe Customer Engineering team is Salesforce's zero-to-one product hardening function for Service Cloud and Agentforce. We embed senior engineers directly with a small... 
    Suggested
    Full time
    Live in

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...at the intersection of AI, Security, and Infrastructure. About This Role We're seeking an experienced front-end focused Product Engineer to lead the charge in building the world's first AI-native platform that autonomously finds and fixes software vulnerabilities... 
    Suggested
    Work at office

    DepthFirst

    San Francisco, CA
    1 day ago
  •  ...Most engineering jobs start with a ticket. This one starts with a customer problem. At Metaview, you will talk directly to the people...  ...what happens next. There is no chain of handoffs between product, design, engineering, support, and the customer. The person closest... 
    Suggested
    Work at office
    Visa sponsorship
    Work visa

    Metaview

    San Francisco, CA
    2 days ago
  •  ...About the job Founding Product Engineer About the role Success Matcher Recruitment is partnering with our client, the leading shared housing platform that has cracked the code on co-living and is poised for nationwide scale, to hire an entrepreneurial Founding... 
    Suggested

    Success Matcher Recruitment

    San Francisco, CA
    4 days ago
  •  ...Join Our Team We're looking for full stack Product Engineers to join our team building AthenaHQ, the leading platform powering global brands on AI Search. We're looking for an engineer who enjoys owning products. You'll work with the latest technologies, interface... 

    AthenaHQ

    San Francisco, CA
    3 days ago
  •  ...startups to global brands, trust Nightfall's software platform and APIs to Client, classify, and protect sensitive data. As a Product Engineer you'll enable us to deliver our platform reliably, securely, and at massive scale. You'll help architect low latency, real-time... 

    Macpower Digital Assets Edge

    San Francisco, CA
    10 hours ago
  •  ...AirOps Product Engineer AirOps is the full-service platform for brand growth in the age of AI search. As consumers shift from traditional search engines to platforms like ChatGPT, Claude, and Gemini, the entire ruleset of growth is being rewritten. Buyers now rely... 
    Flexible hours
    Shift work

    AirOps

    San Francisco, CA
    4 days ago
  • $160k - $200k

     ...About the job Founding Product Engineer About the Company Our client is a venture-backed startup building the next generation of revenue infrastructure for B2B AI companies, starting with intelligent deal pricing and quoting. They are replacing legacy tooling... 
    Full time
    H1b
    Visa sponsorship

    David Joseph and Company

    San Francisco, CA
    10 hours ago
  • $160k - $250k

     ...will directly shape how we grow. About the Role Most CRM products were built for sales managers, not the people who actually use...  ...across the stack; PM or designer backgrounds with strong engineering skills are welcome Prior experience with PLG or growth mechanics... 
    Work at office
    Flexible hours
    3 days per week

    Clarify

    San Francisco, CA
    1 day ago
  •  ...lives in Ando, and then convince their teammates and friends to do the same. We're looking for founding engineers who are excited by that challenge: building a product from first principles, shaping the future of how humans and AI collaborate, and dogfooding what they... 
    Full time
    Work from home

    Ando

    San Francisco, CA
    3 days ago
  •  ...Product Engineer We are looking for a Product Engineer with 2+ years of experience to join a fast-moving LegalTech startup transforming the U.S. immigration experience through AI. This is a backend-leaning, full-stack role where you will own meaningful product features... 
    Immediate start

    NxT Level

    San Francisco, CA
    4 days ago
  • $140k - $280k

     ...this year-and that's why we're hiring. You'll ship AI-powered product features end-to-end. Real systems, real users, real revenue-the...  ...and applying it before anyone else does. The best product engineers here don't just write features. They embed with the operators who... 
    Work at office
    Remote work
    Relocation
    Monday to Friday
    Early shift

    Harper Group

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...Product Engineer We're a small, dynamic team based in San Francisco, and we're looking for a product engineer to join us. In this in-person role, you'll have the opportunity to wear multiple hats, interact directly with our customers, and play a vital part in shaping... 
    Visa sponsorship

    Artie

    San Francisco, CA
    2 days ago
  •  ...About the job Product Engineer Job Description: Our client is seeking - a highly skilled and motivated Product Engineer to join our team in San Francisco or New York. As a Product Engineer, you will be responsible for designing, developing, and testing our... 

    UpCore Solutions

    San Francisco, CA
    23 hours ago
  •  ...from fast-growing startups to large enterprises. We'll share more details when we talk. About This Role At Lapel, our product engineering team owns all product surface areas from ideation to delivery to customers. On this team, you'll own features end-to-end across... 
    Work at office
    Work from home

    Lapel

    San Francisco, CA
    2 days ago
  •  ...assess and monitor the novel risks introduced by AI in their products and across their assets and ecosystem. Our research has uncovered...  ...traditional tooling wasn't built to solve. We're hiring engineers across the stack to help us build the platform, detections, integrations... 

    PromptArmor

    San Francisco, CA
    1 day ago
  •  ...We're Hiring The First Engineer For Our New Product We're hiring the first engineer for our new product. You will own this from start to initial launch. Building the best APIs for realtime people and company data took us from 0 to $4M ARR in first 9 months while... 

    Crustdata (YC F24)

    San Francisco, CA
    4 days ago
  •  ...and HOF Capital. The team is based in San Francisco and includes engineers, designers, and operators from Airbnb, Palantir, Pinterest, IMC...  ...my thoughts on the perfect candidate we're looking to join our product team: Product focused: There are a lot of features that... 

    Conversion Services

    San Francisco, CA
    2 days ago
  •  ...Magic Patterns AI Engineer Opportunity Hey, I'm Teddy, CTO & co-founder at Magic Patterns! Our product team has grown a lot over the last few months here in San Francisco. Our mission is to let anyone build delightful software. We're a lean team where everyone contributes... 

    Magic Patterns

    San Francisco, CA
    1 day ago
  • $195k - $350k

     ...Product Engineer San Francisco (Hybrid); San Mateo, CA (Hybrid) Eve is redefining legal technology for plaintiff law firms, and we're building the team that will take us there. We help firms handle more cases, recover more for clients, and grow with AI that works... 
    Temporary work
    Work at office
    Local area
    Flexible hours

    Eve

    San Francisco, CA
    2 days ago
  •  ...Founding Product Engineer Weave (YC W25) is building the definitive platform for understanding and improving how engineering teams work. We believe the way engineering output is measured today is fundamentally broken and that modern AI can give teams a far more accurate... 
    Immediate start

    Weave, Inc.

    San Francisco, CA
    2 days ago
  •  ...schools. Featured on Business Insider. You'll Own features end-to-end - interview customers every week and watch them use the product, and ship the feature they need by the next week Actually use the algorithms, data structures, and system design that you... 
    Full time
    Work at office
    Relocation

    Bild AI

    San Francisco, CA
    1 day ago
  • $185k - $230k

     ...About the job Product Engineer Product Engineer San Francisco, CA • Hybrid (3 days/week on-site) • Full-time Compensation: $185K-$230K + equity About the Company Our client is a seed-stage startup building AI-powered software for global trade... 
    Full time
    H1b
    Work at office
    Relocation
    Visa sponsorship
    3 days per week

    David Joseph and Company

    San Francisco, CA
    3 days ago
  • $185k - $230k

     ...4M, serves more than 80 customers, and has grown revenue more than fourfold in the past six months. This is a full-stack Product Engineer role on a small, high-caliber team with three hires planned. You will own meaningful parts of the product from problem discovery... 
    H1b
    Work at office
    Relocation
    3 days per week

    Raydar

    San Francisco, CA
    16 days ago
  •  ...Job Description Job Description About this role We are looking for a Product Engineer (Search) with 3–12 years of experience to own our client's developer-facing search endpoint — closing the gap between retrieval and ranking research and what developers actually... 

    NxT Level

    San Francisco, CA
    13 days ago
  • $140k - $180k

     ...Description Job Description About the Role This is a founding engineering role at a seed-stage legaltech startup building AI-native...  ...directly alongside attorneys and AI engineers to shape the core product from scratch, setting the engineering culture and standards... 
    Full time
    Contract work

    Clera

    San Francisco, CA
    1 day ago
  •  ...scale while maintaining consistency, security, and performance across BI tools, spreadsheets, and embedded applications. As a Product Engineer at Cube, you'll take product ideas from spark to production — owning both what we build and how we build it. You'll pair... 
    Remote work

    Cube Dev

    San Francisco, CA
    16 days ago
  • $190k - $210k

     ...Job Description Job Description About the Role A well-funded, early-stage fintech startup is looking for a Founding Product Engineer to join a small, senior team building a new kind of collaborative financial product. You'll have broad ownership across the stack... 
    Remote work

    Clera

    San Francisco, CA
    14 days ago
  • $150k - $250k

     ...building an agentic AI platform for enterprise software delivery. Their product is already in live use across large enterprise implementations, and they are growing a small, high-caliber engineering team. Founded 2024 · ~15 people · Industry: B2B, Enterprise, AI... 
    Full time
    Internship
    H1b
    Work at office
    Remote work
    Visa sponsorship
    Monday to Friday

    David Joseph & Company

    San Francisco, CA
    14 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Engineer. Be the first to apply!