Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Engineer

LiteLLM AI Gateway

Product Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role

This isn't a traditional product management role, and it isn't a traditional software engineering role.

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM's second major product.
What We're Looking For
  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership-you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.
Bonus Points
  • Experience at an early-stage startup.
  • Experience building developer tools or infrastructure products.
  • Open source contributions.
  • You've built and launched your own product.
  • Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Product Engineer in San Francisco, CA vacancy
  • $197.3k - $313.7k

     ...right place! Agentforce is the future of AI, and you are the future of Salesforce.About the TeamThe Customer Engineering team is Salesforce's zero-to-one product hardening function for Service Cloud and Agentforce. We embed senior engineers directly with a small... 
    Suggested
    Full time
    Live in

    Salesforce

    San Francisco, CA
    4 days ago
  • $150k - $250k

    About the RoleWe're looking for a Product Engineer who wants to operate like a founder.Not someone who waits for specs and tickets. Someone who sees opportunities, talks to users, prototypes fast, ships relentlessly, and helps define what the product should become.This... 
    Suggested

    11x AI

    San Francisco, CA
    4 days ago
  •  ...Clarity Pediatrics, Inc. is looking for a Growth Engineer to lead product-led growth initiatives from research to implementation. You will enhance provider referrals and develop enterprise integrations essential for growth. The ideal candidate has 6+ years of product... 
    Suggested

    Clarity Pediatrics, Inc.

    San Francisco, CA
    2 days ago
  • $200k - $275k

     ...000.00/yr Direct message the job poster from Confero Hiring Staff/Principal Software and Security Engineers for IAM, AppSec and AI Security vendors Product Engineer | AI Agents for Enterprise Compliance | $280K DOE + Equity | Palo Alto Confero is partnered... 
    Suggested
    Full time

    Confero Inc

    San Francisco, CA
    3 days ago
  •  ...Kinelo, a seed-stage company with a San Francisco office, is hiring two Product Engineers to collaborate with AI agents and human teammates. You’ll help shape architecture, product requirements, and user needs while delivering software that ships and scales in a fast-moving... 
    Suggested
    Work at office

    Kinelo

    San Francisco, CA
    2 days ago
  •  ...David Joseph & Company seeks a Product Operations Lead in San Francisco to own and scale the data-ops platform, managing the human...  ...campaigns, build workflows from scratch, and collaborate with engineering to ship tooling improvements. The role prioritizes startup experience... 
    Full time

    David Joseph & Company

    San Francisco, CA
    2 days ago
  • $140k - $200k

     ...Base pay range $139,999.00/yr - $200,000.00/yr Mission We’re looking for full stack Product Engineers to join our team building AthenaHQ, the leading platform powering global brands on AI Search. We’re looking for an engineer who enjoys owning products You’ll work with... 
    Full time

    AthenaHQ

    San Francisco, CA
    3 days ago
  •  ...A leading AI systems company in San Francisco seeks a Sr. Product Engineer to shape product direction and build across the entire stack. The ideal candidate combines product intuition with technical skills, notably in React, Typescript, and Python. Responsibilities include... 

    Imbue, Inc.

    San Francisco, CA
    2 days ago
  • $130k - $150k

     ...institutions, and crypto companies detect and prevent financial crime — from terrorist financing to human trafficking. The Full-Stack Product Engineering team builds the core products and services that make this possible, from customer-facing applications to foundational APIs... 
    Summer work
    Internship
    Work at office
    Immediate start
    Worldwide
    3 days per week

    Trm Labs

    San Francisco, CA
    1 day ago
  •  ...Stand is seeking an experienced engineer to translate complex domain problems into shippable systems in San Francisco. You will own production architectures, drive quality and reliability, and collaborate with stakeholders to define success metrics and tradeoffs under... 

    Jobtailor

    San Francisco, CA
    2 days ago
  •  ...Fluidstack in San Francisco is seeking a proficient engineer for the Decision Team to help automate capital and asset processes for...  ...into structured data and actionable insights. You will deploy production code in Go, Python, or TypeScript, leverage LLMs, and build systems... 

    Fluidstack

    San Francisco, CA
    2 days ago
  •  ...Software Guidance & Assistance, Inc. (SGA), is seeking an AI Product Engineer (LLM, voice AI agent) for a full-time position in San Francisco, CA. The role is hybrid with 2-3 days onsite weekly, offering ownership across the stack and direct impact on scalable voice interviewing... 
    Full time

    Software Guidance & Assistance

    San Francisco, CA
    2 days ago
  •  ...exclusive features. Direct message the job poster from Novel Technology Services Our client is looking for theirfirst dedicated product engineer. They are an AI driven startup to produce the data and evals necessary for comprehensively automating work enabling agents to... 
    Full time
    Remote work

    Novel Technology Services

    San Francisco, CA
    3 days ago
  • $140k - $200k

     ...Join to apply for the Product Engineer role at Hamming AI Join to apply for the Product Engineer role at Hamming AI Get AI-powered advice on this job and more exclusive features. This range is provided by Hamming AI. Your actual pay will be based on your skills and experience... 
    Full time

    Hamming AI

    San Francisco, CA
    3 days ago
  • $230k - $300k

     ...companies in AI (Hugging Face, Groq, Perplexity and a bunch of stealth product teams pushing what’s possible with AI agents) They’re building the hyperscaler for AI agents , and looking for an engineer who wants to show the world what’s possible. What you’ll do: Build... 
    Full time

    AMIGOS

    San Francisco, CA
    3 days ago
  •  ...Lapel Product Engineering Role At Lapel, we believe the most hospitable companies win. We're building the data, infrastructure, and tools that help customer-facing teams understand every customer and act on that insight at scale throughout the entire customer lifecycle... 
    Work at office
    Work from home

    Lapel

    San Francisco, CA
    1 day ago
  •  ...Job Title Under the direction of the Information Technology Manager I, the Information Technology Specialist I serves as the Product Engineer for the Delete Request and Opt-Out Platform (DROP). DROP is California's first-of-its-kind privacy platform helping... 

    California State Jobs

    San Francisco, CA
    3 days ago
  • $170k - $350k

    Sr. Product Engineer Summary In this role, you’ll have the unique opportunity to shape our product and help build 0-1 — not just the technologies we use, but the overall direction of our product as it evolves. You will be responsible for building across our entire stack... 
    Full time

    Imbue, Inc.

    San Francisco, CA
    1 day ago
  • $160k - $250k

     ...will directly shape how we grow. About the Role Most CRM products were built for sales managers, not the people who actually use...  ...across the stack; PM or designer backgrounds with strong engineering skills are welcome Prior experience with PLG or growth mechanics... 
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Clarify

    San Francisco, CA
    5 hours ago
  •  ...and HOF Capital. The team is based in San Francisco and includes engineers, designers, and operators from Airbnb, Palantir, Pinterest, IMC...  ...my thoughts on the perfect candidate we're looking to join our product team: Product focused: There are a lot of features that... 

    Conversion Services

    San Francisco, CA
    1 day ago
  •  ...We're Hiring The First Engineer For Our New Product We're hiring the first engineer for our new product. You will own this from start to initial launch. Building the best APIs for realtime people and company data took us from 0 to $4M ARR in first 9 months while... 

    Crustdata (YC F24)

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...Product Engineer We're a small, dynamic team based in San Francisco, and we're looking for a product engineer to join us. In this in-person role, you'll have the opportunity to wear multiple hats, interact directly with our customers, and play a vital part in shaping... 
    Visa sponsorship

    Artie

    San Francisco, CA
    1 day ago
  • $140k - $280k

     ...this year-and that's why we're hiring. You'll ship AI-powered product features end-to-end. Real systems, real users, real revenue-the...  ...and applying it before anyone else does. The best product engineers here don't just write features. They embed with the operators who... 
    Work at office
    Remote work
    Relocation
    Monday to Friday
    Early shift

    Harper Group

    San Francisco, CA
    2 days ago
  •  ...Product Engineer We are looking for a Product Engineer with 2+ years of experience to join a fast-moving LegalTech startup transforming the U.S. immigration experience through AI. This is a backend-leaning, full-stack role where you will own meaningful product features... 
    Immediate start

    NxT Level

    San Francisco, CA
    3 days ago
  •  ...lives in Ando, and then convince their teammates and friends to do the same. We're looking for founding engineers who are excited by that challenge: building a product from first principles, shaping the future of how humans and AI collaborate, and dogfooding what they... 
    Full time
    Work from home

    ASARI S.A de CV

    San Francisco, CA
    3 days ago
  •  ...schools. Featured on Business Insider. You'll Own features end-to-end - interview customers every week and watch them use the product, and ship the feature they need by the next week Actually use the algorithms, data structures, and system design that you... 
    Full time
    Work at office
    Relocation

    Bild AI

    San Francisco, CA
    5 hours ago
  •  ...Alma Product Engineer Alma is an AI-native law firm. We combine AI with an exceptional legal team to deliver fast, transparent, and high-touch legal services at a fraction of the cost and speed of legacy firms. Our first market is immigration law. We're focused on... 
    Relocation

    Alma

    San Francisco, CA
    2 days ago
  • $2,000 per month

     ...Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded across...  ...product, data, and decision-making, and we’re looking for a Product Engineer to help take it to the next level.Why this role mattersThis isn... 
    Home office

    Amplitude

    San Francisco, CA
    4 days ago
  • $172k - $203k

     ...empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their...  ...of the office. We are looking for a Senior Mechanical Design Engineer to join our hardware team working on future wearables. This opportunity... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Oura

    San Francisco, CA
    3 days ago
  • Open call for Founders / Founding Teams (Product Management / Engineering roles) In 1973 at Xerox PARC, Bob Metcalfe sketched a way for many computers to share a single wire — borrowing the throughput math from his study of Hawaii's ALOHAnet — and he and David Boggs built... 

    Mercury

    San Francisco, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Engineer. Be the first to apply!