Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Engineer

LiteLLM AI Gateway

Product Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product.

We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role

This isn't a traditional product management role, and it isn't a traditional software engineering role.

You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM's second major product.
What We're Looking For
  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership-you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.
Bonus Points
  • Experience at an early-stage startup.
  • Experience building developer tools or infrastructure products.
  • Open source contributions.
  • You've built and launched your own product.
  • Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Product Engineer in San Francisco, CA vacancy
  •  ...The app is live on the App Store. You will be one of the first engineers at Quippy. You will take features from a rough idea to something...  ...you wrote ships to real users. What you will work on Build product end to end across the iOS app (Expo, React Native, TypeScript)... 
    Suggested
    Full time
    Remote work

    Quippy

    San Francisco, CA
    1 hour ago
  • $150k - $250k

     ...San Francisco, CA | Early-Stage AI | Full-Time Some engineering roles ask you to own a piece of the product. This one gives you the opportunity to help shape the company. We’re partnering with a fast-growing, well-funded AI startup tackling one of the largest... 
    Suggested
    Full time
    Work at office
    Monday to Thursday

    EPIC Placements

    San Francisco, CA
    3 days ago
  •  ...Founding Product Engineer — Smart Bricks (USA Launch) Location: San Francisco, CA Type: Full-time Team: Founding Team (USA) Smart Bricks is building the world’s AI-native real estate investment infrastructure. Think of us as Bloomberg + Robinhood for global real estate... 
    Suggested
    Full time

    Smart Bricks

    San Francisco, CA
    9 hours ago
  • $160k - $250k

     ...will directly shape how we grow. About the Role Most CRM products were built for sales managers, not the people who actually use...  ...across the stack; PM or designer backgrounds with strong engineering skills are welcome Prior experience with PLG or growth mechanics... 
    Suggested
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Madrona Venture Labs

    San Francisco, CA
    2 days ago
  •  ...Unto Labs is a team of low-level engineers pushing distributed systems to the physical limits of modern hardware. We're reimagining blockchains...  ...the service of global scale applications. We're seeking a Product Engineer to invent, prototype, and launch breakthrough... 
    Suggested

    Unto Labs

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...the clock. Already profitable and with PMF, this is a lean, engineering-led team with no PM layer between you and the customer. You'll...  ...is TypeScript-led. What they're looking for: Strong product engineering instincts, comfortable owning a problem from idea... 

    Trust In Soda

    San Francisco, CA
    4 days ago
  •  ...The Role What You'll Do Ship product and talk to users. Build performant, beautiful experiences that people genuinely enjoy...  ...to external systems. What We're Looking For A strong engineer with attention to detail, thoughtful about UX, and deeply empathetic... 

    ThirdLayer, Inc.

    San Francisco, CA
    2 days ago
  •  ...and step in when something needs their judgment. We’re looking for an engineer who cares about making that experience useful, clear, and reliable. What you’d work on You’d build the product our customers use to work with agents, from the interface through the... 

    Varick Agents LTD.

    San Francisco, CA
    3 days ago
  •  ...from the models that design each vaccine to the tools our scientists and patients use. The role We're hiring a founding product engineer. With tools like Claude Code, anyone can write code now, so what matters most is judgment: knowing what to build and what it should... 
    Full time
    Relocation

    Serova

    San Francisco, CA
    4 days ago
  • $160k - $240k

     ...place the best people in the right roles to drive long-term success for both clients and candidates. Title of the role: Product Engineer Location: Remote (U.S.) Company Stage of Funding: early-stage healthcare startup Office Type: Remote Salary: $1... 
    Work at office
    Remote work
    Flexible hours

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  •  ...profiles across active roles and use resumes/profiles to understand which backgrounds may be a fit. THE ROLE As a Founding Product Engineer, you may work on projects that require strong execution, communication, analytical judgment, and the ability to move quickly... 

    Career-Launch.net

    San Francisco, CA
    2 days ago
  •  ...Hardware and software, one stack. Software alone is no moat. Lasting products are atoms and bitsdesigned together — device, install, service,...  ...for people's lives — including our own. Founding AI/ML Engineer San Francisco · Full-time Make frontier-quality... 
    Full time
    Local area

    Project Crete, Inc.

    San Francisco, CA
    5 days ago
  •  ...Product Engineer / Product Researcher At Engram, we're building a new kind of model. Our models build familiarity and deep understanding of the workspaces they operate in, and learn continually over time. We're hiring for a new role to own this new product experience... 

    Engram Lab

    San Francisco, CA
    2 days ago
  •  ...Anything is the AI product engineer for the next wave of entrepreneurs. It's an AI agent that turns English into apps. Everything you need make money on the internet built in - mobile, web, design, AI, backend, infra, payments. Launched Aug 7th. Hit $5m rev... 
    Temporary work

    CREATE

    San Francisco, CA
    2 days ago
  •  ...Reducto has raised over $100M from world-class investors including a16z, Benchmark, and First Round Capital. The Role As a Product Engineer, you'll work on the features used by our customers to design, build, test, and evaluate their business critical document... 
    Work at office
    Local area

    Reducto, Inc.

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...Chen (former GP at Kleiner Perkins / Coatue). Most social products make people lonelier. We were on the front page of the Wall...  ...is a product building role, meaning you'll be responsible for engineering, design, product, analytics, and marketing for large features,... 
    Work at office
    Local area

    Relationship LLC

    San Francisco, CA
    4 days ago
  • $230k - $300k

     ...companies in AI (Hugging Face, Groq, Perplexity and a bunch of stealth product teams pushing what’s possible with AI agents) They’re building the hyperscaler for AI agents , and looking for an engineer who wants to show the world what’s possible. What you’ll do: Build... 
    Full time

    AMIGOS

    San Francisco, CA
    5 days ago
  •  ...mission We're proud to work with many incredible companies, accelerating their ability to build their products. We've spent years watching talented engineering teams lose momentum to the same frustrating bottleneck: waiting. Waiting for CI to finish. Waiting for... 
    Temporary work
    Immediate start
    Flexible hours

    Name.Space

    San Francisco, CA
    2 days ago
  •  ...Vercel. If you're interested in building critical infrastructure for agents on the web, we'd love to chat. About the Role Product Engineers at Kernel are full-stack engineers who think about the product as much as the code. You know how to translate your strong... 
    Relocation package

    Kernel (yc S25)

    San Francisco, CA
    3 days ago
  • $185k - $230k

     ...Product Engineer Location - San Francisco, CA (Hybrid) - Hybrid role requiring three days per week in-office in Downtown San Francisco. Compensation - $185,000 – $230,000 Base + Competitive Early-Stage Equity Visa - Open to Visa Transfers (OPT, H1B Transfers)... 
    H1b
    Work at office
    3 days per week

    Recruiting from Scratch

    San Francisco, CA
    3 days ago
  •  ...As a Product Engineer at Emanate, you'll build the features our customers use to design, test, and run their business-critical revenue workflows. Our goal is to make AI-powered revenue generation accessible to companies that are building the backbone of the physical economy... 

    Emanate

    San Francisco, CA
    4 days ago
  •  ...lives in Ando, and then convince their teammates and friends to do the same. We're looking for founding engineers who are excited by that challenge: building a product from first principles, shaping the future of how humans and AI collaborate, and dogfooding what they... 
    Full time
    Work from home

    Ando

    San Francisco, CA
    4 days ago
  •  ...About the job Product Engineer At Cube, we're redefining how organizations deliver, consume, and automate data and analytics across teams, tools, and AI agents. Our mission is to enable Agentic Analytics, where AI agents work alongside humans on a shared semantic... 
    Remote work

    Cube Dev, Inc

    San Francisco, CA
    3 days ago
  • $185k - $230k

     ...Product Engineer Our client is a seed-stage technology company building an AI-native platform for global trade, customs compliance, and duty recovery. Its software brings fragmented documents, spreadsheets, APIs, and supply-chain data into one system so businesses... 
    H1b
    Work at office
    Relocation
    3 days per week

    Seed-stage technology company

    San Francisco, CA
    2 days ago
  • $140k - $180k

     ...contracts through legal at record speed, with transparency, predictable pricing, and exceptional quality. We're hiring a Founding Product Engineer to build the platform that’s reinventing how legal work gets done. You’ll sit next to attorneys and AI engineers, turning... 
    Work at office

    Arceus

    San Francisco, CA
    4 days ago
  •  ...Software Agents We're the makers of Devin, the first AI software engineer. Our team is extremely talent-dense. Among our founding team...  ...surface they touch. Meeting that bar across an IDE, a web product, and a CLI requires engineers who can own the full experience,... 

    Cognition AI

    San Francisco, CA
    3 days ago
  •  ...seed funding from leading Silicon Valley investors and are scaling our small, elite engineering team to meet growing customer demand. Role Description As Mercator's first product engineer, you'll architect and build the core systems that power our simulation-... 
    H1b

    Mercator Inc

    San Francisco, CA
    4 days ago
  •  ...serve more clients, reduce bottlenecks, and give their best people time back for higher-value work. You will work across product, design, engineering, and implementation. Some days that means mapping how tax packages move through a firm. Other days it means building a... 

    Cranston Accounting Group

    San Francisco, CA
    2 days ago
  • $150k - $195k

     ...Build web products end to end, from the data layer to the last few pixels, with performance and accessibility as constraints rather than aspirations. Team Web & Product Type Full-time Band $150k - $195k Location San Francisco or remote (UTC-8 to UTC+2)... 
    Hourly pay
    Full time
    For contractors
    Remote work

    Brainfullstack Ltd.

    San Francisco, CA
    2 days ago
  •  ...I'm looking for a Founding Product Engineer to join me at GloweUp. GloweUp is an early-stage femtech company building at the intersection of women's hormonal health, skincare, data, and AI. We're developing a consumer platform designed to help women better understand... 

    GloweUp

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Engineer. Be the first to apply!