Product Engineer
LiteLLM AI Gateway
Product Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
- Build new product features from concept to production.
- Work directly with customers to understand pain points and validate solutions.
- Ship quickly while maintaining a high quality bar.
- Prototype new ideas and iterate based on user feedback.
- Own major product areas and continuously improve them over time.
- Design backend APIs and services using Python and FastAPI.
- Build intuitive developer experiences across our API, dashboard, and CLI.
- Collaborate directly with the founders on product direction and technical decisions.
- Help define and build LiteLLM's second major product.
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong software engineering fundamentals.
- Experience building production software, preferably with Python.
- Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
- Strong product intuition and curiosity about how customers use software.
- Excellent written and verbal communication.
- High ownership-you naturally identify problems and solve them without waiting to be asked.
- Comfortable operating in ambiguity and making decisions with incomplete information.
- Excited by shipping quickly and learning from real users.
- Experience at an early-stage startup.
- Experience building developer tools or infrastructure products.
- Open source contributions.
- You've built and launched your own product.
- Familiarity with AI infrastructure, LLMs, or developer platforms.
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Product Engineer in San Francisco, CA vacancy
$197.3k - $313.7k
...right place! Agentforce is the future of AI, and you are the future of Salesforce.About the TeamThe Customer Engineering team is Salesforce's zero-to-one product hardening function for Service Cloud and Agentforce. We embed senior engineers directly with a small...SuggestedFull timeLive in$150k - $250k
About the RoleWe're looking for a Product Engineer who wants to operate like a founder.Not someone who waits for specs and tickets. Someone who sees opportunities, talks to users, prototypes fast, ships relentlessly, and helps define what the product should become.This...Suggested- ...Clarity Pediatrics, Inc. is looking for a Growth Engineer to lead product-led growth initiatives from research to implementation. You will enhance provider referrals and develop enterprise integrations essential for growth. The ideal candidate has 6+ years of product...Suggested
$200k - $275k
...000.00/yr Direct message the job poster from Confero Hiring Staff/Principal Software and Security Engineers for IAM, AppSec and AI Security vendors Product Engineer | AI Agents for Enterprise Compliance | $280K DOE + Equity | Palo Alto Confero is partnered...SuggestedFull time- ...Kinelo, a seed-stage company with a San Francisco office, is hiring two Product Engineers to collaborate with AI agents and human teammates. You’ll help shape architecture, product requirements, and user needs while delivering software that ships and scales in a fast-moving...SuggestedWork at office
- ...David Joseph & Company seeks a Product Operations Lead in San Francisco to own and scale the data-ops platform, managing the human... ...campaigns, build workflows from scratch, and collaborate with engineering to ship tooling improvements. The role prioritizes startup experience...Full time
$140k - $200k
...Base pay range $139,999.00/yr - $200,000.00/yr Mission We’re looking for full stack Product Engineers to join our team building AthenaHQ, the leading platform powering global brands on AI Search. We’re looking for an engineer who enjoys owning products You’ll work with...Full time- ...A leading AI systems company in San Francisco seeks a Sr. Product Engineer to shape product direction and build across the entire stack. The ideal candidate combines product intuition with technical skills, notably in React, Typescript, and Python. Responsibilities include...
$130k - $150k
...institutions, and crypto companies detect and prevent financial crime — from terrorist financing to human trafficking. The Full-Stack Product Engineering team builds the core products and services that make this possible, from customer-facing applications to foundational APIs...Summer workInternshipWork at officeImmediate startWorldwide3 days per week- ...Stand is seeking an experienced engineer to translate complex domain problems into shippable systems in San Francisco. You will own production architectures, drive quality and reliability, and collaborate with stakeholders to define success metrics and tradeoffs under...
- ...Fluidstack in San Francisco is seeking a proficient engineer for the Decision Team to help automate capital and asset processes for... ...into structured data and actionable insights. You will deploy production code in Go, Python, or TypeScript, leverage LLMs, and build systems...
- ...Software Guidance & Assistance, Inc. (SGA), is seeking an AI Product Engineer (LLM, voice AI agent) for a full-time position in San Francisco, CA. The role is hybrid with 2-3 days onsite weekly, offering ownership across the stack and direct impact on scalable voice interviewing...Full time
- ...exclusive features. Direct message the job poster from Novel Technology Services Our client is looking for theirfirst dedicated product engineer. They are an AI driven startup to produce the data and evals necessary for comprehensively automating work enabling agents to...Full timeRemote work
$140k - $200k
...Join to apply for the Product Engineer role at Hamming AI Join to apply for the Product Engineer role at Hamming AI Get AI-powered advice on this job and more exclusive features. This range is provided by Hamming AI. Your actual pay will be based on your skills and experience...Full time$230k - $300k
...companies in AI (Hugging Face, Groq, Perplexity and a bunch of stealth product teams pushing what’s possible with AI agents) They’re building the hyperscaler for AI agents , and looking for an engineer who wants to show the world what’s possible. What you’ll do: Build...Full time- ...Lapel Product Engineering Role At Lapel, we believe the most hospitable companies win. We're building the data, infrastructure, and tools that help customer-facing teams understand every customer and act on that insight at scale throughout the entire customer lifecycle...Work at officeWork from home
- ...Job Title Under the direction of the Information Technology Manager I, the Information Technology Specialist I serves as the Product Engineer for the Delete Request and Opt-Out Platform (DROP). DROP is California's first-of-its-kind privacy platform helping...
$170k - $350k
Sr. Product Engineer Summary In this role, you’ll have the unique opportunity to shape our product and help build 0-1 — not just the technologies we use, but the overall direction of our product as it evolves. You will be responsible for building across our entire stack...Full time$160k - $250k
...will directly shape how we grow. About the Role Most CRM products were built for sales managers, not the people who actually use... ...across the stack; PM or designer backgrounds with strong engineering skills are welcome Prior experience with PLG or growth mechanics...Work at officeRemote workFlexible hours3 days per week- ...and HOF Capital. The team is based in San Francisco and includes engineers, designers, and operators from Airbnb, Palantir, Pinterest, IMC... ...my thoughts on the perfect candidate we're looking to join our product team: Product focused: There are a lot of features that...
- ...We're Hiring The First Engineer For Our New Product We're hiring the first engineer for our new product. You will own this from start to initial launch. Building the best APIs for realtime people and company data took us from 0 to $4M ARR in first 9 months while...
$150k - $250k
...Product Engineer We're a small, dynamic team based in San Francisco, and we're looking for a product engineer to join us. In this in-person role, you'll have the opportunity to wear multiple hats, interact directly with our customers, and play a vital part in shaping...Visa sponsorship$140k - $280k
...this year-and that's why we're hiring. You'll ship AI-powered product features end-to-end. Real systems, real users, real revenue-the... ...and applying it before anyone else does. The best product engineers here don't just write features. They embed with the operators who...Work at officeRemote workRelocationMonday to FridayEarly shift- ...Product Engineer We are looking for a Product Engineer with 2+ years of experience to join a fast-moving LegalTech startup transforming the U.S. immigration experience through AI. This is a backend-leaning, full-stack role where you will own meaningful product features...Immediate start
- ...lives in Ando, and then convince their teammates and friends to do the same. We're looking for founding engineers who are excited by that challenge: building a product from first principles, shaping the future of how humans and AI collaborate, and dogfooding what they...Full timeWork from home
- ...schools. Featured on Business Insider. You'll Own features end-to-end - interview customers every week and watch them use the product, and ship the feature they need by the next week Actually use the algorithms, data structures, and system design that you...Full timeWork at officeRelocation
- ...Alma Product Engineer Alma is an AI-native law firm. We combine AI with an exceptional legal team to deliver fast, transparent, and high-touch legal services at a fraction of the cost and speed of legacy firms. Our first market is immigration law. We're focused on...Relocation
$2,000 per month
...Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded across... ...product, data, and decision-making, and we’re looking for a Product Engineer to help take it to the next level.Why this role mattersThis isn...Home office$172k - $203k
...empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their... ...of the office. We are looking for a Senior Mechanical Design Engineer to join our hardware team working on future wearables. This opportunity...Work at officeLocal areaRemote workFlexible hours- Open call for Founders / Founding Teams (Product Management / Engineering roles) In 1973 at Xerox PARC, Bob Metcalfe sketched a way for many computers to share a single wire — borrowing the throughput math from his study of Hawaii's ALOHAnet — and he and David Boggs built...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Engineer. Be the first to apply!
Related searches
- data center design engineer San Francisco, CA
- cad design engineer solidworks San Francisco, CA
- new product engineer San Francisco, CA
- chief design engineer San Francisco, CA
- product engineer San Francisco, CA
- entry level design engineer San Francisco, CA
- senior manager product engineering San Francisco, CA
- ic design engineer San Francisco, CA
- sr. product engineer San Francisco, CA
- digital design engineer San Francisco, CA

