Product Engineer
LiteLLM AI Gateway
Product Engineer LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications-and now we're building our second product. We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
About the Role This isn't a traditional product management role, and it isn't a traditional software engineering role. You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product. If you enjoy owning a problem end-to-end-from idea to production-you'll thrive here.
Responsibilities
- Build new product features from concept to production.
- Work directly with customers to understand pain points and validate solutions.
- Ship quickly while maintaining a high quality bar.
- Prototype new ideas and iterate based on user feedback.
- Own major product areas and continuously improve them over time.
- Design backend APIs and services using Python and FastAPI.
- Build intuitive developer experiences across our API, dashboard, and CLI.
- Collaborate directly with the founders on product direction and technical decisions.
- Help define and build LiteLLM's second major product.
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong software engineering fundamentals.
- Experience building production software, preferably with Python.
- Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
- Strong product intuition and curiosity about how customers use software.
- Excellent written and verbal communication.
- High ownership-you naturally identify problems and solve them without waiting to be asked.
- Comfortable operating in ambiguity and making decisions with incomplete information.
- Excited by shipping quickly and learning from real users.
- Experience at an early-stage startup.
- Experience building developer tools or infrastructure products.
- Open source contributions.
- You've built and launched your own product.
- Familiarity with AI infrastructure, LLMs, or developer platforms.
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Product Engineer in San Francisco, CA vacancy
- ...The app is live on the App Store. You will be one of the first engineers at Quippy. You will take features from a rough idea to something... ...you wrote ships to real users. What you will work on Build product end to end across the iOS app (Expo, React Native, TypeScript)...SuggestedFull timeRemote work
$150k - $250k
...San Francisco, CA | Early-Stage AI | Full-Time Some engineering roles ask you to own a piece of the product. This one gives you the opportunity to help shape the company. We’re partnering with a fast-growing, well-funded AI startup tackling one of the largest...SuggestedFull timeWork at officeMonday to Thursday- ...Founding Product Engineer — Smart Bricks (USA Launch) Location: San Francisco, CA Type: Full-time Team: Founding Team (USA) Smart Bricks is building the world’s AI-native real estate investment infrastructure. Think of us as Bloomberg + Robinhood for global real estate...SuggestedFull time
$160k - $250k
...will directly shape how we grow. About the Role Most CRM products were built for sales managers, not the people who actually use... ...across the stack; PM or designer backgrounds with strong engineering skills are welcome Prior experience with PLG or growth mechanics...SuggestedWork at officeRemote workFlexible hours3 days per week- ...Unto Labs is a team of low-level engineers pushing distributed systems to the physical limits of modern hardware. We're reimagining blockchains... ...the service of global scale applications. We're seeking a Product Engineer to invent, prototype, and launch breakthrough...Suggested
$200k - $250k
...the clock. Already profitable and with PMF, this is a lean, engineering-led team with no PM layer between you and the customer. You'll... ...is TypeScript-led. What they're looking for: Strong product engineering instincts, comfortable owning a problem from idea...- ...The Role What You'll Do Ship product and talk to users. Build performant, beautiful experiences that people genuinely enjoy... ...to external systems. What We're Looking For A strong engineer with attention to detail, thoughtful about UX, and deeply empathetic...
- ...and step in when something needs their judgment. We’re looking for an engineer who cares about making that experience useful, clear, and reliable. What you’d work on You’d build the product our customers use to work with agents, from the interface through the...
- ...from the models that design each vaccine to the tools our scientists and patients use. The role We're hiring a founding product engineer. With tools like Claude Code, anyone can write code now, so what matters most is judgment: knowing what to build and what it should...Full timeRelocation
$160k - $240k
...place the best people in the right roles to drive long-term success for both clients and candidates. Title of the role: Product Engineer Location: Remote (U.S.) Company Stage of Funding: early-stage healthcare startup Office Type: Remote Salary: $1...Work at officeRemote workFlexible hours- ...profiles across active roles and use resumes/profiles to understand which backgrounds may be a fit. THE ROLE As a Founding Product Engineer, you may work on projects that require strong execution, communication, analytical judgment, and the ability to move quickly...
- ...Hardware and software, one stack. Software alone is no moat. Lasting products are atoms and bitsdesigned together — device, install, service,... ...for people's lives — including our own. Founding AI/ML Engineer San Francisco · Full-time Make frontier-quality...Full timeLocal area
- ...Product Engineer / Product Researcher At Engram, we're building a new kind of model. Our models build familiarity and deep understanding of the workspaces they operate in, and learn continually over time. We're hiring for a new role to own this new product experience...
- ...Anything is the AI product engineer for the next wave of entrepreneurs. It's an AI agent that turns English into apps. Everything you need make money on the internet built in - mobile, web, design, AI, backend, infra, payments. Launched Aug 7th. Hit $5m rev...Temporary work
- ...Reducto has raised over $100M from world-class investors including a16z, Benchmark, and First Round Capital. The Role As a Product Engineer, you'll work on the features used by our customers to design, build, test, and evaluate their business critical document...Work at officeLocal area
$150k - $250k
...Chen (former GP at Kleiner Perkins / Coatue). Most social products make people lonelier. We were on the front page of the Wall... ...is a product building role, meaning you'll be responsible for engineering, design, product, analytics, and marketing for large features,...Work at officeLocal area$230k - $300k
...companies in AI (Hugging Face, Groq, Perplexity and a bunch of stealth product teams pushing what’s possible with AI agents) They’re building the hyperscaler for AI agents , and looking for an engineer who wants to show the world what’s possible. What you’ll do: Build...Full time- ...mission We're proud to work with many incredible companies, accelerating their ability to build their products. We've spent years watching talented engineering teams lose momentum to the same frustrating bottleneck: waiting. Waiting for CI to finish. Waiting for...Temporary workImmediate startFlexible hours
- ...Vercel. If you're interested in building critical infrastructure for agents on the web, we'd love to chat. About the Role Product Engineers at Kernel are full-stack engineers who think about the product as much as the code. You know how to translate your strong...Relocation package
$185k - $230k
...Product Engineer Location - San Francisco, CA (Hybrid) - Hybrid role requiring three days per week in-office in Downtown San Francisco. Compensation - $185,000 – $230,000 Base + Competitive Early-Stage Equity Visa - Open to Visa Transfers (OPT, H1B Transfers)...H1bWork at office3 days per week- ...As a Product Engineer at Emanate, you'll build the features our customers use to design, test, and run their business-critical revenue workflows. Our goal is to make AI-powered revenue generation accessible to companies that are building the backbone of the physical economy...
- ...lives in Ando, and then convince their teammates and friends to do the same. We're looking for founding engineers who are excited by that challenge: building a product from first principles, shaping the future of how humans and AI collaborate, and dogfooding what they...Full timeWork from home
- ...About the job Product Engineer At Cube, we're redefining how organizations deliver, consume, and automate data and analytics across teams, tools, and AI agents. Our mission is to enable Agentic Analytics, where AI agents work alongside humans on a shared semantic...Remote work
$185k - $230k
...Product Engineer Our client is a seed-stage technology company building an AI-native platform for global trade, customs compliance, and duty recovery. Its software brings fragmented documents, spreadsheets, APIs, and supply-chain data into one system so businesses...H1bWork at officeRelocation3 days per week$140k - $180k
...contracts through legal at record speed, with transparency, predictable pricing, and exceptional quality. We're hiring a Founding Product Engineer to build the platform that’s reinventing how legal work gets done. You’ll sit next to attorneys and AI engineers, turning...Work at office- ...Software Agents We're the makers of Devin, the first AI software engineer. Our team is extremely talent-dense. Among our founding team... ...surface they touch. Meeting that bar across an IDE, a web product, and a CLI requires engineers who can own the full experience,...
- ...seed funding from leading Silicon Valley investors and are scaling our small, elite engineering team to meet growing customer demand. Role Description As Mercator's first product engineer, you'll architect and build the core systems that power our simulation-...H1b
- ...serve more clients, reduce bottlenecks, and give their best people time back for higher-value work. You will work across product, design, engineering, and implementation. Some days that means mapping how tax packages move through a firm. Other days it means building a...
$150k - $195k
...Build web products end to end, from the data layer to the last few pixels, with performance and accessibility as constraints rather than aspirations. Team Web & Product Type Full-time Band $150k - $195k Location San Francisco or remote (UTC-8 to UTC+2)...Hourly payFull timeFor contractorsRemote work- ...I'm looking for a Founding Product Engineer to join me at GloweUp. GloweUp is an early-stage femtech company building at the intersection of women's hormonal health, skincare, data, and AI. We're developing a consumer platform designed to help women better understand...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Engineer. Be the first to apply!
Related searches
- entry level product engineer San Francisco, CA
- senior manager product engineering San Francisco, CA
- product design engineer San Francisco, CA
- digital design engineer San Francisco, CA
- product engineering intern San Francisco, CA
- sr. product engineer San Francisco, CA
- staff design engineer San Francisco, CA
- senior product design engineer San Francisco, CA
- rtl design engineer San Francisco, CA
- entry level design engineer San Francisco, CA

