Product Manager, Inference

Role Description

We're looking for a Product Manager to own LiveKit Inference: the gateway that gives developers managed access to the best models for voice AI, through a single integration.

Our PM team is small and high-leverage, with each PM coming in to establish the foundations in a new area of the business. Inference is one of the most important revenue-generating products we have. It needs a dedicated owner, and that would be you.

You'll set the vision and roadmap for LiveKit Inference, from which models and providers we offer to how we think about the space evolving strategically over the medium and long term. You’ll partner directly with the engineering team that builds it. This product involves both commercial relationships with frontier model labs as well as direct model hosting and optimization.

• Recently launched a voice-optimized deployment of Gemma 4 31B.
• Scaling up to become the go-to inference provider for voice workloads.
• Goal is to make LiveKit Inference the obvious default over wiring up model providers directly.
• Decide how LiveKit stays ahead of the fast-moving model landscape.

Qualifications

• 8+ years in product management, at a senior or staff level, ideally having owned a developer-facing API, platform, or AI/ML product.
• Technical depth: Ability to reason about model serving, routing, latency, and quality tradeoffs.
• Infrastructure and tradeoff sense: Experience in managing cost, performance, and vendor/provider tradeoffs.
• Cross-functional influence: Ability to influence through clarity, trust, and good judgment.
• Communication as a superpower: Strong writing and presentation skills.
• Comfort with ambiguity: Ability to prioritize ruthlessly and move quickly without perfect information.

Requirements

• Obsessed with making the best product for customers.
• Known as the go-to person for tackling tough problems.
• Work hard and can build and ship fast.
• Focused on polish, detail, and quality.
• Fast learner, frequently picking up new tips, tricks, and skills.

Nice to Have

• Built a model gateway, inference API, model-provider product, or AI/ML platform.
• Familiarity with model benchmarking and how both performance and quality are measured (e.g. TTFT).
• Familiarity with the STT, TTS, LLM, and real-time model space and top providers.
• Background at a developer tools, API infrastructure, or AI/ML company.
• Familiarity with voice AI, real-time communication, or telephony.
• Experience with usage-based pricing models and cost or margin optimization.

Benefits

• An opportunity to build something truly impactful to the world.
• Contribute to open source alongside world-class engineers.
• Competitive salary and equity package.
• Health, dental, and vision benefits.
• Flexible vacation policy.

Our Commitment to You

LiveKit is an equal opportunity employer and does not discriminate on the basis of any characteristic protected by applicable law. If you require a reasonable accommodation during the application or interview process, please contact View email address on remotive.com.