Senior Product Manager - Inference Platform

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Product Manager – Inference Platform based in the United States.

Take ownership of a core product stream within a high-performance AI inference platform designed to make large-scale AI workloads more efficient, reliable, and accessible. In this role, you will shape product strategy and roadmaps, guide execution across multiple engineering teams, and drive platform capabilities from conception through launch and adoption. You will work at the intersection of AI infrastructure, distributed systems, and enterprise software, translating complex technical challenges into customer-focused solutions. By collaborating closely with engineering, research, and enterprise customers, you will help optimize inference performance, scalability, and cost efficiency. You will also monitor emerging models, hardware, and market trends to identify opportunities for innovation. This remote opportunity offers significant ownership, technical depth, and the chance to influence the infrastructure powering the next generation of AI applications.

As a Senior Product Manager – Inference Platform, you will lead the strategy, development, and adoption of critical inference platform capabilities while aligning technical execution with customer needs and business priorities. Your responsibilities will include:

• Own the product strategy, roadmap, and measurable outcomes for a core stream of the AI inference platform.

• Coordinate and align multiple cross-functional engineering teams working on public APIs, request routing, performance optimization, reliability, and enterprise enablement.

• Partner with engineering and research teams to improve inference scalability, reliability, and cost efficiency.

• Translate complex technical improvements into dependable platform capabilities that deliver tangible value to developers and enterprise customers.

• Conduct customer research, interviews, and hands-on proofs of concept, with particular attention to managed enterprise customers.

• Analyze emerging open-source models, inference economics, hardware developments, and real-world AI adoption patterns to identify product opportunities.

• Turn market insights and customer feedback into prioritized product initiatives and strategic investment decisions.

• Communicate product direction, requirements, trade-offs, and expectations effectively across engineering, research, sales, support, and leadership.

• Develop clear product requirements documents (PRDs), request for comments (RFCs), release notes, and other documentation to support alignment and delivery.

• Adapt product priorities and execution plans as customer requirements, technologies, and market conditions evolve.

Requirements:

The ideal candidate combines strong product leadership with hands-on technical understanding of AI inference and production infrastructure. You should be comfortable navigating ambiguity, influencing engineering teams, and translating complex technical concepts into clear product decisions. Required qualifications include:

• Demonstrated experience launching and managing technical platform products from strategy through delivery and adoption.

• Senior-level product management experience with the ability to lead initiatives spanning multiple engineering teams.

• Strong technical understanding of AI inference, including model serving, distributed systems, and production infrastructure.

• Ability to independently analyze technical problems, evaluate trade-offs, and develop informed product decisions in close collaboration with engineers.

• Experience working with B2B or enterprise customers, particularly technical buyers.

• Excellent communication and stakeholder management skills across engineering, research, sales, support, and leadership.

• Strong written communication skills, including experience preparing clear PRDs, RFCs, release notes, and technical product documentation.

• Ability to manage expectations, prioritize competing needs, and maintain alignment across cross-functional teams.

• Comfort working in a fast-moving environment where product scope, technology, and customer requirements can change quickly.

• Strong analytical thinking and a customer-focused approach to product development.

Additional experience that would be an advantage:

• Experience with model post-training, including training draft models.

• Experience establishing and managing third-party technical partnerships.

Benefits:

• Competitive base salary: Annual compensation ranging from $228,000 to $285,000 , depending on experience, skills, qualifications, hiring level, and geographic location.

• Comprehensive health coverage: Medical, dental, and vision insurance fully paid by the employer for employees and their families.

• Retirement savings: 401(k) plan with an employer match of up to 4%, with immediate vesting.

• Paid parental leave: 20 weeks for primary caregivers and 12 weeks for secondary caregivers.

• Remote work support: Monthly reimbursement of up to $85 for mobile and internet expenses.

• Insurance protection: Employer-paid short-term disability, long-term disability, and life insurance coverage.

• Career development: Opportunities for professional growth, continuous learning, and skill development.

• Flexibility and ownership: A remote working arrangement that encourages autonomy and accountability.

• Collaborative culture: Work alongside talented international teams in an innovative, fast-moving environment.

• Meaningful impact: Contribute to advanced AI infrastructure and help shape the future of large-scale AI applications.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1