Senior Product Manager, Inference
$160k - $275kFull-time
Lightning AI
WHO WE ARE
Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction. Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in. We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.WHAT WE'RE LOOKING FOR
We're looking for a Founding Product Manager for Inference who will own this product end-to-end—roadmap, pricing, and GTM—from the ground up. This is a zero-to-one role at the intersection of deep technical fluency and commercial instinct. You'll define what we build and why, design the developer journey from first API call to production workload, and be the product voice in sales cycles and the market. The right candidate has lived inside the machine; they've operated model serving infrastructure or shipped products on top of it, and can move fluidly between a latency/throughput tradeoff conversation with an infra engineer and a positioning conversation with a sales lead. You will be joining the Product Team and report to our VP of Product working directly with our executive team as we grow this business. This is a hybrid role based in our New York City or San Francisco office with in-office requirements of 2 days per week.WHAT YOU’LL DO
* Define Lightning AI's inference product vision and roadmap — what we build, what we don't, and in what order — translating the competitive landscape (vLLM, Together, Fireworks, Modal, hyperscaler inference APIs) into a differentiated strategy grounded in Lightning's compute and software advantage * Own inference pricing and packaging end-to-end: design the model (per-token, per-second, reserved capacity), run pricing experiments with Growth and Finance, and define the tiers that convert self-serve developers into enterprise contracts * Be the product voice in GTM: develop sales positioning, answer technical objections in the field, and partner with Marketing on the benchmarks, reference architectures, and developer content that builds credibility with ML engineers and platform teams * Own the developer journey from API key to production-scale deployment — identify and remove friction across onboarding, documentation, SDK ergonomics, and dashboard observability * Lead experiments across activation flows, pricing pages, and upgrade prompts; track and move DAU/MAU, Time to Value, Activation %, PQLs, and expansion revenue * Partner with engineering to write tight specs and make fast build/buy/partner decisions; collaborate across Product to ensure inference coheres with training, fine-tuning, and storage surfaces * Establish inference-specific metrics — throughput, latency SLAs, cold-start behavior, cost per token — and build the instrumentation to track themWHAT YOU’LL NEED
* 7+ years of product management experience, with at least 3 years in infrastructure, platform, or developer tooling products * Direct, hands-on experience with model serving or inference infrastructure — you've shipped in this space; you understand quantization, batching strategies, KV cache, and speculative decoding at a level that lets you go deep with ML engineers * Proven track record owning product pricing and packaging decisions, not just feature decisions — you've modeled unit economics and made calls that affected margin * Experience with a PLG or trial-to-paid motion in a developer product; you know how to build self-serve growth loops and run rigorous A/B experiments * Strong analytical skills — comfortable with product instrumentation, metrics, and dashboards; you pull your own data * Excellent written and verbal communication; you can write a crisp one-pager, a technical spec, and a customer-facing benchmark brief with equal fluency * Bias for action and comfort operating with high ambiguity in a fast-moving environment * Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience) * Bonus: Prior experience at a neocloud, hyperscaler inference team, or AI infrastructure startup; familiarity with the PyTorch/Lightning ecosystem; background in GPU cluster products or consumption-based infrastructure pricingCOMPENSATION
We are committed to offering competitive compensation that reflects the value each team member brings to our mission. Final offers are based on factors such as experience, skills, geographic location, and role expectations. In addition to base salary, our total rewards package for eligible roles includes a discretionary bonus, a meaningful equity component, and comprehensive benefits. The anticipated annual base salary range for this role is:$160,000—$275,000 USD
BENEFITS AND PERKS
We offer a comprehensive and competitive benefits package designed to support our employees’ health, well-being, and long-term success. Benefits may vary by location, team, and role. Benefits include: * Comprehensive medical, dental and vision coverage (U.S.); Private medical and dental insurance (U.K.)- Retirement and financial wellness support (U.S.); Pension contribution (U.K.)
- Generous paid time off, plus holidays
- Paid parental leave
- Professional development support
- Wellness and work-from-home stipends
- Flexible work environment
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Product Manager, Inference in New York, NY vacancy
$156k - $180k
...range $156,000.00/yr - $180,000.00/yr Job Description As a Senior Product Manager specializing in offer optimization, you will spearhead the... ...increase your chances of interviewing at Postscript by 2x Inferred from the description for this job Medical insurance 401(k)...SeniorFull timeRemote workWork from homeFlexible hours$185k - $235k
...Senior Product Manager — Agentic AI Experiences New York, New York About the Role Wizard is building an AI-powered shopping experience that... ...workflows, and product requirements. Partner with engineering on inference pipelines, agent planning, retrieval, and orchestration...SeniorRemote workFlexible hours$98.68k - $148.02k
...ISACA is seeking a Sr. Product Manager to drive the strategy and execution of products serving membership domains like security and audit. This strategic role will collaborate cross-functionally while overseeing the product lifecycle from ideation to market launch. The...Senior- ...Impiricus, Inc. is looking for a Senior Product Manager to define and execute the omnichannel growth roadmap. In this role, you will lead cross-functional teams from concept to launch while ensuring adherence to compliance in a regulated environment. You should have at...Senior
- ...OKX is seeking a Product Manager to lead the development and delivery of product strategies within its Trading Product Group. The successful candidate will have 5-8 years of experience in product management with a strong interest in the Web3/Crypto industry. Responsibilities...Senior
$96.5k - $207.5k
...Fifth Third Bank, N.A. is seeking a Senior Product Manager to lead the growth of Integrated Payables within our Commercial Payments portfolio. This role involves designing payment experiences that improve operational efficiency while ensuring solutions are both viable...Senior$190k - $220k
...A leading real estate investing platform in the United States seeks a Senior Product Manager to drive key marketplace strategies and experiences. In this pivotal role, you will collaborate closely with engineering, design, and business teams to create innovative, user...SeniorFlexible hours$166k - $208k
...Framework Ventures is looking for a Product Manager to lead the strategy for engagement tooling. This role involves defining the product vision, improving engagement metrics, and collaborating with design, engineering, and marketing teams. Ideal candidates will have over...Senior- ...A leading technology company is seeking a Senior Product Manager to manage the product life cycle of its offerings. The ideal candidate will have over 5 years of experience in Product Management, particularly in SaaS and enterprise software. Strong organizational abilities...Senior
- ...A leading analytics engineering company is seeking a Product Manager for Developer Experience to enhance the developer workflow within their platform. This remote role involves owning the roadmap across various tools, collaborating closely with engineering teams, and leading...SeniorRemote work
$145k - $220k
...A leading mobile gaming company is seeking a Sr. Product Manager for the Marvel Strike Force team. This role involves owning the performance and implementation of key monetization strategies through data analysis and SQL expertise. Ideal candidates will have experience...SeniorRemote work- ...Ondo Finance is seeking a Senior Product Manager to enhance integrations and discovery of high-value opportunities. This role demands experience in product management and a background in blockchain and DeFi. The ideal candidate will engage with customers and partners,...SeniorRemote work
$170k - $210k
...A leading developer tools company is seeking a Product Manager to enhance their platform's user experience. This fully remote role involves collaborating across teams to address customer needs, drive product innovations, and ensure software quality. You will synthesize...SeniorRemote work- ...Skills: - Mandatory skills 6+ years in product management, with extensive hands-on involvement in healthcare SaaS, payer-to-payer integrations, IT consolidation, or data products. Proven track record in facilitating story map prioritization and coordinating complex epics...Senior
- ...Framework Ventures is looking for a Senior Product Manager for KYC Experience & Compliance to lead the product strategy, execution, and outcomes. The role involves owning the end-to-end KYC process while ensuring compliance and user trust. Ideal candidates will have over...Senior
$170k - $200k
...hire better, is partnering with an AI-native platform transforming how insurance underwriting is done. Quick Snapshot Role: Senior Product Manager Compensation: $170K – $200K + bonus + equity Location: Remote (U.S) Experience: 5 - 8 years of experience building and...SeniorRemote work- ...clinical outcomes, and address social drivers of health. The product and engineering teams operate in a fully distributed... ...Interoperability across the platform. Role: We’re seeking an experienced Senior Product Manager with deep expertise in Clinical Data and Healthcare...SeniorRemote work
$140k - $185k
# Senior Product ManagerRemote-first · NYC preferred Full-time $140k – $185k / year SeniorProductRemote### Apply for this role## About the... ...results to leadership## Requirements* •5+ years of product management experience at a technology company* •Strong analytical skills...SeniorFull timeRemote work- ...impressions a month. InMobi is looking for a product leader to drive this vision by solving... ...tech ecosystem today. In the role of a senior PM within InMobi Exchange, you will be... ...consisting of product marketing and partner management functions. Responsibilities Responsible...Senior
$175k - $244.5k
...Highlevel is seeking a skilled Product Manager to lead the Creators Product team in the United States. The role focuses on enhancing the learning experience for over 1.1 million monthly users through strategic leadership, collaboration, and analytics. As a remote-first...SeniorRemote work$10 per hour
...globe. We’re an 80-person team (~50 in engineering), located across North and South America. The Role We’re looking for a Senior Product Manager to join Canals as our second full-time product hire. You’ll report directly to our co-founder, CEO, who has owned all product...SeniorFull timeRemote workFlexible hours- ...FinMkt’s proprietary, omni-channel, and product-agnostic SaaS platform is optimized for... ...well versed in the core tenets of product management and has the drive to understand the... ...organization. Experience working closely with senior leadership. Experience translating data...SeniorWork experience placementRemote work
$129k - $228k
...A leading life insurance technology firm is looking for a seasoned product manager to enhance the digital consumer experience. This role involves building customer-focused online shopping experiences, driving improvements to conversion rates, and educating consumers about...SeniorFull timeRemote work- ...Squared LATAM, we partner with leading U.S. companies to build high-impact digital products through strong product, design, and engineering practices. We are looking for a Senior Product Manager – Patient Experience to join a U.S.-based digital health company and lead the...SeniorRemote work
$225k - $300k
...15 hours a month on average. In both our product and our workplace, we’re intentional about... .... About the role We’re looking for a Senior PM to join our team. The product team currently... ...this PM with a dedicated team. You will Manage our product roadmap. You’ll be working...SeniorRemote workFlexible hours$100k
...Overview Will look in US and Europe We are seeking a Senior Product Manager – eSIM to drive the strategy, roadmap, and execution of our eSIM product portfolio across digital channels. This role plays a key part in anticipating user needs and driving the design and launch...SeniorWorldwide- ...⭐️ We are looking for a data-driven and commercially minded Product Manager, Growth to join our Growth team. In this role, you will own the... ...strategies, experiment results, and roadmap priorities to senior stakeholders. Contribute to a culture of experimentation and...SeniorRemote workFlexible hours
- ...a tech-enabled comprehensive medication management (CMM) service augmented by an extended clinical... ...skilled and dedicated Director of Product Management to help build the solutions... ...right times About the Role We are seeking a Senior Product Management to serve as the day-...SeniorFull timeRemote work
- ...Senior Product Manager (multiple positions across AI-forward products & life sciences tech) We’re partnering with an innovative health tech company on a mission to transform healthcare affordability and access. Their enterprise solution is reshaping how patients, providers...Senior
- ...coin economy and rewarded ad monetization. This is a 0-1 build with real P&L ownership, not roadmap management. You'll ship fast, own the numbers, and shape a product that already reaches 40M+ users in the US. What you'll own: Virtual Economy Design — Architect the coin...SeniorCasual work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Product Manager, Inference. Be the first to apply!
Related searches
- product offering manager New York, NY
- senior director product management New York, NY
- product strategy manager New York, NY
- regulatory product manager New York, NY
- sr technical product manager New York, NY
- product engineering manager New York, NY
- product manager crm New York, NY
- product manager beauty New York, NY
- health product manager New York, NY
- director product strategy New York, NY

