Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Product Manager, Inference

$160k - $275k
Full-time

Lightning AI

WHO WE ARE

Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction. Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in. We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.

WHAT WE'RE LOOKING FOR

We're looking for a Founding Product Manager for Inference who will own this product end-to-end—roadmap, pricing, and GTM—from the ground up. This is a zero-to-one role at the intersection of deep technical fluency and commercial instinct. You'll define what we build and why, design the developer journey from first API call to production workload, and be the product voice in sales cycles and the market. The right candidate has lived inside the machine; they've operated model serving infrastructure or shipped products on top of it, and can move fluidly between a latency/throughput tradeoff conversation with an infra engineer and a positioning conversation with a sales lead. You will be joining the Product Team and report to our VP of Product working directly with our executive team as we grow this business. This is a hybrid role based in our New York City or San Francisco office with in-office requirements of 2 days per week.

WHAT YOU’LL DO

* Define Lightning AI's inference product vision and roadmap — what we build, what we don't, and in what order — translating the competitive landscape (vLLM, Together, Fireworks, Modal, hyperscaler inference APIs) into a differentiated strategy grounded in Lightning's compute and software advantage * Own inference pricing and packaging end-to-end: design the model (per-token, per-second, reserved capacity), run pricing experiments with Growth and Finance, and define the tiers that convert self-serve developers into enterprise contracts * Be the product voice in GTM: develop sales positioning, answer technical objections in the field, and partner with Marketing on the benchmarks, reference architectures, and developer content that builds credibility with ML engineers and platform teams * Own the developer journey from API key to production-scale deployment — identify and remove friction across onboarding, documentation, SDK ergonomics, and dashboard observability * Lead experiments across activation flows, pricing pages, and upgrade prompts; track and move DAU/MAU, Time to Value, Activation %, PQLs, and expansion revenue * Partner with engineering to write tight specs and make fast build/buy/partner decisions; collaborate across Product to ensure inference coheres with training, fine-tuning, and storage surfaces * Establish inference-specific metrics — throughput, latency SLAs, cold-start behavior, cost per token — and build the instrumentation to track them

WHAT YOU’LL NEED

* 7+ years of product management experience, with at least 3 years in infrastructure, platform, or developer tooling products * Direct, hands-on experience with model serving or inference infrastructure — you've shipped in this space; you understand quantization, batching strategies, KV cache, and speculative decoding at a level that lets you go deep with ML engineers * Proven track record owning product pricing and packaging decisions, not just feature decisions — you've modeled unit economics and made calls that affected margin * Experience with a PLG or trial-to-paid motion in a developer product; you know how to build self-serve growth loops and run rigorous A/B experiments * Strong analytical skills — comfortable with product instrumentation, metrics, and dashboards; you pull your own data * Excellent written and verbal communication; you can write a crisp one-pager, a technical spec, and a customer-facing benchmark brief with equal fluency * Bias for action and comfort operating with high ambiguity in a fast-moving environment * Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience) * Bonus: Prior experience at a neocloud, hyperscaler inference team, or AI infrastructure startup; familiarity with the PyTorch/Lightning ecosystem; background in GPU cluster products or consumption-based infrastructure pricing

COMPENSATION

We are committed to offering competitive compensation that reflects the value each team member brings to our mission. Final offers are based on factors such as experience, skills, geographic location, and role expectations. In addition to base salary, our total rewards package for eligible roles includes a discretionary bonus, a meaningful equity component, and comprehensive benefits. The anticipated annual base salary range for this role is:

$160,000—$275,000 USD

BENEFITS AND PERKS

We offer a comprehensive and competitive benefits package designed to support our employees’ health, well-being, and long-term success. Benefits may vary by location, team, and role. Benefits include: * Comprehensive medical, dental and vision coverage (U.S.); Private medical and dental insurance (U.K.)
  • Retirement and financial wellness support (U.S.); Pension contribution (U.K.)
  • Generous paid time off, plus holidays
  • Paid parental leave
  • Professional development support
  • Wellness and work-from-home stipends
  • Flexible work environment
At Lightning AI, we are committed to fostering an inclusive and diverse workplace. We believe that diverse teams drive innovation and create better products. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic. We are dedicated to building a culture where everyone can thrive and contribute to their fullest potential.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Product Manager, Inference in New York, NY vacancy
  • $156k - $180k

     ...range $156,000.00/yr - $180,000.00/yr Job Description As a Senior Product Manager specializing in offer optimization, you will spearhead the...  ...increase your chances of interviewing at Postscript by 2x Inferred from the description for this job Medical insurance 401(k)... 
    Senior
    Full time
    Remote work
    Work from home
    Flexible hours

    Post Script

    New York, NY
    5 days ago
  • $185k - $235k

     ...Senior Product Manager — Agentic AI Experiences New York, New York About the Role Wizard is building an AI-powered shopping experience that...  ...workflows, and product requirements. Partner with engineering on inference pipelines, agent planning, retrieval, and orchestration... 
    Senior
    Remote work
    Flexible hours

    Wizard

    New York, NY
    2 days ago
  • $98.68k - $148.02k

     ...ISACA is seeking a Sr. Product Manager to drive the strategy and execution of products serving membership domains like security and audit. This strategic role will collaborate cross-functionally while overseeing the product lifecycle from ideation to market launch. The... 
    Senior

    ISACA

    New York, NY
    5 days ago
  •  ...Impiricus, Inc. is looking for a Senior Product Manager to define and execute the omnichannel growth roadmap. In this role, you will lead cross-functional teams from concept to launch while ensuring adherence to compliance in a regulated environment. You should have at... 
    Senior

    Impiricus, Inc.

    New York, NY
    5 days ago
  •  ...OKX is seeking a Product Manager to lead the development and delivery of product strategies within its Trading Product Group. The successful candidate will have 5-8 years of experience in product management with a strong interest in the Web3/Crypto industry. Responsibilities... 
    Senior

    Framework Ventures

    New York, NY
    5 days ago
  • $96.5k - $207.5k

     ...Fifth Third Bank, N.A. is seeking a Senior Product Manager to lead the growth of Integrated Payables within our Commercial Payments portfolio. This role involves designing payment experiences that improve operational efficiency while ensuring solutions are both viable... 
    Senior

    Fifth Third Bank, N.A.

    New York, NY
    5 days ago
  • $190k - $220k

     ...A leading real estate investing platform in the United States seeks a Senior Product Manager to drive key marketplace strategies and experiences. In this pivotal role, you will collaborate closely with engineering, design, and business teams to create innovative, user... 
    Senior
    Flexible hours

    BiggerPockets

    New York, NY
    5 days ago
  • $166k - $208k

     ...Framework Ventures is looking for a Product Manager to lead the strategy for engagement tooling. This role involves defining the product vision, improving engagement metrics, and collaborating with design, engineering, and marketing teams. Ideal candidates will have over... 
    Senior

    Framework Ventures

    New York, NY
    5 days ago
  •  ...A leading technology company is seeking a Senior Product Manager to manage the product life cycle of its offerings. The ideal candidate will have over 5 years of experience in Product Management, particularly in SaaS and enterprise software. Strong organizational abilities... 
    Senior

    Cylynt

    New York, NY
    5 days ago
  •  ...A leading analytics engineering company is seeking a Product Manager for Developer Experience to enhance the developer workflow within their platform. This remote role involves owning the roadmap across various tools, collaborating closely with engineering teams, and leading... 
    Senior
    Remote work

    dbt Labs

    New York, NY
    5 days ago
  • $145k - $220k

     ...A leading mobile gaming company is seeking a Sr. Product Manager for the Marvel Strike Force team. This role involves owning the performance and implementation of key monetization strategies through data analysis and SQL expertise. Ideal candidates will have experience... 
    Senior
    Remote work

    Scopely

    New York, NY
    5 days ago
  •  ...Ondo Finance is seeking a Senior Product Manager to enhance integrations and discovery of high-value opportunities. This role demands experience in product management and a background in blockchain and DeFi. The ideal candidate will engage with customers and partners,... 
    Senior
    Remote work

    Ondo Finance

    New York, NY
    5 days ago
  • $170k - $210k

     ...A leading developer tools company is seeking a Product Manager to enhance their platform's user experience. This fully remote role involves collaborating across teams to address customer needs, drive product innovations, and ensure software quality. You will synthesize... 
    Senior
    Remote work

    Chromatic Inc

    New York, NY
    5 days ago
  •  ...Skills: - Mandatory skills 6+ years in product management, with extensive hands-on involvement in healthcare SaaS, payer-to-payer integrations, IT consolidation, or data products. Proven track record in facilitating story map prioritization and coordinating complex epics... 
    Senior

    TalentOla

    New York, NY
    5 days ago
  •  ...Framework Ventures is looking for a Senior Product Manager for KYC Experience & Compliance to lead the product strategy, execution, and outcomes. The role involves owning the end-to-end KYC process while ensuring compliance and user trust. Ideal candidates will have over... 
    Senior

    Framework Ventures

    New York, NY
    5 days ago
  • $170k - $200k

     ...hire better, is partnering with an AI-native platform transforming how insurance underwriting is done. Quick Snapshot Role: Senior Product Manager Compensation: $170K – $200K + bonus + equity Location: Remote (U.S) Experience: 5 - 8 years of experience building and... 
    Senior
    Remote work

    Crossing Hurdles

    New York, NY
    5 days ago
  •  ...clinical outcomes, and address social drivers of health. The product and engineering teams operate in a fully distributed...  ...Interoperability across the platform. Role: We’re seeking an experienced Senior Product Manager with deep expertise in Clinical Data and Healthcare... 
    Senior
    Remote work

    Signify Technology

    New York, NY
    5 days ago
  • $140k - $185k

    # Senior Product ManagerRemote-first · NYC preferred Full-time $140k – $185k / year SeniorProductRemote### Apply for this role## About the...  ...results to leadership## Requirements* •5+ years of product management experience at a technology company* •Strong analytical skills... 
    Senior
    Full time
    Remote work

    RoleStar, Inc.

    New York, NY
    5 days ago
  •  ...impressions a month. InMobi is looking for a product leader to drive this vision by solving...  ...tech ecosystem today. In the role of a senior PM within InMobi Exchange, you will be...  ...consisting of product marketing and partner management functions. Responsibilities Responsible... 
    Senior

    Framework Ventures

    New York, NY
    5 days ago
  • $175k - $244.5k

     ...Highlevel is seeking a skilled Product Manager to lead the Creators Product team in the United States. The role focuses on enhancing the learning experience for over 1.1 million monthly users through strategic leadership, collaboration, and analytics. As a remote-first... 
    Senior
    Remote work

    High Level Services

    New York, NY
    5 days ago
  • $10 per hour

     ...globe. We’re an 80-person team (~50 in engineering), located across North and South America. The Role We’re looking for a Senior Product Manager to join Canals as our second full-time product hire. You’ll report directly to our co-founder, CEO, who has owned all product... 
    Senior
    Full time
    Remote work
    Flexible hours

    Canals

    New York, NY
    2 days ago
  •  ...FinMkt’s proprietary, omni-channel, and product-agnostic SaaS platform is optimized for...  ...well versed in the core tenets of product management and has the drive to understand the...  ...organization. Experience working closely with senior leadership. Experience translating data... 
    Senior
    Work experience placement
    Remote work

    FinMkt

    New York, NY
    2 days ago
  • $129k - $228k

     ...A leading life insurance technology firm is looking for a seasoned product manager to enhance the digital consumer experience. This role involves building customer-focused online shopping experiences, driving improvements to conversion rates, and educating consumers about... 
    Senior
    Full time
    Remote work

    Ethos

    New York, NY
    5 days ago
  •  ...Squared LATAM, we partner with leading U.S. companies to build high-impact digital products through strong product, design, and engineering practices. We are looking for a Senior Product Manager – Patient Experience to join a U.S.-based digital health company and lead the... 
    Senior
    Remote work

    EX Squared LATAM

    New York, NY
    5 days ago
  • $225k - $300k

     ...15 hours a month on average. In both our product and our workplace, we’re intentional about...  .... About the role We’re looking for a Senior PM to join our team. The product team currently...  ...this PM with a dedicated team. You will Manage our product roadmap. You’ll be working... 
    Senior
    Remote work
    Flexible hours

    Tremendous

    New York, NY
    5 days ago
  • $100k

     ...Overview Will look in US and Europe We are seeking a Senior Product Manager – eSIM to drive the strategy, roadmap, and execution of our eSIM product portfolio across digital channels. This role plays a key part in anticipating user needs and driving the design and launch... 
    Senior
    Worldwide

    IDT

    New York, NY
    5 days ago
  •  ...⭐️ We are looking for a data-driven and commercially minded Product Manager, Growth to join our Growth team. In this role, you will own the...  ...strategies, experiment results, and roadmap priorities to senior stakeholders. Contribute to a culture of experimentation and... 
    Senior
    Remote work
    Flexible hours

    Nivoda

    New York, NY
    5 days ago
  •  ...a tech-enabled comprehensive medication management (CMM) service augmented by an extended clinical...  ...skilled and dedicated Director of Product Management to help build the solutions...  ...right times About the Role We are seeking a Senior Product Management to serve as the day-... 
    Senior
    Full time
    Remote work

    Scriptology

    New York, NY
    4 days ago
  •  ...Senior Product Manager (multiple positions across AI-forward products & life sciences tech) We’re partnering with an innovative health tech company on a mission to transform healthcare affordability and access. Their enterprise solution is reshaping how patients, providers... 
    Senior

    BioTalent

    New York, NY
    5 days ago
  •  ...coin economy and rewarded ad monetization. This is a 0-1 build with real P&L ownership, not roadmap management. You'll ship fast, own the numbers, and shape a product that already reaches 40M+ users in the US. What you'll own: Virtual Economy Design — Architect the coin... 
    Senior
    Casual work

    Framework Ventures

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Product Manager, Inference. Be the first to apply!