AI/ML Product Manager - Model Serving

Product Manager, Model Serving – AI/ML Solutions Team New York, NY, United States Job Description You enjoy shaping the future of product innovation as a core leader, driving value for customers, guiding successful launches, and exceeding expectations. Join our dynamic AI/ML Solutions team and make a meaningful impact by delivering high-quality model serving infrastructure and capabilities that empower data scientists, engineers, and business stakeholders alike. As a Product Manager in Model Serving, you are an integral part of the team that innovates new AI/ML product offerings and leads the end-to-end product life cycle. You will play a crucial role in developing and implementing our enterprise model serving platform capabilities spanning model deployment, inference infrastructure, and lifecycle management. Utilizing your deep understanding of how to get a product off the ground, you guide the successful launch of ML platform features, gather crucial feedback, and ensure top-tier client experiences. With a strong commitment to scalability, resiliency, and stability, you collaborate closely with cross-functional teams including ML engineers, data scientists, and platform engineers to deliver high-quality products that exceed customer expectations. Job responsibilities Develops a product strategy and product vision for model serving capabilities that delivers measurable value to internal and external customers across the AI/ML lifecycle Manages discovery efforts and market research to uncover model deployment and inference needs, integrating insights into a prioritized product roadmap Owns, maintains, and develops a product backlog that enables development teams to support the overall strategic roadmap for model serving, including real-time and batch inference Builds the framework and tracks key success metrics such as inference latency, throughput, model availability, and cost efficiency, Leads end-to-end product delivery processes including intake, dependency management, release management, product operationalization, delivery feasibility decision-making, and product performance reporting, while escalating opportunities to improve efficiencies and functional coordination Carries out in-depth quantitative and qualitative analysis to support business cases for model serving investments and leadership decision-making Leads the completion of change management activities across functional partners and ensures adherence to the firm's risk, controls, compliance, and regulatory requirements including model risk governance standards Communicates proposed solutions and insights effectively to stakeholders across ML engineering, data science, risk, and business teams Promotes adherence to industry standards and best practices for ML model deployment, serving infrastructure, and MLOps (e.g., model registries, CI/CD for ML, feature stores) Stays informed on industry trends and emerging technologies in model serving, LLM inference optimization, ML observability, and AI platform architecture Required qualifications, capabilities, and skills 5+ years of experience or equivalent expertise in product management, with exposure to AI/ML platforms, MLOps, or a closely related domain Advanced knowledge of the product development life cycle, design, and data analytics, with specific familiarity with ML model lifecycle stages (training, validation, deployment, monitoring, retraining) Proven ability to lead product life cycle activities including discovery, ideation, strategic development, requirements definition, and value management Demonstrated ability to execute operational management and change readiness activities in a fast-moving AI/ML environment Strong understanding of delivery and a proven track record of implementing continuous improvement processes for ML platform capabilities Strong influencing and partnership/collaboration skills to drive cross-functional teams including data scientists, ML engineers, and platform architects to build better solutions and execute product go‑live plans Experience in product or platform-wide release management, deployment processes, and strategies for ML systems; must be able to build solutions from the ground up Strong technical background with experience working on AWS, containerized workloads (e.g., Docker, Kubernetes), and model serving frameworks; experience with JIRA and Agile methodologies Foundational understanding of ML model serving concepts including online vs. batch inference, model versioning, shadow deployments, and canary releases Preferred qualifications, capabilities, and skills Demonstrated prior experience working in a highly matrixed, complex organization with multiple ML and data platform stakeholders Practical experience with modern ML serving and orchestration technologies such as Ray Serve, Seldon, or Databricks Experience with ML observability, model monitoring, and drift detection frameworks Knowledge of LLM inference optimization techniques such as quantization, batching strategies, and GPU resource management Familiarity with feature stores, model registries, and end-to-end MLOps pipeline We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission‑based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on‑site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation. Equal Opportunity Employer/Disability/Veterans #J-18808-Ljbffr JPMorgan Chase & Co.