AI/LLM Product Manager - Senior Associate
JPMorgan Chase & Co.
Job Description
Join us in building the next generation of AI and autonomous agents to solve mission‑critical operational and banking productivity challenges at the scale of the world’s largest bank. In this role, you’ll own AI use cases end‑to‑end—from discovery and problem framing through requirements, delivery, and long‑term reliability. You’ll design, build, and extend production-grade agentic systems, partnering closely with data science, engineering, and business stakeholders. Success means more than shipping: you’ll be accountable for performance, safety, and day‑to‑day behavior once real bankers rely on these capabilities.
Key Responsibilities
- Define product requirements, features, and roadmap components for AI use cases, translating business problems into agentic solutions and workflows.
- Lead end-to-end delivery from pilot through production, owning what the agent does, what it is permitted to do, how it acts under uncertainty, and where autonomy boundaries sit.
- Build and extend the agents and the net-new infrastructure they depend on: the services, APIs, and integrations that surround the model and make the system work.
- Drive model validation, performance monitoring, drift detection, and iterative improvement, keeping behavior correct as you ship and extend.
- Manage backlog prioritization, sprint planning, and delivery tracking.
- Partner with stakeholders to identify opportunities for AI-driven efficiency or revenue growth, and run user feedback sessions, folding insights into product enhancements.
- Define success metrics and measure business impact, including reliability, adoption, and reuse.
- Ensure alignment with data governance, compliance, and risk standards, working across Engineering, Data Science, Controls, and the business.
Required Skills & Experience
- 3–6+ years in product management, data products, or technology delivery, or equivalent expertise.
- Have shipped an LLM-powered, autonomous, or agentic system to production
- Demonstrated experience designing and running evals for such systems as needed to meet product driven success criteria. You reason about probabilistic behavior and drift, not deterministic pass or fail.
- Strong understanding of the AI/ML lifecycle (training, validation, deployment, monitoring)
- Understanding of production-grade data judgment: what good data looks like, where it degrades, pipeline stability, and how quality propagates into behavior.
- Experience building net-new infrastructure and integrations, with the ability to hold your own on architecture, APIs, and data pipelines.
- Experience working with cross-functional teams (Tech, Data Science, Business), with strong communication and stakeholder-management skills.
- Comfort operating inside a large, regulated institution where governance and controls are design inputs, not obstacles.
- Ability to ship AI-enabled products and lead complex programs in large, matrixed organizations.
- Previous experience in commercial and investment banking a plus
Success Profile
Ownership mindset. Takes a use case from ambiguous problem to reliable production system and stays accountable for how it behaves. Builds for an institution, not a demo. Treats governance, auditability, and real constraints as the interesting part of the problem, and knows the difference between a weekend prototype and a system bankers depend on.
About Us
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
About the Team
J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.- ...building the next generation of AI and autonomous agents to solve... ...operational and banking productivity challenges at the scale of the... ...correct as you ship and extend. Manage backlog prioritization, sprint... ...equivalent expertise. Have shipped an LLM-powered, autonomous, or...SeniorWeekend work
- JPMorgan Chase & Co. in New York seeks a product leader to own AI use cases end-to-end—from discovery and framing through requirements, delivery... ...data science, engineering, and business partners. You’ll manage backlogs and sprints, define success metrics, and ensure governance...Senior
- JPMorgan Chase & Co. in New York seeks a product manager to own AI use cases end-to-end in a regulated banking environment. You’ll design, ship, and sustain agentic systems powering productivity and automation for bankers, coordinating with data science, engineering, and...Senior
$170k - $210k
...Now Pay Later apps, and AI chat surfaces. Powered... ...relevant text and product ads that match consumers... ...RoleWe are looking for a Senior Product Manager to own search... ...generative search, or LLM-powered surfaces, especially... ...experience; training; associated responsibilities; and...SeniorSummer workWork at office$192k - $240k
...applications, for legacy applications and modern AI applications alike. Yet most... ...smarter. We’re looking for an experienced product manager passionate about joining this mission to... ...including manual evaluations, golden data sets, LLM as judge, to measure and improve AI...SeniorWork at office$165k - $220k
About MAIA MAIA is our next leap in AI, an always-available assistant that amplifies... ...outcomes for clients. About the RoleThe Senior Product Manager for the AI Foundry team will own the... ...architecture decisions. Comfort with Python, LLM tooling, agent frameworks, APIs, and...SeniorWork at office3 days per week$180k - $210k
About TrabaTraba is building the AI operating layer for the... ...building applied AI that drives real productivity gains and transforms how the... ...and experienced Product Manager to join as a founding member of... ...interfaces, wrappers, or lightweight LLM integrations alone is not...SeniorTemporary workLocal areaFlexible hoursShift work$175k - $285k
...monitoring, third-party risk management, board reporting, and... ...for a Principal Product Manager to own high-impact... ...engineering, data, and AI and is expected to operate... ...agentic workflows, LLM integration, or intelligent... ...drive outcomes at a senior level without relying on...SeniorTemporary workImmediate start$187.5k - $225k
...marketing teams, helping organizations build, manage, and optimize high-performing web... ...or quality. We\'re looking for a Senior Product Manager, AI to own how AI shows up across Webflow\... ..., APIs, and extensibility. Know where LLM-based tools shine and where they break...SeniorOngoing contractPermanent employmentFull timeTemporary workFixed term contractRemote workFlexible hoursShift work- ...volume of $10 trillion.As a Senior Associate Applied AI/ML Scientist within our... ...:Actively collaborate with Product, Technology, and other cross... ...using Large Language Models (LLM), machine learning and other... ...complex concepts to senior management and stakeholders. Required...Senior
- ...approaches (including modern LLM-based methods where... ...loops, monitoring models in production, and continuously iterating... ...operational workflows.As an Applied AI/ML Senior Associate in our AI for Operations... ...processing and asset management. We offer a competitive total...SeniorWork experience placement
$124.8k - $171.6k
...continues its transformation into an AI-first enterprise, we are looking for a hands-on Senior Product Manager to design, prototype, and... ...), and use results, including LLM-as-judge where validated, to... ...support whole-person well-being. Associate benefits are designed to...SeniorFull timeTemporary workApprenticeshipWork at officeRemote workRelocationShift work3 days per week- Leading the product vision and strategy, the full-time Senior Product Manager, AI will manage the development of personalization systems and a customer-facing AI experience... .../AI products, or similar domains Experience with LLM-powered products or conversational AI, including...SeniorFull timeRemote work
$130k - $150k
...trusted enterprise conversational AI and digital transformation.... ..., encompassing systems for products Conversational AI, Conversational... ...-driven routing, and emerging LLM trends to inform platform... ...years of experience in product management, with a track record of successfully...SeniorPermanent employmentTemporary workLocal areaRemote workFlexible hours$100k - $143k
...days per week As part of AI&D, you'll have the... ...Generative AI to increase productivity, streamline processes,... ...New York Life. This is a senior-level role that... ...Python, Hugging Face, and LLM APIs (e.g., OpenAI, Anthropic... ..., and product managers to integrate AI into enterprise...SeniorLocal area3 days per week$192k - $240k
...from PMs to Sales to SREs uses AI to query their business data -... ...'d be building a zero to one product of what we believe will become... ...experience in B2B SaaS Product Management, with at least some of it... ...product decisionsExperience with AI/LLM-powered products is a strong...SeniorLive inWork at office$100k - $143k
...Enterprise Intelligence as an AI Product Scientist supporting Decision... .... This role is ideal for a senior individual contributor who thrives... ...of data science, product management, and business impact.What You... ...developing generative AI or LLM-powered applications, including...SeniorLocal area3 days per week- Why Jerry.ai? Join a pre-IPO startup with capital ($240M raised)... ...our customer-facing Agentic AI product leveraging LLMs, agents, and internal... ...is building the first app to manage it all. We launched car... ...will include shaping how modern LLM systems, human-in-the-loop feedback...SeniorContract workPart timeFreelanceLocal areaRemote work
$100.6k - $169.8k
## Senior Product Manager, AI Search & Discovery - GrataApplyremote type: Hybridlocations: USA - NY - New... ...id: R36337Datasite and its associated businesses are the global center for facilitating... ...search, ranking, recommendations, and LLM/RAG-powered discovery workflows*...SeniorWork at officeFlexible hours$176k - $256k
...prompt-aware" content to ensure AI agents provide accurate,... ...when deterministic context vs. LLM reasoning is required.Organize... ...knowledge base.Partner across Product, Legal, and Brand teams to harvest... ....11 years of experience in management consulting, product management...SeniorShift work$200.7k - $229.1k
Senior Manager, Product Manager - AI Acceleration About the Team The Product Manager for the AI Acceleration... ...intuitive solutions that improve both the associate and customer experience. You must be... ...(deterministic guardrails, online LLM-as-Judge, and offline golden-dataset...SeniorFull timePart timeLocal area$129k - $207k
...Growth organization is building the next generation of AI-native products. We are seeking a Senior Product Manager , to transform ambiguous, complex customer... ...applied AI landscape, including Large Language Model (LLM) capabilities, multi-agent orchestration, and human...SeniorRemote work$190.8k - $267.1k
...faster and build smarter. The Role: As the Senior Product Manager for the Ads ML Platform, you will hold... .... Whether it's integrating generative AI to increase developer productivity, establishing... ...(including Generative AI and LLM workflows) to stay ahead of the curve. Accelerate...SeniorFor contractorsWork experience placementWork at officeRemote workHome officeFlexible hours$100k - $143k
...Artificial Intelligence & Data (AI&D) organization, you will... ...Data Scientists, Engineers, and product and technology partners while... ...understanding of model lifecycle management, responsible AI principles,... ...in implementing and refining LLM/RAG approaches (vector stores,...SeniorLocal area3 days per week- LSEG is hiring a leader for applied AI products in New York, focusing on enhancing decision-making through innovative AI solutions. The ideal... ...will have 4-8 years of experience, including work with AI/LLM products, and a strong background in intelligent systems. The role...Senior
- Deel is seeking a hands-on Product Manager to own and drive Deel's AI assistants across internal tools and customer surfaces. You will prototype with LLM APIs, design tool-calling and agent workflows, measure outcomes, and ship MVPs rapidly in a fast-moving space. The...Senior
- ...builds. We’re an applied AI company serving the... ...We are still early. The product surface area is expanding... ...We're hiring a Product Manager, Applied AI to own PermitFlow... ...'re hiring at Staff or Senior Staff, with the level based... ...with golden data sets, LLM-as-judge, human...SeniorFull timeFor contractorsWork at officeRelocationHome officeMonday to Friday
- ...Solutions is looking for an entrepreneurial and highly technical Senior Product Manager to lead our AI & Commerce Foundations Team. In this greenfield role, you... ...when to use RAG vs fine-tuning, and can explain LLM limitations (hallucinations, latency, cost). You've worked...SeniorRemote jobFull timeWork from homeShift work
$124k - $177k
Location Designation: Hybrid - 3 days per week The Data Product Owner has a critical role within the AI&D product management organization that sits at the intersection of business strategy, data, and technology. Your impact is both strategic and operational. You will drive...SeniorWork at officeLocal areaRemote workMonday to Friday3 days per week$100k - $143k
...help build modern Wealth Management capabilities that... ...native development, and AI-first delivery.We are looking for a Senior Full Stack Developer who... ...development tools to increase productivity while maintaining high standards... ...as prompt engineering, LLM integration, retrieval-...SeniorLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI/LLM Product Manager - Senior Associate. Be the first to apply!
- online product manager New York, NY
- intern product manager summer New York, NY
- product account manager New York, NY
- senior manager product development New York, NY
- director global product management New York, NY
- product strategy manager New York, NY
- health product manager New York, NY
- product manager data analytics New York, NY
- regulatory product manager New York, NY
- product security manager New York, NY


