Technical Product Manager - AI Product Operations

Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries. Our growth is driven by delivering real results for our clients. It's also enabled by our culture, which encourages individual development, embraces an inclusive environment, rewards innovative excellence and supports our communities. With qualities like those, it's no wonder we're consistently ranked among the best companies to work for by Fortune Magazine, Consulting Magazine, Seramount, Fair360 and others. If you're as passionate about your future as we are, join our team.KPMG is currently seeking a Technical Product Manager - AI Product Operations to join our Audit Technology Alliance organization.Responsibilities:Act as a "player-coach" managing a team of specialists, while treating the AI monitoring and evaluation infrastructure as an internal product with a defined strategic roadmapTreat the AI monitoring and evaluation infrastructure as an internal product; define its strategic roadmap, gather stakeholder requirements, and drive its continuous improvementLead the creation of real-time dashboards to interpret evaluation results, building complex monitors to capture agent traces, human-in-the-loop decisions, and user feedbackDrive root-cause analysis and cross-functional remediation for AI system issues (including documenting post-mortems), while creating scalable runbooks (SOPs) to streamline deploymentsPartner with product managers and engineering leaders to design and implement evaluators directly into the product lifecycle, leading training efforts on how to accurately interpret and use the resultsCollaborate closely with audit methodology specialists, risk, and compliance teams to ensure all AI evaluation flows, metrics, and guardrails actively support firm audit quality standardsAct with integrity, professionalism, and personal responsibility to uphold KPMG's respectful and courteous work environmentQualifications:Minimum eight years of recent overall professional experience in Technical Product Management, Product Operations, or Data Science, including a proven track record of building and managing high-performing teamsMaster's degree from an accredited college or university is preferred; minimum of a Bachelor's degree from an accredited or university is requiredStrong technical background with a distinct product management mindset; you don't need to write production code, but you must deeply understand ML/AI concepts to design sophisticated evaluation productsExtensive knowledge of Generative AI/LLMs, prompt engineering, and GenAI evaluation techniques (for example, automated scoring, human-in-the-loop review, hallucination detection)Demonstrated ability to conceptualize scalable measurement frameworks, define critical KPIs, and design structured workflows out of complex, unstructured AI outputsExceptional written and verbal communication skills, with a proven ability to translate highly technical AI performance metrics into clear business narratives for executive stakeholdersApplicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future; KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)KPMG LLP and its subsidiaries (“KPMG”) complies with all local/state regulations regarding displaying salary ranges. If required, the ranges displayed below or via the URL below are specifically for those potential hires who will work in the location(s) listed. Any offered salary is determined based on relevant factors such as applicant's skills, job responsibilities, prior relevant experience, certain degrees and certifications and market considerations. In addition, KPMG is proud to offer a comprehensive, competitive benefits package, with options designed to help you make the best decisions for yourself, your family, and your lifestyle. Available benefits are based on eligibility. Our Total Rewards package includes a variety of medical and dental plans, vision coverage, disability and life insurance, 401(k) plans, and a robust suite of personal well-being benefits to support your mental health. Depending on job classification, standard work hours, and years of service, KPMG provides Personal Time Off per fiscal year. Additionally, each year KPMG publishes a calendar of holidays to be observed during the year and provides eligible employees two breaks each year where employees will not be required to use Personal Time Off; one is at year end and the other is around the July 4th holiday. Additional details about our benefits can be found towards the bottom of our KPMG US Careers site at Benefits & How We Work.Follow this link to obtain salary ranges by city outside of CA: KPMG offers a comprehensive compensation and benefits package. KPMG is an equal opportunity employer. KPMG complies with all applicable federal, state and local laws regarding recruitment and hiring. All qualified applicants are considered for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, citizenship status, disability, protected veteran status, or any other category protected by applicable federal, state or local laws. The attached link contains further information regarding KPMG's compliance with federal, state and local recruitment and hiring laws. No phone calls or agencies please.KPMG recruits on a rolling basis. Candidates are considered as they apply, until the opportunity is filled. Candidates are encouraged to apply expeditiously to any role(s) for which they are qualified that is also of interest to them.Los Angeles County applicants: Material job duties for this position are listed above. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, and safeguard business operations and company reputation. Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.