Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Technology Product Manager, AI Quality & Evaluation

$107.5k - $188.4k

Wolters Kluwer Financial Services

Build the product capabilities that help ensure AI-enabled healthcare experiences are useful, trusted, and responsibly deployed. At Wolters Kluwer Health, the UpToDate suite supports millions of clinical decisions every day. As AI becomes part of healthcare workflows, quality cannot be treated as a one-time launch checkpoint. AI experiences need to be evaluated, monitored, and improved continuously so clinicians and care teams can trust the information and interactions they rely on. As Senior Product Manager, AI Quality & Evaluation, you will play a core role in translating clinical quality standards and evaluation strategy into scalable product capabilities. Working under product leadership and in close partnership with clinical, technical, and data experts, you will help define the requirements, workflows, tooling, automation, and reporting needed to evaluate AI-enabled experiences before and after launch. This role does not own the clinical quality standard or statistical methodology. It helps make those standards operational at scale through usable tools, repeatable workflows, measurable signals, and clear evidence that supports product decisions, customer trust, and responsible AI. What You'll Do Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities. Drive discovery and delivery for defined AI quality and evaluation capabilities, including tooling, automation, monitoring, evidence capture, and reporting. Partner with clinical, data science, engineering, product, legal, compliance, and customer-facing teams to operationalize AI evaluation before and after launch. Identify opportunities to automate and scale evaluation workflows while preserving appropriate expert oversight. Define product requirements for review workflows, issue triage, launch readiness, post-launch monitoring, and quality reporting. Use evaluation insights to inform product improvements, user experience, content quality, model behavior, and operational processes. Track emerging market practices and customer expectations related to AI quality, evaluation, benchmarking, and responsible AI. Translate AI quality and evaluation practices into clear narratives for product leaders, customer-facing teams, and internal stakeholders. What You'll Bring 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas. Strong product discovery and execution skills, including requirements definition, roadmap planning, experimentation, and metrics-driven decision-making. Ability to translate complex clinical, technical, quality, or risk concepts into practical product requirements and workflows. Experience working with engineering, data, clinical, compliance, customer-facing, or operational stakeholders. Strong analytical thinking and comfort defining metrics, dashboards, workflows, and decision criteria. Strong communication skills, especially around quality, trust, tradeoffs, evidence, and customer value. Curiosity and learning agility around AI, evaluation methods, responsible AI, and emerging technologies. Preferred Background Experience with AI-enabled products, healthcare technology, quality tooling, data products, search/retrieval quality, content quality, clinical validation, or decision-support products. Familiarity with AI evaluation methods, benchmarks, monitoring, human-in-the-loop review, automation, or applied machine learning concepts. Experience in healthcare, clinical workflows, regulated environments, or professional-information products. Experience supporting customer-facing narratives around product quality, trust, or responsible technology. What Success Looks Like Expert-defined quality standards are translated into scalable product workflows, tools, and requirements. Evaluation processes become more automated, repeatable, measurable, and usable by cross-functional teams. Product teams have clearer quality signals and launch-readiness criteria for AI-enabled experiences. Evaluation insights improve product quality, customer trust, user experience, and responsible AI practices. Customer-facing teams can clearly explain how AI quality and trust are evaluated.#LI-HybridOur Interview PracticesTo maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.Compensation:$107,500.00 - $188,400.00 USDThis role is eligible for Bonus.Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process. Additional Information:Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request. SummaryLocation: USA-MA-Remote; USA-IL-Remote; USA - Coppell, TX; USA - Waltham, MA; USA - Philadelphia, PA; USA-PA-Remote; USA-TX-Austin-Southwest Pkwy; USA - Riverwoods, IL; USA - Indianapolis, IN; USA - Greenwood Village, COType: Full time

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Technology Product Manager, AI Quality & Evaluation in Waltham, MA vacancy
  • $85.6k - $149.4k

    About the RoleAs a Senior Technology Product Manager - GTM Enablement and Launch Lead, you will play a critical role in ensuring the successful planning, coordination...  ...initiatives, including core product launches, AI‑related capabilities, new products, and pricing or... 
    Suggested
    Full time
    Work at office

    Wolters Kluwer

    Waltham, MA
    1 day ago
  • $128.9k - $226.05k

    ## Lead Technology Product Manager, Clinical Decision Support Adoption & Engagement AnalyticsApplyremote type...  ...As we continue to evolve our CDS and AI-enabled experiences, we need clear...  ...so teams can rely on consistent, high-quality product data.* Translate analysis... 
    Suggested
    Work at office

    Wolters Kluwer

    Waltham, MA
    5 days ago
  • $151.9k - $238.7k

     ...agents read the evidence and propose answers, and where evaluation — not hand-built logic — decides what ships. We're hiring a Principal Product Manager to own Person Data outcomes end to end and to build the AI evaluation discipline the whole team will run on.What You... 
    Suggested
    Worldwide

    ZoomInfo

    Waltham, MA
    3 days ago
  • $151.6k - $208.4k

     ...continues its transformation into an AI-first enterprise, we are looking for a hands-on, technically proficient Lead Product Manager to lead the design, prototyping, and...  ...first demo through launch and iteration. Evaluation and quality: Own how quality is defined and... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Relocation
    Shift work
    3 days per week

    Humana

    Boston, MA
    5 days ago
  • $125.5k - $157.5k

    Job Title:Lead, Digital Product Manager- R&DJob Description:Here at Entegris, we use...  ...science to enable technologies that transform the world,...  ...workstreams across data, AI, modeling, applications, integration...  ...partners to define, evaluate, implement, and continuously... 
    Suggested
    Full time
    H1b
    Remote work

    Entegris

    Billerica, MA
    1 day ago
  • $151.9k - $238.7k

     ...contribute. You’ll make things happen–fast. Principal Product Manager, Person Data and AI Evaluations ZoomInfo | Product | Core Data About ZoomInfo...  ...run on. You inherit a live portfolio: person data quality (removing bogus or outdated executive contacts,... 
    Immediate start
    Worldwide
    Day shift

    ZoomInfo Technologies LLC

    Waltham, MA
    5 days ago
  • $136.2k - $204.2k

     ...The Salesforce Lead is part of our Fuels Marketing...  ...needs into scalable technology solutions, drives...  ...Partners' Salesforce Product team Communicate commercial...  ...Salesforce Product Manager on prioritization and...  ...market conditions Evaluate adjacent tools (AI, customer service... 
    Permanent employment
    Full time
    Contract work
    Local area

    Global Partners

    Newton, MA
    1 day ago
  • $177k - $278.08k

     ...director level, to identify, evaluate, and advance external...  ...opportunities in AI, automation, data, and digital technologies that can accelerate and...  ...emerging capabilities, leading technical diligence, and...  ...include:Building a high-quality pipeline of external opportunities... 
    Minimum wage
    Work at office
    Local area
    2 days per week
    3 days per week

    Takeda

    Cambridge, MA
    4 days ago
  • $177k - $278.08k

     ...DescriptionTitle: Technical Product Owner, AI-Native End Point...  ...with the Business Lead to convert scientific...  ...discipline (backlog management, sprint planning, release...  ..., delivery quality, timeline, and platform...  ...Collaborate with our external technology/build partners on... 
    Minimum wage
    Contract work
    Local area

    Takeda

    Boston, MA
    3 days ago
  • $168k - $252k

     ...seeking a highly technical Lead Product Manager to set the vision, strategy,...  ...reliability.Accelerate with AI: Institutionalize AI and automation...  ...based on outcomes.Champion Quality & Reliability: Drive...  ...limitless potential for the technology we’re developing to nurture... 
    Temporary work

    Klaviyo

    Boston, MA
    2 days ago
  •  ...A fintech company in Cambridge seeks a Principal Product Manager to own the Halo AI wealth management product. This hybrid role requires strong experience in shipping AI products and navigating compliance in regulated environments. You will define product strategy, enhance... 

    Datalign Advisory, LLC.

    Cambridge, MA
    4 days ago
  • $75k - $165k

    Team: Product Management & AlliancesCity: BostonState: MA Veeva Systems is a mission-driven organization and pioneer in...  ...technical product manager to design and deliver high-value AI Agent solutions across the Veeva Quality Cloud suite of products. Veeva Quality Cloud... 
    Work at office
    Local area
    Remote work
    Work from home
    3 days per week

    Veeva Systems

    Boston, MA
    4 days ago
  • $146.2k - $261.4k

     ...Description RAND's Center on AI, Security, and Technology (CAST), part of the...  ...be responsible for managing significant research...  ...projects, and leading multidisciplinary...  ...will build systems to evaluate how AI models perform...  ...commitment to high-quality, rigorous analysis and... 
    Fixed term contract
    Work experience placement
    Remote work
    Work from home

    RAND Corporation

    Boston, MA
    5 days ago
  • $164.07k - $200.53k

     ...Lead AI Product Owner (R08113) Blue Cross Blue Shield of Massachusetts is seeking a visionary...  ...Own the Strategic Roadmap: Develop and manage the strategic roadmap for your entire product...  ...space, and emerging Generative AI technologies to influence our strategic direction. Required... 
    Full time
    Work at office
    Local area
    Flexible hours

    Blue Cross Blue Shield of Massachusetts

    Boston, MA
    5 days ago
  • $162k - $258k

     ...Elevator Pitch: Evolv Technology is looking for a Director of Product, AI, a senior...  ...annotation standards, evaluate models, run field...  ...engineering as the product lead for our detection...  ..., dataset quality, and validation standards...  ...years of product management experience,... 
    Full time
    Work at office
    Local area
    Remote work

    Evolv Technology

    Waltham, MA
    5 days ago
  • $150k - $180k

    ## Senior Product Manager, AI & AnalyticsApplylocations: Waltham, MA: Massachusetts...  .... We build and connect technologies to help protect people,...  ...and AI Research teams to evaluate technical trade-offs around...  ...intuitive operator experiences.* **Lead Continuous Discovery:**Run... 
    Local area
    Remote work
    Relocation

    Motorola Solutions

    Waltham, MA
    3 days ago
  • $103k - $154.6k

    Job Summary:The Product Manager, Marketing Technology is responsible for leading the development and optimization of marketing...  ...Manages vendor relationships and evaluates emerging marketing technologies...  ...measure progress.Enhance Data Quality and Trust: Build and scale mechanisms... 
    Full time
    Work at office
    Local area
    Flexible hours

    Global Partners LP

    Waltham, MA
    4 days ago
  • $89k - $104k

     ...in the dark. So, join us as a Product Manager, and find your superpower. We...  ...and play a critical part in our Technology & Innovation organization, we...  ...Grid utilizes an assessment that evaluates the job qualifications/characteristics using AI or statistically based scoring... 
    Work at office
    Local area
    Remote work
    Flexible hours

    National Grid

    Waltham, MA
    2 days ago
  •  ...The Director of Product & Technology leads the end-to-end build and ongoing evolution...  ..., infrastructure, and AI-based data solutions that bring...  ...lead: scouting and managing IT partners and consultants...  ...Lead a structured process for evaluating, prioritizing and managing... 
    Temporary work
    Remote work
    Flexible hours
    1 day per week

    American Consumer Credit Counseling

    Auburndale, MA
    2 days ago
  • $196k - $294k

     ...RoleKlaviyo is seeking a Senior Lead Product Manager to drive our Enterprise...  ...unifying customer data, powering AI-driven automation, and...  ...as an AEDT. As part of the evaluation process we provide Covey with...  ...limitless potential for the technology we’re developing to nurture... 
    Worldwide

    Klaviyo

    Boston, MA
    4 days ago
  •  ...BNY Mellon is seeking a Product Manager for Data & Data Infrastructure to lead a global data platform strategy in a fast-paced enterprise setting. You will align...  ...manage PMs, and collaborate with GTM to deliver scalable, AI-enabled data solutions for asset managers and... 

    BNY Mellon

    Boston, MA
    4 days ago
  • $160.1k - $286k

    Associate Director, Product Management, UpToDate Core Experience...  ...experiences. Lead discovery and prioritization...  ..., and overall product quality. Manage roadmap priorities...  ...with healthcare technology, clinical decision support...  ...without the assistance of AI tools or external... 
    Full time
    Work at office

    Wolters Kluwer

    Waltham, MA
    4 days ago
  • $196k - $294k

     ...Klaviyo is seeking a Senior Lead Product Manager to drive our Enterprise product...  ...customer data, powering AI-driven automation, and expanding...  ...as an AEDT. As part of the evaluation process we provide Covey...  ...limitless potential for the technology we’re developing to nurture... 
    Worldwide

    Klaviyo Inc.

    Boston, MA
    7 hours ago
  • $106.3k

     ...FORConverse is looking for a Lead, Digital Product Manager to lead product management...  ...will partner closely with Technology, UX Design, Experience...  ...stakeholders to deliver high-quality consumer experiencesDrive...  ...measure performance, and evaluate product impactSynthesize analytics... 
    Full time
    Work at office
    Home office

    Nike

    Boston, MA
    10 hours ago
  • $156.2k - $211.4k

    Rapid7 is looking for a Lead Product Manager, GTM Strategy to help shape how our products are priced...  ...to senior leadership.The skills and qualities you'll bring include:Bring 5+ years of...  ..., skills, and certifications. We evaluate compensation decisions on a case-by-case... 
    Full time
    Work experience placement
    Local area
    Shift work

    Rapid7

    Boston, MA
    4 days ago
  • $196.35k - $292.6k

     ...power innovation. We lead in intelligent data infrastructure...  ...of their data, from AI to multicloud. Ready...  ...looking for a Senior Product Manager to help define and...  ..., and adjacent technologies to help position the product...  ...tools to help evaluate applications and candidate... 
    Work at office
    Local area

    NetApp

    Waltham, MA
    5 days ago
  •  ...Benchmark Health is seeking a Group Product Manager in the Boston area to lead a small PM team and own a meaningful slice of the roadmap centered on AI-native solutions for patients, clinicians, and PCPs. This is a hybrid role with in-office days in Needham and broader... 
    Work at office

    Benchmark Health, Inc.

    Boston, MA
    4 days ago
  •  ...company pioneering AI-guided protein...  ...molecular barcoding technology, we screen...  ...computational models, which leads to better drug...  ...Bio is seeking a Product Manager to serve as the...  ...scopeOwn the quality of all external deliverables...  ..., training and evaluation, agentic systems,... 
    Flexible hours

    Manifold Bio

    Boston, MA
    1 day ago
  • $136k - $204k

     ...destiny.About the TeamThe AI & Analytics pillar...  ...looking for a Senior Product Manager to own Klaviyo's Analytics...  ...five pillars: Trust (quality, correctness, and...  ...where model quality, evaluation, and data grounding were...  ...limitless potential for the technology we’re developing to... 
    Shift work

    Klaviyo

    Boston, MA
    5 days ago
  •  ...Executive Office of Technology Services and...  ...Security (EOTSS) is the lead enterprise...  ...EOTSS oversees and manages the enterprise technology...  ...to enhance the quality of public service...  ...Role:The Enterprise AI Product Manager owns and advances...  ....Identify and evaluate high-impact use... 
    Full time
    Part time
    Work experience placement
    Work at office
    Work from home
    Monday to Friday

    State of Massachusetts, USA

    Boston, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Technology Product Manager, AI Quality & Evaluation. Be the first to apply!