Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Technology Product Manager, AI Quality & Evaluation

$118.3k - $207.4k

Wolters Kluwer Financial Services

Build the product capabilities that help ensure AI-enabled healthcare experiences are useful, trusted, and responsibly deployed. At Wolters Kluwer Health, the UpToDate suite supports millions of clinical decisions every day. As AI becomes part of healthcare workflows, quality cannot be treated as a one-time launch checkpoint. AI experiences need to be evaluated, monitored, and improved continuously so clinicians and care teams can trust the information and interactions they rely on. As Senior Product Manager, AI Quality & Evaluation, you will play a core role in translating clinical quality standards and evaluation strategy into scalable product capabilities. Working under product leadership and in close partnership with clinical, technical, and data experts, you will help define the requirements, workflows, tooling, automation, and reporting needed to evaluate AI-enabled experiences before and after launch. This role does not own the clinical quality standard or statistical methodology. It helps make those standards operational at scale through usable tools, repeatable workflows, measurable signals, and clear evidence that supports product decisions, customer trust, and responsible AI. What You'll Do Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities. Drive discovery and delivery for defined AI quality and evaluation capabilities, including tooling, automation, monitoring, evidence capture, and reporting. Partner with clinical, data science, engineering, product, legal, compliance, and customer-facing teams to operationalize AI evaluation before and after launch. Identify opportunities to automate and scale evaluation workflows while preserving appropriate expert oversight. Define product requirements for review workflows, issue triage, launch readiness, post-launch monitoring, and quality reporting. Use evaluation insights to inform product improvements, user experience, content quality, model behavior, and operational processes. Track emerging market practices and customer expectations related to AI quality, evaluation, benchmarking, and responsible AI. Translate AI quality and evaluation practices into clear narratives for product leaders, customer-facing teams, and internal stakeholders. What You'll Bring 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas. Strong product discovery and execution skills, including requirements definition, roadmap planning, experimentation, and metrics-driven decision-making. Ability to translate complex clinical, technical, quality, or risk concepts into practical product requirements and workflows. Experience working with engineering, data, clinical, compliance, customer-facing, or operational stakeholders. Strong analytical thinking and comfort defining metrics, dashboards, workflows, and decision criteria. Strong communication skills, especially around quality, trust, tradeoffs, evidence, and customer value. Curiosity and learning agility around AI, evaluation methods, responsible AI, and emerging technologies. Preferred Background Experience with AI-enabled products, healthcare technology, quality tooling, data products, search/retrieval quality, content quality, clinical validation, or decision-support products. Familiarity with AI evaluation methods, benchmarks, monitoring, human-in-the-loop review, automation, or applied machine learning concepts. Experience in healthcare, clinical workflows, regulated environments, or professional-information products. Experience supporting customer-facing narratives around product quality, trust, or responsible technology. What Success Looks Like Expert-defined quality standards are translated into scalable product workflows, tools, and requirements. Evaluation processes become more automated, repeatable, measurable, and usable by cross-functional teams. Product teams have clearer quality signals and launch-readiness criteria for AI-enabled experiences. Evaluation insights improve product quality, customer trust, user experience, and responsible AI practices. Customer-facing teams can clearly explain how AI quality and trust are evaluated.#LI-HybridOur Interview PracticesTo maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.Compensation:$118,300.00 - $207,400.00 USDThis role is eligible for Bonus.Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process. Additional Information:Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request. SummaryLocation: USA - Chicago, IL, South LaSalle St; USA - Coppell, TX; USA - Waltham, MA; USA - Philadelphia, PA; USA-TX-Austin-Southwest Pkwy; USA - Riverwoods, IL; USA - Indianapolis, IN; USA - Greenwood Village, COType: Full time

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Technology Product Manager, AI Quality & Evaluation in Austin, TX vacancy
  •  ...passionate about the intersection of AI, data, and client experience...  ...? We’re looking for a product leader who thinks in systems...  ...to every problem.As the Lead Product Manager, AI Activation , you will own...  ...how to spec them, and how to evaluate them.Analytical Rigor:... 
    Suggested
    Contract work
    Work at office
    Local area
    Day shift

    Realtor.com

    Austin, TX
    4 days ago
  • $171.6k - $245k

     ...Lead Product Manager We're looking for a Lead Product Manager who is a great product manager first...  ...happens to have real depth in modern AI/ML. You'll own product strategy for key...  ...can do. Get your hands dirty with the technology—you're comfortable digging into how a... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    Webex Events (formerly Socio)

    Austin, TX
    1 day ago
  • $107.5k - $188.4k

    Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer, we combine deep clinical expertise with responsible AI to build products that improve care—and driving awareness, adoption,...  ...Preferred · Experience in healthcare technology, clinical decision support, or... 
    Suggested
    Full time
    Work at office
    Remote work

    Wolters Kluwer

    Austin, TX
    2 days ago
  • $123k - $217k

    ## Lead Technical Product ManagerApplyremote type: Hybridlocations: Austin, TXtime...  ..., and thrive with our open, AI-driven commerce ecosystem....  ...a ***Lead Technical Product Manager*** to drive the execution...  ...fluency with modern front-end web technology: TypeScript, React, Next.js... 
    Suggested
    Live in
    Work at office
    Remote work
    Worldwide
    Day shift
    3 days per week

    Commerce Co.

    Austin, TX
    11 hours ago
  •  ...is looking for a ***Lead Technical Product Manager*** to drive the execution and evolution of **Catalyst...  ...documentation are structured so that AI coding agents can build on the platform...  ...on fluency with modern front-end web technology: TypeScript, React, Next.js (App... 
    Suggested
    Live in
    Work at office
    Remote work
    Day shift
    3 days per week

    BigCommerce

    Austin, TX
    4 days ago
  • $172.5k - $225k

    Circle (NYSE: CRCL) is one of the world’s leading internet financial platform companies,...  ...forCircle is seeking a Lead Product Manager, Token within the Arc product team to define...  ...Create simulations and scenario analyses to evaluate token distributions, validator rewards,... 
    Flexible hours

    Circle

    Austin, TX
    2 days ago
  •  ....We're looking for a Lead Product Manager to build and scale a...  ...this platform will feed AI model training and...  ...arrives. This requires evaluating intangible factors...  ...naturally rewards higher-quality, more valuable...  ...prop-tech, real estate technology, digital media licensing... 
    Contract work
    Local area
    Immediate start
    Shift work

    Realtor.com

    Austin, TX
    7 hours ago
  • $150k - $225k

    Title: Lead Product Manager, Quoting & Distribution Location (hybrid...  ...drives us. We use technology and data to help our...  ...— also leveraging AI to create smarter, faster...  ...on time and with quality.Translate complex integration...  ...experience scoping, evaluating, and deploying AI to... 
    Temporary work
    Flexible hours

    Hippo Insurance

    Austin, TX
    1 day ago
  • $99.6k - $137k

     ...the Future of Industrial Technology!Ready to make a tangible impact...  ...Document Crunch team, the quality of our AI is the product — and we're looking for...  ...teams to understand and manage their risks with confidence...  ...volume and variety of AI evaluation we need is growing far faster... 
    Ongoing contract
    Full time
    Contract work
    Local area
    Worldwide
    Flexible hours

    Trimble Navigation

    Austin, TX
    3 days ago
  •  ...innovation-driven medical technology growth company...  ...range of products, services and integrated...  ...Global Product Manager, Enabling TechnologiesReports...  ...Manager to lead strategic product...  ..., regulatory, quality, and operations teams...  ...require in-depth evaluation of various factors... 
    Full time
    H1b

    Enovis

    Austin, TX
    1 day ago
  • $148k - $203.5k

     ...enables the exciting technologies that literally...  ...world - like AI and IoT. If you...  ...a supportive leading global company....  ...the product lifecycle for Agentic...  ...Monitoring, and Evaluation of AI SystemsEnterprise...  ...productivity, quality, and business...  ...managing AI, GenAI, Digital... 
    Full time

    Applied Materials

    Austin, TX
    1 day ago
  • $120k - $160k

    Director of Applied AI Product:The Director of AI Product...  ...proprietary data and technology our industry cannot...  ...This is not a role that manages AI features from a distance...  ...mix toward speed, quality, and cost as our own...  ...technical tradeoffs, not only evaluate them.A history of... 
    Live in
    Immediate start
    Remote work
    Work from home

    Acceleration Partners

    Austin, TX
    2 days ago
  •  ...Kubernetes-native AI infrastructure company...  ...composable, production-ready developer platforms...  ...control needed to manage infrastructure...  ...bottlenecks, evaluating system design trade...  ...working directly with leading GPU cloud...  ...-generation cloud technologies.Be a part of cutting... 

    Mirantis

    Austin, TX
    1 day ago
  • $115k - $145k

     ...oriented, and execution‑focused Product Manager to lead the development and...  ...a high level of detail and quality in requirements documentation...  ...and other artifacts. Leverage AI‑assisted tools, prototyping platforms, and emerging technologies to rapidly explore and validate... 
    Local area

    Partner Engineering and Science

    Austin, TX
    1 day ago
  • $175k - $285k

     ...patented rating technology is used by over...  ...third-party risk management, board reporting...  ...for a Principal Product Manager to own high...  ..., data, and AI and is expected...  ...strategic positioning. Lead the design and...  ...logic, output quality standards, and evaluation frameworks;... 
    Temporary work
    Immediate start

    SecurityScorecard

    Austin, TX
    1 day ago
  • $220.1k - $297.7k

     ...is safe and high-quality, and then find a way...  ...along with a Gen AI content scanner handling...  ...Development Manager to own content quality...  ...-of-managers role leading several distinct...  ...scanner that evaluates content for quality...  ...Working with your product management partners... 
    Flexible hours

    AmazonWebServices

    Austin, TX
    3 days ago
  • $110.7k - $226.13k

     ...you a passionate Product Manager with a proven track...  ...innovation, cutting-edge AI solutions, and...  ...individual to lead our product support...  ...Employer Services technology team, you will be...  ...attention to detail and quality of work...  ...development, or risk evaluation and controlProven... 
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Deloitte

    Austin, TX
    1 day ago
  •  ...empowers thousands of leading B2C, B2B and...  ...commerce operations from product discovery to...  ...things that we love.AI is part of how we...  ...with Engineering to evaluate technical...  ...problems through technology, data, and process...  ...experience in Product Management, Technical Product... 
    Full time
    Temporary work
    H1b
    Live out
    Work at office
    Remote work
    Visa sponsorship

    Cart

    Austin, TX
    2 days ago
  • $130k - $180k

     ...Welcome.” Building the best product, the best teams, and...  ...Technical Product Manager to help support The Zebra...  ...experiences. You will lead the charge on the full...  ...technical challenge of keeping AI performing at its peak...  ...success metrics and evaluate product performance... 
    Work at office
    Immediate start
    Remote work

    The Zebra

    Austin, TX
    3 days ago
  •  ...Kubernetes-native AI infrastructure company...  ...composable, production-ready developer platforms...  ...control needed to manage infrastructure...  ...requirements, evaluate trade-offs, and ship...  ...working directly with leading GPU cloud...  ...-generation cloud technologies.Be a part of cutting... 

    Mirantis

    Austin, TX
    7 hours ago
  • $132k - $209k

     ...five years ago. AI changes what's...  ...content operations product roadmap inside...  ...remit to lead — setting direction...  ...most product managers say they want —...  ...content review and quality checks,...  ...opinions about evaluating, prompting, and...  ...Leader in marketing technology by industry analysts... 
    Temporary work
    Work at office
    Local area

    Braze

    Austin, TX
    1 day ago
  • $150k - $230k

    Title: Lead Product Manager, Hippo Plus Location: Austin, TX / Dallas, TX / Morristown, NJ / San Jose...  ...(Hybrid) Reporting to: Chief Product & AI Officer About Hippo: Hippo was built on...  ..., that mission still drives us. We use technology and data to help our customers stay... 
    Temporary work
    Flexible hours

    Hippo Insurance

    Austin, TX
    3 days ago
  • $196.5k - $291.5k

     ...PayPal and Venmo branded credit products, a credit card, a debit card,...  ...exchanges and returns, and manage risk. We enable consumers to...  ...milliseconds. We're looking for a Lead PM to own the foundation...  ...Interfaces with product and technology leadership as needed.Partners... 
    Full time
    Contract work
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    Austin, TX
    2 days ago
  •  ...connections, and building confidence through expert guidance.As Lead Product Manager for Identity & Auth, you will own the strategy and roadmap...  ...layer.Operate with platform rigor: Own reliability and quality for a critical-path system, driving down change-failure rate... 
    Work at office
    Local area

    Realtor.com

    Austin, TX
    2 days ago
  • $111k - $166k

     ...’t wait to meet you.At Braze, Product Marketing sits at the center of...  ...and GTM for the strategic technology partnerships that extend what'...  ...to WorkABOUT BRAZEBraze is the leading customer engagement platform that...  ...to combine and activate AI agents, models, and features at... 
    Work at office
    Local area

    Braze

    Austin, TX
    2 days ago
  •  ...RoleHopper is looking for a Lead, Finance Analytics & Enablement AI/ML to own our data...  ...the organization, managing partner...  ...design, and AI model evaluation frameworksFamiliarity...  ...HaveBackground at a high-growth technology or marketplace...  ...fintech products to bring transparency... 
    Work experience placement
    Remote work
    Work from home

    Hopper

    Austin, TX
    4 days ago
  • 7+ years of Product Management experience delivering AI, Generative AI, or enterprise software products. Hands-on...  ...AI-driven products. Ability to evaluate, compare, and select appropriate LLMs...  ...Claude Experience Required: 6-8 #J-18808-Ljbffr VMC Soft Technologies, Inc

    VMC Soft Technologies, Inc

    Austin, TX
    2 days ago
  • Staff Product Manager, AI PlatformLocation: Austin, TX (Hybrid, 2-3 Days/Week...  ..., agent frameworks, evaluation systems, observability, and...  ...Establish standards for data quality, reliability, instrumentation...  ...for leveraging AI tools and technologies in day-to-day work.... 
    2 days per week
    3 days per week

    CyberCoders

    Austin, TX
    3 days ago
  • $124k - $280k

     ...processes, improve productivity, and drive...  ...network to deliver quality results. You...  ...experiences you need to lead and deliver...  ...development of AI-enabled...  ...functions. As a Senior Manager, you will serve...  ...chain, and technology platforms-...  ...team members. We evaluate these factors thoughtfully... 
    Full time
    H1b

    PwC

    Austin, TX
    4 days ago
  •  ...are looking for a Principal Product Manager to drive the product...  ...execution for Enterprise AI at Realtor.com. Enterprise...  ...investments in the company's technology portfolio, and the AmpAI team...  ...Tech, Governance, and AI Evaluation: You will lead the deployment of next-gen... 
    Contract work
    Work at office
    Local area

    Realtor.com

    Austin, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Technology Product Manager, AI Quality & Evaluation. Be the first to apply!