Director - AI Validation and Monitoring

The Director - AI Validation and Monitoring is the organizational architect of Mayo's policies and processes for measuring, monitoring, and reporting on the real-world effectiveness of AI systems used in clinical practice. As the AI portfolio grows to encompass predictive analytics, generative AI, and agentic AI across clinical and patient experience activities in the Practice, this leader will ensure that every deployed model meets Mayo performance and safety standards and continues to perform as intended — and that performance is defined not just by technical accuracy, but by clinical impact, patient safety, and return on investment. Reporting to the Senior Director, AIA, the Director will build the talent, infrastructure, and culture necessary to make rigorous AI evaluation a continuous organizational capability rather than a one-time validation event. The Director also designs and operationalizes a pre- and post-deployment performance monitoring and reporting program that tracks model performance across diverse care settings, patient populations, and time horizons — detecting drift, degradation, and disparate impact before they translate into low performance, clinical harm or operational inefficiency. This leader will develop standardized evaluation frameworks that define success metrics for each AI use case in collaboration with clinical, operational, and financial stakeholders, ensuring alignment between technical performance indicators and meaningful outcomes such as patient benefit, patient volume, and clinician burden. The Director will oversee the build-out of dashboards and reporting pipelines that surface AI performance data to AIA and Practice leadership. They will also support structured retrospective reviews when AI-assisted decisions contribute to adverse events or near-misses, working in close partnership with patient safety, quality, and legal teams to drive corrective action and continuous improvement. Additionally, the Director partners with other AIA components to ensure that performance evaluation supports AIA and Mayo goals for high-performing, transformative clinical care. The Director will be the enterprise nexus for advancing Mayo's leadership in robust yet practical performance and risk evaluation to elevate current standards of care, partnering closely with Practice leaders across departments and sites, as well as other enterprise governance leaders and bodies. Above all, the successful candidate will be a credible, collaborative leader who can work across the boundaries of AI technology, data science, clinical medicine, and operations — translating evaluation findings into the institutional learning that makes AI better and safer for every patient we serve. Key Responsibilities * AI Strategy & Program Leadership: Lead development and execution of enterprise AI strategy and multi-year roadmaps aligned with organizational goals. * Portfolio Oversight: Oversee intake, prioritization, and sequencing of AI initiatives; balance value, feasibility, risk, and capacity across portfolios. * Cross‑Functional Leadership: Partner with clinical, operational, technical, legal, compliance, and data leaders to advance AI initiatives from concept through deployment. * Governance & Responsible AI: Ensure AI initiatives adhere to governance frameworks, ethical standards, regulatory requirements, and risk management practices. * Operational Enablement: Establish operating rhythms, performance metrics, and reporting mechanisms to track progress, outcomes, and value realization. * Stakeholder Engagement: Serve as a trusted advisor to senior leaders; communicate AI strategy, progress, and impact through executive‑level updates and presentations. * People & Team Leadership: Lead, develop, and support managers and senior professionals; foster a culture of accountability, collaboration, and continuous improvement. * Financial & Resource Stewardship: Support budget planning, resource allocation, and business case development for AI initiatives. Core Competencies

• Enterprise AI & Digital Strategy
• Executive Presence & Influence
• Change Leadership & Resilience
• Ethical & Responsible AI Stewardship
• Cross‑Functional Collaboration
• Program & Portfolio Management

This is a hybrid position and incumbent must live within 100 miles of a Mayo Clinic campus. Fulltime remote may be considered. Mayo Clinic will not sponsor or transfer visas for this position including F1

OPT STEM.

Why Mayo Clinic Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans [ – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic. Benefits Highlights

• Medical: Multiple plan options.
• Dental: Delta Dental or reimbursement account for flexible coverage.
• Vision: Affordable plan with national network.
• Pre-Tax Savings: HSA and FSAs for eligible expenses.
• Retirement: Competitive retirement package to secure your future.

Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is. [ Equal Opportunity All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law" [ Mayo Clinic participates in E-Verify [ and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.