Senior Director, Technical Product Management — AI Quality & Evaluation
$218.4k - $365.2kSalesforce
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Product Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce. What You’ll Be Doing & Why It Matters Help build the next generation of Agentforce. We’re an entrepreneurial incubation team within Salesforce, combining the pace and ownership of a startup with access to enterprise customers and Salesforce’s distribution. We’re looking for a technical product leader with deep AI expertise who wants to turn frontier capabilities into products customers can rely on. Our team works closely with AI researchers, applied scientists, and engineers, uses coding agents extensively, and builds and experiments outside the core platform to iterate quickly. You’ll shape product strategy for AI quality and evaluation, establish how we measure progress, and personally lead a customer quality workstream and a focused feature from early learning through delivery. This is a hands-on individual contributor leadership role, with an IC focus expected through 2027. You’ll lead through product ownership, technical judgment, and cross-functional influence while coaching colleagues, including junior designers and technical program managers. People-management responsibilities may develop as the product and team grow. You should enjoy inspecting traces and data, challenging evaluation results, prototyping with coding agents, and working directly with customers. Engineering partners own technical architecture and production implementation. Core Responsibilities & Scope
- Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
- Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
- Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
- Personally lead customer investigations and experiments. For example, investigate why an agent gives an incorrect answer or fails a tool-driven workflow, define the expected behavior, and partner with researchers and engineers to test a change and validate its customer impact.
- Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
- Partner with researchers, applied scientists, and engineers to design credible evaluations. Apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non-deterministic model behavior and grader reliability.
- Lead delivery of capabilities that help customers understand and improve AI performance. For example, prototype an experience that turns a failed agent interaction into an evaluation case, makes the quality gap clear, and helps a customer verify whether a proposed change works.
- Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example.
- Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.
- A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact.
- Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact.
- Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements.
- Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. You can define what good looks like for a non-deterministic system and challenge conclusions with technical partners.
- Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. You can explain when lessons from a previous product apply and when the context demands a different approach.
- Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum.
- Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast-moving environment.
- Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.
- Evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.
- Building in an AI-native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from both successful and unsuccessful experiments.
- Hands-on prototyping with coding agents and delivery of customer-facing performance or outcome experiences.
- Leading initiatives that require agreement across research, engineering, product, and customer-facing organizations.
- ...Technical Product Leader, AgentforceSalesforce is the #1 AI CRM, where humans with agents drive customer... ...strategy for AI quality and evaluation, establish how we measure... ...technical program managers. People-management responsibilities... ...to customers and senior stakeholders.Minimum...QualitySeniorFlexible hours
- ...Salesforce is seeking a technical product leader to shape the next generation of Agentforce, blending startup speed with enterprise scale. You will own AI quality and evaluation, lead customer investigations, and drive cross-functional delivery with researchers, engineers...QualitySenior
$205.6k - $257k
...the leading AI data foundry,... ...decisions.Scale's evaluation and data products shape how the... ...AI Product Management, ML Research,... ...judgment, technical fluency, operational... ...depth.Senior AI PM, Leaderboards... ...design, and quality bars.Drive... ...to Board of Director approval. Your...QualitySeniorFull time$400k
...intuitive spend management, bill pay, and... ...effortlessly. Brex’s AI-native... ...grow your career.Product at BrexThe Product... ...on, how you evaluate an answer that... ..., how you keep quality moving up as the... ...judgment this senior role calls for.... ...right.You have technical depth, and you'...QualitySeniorWork at officeRemote workShift work3 days per week- ...the next era of AI. We design, build... ...computing. Our Technical Sourcing team sits... ...looking for a Senior Technical Sourcing Manager, Rack Integration... ...into a live, production-ready fleet. You... ...process, ensuring quality, schedule, and specification... ...committed to evaluating qualified...QualitySeniorDaily paidContract workTemporary workLive outRelocation package
$150.1k - $227k
...SalesforceSalesforce is the #1 AI CRM, where humans... ...Infrastructure, Technical Program Managers (TPMs) are... ...’ll partner with senior leadership to... ...and product development lifecycle... ...and driving high-quality, innovative, and... ...recruiters assess and evaluate candidates’ resumes...QualitySeniorFull time- ...ever, you can manage and automate every... ...software into products our customers... ...and use. As the senior product design... ...manager for our AI Platform, you will... ...adoption, quality control, and cross... ....Help attract, evaluate, and close... ...edge cases, and technical dependencies into...QualitySeniorWork at office3 days per week
$163.64k - $336.9k
...the people behind the product.Discover a career... ...Possible.At Pinterest, AI isn't just a feature,... ...here.As a Sr. Staff Technical Program Manager for Search Signals at... ...ensuring on-time, high-quality results across interconnected... ..., and model evaluation.Shape the future of the...QualitySeniorWork at officeLocal areaRemote workRelocation package$162.1k - $224.5k
...experimentation, and advanced AI to reshape access to... ...partners across Product, Engineering,... ...and consumers. As a Senior Technical Program Manager, you will own program... ...reliably and with quality. You will partner with... ...discussions by evaluating software architecture...QualitySeniorCurrently hiringLocal areaRemote workWork from home$115k - $188k
...IQ is HP’s new AI innovation lab.... ...researchers, and product minds—focused... ...for a Program Manager who can help drive... ...exceptional quality and developer efficiency... ...a blend of technical fluency,... ...program updates for senior leadership.... ...pipelines, or model evaluation workflows....QualitySeniorFull timeTemporary workLocal areaFlexible hours- ...(SGA), is searching for an Technical AI Product Manager for a Remote Full Time assignment... ...strategies. Evaluate trade-offs across performance... ...enabled features with a focus on quality, safety, scalability, and... ...collaborating with senior engineering and machine learning...QualityFull timeRemote work
- We are seeking an experienced Senior Technical Product Manager with 8+ years of experience, including direct... ...readiness and post-launch quality. Benchmark capabilities against industry... ...understand and discuss technical concepts, evaluate tradeoffs, and assess new...QualitySenior
$141.5k - $224k
...Technical Product Manager, Edge PlatformAt Viasat, the work you do... ...), and decrease TCO (quality, diagnostics, supportability... ...and the ability to evaluate product performance... ...stakeholders and senior leadership.What Will... ...JobExperience implementing AI-driven solutions to...Quality$190.8k - $267.1k
...Senior Technical Product Manager, Ads ML Platform Reddit Senior Technical Product Manager, Ads ML Platform... ...Whether it's integrating generative AI to increase developer productivity,... ...us. We will use this information to evaluate your application for employment or an...SeniorFor contractorsWork experience placementWork at officeRemote workHome officeFlexible hours$148.5k - $313.7k
...Salesforce is the #1 AI CRM, where humans... ...’s world-class product and project offerings... ...potential technical debt. Our team is... ...Identify and proactively manage risk areas and commit... ...Required Qualities TRUST: Trusts the... ...recruiters assess and evaluate candidates’ resumes...QualitySeniorFull timeWork experience placement$104.9k - $199.07k
...our core values of Quality, Integrity, and... ...questions. Through our products, education, and... ...healthcare cost and care management.MedInsight is a... ...is seeking a Technical Product Manager with... ...analytics and AI products. This role... ...experience metrics to evaluate whether platform...QualityFull timeWork experience placementRemote workFlexible hours$194.6k - $285.7k
...TeamDesigns, develops, and manages activities for a specific product or group of... ...engineering, test, quality, and marketing as the... ...a significant AI Security product domain... ...approaches, evaluate technical feasibility, and turn... ...execution.Serve as a senior AI Security domain...QualitySeniorFull timeTemporary workWork at officeLocal areaImmediate startFlexible hoursShift work$267k - $331.9k
...thoughtful use of AI to improve clarity, speed, and quality of work. What You’... ...Lead (PSTL) is a senior scientific and strategic... ..., and lifecycle management. The role requires... ...development evaluations.Build strong relationships... ...Sciences, CMC, or Technical Operations....QualitySeniorFull timeWork at officeFlexible hours$175k - $215k
...vertically integrated AI infrastructure... ...About the Role: As Senior Manager, Technical Recruiting, you will... ...history. Reporting to the Director of Technical Talent Acquisition... ..., AI, Hardware, and Product organizations.... ...compromising talent quality. You'll operate as...QualitySeniorTemporary work- ...Uber Technologies Inc. is seeking a Program Manager II (Technical Operations) to bridge technical vision with... ...accelerate technical velocity while maintaining quality and governance. You will collaborate with Engineering, Product, and Data Science to unblock milestones,...QualitySenior
$210k - $220k
...CaliforniaProduct - Product Management Office /US Full-time... ...feature development, technical infrastructure, partner... ...speed of execution with quality and customer... ...researchEstablish processes for evaluating which strategic... ...artificial intelligence (AI) tools to support...QualitySeniorFull timeTemporary workWork at office$175k - $215k
...only vertically integrated AI infrastructure company built... ...Crusoe.About This Role:As the Senior Manager, Technical Recruiting, you will lead... ...Infrastructure, AI, Hardware, Product and other critical technical... ...to ensure consistent, high-quality hiring decisions.Identify opportunities...QualitySeniorTemporary work- ...Senior Director, Product Management, Data Intelligence Platform About the Company Healthcare technology... ...building scalable solutions to improve quality, affordability, and experience... ...analytics, machine learning, and generative AI, while balancing investment...QualitySenior
- ...Senior Technical Program Manager of Applied AIAI is changing how the world communicates... .... We use cutting-edge AI, machine translation, and... ...compromising on brand, voice, or quality.At LILT, we empower our... ...Control: Partner with production to implement rigorous, automated...QualitySeniorWork at office
- ...Senior Technical Program ManagerCode Metal is seeking a Senior Technical Program Manager to lead complex initiatives across a growing... ...will partner with Product, Engineering,... ...advance Code Metal's AI-powered code translation... ...measuring progress, product quality, and technical...QualitySeniorRemote workRelocation packageFlexible hoursShift work
$75k - $165k
...Role We are seeking an experienced technical product manager to design and deliver high-value AI Agent solutions across the Veeva Quality Cloud suite of products. Veeva Quality... ...using AI Assist with AI Agent evaluations Present feature capabilities and...QualityWork at officeLocal areaRemote workWork from homeFlexible hours$120k - $200k
...companies rely on to manage the full lifecycle... ...an experienced product manager to own and... ...Product Strategy & AI: Own the vision,... ...the scalability and quality standards of the... ...production platforms Technical Proficiency:... ...with our group's Senior Leader. Once all interviews...QualitySeniorWork at officeLocal areaWork from homeFlexible hours$144k - $244.8k
...opportunity We’re looking for a Technical Product & Innovation Manager to support the Digital... ...adoption, experience, quality, reliability, efficiency, cost... ...for broader scale Evaluate emerging capabilities, including generative AI, agentic workflows, automation...QualitySummer holidayFlexible hours$260k - $340k
...Atoms builds Physical AI — real-world robots for... ...scalable, and more productive. This work requires... ...subject-matter expert on technical accounting, providing... ...Lead the research, evaluation, and documentation of... ...practical recommendations for senior leadership, while...SeniorFull timeTemporary workWork at office$80k - $110k
...Senior Technical Operations Manager, Mobile (In-App)At Magnite, we cultivate an environment... ...— through sophisticated, AI-enhanced programmatic... ...intersection of Account Management, Product, and Engineering to drive... ...access brand-safe, high-quality ad inventory and execute...QualitySeniorWork experience placementWork at officeLocal areaRemote workMonday to Friday
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Director, Technical Product Management — AI Quality & Evaluation. Be the first to apply!
- technical director San Francisco, CA
- director of technical services San Francisco, CA
- technical product manager San Francisco, CA
- technical coordinator San Francisco, CA
- technical director engineering San Francisco, CA
- technical account manager San Francisco, CA
- technical writing manager San Francisco, CA
- technical services manager San Francisco, CA
- technical marketing manager San Francisco, CA
- technical business manager San Francisco, CA




