Senior Director, Technical Product Management — AI Quality & Evaluation
$218.4k - $365.2kSalesforce
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Product Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce. What You’ll Be Doing & Why It Matters Help build the next generation of Agentforce. We’re an entrepreneurial incubation team within Salesforce, combining the pace and ownership of a startup with access to enterprise customers and Salesforce’s distribution. We’re looking for a technical product leader with deep AI expertise who wants to turn frontier capabilities into products customers can rely on. Our team works closely with AI researchers, applied scientists, and engineers, uses coding agents extensively, and builds and experiments outside the core platform to iterate quickly. You’ll shape product strategy for AI quality and evaluation, establish how we measure progress, and personally lead a customer quality workstream and a focused feature from early learning through delivery. This is a hands-on individual contributor leadership role, with an IC focus expected through 2027. You’ll lead through product ownership, technical judgment, and cross-functional influence while coaching colleagues, including junior designers and technical program managers. People-management responsibilities may develop as the product and team grow. You should enjoy inspecting traces and data, challenging evaluation results, prototyping with coding agents, and working directly with customers. Engineering partners own technical architecture and production implementation. Core Responsibilities & Scope
- Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
- Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
- Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
- Personally lead customer investigations and experiments. For example, investigate why an agent gives an incorrect answer or fails a tool-driven workflow, define the expected behavior, and partner with researchers and engineers to test a change and validate its customer impact.
- Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
- Partner with researchers, applied scientists, and engineers to design credible evaluations. Apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non-deterministic model behavior and grader reliability.
- Lead delivery of capabilities that help customers understand and improve AI performance. For example, prototype an experience that turns a failed agent interaction into an evaluation case, makes the quality gap clear, and helps a customer verify whether a proposed change works.
- Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example.
- Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.
- A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact.
- Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact.
- Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements.
- Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. You can define what good looks like for a non-deterministic system and challenge conclusions with technical partners.
- Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. You can explain when lessons from a previous product apply and when the context demands a different approach.
- Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum.
- Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast-moving environment.
- Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.
- Evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.
- Building in an AI-native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from both successful and unsuccessful experiments.
- Hands-on prototyping with coding agents and delivery of customer-facing performance or outcome experiences.
- Leading initiatives that require agreement across research, engineering, product, and customer-facing organizations.
$180k - $230k
...Industry Group, our Core, AI & Search team builds the... ...complex work, while enabling product teams to deliver better... ...faster. We are seeking a Senior Technical Product Manager to own the technical... ...strategy and roadmap for AI evaluation, quality, safety, and guardrails....QualitySenior$124.8k - $171.6k
...Senior Product ManagerAs Humana continues its transformation... ...into an AI-first enterprise,... ...Senior Product Manager to design, prototype... ...prototyping, evaluation, and launch.Business... ....Evaluation and quality: Build golden... ...scorecards, and technical detail needed to...QualitySeniorFull timeTemporary workApprenticeshipWork at officeRemote workRelocationShift work3 days per week$106.61k - $284.28k
...prioritize safety and quality in everything we... ...of functional and technical expertise, as well... ...for driving product roadmap and prioritization... ...and HR Knowledge Management.Work closely with... ...the business and evaluate ServiceNow... ...years working with AI-enabled capabilities...QualitySeniorFull time$180k - $230k
...Industry Group, our Core, AI & Search team builds... ..., while enabling product teams to deliver... ...faster. We are seeking a Senior Technical Product Manager to own the technical... ...Engineering and AI Quality to support model... ...Integrate AI Quality's evaluation tools and safety...QualitySenior$140k - $165k
...Exploitation (NCOSE) is seeking a Senior Technical Product Manager to lead the development,... ...evolution of an innovative AI-powered Parent Center... ...enough to challenge developers, evaluate technical recommendations,... ...firm accountable for quality, schedule, and results....QualitySeniorWork at officeLocal areaRemote work$151.2k - $204.6k
...GCP) Technology and Product builds and manages the tech portfolio... ...are looking for a Senior Product Manager, Technical to coordinate,... ...time and at a high quality bar.- Analyze usage... ...impact after launch.- Evaluate technical... ...integrate generative AI and automation into...QualitySeniorFlexible hoursDay shift- ...Storable is seeking experienced AI-native Senior Product Managers Technical to support our growing Marine and... ...closely with engineering and design to evaluate technical approaches resolve... ...evaluating AI-generated work for accuracy quality privacy and reliability....QualitySeniorFull timeTemporary workLocal areaImmediate startHome officeOverseasRelocation packageFlexible hours
$151.2k - $204.6k
...customers to easily manage access to their homes... ...are seeking a hands-on AI first Sr Product Manager - Tech who is... ...emphasis on design quality performance and customer... ...user stories and technical specifications that engineering... ...Required Experience: Senior IC ]]...QualitySeniorFull timeLocal areaFlexible hours$105.79k - $141.05k
...trusted network for the AI‑powered world,... ...We are seeking a Senior Lead Technical Marketing Manager to shape how Lumen brings... ...with many functions—Product Marketing, Product Management... ..., solution quality, and conversion.... ...Background results will be evaluated on a case-by-case...QualitySeniorFull timeTemporary workWork from home$166k - $220k
...powered by Lattice OS, an AI-powered operating... ...a highly motivated Technical Program Manager (TPM) to oversee the... ...ensure on-time, high-quality software releases to... ...a deep commitment to product quality. This is a high... ...engineering, test & evaluation, and program management...QualitySeniorFull timeWork experience placement$200.7k - $229.1k
Senior Technical Product Manager | Developer Tooling - Capital One Travel### Senior Technical... ...Travel funnels; we unlock AI-driven front-end... ...architectural discussions, able to evaluate technical tradeoffs first-... ...them with the right quality and in a timely fashion. Comfortable...QualitySeniorFull timePart timeH1b$245k - $300k
Lead the product team building the shared... ...next-generation AI-powered... ...We are seeking a Senior Director, Core, AI & Search... ...will lead Product Managers and Technical Product Managers... ...workflows. Define quality and measurement... ...Demonstrated ability to evaluate and introduce...QualitySeniorFull time$147.68k - $236.28k
...cloud software. Like our products, we work better together.... ...transforms public safety. As a Senior Technical Program Manager II, AI, you will play a pivotal... ..., and post-launch evaluation.Cross-Functional Leadership... ...ability to author clear, high-quality technical specifications...QualitySeniorWork experience placementWork at officeRemote work$166.38k - $191.98k
...Position: Senior Technical Account Manager, Federal Programs Location: District of... ...review output and hold delivery quality. Define and defend the... ...use and refine AI-driven prompts to improve the... ...requests will be reviewed and evaluated on a case-by-case basis....QualitySeniorFull timeTemporary workWork experience placementLocal areaImmediate startRemote workFlexible hours- ...Technical Product ManagerAARP is the nation's largest nonprofit... ...chosen, high-quality products and services... ...The Technical Product Manager is responsible for the... ...tools, analytics, and AI-enabled capabilities to... ...relationshipsIndependent judgement in evaluation options to make sound...QualityWork at officeRemote workVisa sponsorshipWork visaMonday to Friday
- Senior Manager, Technical Accounting Job Description Who is CoStar Group... ...to delivering high-quality service to... ...accounting standards, evaluate their potential impact... ...Ability to leverage AI-enabled tools and automation... ...unique and valuable products and services. We’ve continually...QualitySeniorFull time
$125k - $135k
...seeking an experienced Technical Product Manager to design and deliver... ...and roll‑out of AI‑driven tools), commercial... ...how prototypes are evaluated with users, reviewed... ...expected results, and clear quality thresholds. Run them... ..., technology, and senior leadership teams....QualityDay shift- ...Description Shield AI is a venture-backed... ...intelligent systems. Its products include Hivemind... ...for an exceptional Senior Staff Technical Program Manager to join our Weapons... ...allocation. Continuously evaluate and rebalance... ...Drive Timely, High-Quality Decisions ~ Facilitate...QualitySeniorFull timeTemporary workPart timeWork experience placementWorldwide
$110.4k - $189k
...annuallyJOB SUMMARYThe Senior Manager, Technical Solution Engineer... ...ownership of product delivery to turn... ...to the Senior Director, HR Solution Engineering... ...to advance the evaluation of opportunities... ...Familiarity with AI/ML concepts and... ...to deliver high-quality technology solutions...QualitySeniorFull timeWork at officeRemote workFlexible hours$151.2k - $204.6k
...organization is looking for an experienced technical product manager to lead the development of digital... ...maintenance powered by IoT data and AI to identify equipment issues before breakdowns... ...tools that enable stakeholders to evaluate changes to space layouts, capacity...SeniorWork at officeFlexible hours- Twenty builds AI-enabled technology for mission-critical cyber... .... We're seeking a Staff Product Manager to help make agentic AI systems... ...and engineering teams to shape evaluation capabilities—from defining agent performance and product quality to turning results into useful...Quality
$235.8k - $307.85k
...are looking for a Senior Principal Technical Program Manager (P70) to lead the strategy... ...Conversational AI & Agent Platforms... ...-leverage Platform Products with first-class... ...without compromising quality or safety.... ...Familiarity with offline LLM evaluation harnesses,...QualitySeniorFull timeWork at officeLocal area- ...business value with AI.What You’ll Do... ...Teradata’s product-led growth strategy... ...with product management, engineering,... ...as Teradata’s senior product leader... ...memory, reasoning, evaluation, guardrails,... ...complex AI and technical capabilities into... ...trust and quality.Why we think you...QualitySeniorFlexible hours
$169.35k - $237.09k
...critical operations worldwide. As a Senior Technical Product Manager at Blue Origin, you will serve as a single... ...or inorganic growth and acquisition evaluation. Regardless of domain, your core job... ...), Assembly, Integration, and Test (AI&T) planning, and production rate...SeniorPermanent employmentFull timeTemporary workLocal areaWorldwideRelocation package$160k - $220k
...Senior Program Manager, Deployment AutomationWe are seeking a highly technical Senior Program Manager to lead operational intelligence, analytics... ...across large-scale AI infrastructure deployment programs... ...frameworks to improve execution quality and organizational scalability...QualitySeniorFlexible hours$148.7k - $201.2k
...communication, and AI is our catalyst.... ...with AWS product teams, we are reimagining... ...looking for a Technical Program Manager based in Arlington... ...schedule, budget, quality, along with risk... ...and reporting to senior leadership- Experience... ...building and evaluating system-level technical...QualitySeniorLive inWork at officeImmediate startFlexible hours- ...Assurance North America is seeking a Senior Manager, ICT Delivery & Technical Operations is the senior leader... ...for the overall delivery, technical quality, client-facing execution, client satisfaction... ...18, TISAX, cloud security, privacy, AI governance, cybersecurity, or...QualitySeniorTemporary workRemote workWorldwide
$269.6k - $307.7k
...Senior Director, Product Management, Risk Data Product Management at Capital One is... ...intersection of data, applied AI, and customer-centric... ...inputs into a unified, high-quality asset for enterprise-wide... ...reasonable accommodations. For technical support or questions about...QualitySeniorFull timePart timeLocal area$130k - $216k
...What You Will Do: The Technical Product Manager translates complex... ...supporting internal AI Transformation, Solution... ...and demonstrate value. Evaluate buy, configure, build... ...across cost, quality, security, complexity... ...communicate tradeoffs to senior stakeholders. Plan adoption...QualityTemporary workFlexible hours$140k - $200k
Position Summary As a Senior GCP Technical Account Manager (Lead Cloud Integrated... ...Infrastructure Engineer II) on the AI & Engineering team, you... ...with client Support, Product Engineering, and Site Reliability... ...attention to detail and quality of work productAbility to...QualitySeniorLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Director, Technical Product Management — AI Quality & Evaluation. Be the first to apply!
- senior technical product manager Washington DC
- technical writing manager Washington DC
- senior technical director Washington DC
- technical business manager Washington DC
- senior technical manager Washington DC
- technical superintendent Washington DC
- technical services manager Washington DC
- technical integration manager Washington DC
- technical director Washington DC
- director technical accounting Washington DC






