Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Director, Technical Product Management — AI Quality & Evaluation

$218.4k - $365.2k
Full-time

Salesforce

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Product Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce. What You’ll Be Doing & Why It Matters Help build the next generation of Agentforce. We’re an entrepreneurial incubation team within Salesforce, combining the pace and ownership of a startup with access to enterprise customers and Salesforce’s distribution. We’re looking for a technical product leader with deep AI expertise who wants to turn frontier capabilities into products customers can rely on. Our team works closely with AI researchers, applied scientists, and engineers, uses coding agents extensively, and builds and experiments outside the core platform to iterate quickly. You’ll shape product strategy for AI quality and evaluation, establish how we measure progress, and personally lead a customer quality workstream and a focused feature from early learning through delivery. This is a hands-on individual contributor leadership role, with an IC focus expected through 2027. You’ll lead through product ownership, technical judgment, and cross-functional influence while coaching colleagues, including junior designers and technical program managers. People-management responsibilities may develop as the product and team grow. You should enjoy inspecting traces and data, challenging evaluation results, prototyping with coding agents, and working directly with customers. Engineering partners own technical architecture and production implementation. Core Responsibilities & Scope

  • Set a coherent product strategy and roadmap for AI quality and evaluation, connecting customer needs, technical opportunities, and measurable business outcomes.
  • Establish shared quality definitions, evaluation requirements, coverage priorities, and release criteria with research, engineering, and product partners.
  • Make explicit investment tradeoffs across customer quality improvements, evaluation capabilities, and product features; align teams on priorities and decision ownership.
  • Personally lead customer investigations and experiments. For example, investigate why an agent gives an incorrect answer or fails a tool-driven workflow, define the expected behavior, and partner with researchers and engineers to test a change and validate its customer impact.
  • Build an operating approach that connects customer feedback, evaluation evidence, experiments, releases, and learning across teams.
  • Partner with researchers, applied scientists, and engineers to design credible evaluations. Apply AI/ML fundamentals such as training/test separation, overfitting, representative coverage, and independent validation to assess non-deterministic model behavior and grader reliability.
  • Lead delivery of capabilities that help customers understand and improve AI performance. For example, prototype an experience that turns a failed agent interaction into an evaluation case, makes the quality gap clear, and helps a customer verify whether a proposed change works.
  • Coach product partners, junior designers, and technical program managers in problem framing, experimentation, and delivery; raise the quality of decisions through mentorship and practical example.
  • Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices clearly to customers and senior stakeholders.
Minimum Requirements
  • A record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact.
  • Deep hands-on experience building AI agents and evaluation capabilities in close partnership with AI researchers, applied scientists, or AI engineers. One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact.
  • Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and the tradeoffs among model, data, system, and product improvements.
  • Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty. You can define what good looks like for a non-deterministic system and challenge conclusions with technical partners.
  • Principled, flexible thinking: frame the underlying customer problem, test assumptions, and change direction when evidence warrants it. You can explain when lessons from a previous product apply and when the context demands a different approach.
  • Experience establishing shared standards and resolving cross-team disagreements while preserving clear accountability and delivery momentum.
  • Evidence of coaching and mentoring colleagues without relying on reporting authority, and the ability to deliver independently in a fast-moving environment.
  • Clear communication with customers, technical teams, and senior leaders, including an honest account of what is known, uncertain, or still unproven.
Preferred Qualifications
  • Evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products.
  • Building in an AI-native startup or entrepreneurial environment, taking a new product from early customer learning to adoption, and applying lessons from both successful and unsuccessful experiments.
  • Hands-on prototyping with coding agents and delivery of customer-facing performance or outcome experiences.
  • Leading initiatives that require agreement across research, engineering, product, and customer-facing organizations.
What success looks like Customers see credible improvement in real agent workflows, supported by evaluations they can trust. You independently take an initial quality problem from failure analysis through experimentation and customer validation, and deliver a focused feature with engineering. Teams make better release and investment decisions because of the evidence, product judgment, and coaching you bring. Unleash Your Potential When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best , and our AI agents accelerate your impact so you can do your best . Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world. Accommodations If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this [Accommodations Request Form]( Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our [Candidate Privacy Statement]( for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options. Posting Statement Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. [Know your rights: workplace discrimination is illegal.]( Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education. In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $218,400 - $365,200 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $263,200 - $401,400 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Director, Technical Product Management — AI Quality & Evaluation in Washington DC vacancy
  • $180k - $230k

     ...Industry Group, our Core, AI & Search team builds the...  ...complex work, while enabling product teams to deliver better...  ...faster. We are seeking a Senior Technical Product Manager to own the technical...  ...strategy and roadmap for AI evaluation, quality, safety, and guardrails.... 
    Quality
    Senior

    Bloomberg Industry Group, Inc.

    Arlington, VA
    3 days ago
  • $124.8k - $171.6k

     ...Senior Product ManagerAs Humana continues its transformation...  ...into an AI-first enterprise,...  ...Senior Product Manager to design, prototype...  ...prototyping, evaluation, and launch.Business...  ....Evaluation and quality: Build golden...  ...scorecards, and technical detail needed to... 
    Quality
    Senior
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Relocation
    Shift work
    3 days per week

    Humana

    Washington DC
    3 days ago
  • $106.61k - $284.28k

     ...prioritize safety and quality in everything we...  ...of functional and technical expertise, as well...  ...for driving product roadmap and prioritization...  ...and HR Knowledge Management.Work closely with...  ...the business and evaluate ServiceNow...  ...years working with AI-enabled capabilities... 
    Quality
    Senior
    Full time

    Oak St. Health

    Washington DC
    4 days ago
  • $180k - $230k

     ...Industry Group, our Core, AI & Search team builds...  ..., while enabling product teams to deliver...  ...faster. We are seeking a Senior Technical Product Manager to own the technical...  ...Engineering and AI Quality to support model...  ...Integrate AI Quality's evaluation tools and safety... 
    Quality
    Senior

    Jobleads-US

    Arlington, VA
    1 day ago
  • $140k - $165k

     ...Exploitation (NCOSE) is seeking a Senior Technical Product Manager to lead the development,...  ...evolution of an innovative AI-powered Parent Center...  ...enough to challenge developers, evaluate technical recommendations,...  ...firm accountable for quality, schedule, and results.... 
    Quality
    Senior
    Work at office
    Local area
    Remote work

    National Center on Sexual Exploitation

    Washington DC
    3 days ago
  • $151.2k - $204.6k

     ...GCP) Technology and Product builds and manages the tech portfolio...  ...are looking for a Senior Product Manager, Technical to coordinate,...  ...time and at a high quality bar.- Analyze usage...  ...impact after launch.- Evaluate technical...  ...integrate generative AI and automation into... 
    Quality
    Senior
    Flexible hours
    Day shift

    Amazon

    Arlington, VA
    1 day ago
  •  ...Storable is seeking experienced AI-native Senior Product Managers Technical to support our growing Marine and...  ...closely with engineering and design to evaluate technical approaches resolve...  ...evaluating AI-generated work for accuracy quality privacy and reliability.... 
    Quality
    Senior
    Full time
    Temporary work
    Local area
    Immediate start
    Home office
    Overseas
    Relocation package
    Flexible hours

    Storable

    Washington DC
    3 days ago
  • $151.2k - $204.6k

     ...customers to easily manage access to their homes...  ...are seeking a hands-on AI first Sr Product Manager - Tech who is...  ...emphasis on design quality performance and customer...  ...user stories and technical specifications that engineering...  ...Required Experience: Senior IC ]]... 
    Quality
    Senior
    Full time
    Local area
    Flexible hours

    Amazon

    Washington DC
    28 days ago
  • $105.79k - $141.05k

     ...trusted network for the AI‑powered world,...  ...We are seeking a Senior Lead Technical Marketing Manager to shape how Lumen brings...  ...with many functions—Product Marketing, Product Management...  ..., solution quality, and conversion....  ...Background results will be evaluated on a case-by-case... 
    Quality
    Senior
    Full time
    Temporary work
    Work from home

    Lumen

    Adelphi, MD
    1 day ago
  • $166k - $220k

     ...powered by Lattice OS, an AI-powered operating...  ...a highly motivated Technical Program Manager (TPM) to oversee the...  ...ensure on-time, high-quality software releases to...  ...a deep commitment to product quality. This is a high...  ...engineering, test & evaluation, and program management... 
    Quality
    Senior
    Full time
    Work experience placement

    Anduril Industries

    Washington DC
    2 days ago
  • $200.7k - $229.1k

    Senior Technical Product Manager | Developer Tooling - Capital One Travel### Senior Technical...  ...Travel funnels; we unlock AI-driven front-end...  ...architectural discussions, able to evaluate technical tradeoffs first-...  ...them with the right quality and in a timely fashion. Comfortable... 
    Quality
    Senior
    Full time
    Part time
    H1b

    Jobleads-US

    McLean, VA
    2 days ago
  • $245k - $300k

    Lead the product team building the shared...  ...next-generation AI-powered...  ...We are seeking a Senior Director, Core, AI & Search...  ...will lead Product Managers and Technical Product Managers...  ...workflows. Define quality and measurement...  ...Demonstrated ability to evaluate and introduce... 
    Quality
    Senior
    Full time

    Bloomberg Industry Group

    Arlington, VA
    1 day ago
  • $147.68k - $236.28k

     ...cloud software. Like our products, we work better together....  ...transforms public safety. As a Senior Technical Program Manager II, AI, you will play a pivotal...  ..., and post-launch evaluation.Cross-Functional Leadership...  ...ability to author clear, high-quality technical specifications... 
    Quality
    Senior
    Work experience placement
    Work at office
    Remote work

    Axon

    Washington DC
    16 hours ago
  • $166.38k - $191.98k

     ...Position: Senior Technical Account Manager, Federal Programs Location: District of...  ...review output and hold delivery quality. Define and defend the...  ...use and refine AI-driven prompts to improve the...  ...requests will be reviewed and evaluated on a case-by-case basis.... 
    Quality
    Senior
    Full time
    Temporary work
    Work experience placement
    Local area
    Immediate start
    Remote work
    Flexible hours

    Fortress LLC

    Washington DC
    3 days ago
  •  ...Technical Product ManagerAARP is the nation's largest nonprofit...  ...chosen, high-quality products and services...  ...The Technical Product Manager is responsible for the...  ...tools, analytics, and AI-enabled capabilities to...  ...relationshipsIndependent judgement in evaluation options to make sound... 
    Quality
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Monday to Friday

    Older Adults Technology Services

    Washington DC
    2 days ago
  • Senior Manager, Technical Accounting Job Description Who is CoStar Group...  ...to delivering high-quality service to...  ...accounting standards, evaluate their potential impact...  ...Ability to leverage AI-enabled tools and automation...  ...unique and valuable products and services. We’ve continually... 
    Quality
    Senior
    Full time

    CoStar Group, Inc.

    Arlington, VA
    3 days ago
  • $125k - $135k

     ...seeking an experienced Technical Product Manager to design and deliver...  ...and roll‑out of AI‑driven tools), commercial...  ...how prototypes are evaluated with users, reviewed...  ...expected results, and clear quality thresholds. Run them...  ..., technology, and senior leadership teams.... 
    Quality
    Day shift

    Politico

    Arlington, VA
    3 days ago
  •  ...Description Shield AI is a venture-backed...  ...intelligent systems. Its products include Hivemind...  ...for an exceptional Senior Staff Technical Program Manager to join our Weapons...  ...allocation. Continuously evaluate and rebalance...  ...Drive Timely, High-Quality Decisions ~ Facilitate... 
    Quality
    Senior
    Full time
    Temporary work
    Part time
    Work experience placement
    Worldwide

    Shield AI

    Washington DC
    1 day ago
  • $110.4k - $189k

     ...annuallyJOB SUMMARYThe Senior Manager, Technical Solution Engineer...  ...ownership of product delivery to turn...  ...to the Senior Director, HR Solution Engineering...  ...to advance the evaluation of opportunities...  ...Familiarity with AI/ML concepts and...  ...to deliver high-quality technology solutions... 
    Quality
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Marriott International

    Bethesda, MD
    1 day ago
  • $151.2k - $204.6k

     ...organization is looking for an experienced technical product manager to lead the development of digital...  ...maintenance powered by IoT data and AI to identify equipment issues before breakdowns...  ...tools that enable stakeholders to evaluate changes to space layouts, capacity... 
    Senior
    Work at office
    Flexible hours

    Amazon

    Arlington, VA
    4 days ago
  • Twenty builds AI-enabled technology for mission-critical cyber...  .... We're seeking a Staff Product Manager to help make agentic AI systems...  ...and engineering teams to shape evaluation capabilities—from defining agent performance and product quality to turning results into useful... 
    Quality

    Twenty

    Arlington, VA
    1 day ago
  • $235.8k - $307.85k

     ...are looking for a Senior Principal Technical Program Manager (P70) to lead the strategy...  ...Conversational AI & Agent Platforms...  ...-leverage Platform Products with first-class...  ...without compromising quality or safety....  ...Familiarity with offline LLM evaluation harnesses,... 
    Quality
    Senior
    Full time
    Work at office
    Local area

    Atlassian

    Washington DC
    5 days ago
  •  ...business value with AI.What You’ll Do...  ...Teradata’s product-led growth strategy...  ...with product management, engineering,...  ...as Teradata’s senior product leader...  ...memory, reasoning, evaluation, guardrails,...  ...complex AI and technical capabilities into...  ...trust and quality.Why we think you... 
    Quality
    Senior
    Flexible hours

    Teradata

    Washington DC
    4 days ago
  • $169.35k - $237.09k

     ...critical operations worldwide. As a Senior Technical Product Manager at Blue Origin, you will serve as a single...  ...or inorganic growth and acquisition evaluation. Regardless of domain, your core job...  ...), Assembly, Integration, and Test (AI&T) planning, and production rate... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Local area
    Worldwide
    Relocation package

    Blue Origin

    Washington DC
    3 days ago
  • $160k - $220k

     ...Senior Program Manager, Deployment AutomationWe are seeking a highly technical Senior Program Manager to lead operational intelligence, analytics...  ...across large-scale AI infrastructure deployment programs...  ...frameworks to improve execution quality and organizational scalability... 
    Quality
    Senior
    Flexible hours

    Nscale

    Washington DC
    1 day ago
  • $148.7k - $201.2k

     ...communication, and AI is our catalyst....  ...with AWS product teams, we are reimagining...  ...looking for a Technical Program Manager based in Arlington...  ...schedule, budget, quality, along with risk...  ...and reporting to senior leadership- Experience...  ...building and evaluating system-level technical... 
    Quality
    Senior
    Live in
    Work at office
    Immediate start
    Flexible hours

    Amazon

    Arlington, VA
    4 days ago
  •  ...Assurance North America is seeking a Senior Manager, ICT Delivery & Technical Operations is the senior leader...  ...for the overall delivery, technical quality, client-facing execution, client satisfaction...  ...18, TISAX, cloud security, privacy, AI governance, cybersecurity, or... 
    Quality
    Senior
    Temporary work
    Remote work
    Worldwide

    DNV GL

    Arlington, VA
    2 days ago
  • $269.6k - $307.7k

     ...Senior Director, Product Management, Risk Data Product Management at Capital One is...  ...intersection of data, applied AI, and customer-centric...  ...inputs into a unified, high-quality asset for enterprise-wide...  ...reasonable accommodations. For technical support or questions about... 
    Quality
    Senior
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    3 days ago
  • $130k - $216k

     ...What You Will Do: The Technical Product Manager translates complex...  ...supporting internal AI Transformation, Solution...  ...and demonstrate value. Evaluate buy, configure, build...  ...across cost, quality, security, complexity...  ...communicate tradeoffs to senior stakeholders. Plan adoption... 
    Quality
    Temporary work
    Flexible hours

    Guidehouse

    McLean, VA
    16 hours ago
  • $140k - $200k

    Position Summary As a Senior GCP Technical Account Manager (Lead Cloud Integrated...  ...Infrastructure Engineer II) on the AI & Engineering team, you...  ...with client Support, Product Engineering, and Site Reliability...  ...attention to detail and quality of work productAbility to... 
    Quality
    Senior
    Local area

    Deloitte

    Rosslyn, VA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Director, Technical Product Management — AI Quality & Evaluation. Be the first to apply!