Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Director, AI & Tooling

$164k - $285.3k
Full-time

Salesforce

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Operations

Job Details

About Salesforce

Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

About the Role

The Director of Help Agent AI & Tooling leads the team accountable for the generative AI capabilities, evaluation tooling, observability, and emerging program initiatives that power Salesforce's Help Agent — a customer-facing Agentforce deployment and one of Salesforce's flagship Customer Zero implementations. This leader sits at the intersection of AI product strategy, data-driven evaluation, and production excellence, and plays a critical role in ensuring the Help Agent performs reliably, improves continuously, and delivers measurable business value.

Note: This role is not a traditional engineering position — it sits at the intersection of business and technology. The Director must have excellent communication and presentation skills, strong executive presence, and proven ability to lead a team and develop talent. We are looking for someone who can navigate complex stakeholder groups, drive alignment, and pose as a trusted advisor to the business, al while managing a team of highly skilled individuals.

Team Functions

This leader directly manages a team covering five core areas:

Generative AI Strategy

- Drive the strategic roadmap for generative AI capabilities within the Help Agent — including retrieval architecture (e.g., Ensemble Retriever), LLM configurations, prompt and planner optimization, and agentic readiness scoring.

- Partner closely with Tech & Product, and other technology teams to influence the Help Agent roadmap and direct engineering relationships.

Evaluations Tooling

- Own the end-to-end evaluations tooling strategy for Help Agent performance — including the Testing Center, Agentforce Testing Agents (ATA), and custom evaluation frameworks.

- Define and track answer quality metrics including completeness, correctness, relevance, faithfulness, clarity, and latency.

- Manage tooling gaps, coordinate with Tech & Product on product priorities, and expand evaluation capabilities toward greater scale and automation.

Help Agent Observability

- Lead the observability program for the Help Agent — encompassing real-time performance monitoring, session tracing, error analysis, failure clustering, and business impact measurement.

- Serve as the primary stakeholder and voice of the Customer Zero on the Tech & Product Observability product roadmap.

- Coordinate with Technology Teams to converge on a comprehensive, always-on observability solution that replaces fragmented tooling.

NNAOV Program Management

Oversee the Net New Annual Order Value (NNAOV) program, driving pipeline generation through the Help Agent. Partner with the dedicated NNAOV Program Manager to define program goals, manage intake, and report on business outcomes.

AI Skill & Application Development

Support the creation and delivery of AI Skills via applications like Slackbot, Claude Code and others to support the team's ability to deliver evaluations, insights, and opportunity sourcing for Roadmap development.

Key Responsibilities

  • Serve as the AI & Tooling team lead within Digital Success Data & AI, setting team mission, operating model, and priorities

  • Act as a Customer Zero steward — representing Salesforce's own use of Agentforce as a reference customer, surfacing product gaps and driving roadmap influence through Shiproom intakes and direct T&P partnerships

  • Monitor and manage Help Agent production health, including end-to-end latency, engagement rate, escalation rate, resolution rate, and quality scores — escalating issues and coordinating cross-functional remediation as needed

  • Lead cross-functional collaboration with Technology Teams to align on evaluations, retrieval strategies, and tooling development

  • Define and mature the AI Evaluations Framework, moving from manual, spreadsheet-based processes toward scalable, automated evaluation at production scale

  • Drive the observability roadmap in partnership with Technology Teams, from current OOTB capabilities to a fully centralized, production-grade monitoring platform

  • Represent AI & Tooling in leadership forums and communicate progress, risks, and strategic direction clearly to senior stakeholders

Expected Outcomes

  • Help Agent resolution rate and quality scores (completeness, correctness, relevance) improve quarter-over-quarter through disciplined evaluation and rapid iteration
  • End-to-end latency - Deliver high quality answers as fast as possible for the application.
  • A centralized, production-grade observability platform is fully adopted by the team as the single source of truth for agent performance
  • The Testing Center is fully onboarded in production, with evaluation coverage scaled well beyond current manual limits
  • The NNAOV Program generates measurable pipeline contribution from Help Agent interactions
  • Tooling is standardized and integrated across the Data & AI team, eliminating fragmented, ad hoc approaches
  • AI & Tooling functions as a center of excellence for generative AI evaluation and tooling practices across Digital Success and the broader Salesforce Customer Zero ecosystem

Unleash Your Potential

When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best , and our AI agents accelerate your impact so you can do your best . Together, we’ll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what’s possible — for yourself, for AI, and the world.

Accommodations

If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form .

Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our Candidate Privacy Statement for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.

In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $164,000 - $261,500 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $196,800 - $285,300 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Director, AI & Tooling in Boston, MA vacancy
  • Director, AI Emerging Solutions, Boston Financial District, 180k to 240k base, bonusHybrid, in-office Tuesday, Wednesday, and Thursday, with...  ...innovation strategy, building expertise in cutting-edge tools and methodologies while delivering measurable business value through... 
    Suggested
    Work at office
    Local area

    BlueSkyClarity

    Boston, MA
    2 days ago
  • $206k - $257.5k

     ...comprehensive benefits, see our website: The Importance of the Role The Director, AI Architecture & Governance is a senior technical leadership...  ...value chain. This role establishes the standards, platform/tooling strategy, and governance frameworks required to deliver AI... 
    Suggested
    Full time

    Sarepta Therapeutics

    Cambridge, MA
    1 day ago
  • $195.42k - $370.53k

     ...class training facility, and leading market tools, we help our people continue to grow both...  ...in Advisory.KPMG is currently seeking a Director, Private Equity IT M&A -Due Diligence and...  ...platform and add-onacquisitions; utilize AI-powered tools to accelerate analysis, identify... 
    Suggested
    H1b
    Local area

    KPMG

    Boston, MA
    10 hours ago
  • $185k - $216k

     ...clients to thrive.What You'll DoAs the BCG Vantage Global Senior Director - AI Cost Advantage, you will lead the BCG Vantage team across...  ...coordination across Practice Areas on Cost, ensuring knowledge, tools (including AI agents), and best practices are shared and applied... 
    Suggested
    Work at office
    Local area

    The Boston Consulting Group

    Boston, MA
    10 hours ago
  •  ...class training facility, and leading market tools, we help our people continue to grow both...  .... KPMG is currently seeking a Director Insurance IT M&A - Due Diligence, Integration...  ...insurance technologylandscapes; implement AI-powered tools for predictive analytics on... 
    Suggested
    H1b
    Local area

    KPMG

    Boston, MA
    3 days ago
  • $200k - $235k

     ...expertise, human-centred creativity, and AI-driven insights, fostering a unique environment...  ...innovation. Experience #LifeatRealChem.Director, Technical Product OperationsRole...  ...Fargate, EKS), AWS Lambda, and observability tooling.Relevant certifications (AWS Solutions Architect... 
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week

    Real Chemistry

    Boston, MA
    3 days ago
  • $170k - $233.75k

    About This Role:As the Associate Director of Data Science & AI, you will spearhead the development and implementation of cutting-edge machine learning...  ...Affairs, you will create predictive models and analytical tools that provide actionable insights into patient populations... 
    Full time
    Temporary work
    Local area

    Biogen Idec

    Cambridge, MA
    2 days ago
  • $144.65k - $216.97k

    Associate Director, AI for Discovery — New Target DiscoveryLocation: Cambridge, MA US (Kendall Square)Salary: Competitive + Excellent BenefitsAbout...  ...and application of agentic AI and predictive modeling tools across AstraZeneca’s therapeutic areas to accelerate new... 
    Full time
    Temporary work
    Work at office
    Worldwide
    Flexible hours
    3 days per week

    AstraZeneca

    Cambridge, MA
    23 hours ago
  • $175k - $205k

     ...bodies and daily lives.WHOOP is hiring a Director of Technical Recruiting to lead the strategy...  ...Engineering, Product, Data Science, AI/ML, Hardware, and other technical functions...  ...recruiting technologies, AI-enabled sourcing tools, and operational improvements that increase... 
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    10 hours ago
  • $200.7k - $271.5k

    Director, Statistical Programming Technical Solutions Summary of Key ResponsibilitiesDesigns and leads Quantitative Sciences...  ...with Data Science team for integrating generative AI and other advanced analytics tools into statistical programming workflows while ensuring regulatory... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Alnylam Pharmaceuticals

    Cambridge, MA
    4 days ago
  • $134k - $348.5k

     ...LevelDirectorJob Description & SummaryThe OpportunityAs an AI Architect Director, you will lead the design and implementation of innovative technology...  ...- Establishing AI design patterns, evaluates platforms and tools, and guides technical teams to deliver reliable, secure,... 
    Full time
    H1b

    PwC

    Boston, MA
    4 days ago
  •  ...opportunities, a world-class training facility, and leading market tools, we help our people continue to grow both professionally and...  ...currently seeking a Manager, SAP Technical Development - SAP Business AI to join our Advisory Services practice.Responsibilities:Manage... 
    H1b
    Local area

    KPMG

    Boston, MA
    4 days ago
  • OverviewThe Associate Director, Nonclinical Writing Innovation, will lead the strategy and adoption of AI-enabled capabilities across nonclinical workflows. This high-visibility...  ...will include, but not limited to, AI tool automation, authoring regulatory dossiers, reporting... 
    Full time
    Contract work
    Temporary work
    Local area
    Flexible hours

    Alnylam Pharmaceuticals

    Cambridge, MA
    2 days ago
  • $136.2k - $204.2k

     ...spearheading the integration of cutting-edge technologies, such as AI and machine learning, while meticulously orchestrating end-to-end...  ...abilities, adept at solving complex problems using data tools and SQL (Python or R a plus). Solid understanding of industry... 
    Permanent employment
    Full time
    Local area

    Global Partners

    Newton, MA
    4 days ago
  • SharkNinja in Needham, MA seeks a Director of UX for hardware to define strategic direction and guide a talented team of designers across...  ...products. You will lead end-to-end deliverables, integrate AI tools, raise craft standards, evangelize design across the company, and... 

    Socket.dev

    Needham Heights, MA
    5 days ago
  • $72.8k - $130k

     ...platform capabilitiesPartner with related product teams, including AI Marketplace where applicable, to ensure platform capabilities...  ...subscription, and commercialization needsApply AI product management tools and practices to improve requirements quality, documentation,... 
    Minimum wage
    Full time
    Work experience placement
    Local area
    Remote work

    UnitedHealth Group

    Boston, MA
    2 days ago
  • We are seeking a highly experienced Observability AI Technical Product Manager with deep hands-on expertise in Dynatrace Intelligence...  ..., and engineering teams on AI-driven observability concepts and tooling. Establish governance for AI models, alerting standards, and... 

    The Ceres Group

    Boston, MA
    10 hours ago
  • $207.65k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions...  ..., Agile, or Hybrid), and proficiency in tools such as MS Project, Smartsheet, JIRA,...  ...and/or the U.S. Department of State - Directorate of Defense Trade Controls. As such, applicants... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Remote work
    Work from home
    Day shift
    2 days per week

    Analog Devices

    Boston, MA
    4 days ago
  •  ...innovative solutions. Empowered with innovative tools, continuous learning, and a global...  ...ideas into reality.We are Secure, Responsible AI & Data Protection professionals who enable...  ...clear, business-relevant narratives for director and C-suite audiences. Contribute to the offering... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  • $107.45k - $199.55k

     ...the full range of statutory leaves of absence.We use data and analytics technologies, such as artificial intelligence (AI), and automated processing tools, to analyze and process the information you provide to us or third parties in the application process. For more... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    John Hancock

    Boston, MA
    2 days ago
  • $151.2k - $204.6k

     ...AFX ProServe Team, you will drive the product roadmap for next-generation agentic tools that revolutionize how AWS ProServe works. You'll be responsible for building and orchestrating AI agents that collaborate seamlessly to automate administrative tasks—enabling sellers... 
    Work from home
    Flexible hours

    AmazonWebServices

    Boston, MA
    23 hours ago
  • $180 per hour

     ...builders, and researchers who want to be part of that loop.As an AI robotics company that deploys its inventions directly into the facilities...  ...not by a person. We’re looking for someone who has watched AI tools get good enough to do some of that grunt work and has a vision... 
    Full time
    Work at office

    Tutor Intelligence

    Watertown, MA
    4 days ago
  • $111.8k - $140k

     ...relational database exports (SQL)Familiarity with ETL concepts and tools — ability to assess a client’s source data, identify quality or...  ...accurately without needing to write production codeFamiliarity with AI-powered platforms and workflows — comfort working with or scoping... 
    Full time
    Contract work
    Local area
    Remote work

    Jones Lang LaSalle

    Boston, MA
    2 days ago
  • $150k - $215k

     ...multiple competing priorities while driving alignment across highly technical teamsStrong commitment to embracing and leveraging AI tools to enhance productivity across program management activities, including planning, documentation, analysis, and communication, while... 
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    10 hours ago
  • $148.7k - $201.2k

    Amazon's Frontier AI Assets (FAI) team works to improve the quality of data used to develop and evaluate AI models. We draw on subject...  ...with expert contributors, creators, cross partner teams, tooling owners - multiple stakeholders and leadership to deliver complex... 
    Flexible hours

    Amazon

    Boston, MA
    3 days ago
  • $116.2k - $229.1k

     ...combining Deloitte's sports industry experience with proprietary data, AI-native decision intelligence, and reusable Converge capabilities....  ...capability into production.Experience using product development tools such as Jira, Confluence, Azure DevOps, Figma, or comparable... 
    Local area

    Deloitte

    Boston, MA
    23 hours ago
  • $120k - $202.5k

     ...visible service model to deliver applications, platforms, and Data & AI workstreams to support our end users and stakeholders.To succeed...  ...Security certifications preferred (e.g., CISM/CISSP)Knowledge of tools or technologies:Expertise in Confluence, Jira & MS Office Suite.... 
    Full time
    Temporary work
    Flexible hours
    Shift work

    State Street Bank

    Quincy, MA
    4 days ago
  • $224k - $280k

     ...define how that scales.We're looking for a Director of Technical Program Management to lead...  ...alignment across disparate teams. Deploy AI to create operational leverage. Identify and...  ...coachingExperienced applying AI as an operational tool, with a practical point of view on where... 
    Work at office
    Shift work

    Datadog

    Boston, MA
    10 hours ago
  • $120k - $202.5k

     ...visible service model to deliver applications, platforms, and Data & AI workstreams to support our end users and stakeholders. To...  ...Security certifications preferred (e.g., CISM/CISSP) Knowledge of tools or technologies: Expertise in Confluence, Jira & MS Office... 
    Temporary work
    Flexible hours
    Shift work

    State Street Corporation

    Quincy, MA
    4 days ago
  •  ...Research: Conducting user interviews, analyzing market trends such as AI, and analyzing competitor products to identify opportunities....  ...devices, firmware, IoT communications, and cloud-based software Tools Skilled in the Microsoft Office suite, including strong proficiency... 
    Full time
    Work at office

    BigBelly Solar

    Needham Heights, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Director, AI & Tooling. Be the first to apply!