Director of Product Management, AI Evals (Mountain View)

Harness is the AI Software Delivery Platform company, led by technologist and entrepreneur Jyoti Bansal (founder of AppDynamics, acquired by Cisco for $3.7B). Harness has raised approximately $570M in funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo Ventures, IVP, Unusual Ventures, Citi Ventures, and more. As AI accelerates code creation, the real bottleneck has shifted to everything after the code – testing, deployments, application security, reliability, compliance, and cost optimization. Harness brings AI and automation to this “outer loop,” helping teams ship software faster while maintaining security and governance throughout the entire software delivery lifecycle.Powered by Harness AI and the Software Delivery Knowledge Graph, the Harness Platform applies deep context and intelligent automation across the software delivery lifecycle with governance and policy-driven controls embedded throughout the platform. Over the past year, Harness powered over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3T protected API calls, and helped manage $2.8B in cloud spend — enabling customers like United Airlines, Morningstar, and Choice Hotels to accelerate releases by up to 75%, reduce cloud costs by up to 60%, and achieve 10x DevOps efficiency. With a global team across 26 offices and 27 countries, Harness is shaping the future of AI software delivery — and we’re looking for exceptional talent to help us move even faster.Position SummaryAI is moving from experimentation to production faster than any technology shift in recent memory, and the teams shipping it are discovering that traditional software testing breaks down for LLM-powered systems. Evaluation is the missing layer, and it's becoming the bottleneck for enterprise AI adoption. Harness is uniquely positioned to solve this: we already sit at the center of how engineering teams ship software, with deep integration into CI/CD pipelines and trusted relationships with platform and developer teams at enterprises worldwide. The AI Evals module is our bet that evaluation belongs in the same pipeline as the rest of software delivery, not as a bolted-on tool. This role will define what that looks like.We are hiring a Director of Product Management to lead Harness's AI Evaluation module defining how engineering teams measure, validate, and continuously improve AI and LLM-powered applications in production. This role has end-to-end business ownership of our AI Evals module, including vision, strategy, and P&LAbout the roleDesign AI-assisted experiences for eval authoring, failure analysis, and remediation recommendations.Own the vision, strategy, roadmap, and P&L for Harness's AI Evals module.Partner with engineering to deliver scalable, differentiated solutions that developers love.Work closely with GTM teams (sales, marketing, customer success) on positioning, adoption, and revenue growth.Engage directly with customers to shape the roadmap, improve adoption, and ensure measurable business impact.Drive competitive positioning and track product metricsAbout you8+ years of product management experience, including AI/ML technologies, developer tooling, or platform products.Experience owning business outcomes including strategy, positioning, and revenue impact.Strong communication and stakeholder management skills across product, engineering, and GTM teams.Obsessed with customer success and outcome-driven.Strong understanding of:LLM evaluation methodologies CI/CD pipelines and developer workflowsAI observability, monitoring, and quality assuranceAgentic AI systems and the unique evaluation challenges they presentPreferred QualificationsExperience building AI/ML evaluation or observability platforms at scale.Experience in building products from the ground up.Familiarity with prompt engineering, fine-tuning pipelines, and dataset versioning.Exposure to AI governance, responsible AI frameworks, or automated remediation.Cloud-native and enterprise SaaS experience.Work LocationHybrid from Mountain View CA. What you will have at HarnessCompetitive salaryComprehensive healthcare benefitsFlexible Spending Account (FSA)Flexible work scheduleEmployee Assistance Program (EAP)Flexible Time Off and Parental LeaveMonthly, quarterly, and annual social and team building eventsMonthly internet reimbursementThe anticipated base salary range for this position is between $265,000 and $280,000 annually. Salary is determined by a combination of factors including location, level, relevant experience, and skills. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. The compensation package for this position may also include equity, and benefits. More details about our company benefits can be found at the following link:  Pay transparency$265,000—$280,000 USDHarness in the news:Accelerating Our Mission to Bring AI to Everything After CodeGoldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuationHow Harness runs 16 “startups within a startup” at scale | Jyoti BansalHarness Research Shows AI Visibility Crisis Fueling Security NightmareHarness has been named to the Inc. Power Partner list for software delivery successAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex or national origin.At Harness, we care about your privacy and are committed to protecting your personal data. For additional information on this topic, you can visit our privacy Portal: Note on Fraudulent Recruiting/OffersWe have become aware that there may be fraudulent recruiting attempts being made by people posing as representatives of Harness. These scams may involve fake job postings, unsolicited emails, or messages claiming to be from our recruiters or hiring managers. Please note, we do not ask for sensitive or financial information via chat, text, or social media, and any email communications will come from the domain @harness.io. Additionally, Harness will never ask for any payment, fee to be paid, or purchases to be made by a job applicant. All applicants are encouraged to apply directly to our open jobs via our website. Interviews are generally conducted via Zoom video conference unless the candidate requests other accommodations.If you believe that you have been the target of an interview/offer scam by someone posing as a representative of Harness, please do not provide any personal or financial information and contact us immediately at View email address on apply.placed-app.com. You can also find additional information about this type of scam and report any fraudulent employment offers via the Federal Trade Commission’s website (, or you can contact your local law enforcement agency.