AI Product Manager, AI Platform - Quality and Evaluation
$136k - $170kRidgeline
Are you passionate about building AI products that customers can trust by making quality measurable rather than subjective? Do you enjoy partnering with engineers and researchers to evaluate large language models, improve AI system performance, and turn data into product decisions? Are you excited by the opportunity to define the future of AI quality, observability, and evaluation platforms that power intelligent applications? If so, we invite you to be a part of our innovative team.
As a Product Manager on Ridgeline's AI Platform team, you'll define and execute the strategy for the systems that ensure our AI capabilities are accurate, reliable, and continuously improving. You'll lead initiatives spanning LLM evaluation frameworks, AI model benchmarking, evaluation harnesses, prompt and model experimentation, AI quality platforms, and observability capabilities that help teams understand, measure, and improve production AI performance. You'll work closely with engineering, AI researchers, design, and product teams to deliver platform capabilities that enable every AI-powered experience across Ridgeline. You'll leverage cutting-edge AI technologies and tools in a fast-moving, creative, progressive work environment while helping establish best practices for developing and operating enterprise AI products.
At Ridgeline, how we work matters as much as what we build. Ridgeliners act like owners, choose growth over comfort, and communicate with transparency. We assume positive intent, bias toward action, and bring solutions—not just problems. We celebrate wins, learn from setbacks, and thrive in a resilient, collaborative, high-performing culture. If this excites you, we’d love to meet you!
You must be work authorized in the United States without the need for employer sponsorship.
The impact you will have
- Define and execute the product strategy and roadmap for Ridgeline's AI Quality Platform
- Build scalable LLM evaluation frameworks and automated evaluation harnesses that enable continuous model validation
- Establish standardized offline and online evaluation methodologies, golden datasets, and quality benchmarks across AI products
- Define the roadmap for AI observability, enabling teams to monitor quality, latency, cost, reliability, and user outcomes in production
- Partner with engineering and AI researchers to build continuous regression testing and experimentation capabilities for generative AI systems
- Drive product decisions using AI quality metrics, customer feedback, and quantitative evaluation data
- Collaborate with engineering teams to deliver platform capabilities that enable trusted, measurable, and continuously improving AI experiences across Ridgeline
- Translate advances in foundation models, evaluation techniques, and AI tooling into platform capabilities that create meaningful customer value
- Prioritize product investments using customer insights, product analytics, and measurable business outcomes
- Communicate product vision, roadmap, and priorities clearly across technical and executive stakeholders
- Foster a collaborative environment rooted in ownership, continuous learning, experimentation, and transparency
What we look for
- 5+ years of product management experience building highly technical platform, infrastructure, or developer-focused products
- Demonstrated experience shipping production AI products powered by large language models
- Experience defining products that incorporate LLM evaluation frameworks, AI quality measurement, and continuous model evaluation
- Deep understanding of offline and online evaluation methodologies, model benchmarking, regression testing, and AI quality metrics
- Experience with LLM observability platforms such as Datadog LLM Observability, Langfuse, LangSmith, Arize AI, Braintrust, Galileo, or similar AI quality and evaluation solutions
- Familiarity with prompt engineering, experimentation frameworks, evaluation datasets, and LLM-as-a-judge techniques for generative AI applications
- Experience partnering effectively with software engineers, ML engineers, AI researchers, and cross-functional stakeholders
- Strong analytical skills with the ability to translate AI performance signals into product decisions
- Excellent written and verbal communication skills
- Willingness to learn about cutting-edge technologies while cultivating expertise in investment management workflows and enterprise AI
- An aptitude for problem solving
- Ability to communicate effectively
- Serious interest in having fun at work
Bonus
- Experience building products around retrieval-augmented generation (RAG), AI agents, MCP, or model orchestration frameworks
- Experience with synthetic data generation and automated evaluation pipelines
- Experience building internal developer platforms or ML infrastructure products
- Experience in enterprise SaaS, developer platforms, or financial technology
About Ridgeline
Ridgeline is headquartered in Lake Tahoe, with offices in New York, Reno, the Bay Area, Dublin Ireland. Ridgeline is recognized by Fast Company as a “Best Workplace for Innovators,” by Frost & Sullivan as a “Technology Innovation Leader,” and by The Software Report as a “Top 100 Software Company.”
Ridgeline is proud to be a community-minded, discrimination-free equal opportunity workplace.
Ridgeline processes the information you submit in connection with your application in accordance with the Ridgeline Candidate Privacy Policy . Please review the Ridgeline Candidate Privacy Policy in full to understand our privacy practices and contact us with any questions.
This posting is for an existing vacancy.
Compensation and Benefits
The typical starting salary range for new hires in this role is listed below. In select locations (including, the San Francisco Bay Area, CA, and the New York City Metro Area), an alternate range may apply as specified below.
The typical starting salary range for this role is: $136,000-$170,000.
The typical starting salary range for this role in the select locations listed above is: $149,500-$187,000.
Final compensation amounts are determined by multiple factors, including candidate experience and expertise, and may vary from the amount listed above.
As an employee at Ridgeline, you’ll have many opportunities for advancement in your career and can make a true impact on the product.
In addition to the base salary, Ridgeline employees can participate in our Company Stock Plan subject to the applicable Stock Option Agreement. We also offer rich benefits that reflect the kind of organization we want to be: one in which our employees feel valued and are inspired to bring their best selves to work. These include unlimited vacation, educational and wellness reimbursements, and $0 cost employee insurance plans. Please check out our Careers page for a more comprehensive overview of our perks and benefits.
- ...other way around. Our platform — combining domain-... ...™), reliable model evaluation (LLM-IQ™), and... ...research, engineering, product, and domain expertise to deliver AI that meets the... ...a Builder Product Manager, AI Platform & Agentic... ...to production-ready quality, balancing customer...PlatformQualityFull time
$132k - $173.2k
...this new era, we seek AI-native thinkers across... ...of how work gets done.Product Manager - Order-to-Cash & Agentic... ...AI-native enterprise platform on Snowflake (“Snow on... ...to measure quality, reliability, latency,... ...and human approvals.AI Evaluation & Production Quality:...PlatformQualityContract workWork at officeRemote work$198k - $247.5k
...Ridgeline is building AI capabilities that help investment management firms work with... ...a Senior Staff AI Product Manager on the... ...leverage Ridgeline’s platform and solve important... ..., orchestration, evaluation, integrations, reliability... ...for evaluating AI quality, safety, trust,...PlatformQuality$110k - $140k
...CATechnology - Data & AI /Full Time /... ...We're hiring an AI Product Owner, Agentic Commerce... ...checkout flows.· Manage the product... ...external partners to evaluate solutions and determine... ...to ensure high-quality, responsible,... ...(in-house or at a platform/agency).· Familiarity...PlatformQualityFull timeWork at officeWork from homeFlexible hours$110k - $140k
...CATechnology - Data & AI /Full Time /... ...We're hiring an AI Product Owner, Intelligent... ...people processes.· Manage the product lifecycle... ...with enterprise platforms (e.g., ERP,... ...external vendors to evaluate solutions and determine... ...governance, data quality, and compliance in...PlatformQualityFull timeWork at officeWork from homeFlexible hours$104.9k - $199.07k
...our core values of Quality, Integrity, and... ...questions. Through our products, education, and... ...healthcare cost and care management.MedInsight is a... ...Manager with a platform engineering focus... ...healthcare analytics and AI products. This... ...metrics to evaluate whether platform capabilities...PlatformQualityFull timeWork experience placementRemote workFlexible hours$190k - $239.5k
...PURPOSEThe Senior Staff IT Product Lead - Enterprise Platforms will lead a... ...Communication, Content Management, Collaboration,... ...improvement.Support the evaluation of product initiatives... ...scalable, and high-quality enterprise... ...robust data management & AI practices to protect...PlatformQualityFull timeWork at officeLocal areaFlexible hours- ...customer experiences.As AI agents increasingly mediate... ...how consumers discover, evaluate, and purchase products, the quality and structure of product... ...intersection of product experience management, AI discoverability, and... ...across master data, PXM platforms, and channel-specific...PlatformQualityLive inWork at officeLocal area
$174k - $246k
...Associate Principal IT Product Lead - Digital... ...initiatives by evaluating business impact, technical... ...):Own the management of the product lifecycle... ...architecture, and quality assurance teams to... ...data management & AI practices to... ...specific technologies or platforms as relevant to the...PlatformQualityFull timeWork at officeLocal areaFlexible hours$190k - $239.5k
...PURPOSEThe Senior Staff IT Product Lead - Digital... ...Operations Platforms).Own two or more digital... ...and support the evaluation of product... ...scalable, and high-quality digital applications... ...research.Stakeholder Management & Cross-Functional... ...data management & AI practices to protect...PlatformQualityFull timeWork at officeLocal areaFlexible hours- ...Product Manager, AI & Automation | Collective Edge | Enterprise-wide (Collective Edge, Royal Ambulance... ...and API integrations with operational platforms, you’ll identify opportunities to... ...s cost across labor, capacity, speed, quality, and service, and set a baseline you...PlatformQuality
$243.94k - $304.92k
...ship dbt code. As Staff Product Manager for Developer... ...Developer Agent (our AI coding assistant inside... ...goals, and the Fusion platform direction. Set success... ...transparency, control, and evaluation in agentic experiences... ...brings together high-quality talent across the globe...PlatformQualityRemote workFlexible hours- ...foundation for physical AI — combining a new... ...delivering a plug-and-play platform for developers,... ...you. The Role As Product Manager for Physical AI Agents... ..., developer surfaces, evaluation systems, and the workflows... ...cadences that make agent quality measurable — success...PlatformQualityFull timeShift work
$168k - $350k
...seeking a Director of Enterprise AI Product Management to shape and steer an... ...functions, partnering closely with Platform Technology, AI Labs,... ...across value streams, evaluate its broader impact, and actively... ...data availability and quality, access, security, infrastructure...PlatformQualityWork at officeLocal areaRemote workFlexible hoursShift work2 days per week3 days per week1 day per week$188.5k - $255k
...Group is looking for a Staff Product Manager to help define and scale the AI-powered experiences that... ...Credit Karma and across the AI platforms and agents where members... ...products. Set the quality bar. Establish and evolve evaluation frameworks for quality, accuracy...PlatformQualityFull time$166.5k - $208.5k
...innovative team. As a Staff Product Manager on Ridgeline's Data Intellgience... ...on our distributed query platform to enable scalable, performant... ...other teams — and increasingly AI agents — can rely on. You... ..., provenance, freshness, and quality signals that both people and...PlatformQuality- ...Senior Director, Product Management, Data Intelligence Platform About the Company Healthcare technology company... ...building scalable solutions to improve quality, affordability, and experience... ..., machine learning, and generative AI, while balancing investment priorities...PlatformQuality
$178k - $267k
...As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we’re... ...join, you’ll feel it. Not just in the products we build, but in how we show up for each... ...defect triage, track delivery and product quality metrics, and communicate progress,...PlatformQualityFull timeWork at officeRemote workHome officeFlexible hours$160k - $192.5k
...Senior Staff Technical Product Manager – Service... ...backend intelligence platform that powers critical decision... ...orchestration system that evaluates complex, interdependent... ...behavior, decision quality, and operational outcomes... ...a deeply technical, AI ‑ driven and analytical...PlatformQualityRemote jobFull timeTemporary workWork at officeImmediate startFlexible hours3 days per week1 day per week- ...frameworks, and enabling quality across enterprise... ...with emerging AI technologies, we'd... ..., framework evaluations, and automation architecture... ....Create and manage automated test data... ...and integrated platforms.Validate Salesforce... ...with developers and product teams to identify...PlatformQuality
- ...providers. Careforce’s autonomous AI agents find, call, and... ...access to healthcare. Technical Product Manager Your job is to build the... ...our agentic care-coordination platform. You take ideas to MVP in... ...have experience setting and evaluating product metrics. Adaptability...PlatformImmediate start
- ...unleashing the power of AI to create value at... ...proprietary assets and platforms, and deep ecosystem relationships... ...(GCC) Engineering Lead/Manager is responsible for... ...deep expertise in product engineering, platform engineering... ...that enable high-quality, efficient, and scalable...PlatformQualityLive inWork at officeLocal area
$196k - $294k
...500 company and a leading AI platform for managing people, money, and agents,... ...ll feel it. Not just in the products we build, but in how we show... ...into scalable, secure, high-quality product experiences that... ...Workmates and the business. Evaluate vendor and SaaS AI...PlatformQualityFull timeWork at officeRemote workHome officeFlexible hours$168k - $252k
...500 company and a leading AI platform for managing people, money, and agents,... ...ll feel it. Not just in the products we build, but in how we show... ...measurable KPIs including quality, adoption, trust, and business... ...experimentation loops, evaluation, and iteration using qualitative...PlatformQualityFull timeWork at officeRemote workHome officeFlexible hours$115k - $130k
...based revenue cycle management solutions –from... ...seeking a Senior Product Owner with strong... ...for requirements quality across the engineering... ...part of a broader platform transformation, you... .... Use AI assistants and agents... ...design discussions and evaluate trade-offs, aligning...PlatformQualityWork at office2 days per week$140k - $210k
...500 company and a leading AI platform for managing people, money, and agents,... ...ll feel it. Not just in the products we build, but in how we show... ...filed.Research. You gather and evaluate information carefully... ...prototyping, assessing output quality, or shipping something with...PlatformQualityFull timeWork at officeRemote workWorldwideHome officeFlexible hours- ...Beauty is looking for a Product Manager, Marketing Technology... ...of customer data, platform architecture, and activation... ...Data Platform (CDP), AI-driven personalization... ...with rigorous evaluation of third-party vendors... ...governance, and data quality Ensure all customer...PlatformQualityFull timeContract workWork at officeWork from homeFlexible hours
$140k - $160k
...Job Molex is seeking a Global Product Manager to lead the strategy,... ...next-generation connectivity platform supporting Near Package Optics... ...Copper (NPC) architectures for AI infrastructure, hyperscale computing... ...engineering, manufacturing, quality, sales, marketing, and...PlatformQualityFlexible hours$165.7k - $248.55k
...Engineering will join the AIX (AI for Engineering... ...secure, governed, and production-ready AI engineering... ..., software quality, and engineering automation... ...enterprise engineering platforms including GitHub, Jira... ...integrations . Research and evaluate emerging LLMs, coding...PlatformQualityLocal area$201.77k - $252.21k
...context teams and AI systems rely on. Fivetran... ...to deliver the products and experiences... ...hiring a Senior Manager to lead the Product... ...who work across dbt platform and CLI-based... ...thoughtful, high-quality work for deeply technical... ...the domain, evaluate tradeoffs, and partner...PlatformQualityFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Product Manager, AI Platform - Quality and Evaluation. Be the first to apply!
- power platform San Ramon, CA
- platform manager San Ramon, CA
- rn quality San Ramon, CA
- quality San Ramon, CA
- quality manufacturing San Ramon, CA
- quality inspection San Ramon, CA
- quality equipment San Ramon, CA
- quality improvement rn San Ramon, CA
- quality improvement nurse San Ramon, CA
- quality tech San Ramon, CA





