Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Product Manager, AI Platform - Quality and Evaluation

$136k - $170k

Ridgeline

Are you passionate about building AI products that customers can trust by making quality measurable rather than subjective? Do you enjoy partnering with engineers and researchers to evaluate large language models, improve AI system performance, and turn data into product decisions? Are you excited by the opportunity to define the future of AI quality, observability, and evaluation platforms that power intelligent applications? If so, we invite you to be a part of our innovative team.

As a Product Manager on Ridgeline's AI Platform team, you'll define and execute the strategy for the systems that ensure our AI capabilities are accurate, reliable, and continuously improving. You'll lead initiatives spanning LLM evaluation frameworks, AI model benchmarking, evaluation harnesses, prompt and model experimentation, AI quality platforms, and observability capabilities that help teams understand, measure, and improve production AI performance. You'll work closely with engineering, AI researchers, design, and product teams to deliver platform capabilities that enable every AI-powered experience across Ridgeline. You'll leverage cutting-edge AI technologies and tools in a fast-moving, creative, progressive work environment while helping establish best practices for developing and operating enterprise AI products.

At Ridgeline, how we work matters as much as what we build. Ridgeliners act like owners, choose growth over comfort, and communicate with transparency. We assume positive intent, bias toward action, and bring solutions—not just problems. We celebrate wins, learn from setbacks, and thrive in a resilient, collaborative, high-performing culture. If this excites you, we’d love to meet you!

You must be work authorized in the United States without the need for employer sponsorship.

The impact you will have

  • Define and execute the product strategy and roadmap for Ridgeline's AI Quality Platform
  • Build scalable LLM evaluation frameworks and automated evaluation harnesses that enable continuous model validation
  • Establish standardized offline and online evaluation methodologies, golden datasets, and quality benchmarks across AI products
  • Define the roadmap for AI observability, enabling teams to monitor quality, latency, cost, reliability, and user outcomes in production
  • Partner with engineering and AI researchers to build continuous regression testing and experimentation capabilities for generative AI systems
  • Drive product decisions using AI quality metrics, customer feedback, and quantitative evaluation data
  • Collaborate with engineering teams to deliver platform capabilities that enable trusted, measurable, and continuously improving AI experiences across Ridgeline
  • Translate advances in foundation models, evaluation techniques, and AI tooling into platform capabilities that create meaningful customer value
  • Prioritize product investments using customer insights, product analytics, and measurable business outcomes
  • Communicate product vision, roadmap, and priorities clearly across technical and executive stakeholders
  • Foster a collaborative environment rooted in ownership, continuous learning, experimentation, and transparency

What we look for

  • 5+ years of product management experience building highly technical platform, infrastructure, or developer-focused products
  • Demonstrated experience shipping production AI products powered by large language models
  • Experience defining products that incorporate LLM evaluation frameworks, AI quality measurement, and continuous model evaluation
  • Deep understanding of offline and online evaluation methodologies, model benchmarking, regression testing, and AI quality metrics
  • Experience with LLM observability platforms such as Datadog LLM Observability, Langfuse, LangSmith, Arize AI, Braintrust, Galileo, or similar AI quality and evaluation solutions
  • Familiarity with prompt engineering, experimentation frameworks, evaluation datasets, and LLM-as-a-judge techniques for generative AI applications
  • Experience partnering effectively with software engineers, ML engineers, AI researchers, and cross-functional stakeholders
  • Strong analytical skills with the ability to translate AI performance signals into product decisions
  • Excellent written and verbal communication skills
  • Willingness to learn about cutting-edge technologies while cultivating expertise in investment management workflows and enterprise AI
  • An aptitude for problem solving
  • Ability to communicate effectively
  • Serious interest in having fun at work

Bonus

  • Experience building products around retrieval-augmented generation (RAG), AI agents, MCP, or model orchestration frameworks
  • Experience with synthetic data generation and automated evaluation pipelines
  • Experience building internal developer platforms or ML infrastructure products
  • Experience in enterprise SaaS, developer platforms, or financial technology

About Ridgeline

Ridgeline is headquartered in Lake Tahoe, with offices in New York, Reno, the Bay Area, Dublin Ireland. Ridgeline is recognized by Fast Company as a “Best Workplace for Innovators,” by Frost & Sullivan as a “Technology Innovation Leader,” and by The Software Report as a “Top 100 Software Company.”

Ridgeline is proud to be a community-minded, discrimination-free equal opportunity workplace.

Ridgeline processes the information you submit in connection with your application in accordance with the Ridgeline Candidate Privacy Policy . Please review the Ridgeline Candidate Privacy Policy in full to understand our privacy practices and contact us with any questions.

This posting is for an existing vacancy.

Compensation and Benefits 

The typical starting salary range for new hires in this role is listed below.  In select locations (including, the San Francisco Bay Area, CA, and the New York City Metro Area), an alternate range may apply as specified below. 

The typical starting salary range for this role is: $136,000-$170,000. 

The typical starting salary range for this role in the select locations listed above is: $149,500-$187,000.

Final compensation amounts are determined by multiple factors, including candidate experience and expertise, and may vary from the amount listed above. 

As an employee at Ridgeline, you’ll have many opportunities for advancement in your career and can make a true impact on the product. 

In addition to the base salary, Ridgeline employees can participate in our Company Stock Plan subject to the applicable Stock Option Agreement. We also offer rich benefits that reflect the kind of organization we want to be: one in which our employees feel valued and are inspired to bring their best selves to work. These include unlimited vacation, educational and wellness reimbursements, and $0 cost employee insurance plans. Please check out our Careers page for a more comprehensive overview of our perks and benefits.

 

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Product Manager, AI Platform - Quality and Evaluation in San Ramon, CA vacancy
  •  ...other way around. Our platform — combining domain-...  ...™), reliable model evaluation (LLM-IQ™), and...  ...research, engineering, product, and domain expertise to deliver AI that meets the...  ...a Builder Product Manager, AI Platform & Agentic...  ...to production-ready quality, balancing customer... 
    Platform
    Quality
    Full time

    articul8

    Dublin, CA
    4 days ago
  • $132k - $173.2k

     ...this new era, we seek AI-native thinkers across...  ...of how work gets done.Product Manager - Order-to-Cash & Agentic...  ...AI-native enterprise platform on Snowflake (“Snow on...  ...to measure quality, reliability, latency,...  ...and human approvals.AI Evaluation & Production Quality:... 
    Platform
    Quality
    Contract work
    Work at office
    Remote work

    Snowflake

    Dublin, CA
    4 days ago
  • $198k - $247.5k

     ...Ridgeline is building AI capabilities that help investment management firms work with...  ...a Senior Staff AI Product Manager on the...  ...leverage Ridgeline’s platform and solve important...  ..., orchestration, evaluation, integrations, reliability...  ...for evaluating AI quality, safety, trust,... 
    Platform
    Quality

    Ridgeline

    San Ramon, CA
    1 day ago
  • $110k - $140k

     ...CATechnology - Data & AI /Full Time /...  ...We're hiring an AI Product Owner, Agentic Commerce...  ...checkout flows.· Manage the product...  ...external partners to evaluate solutions and determine...  ...to ensure high-quality, responsible,...  ...(in-house or at a platform/agency).· Familiarity... 
    Platform
    Quality
    Full time
    Work at office
    Work from home
    Flexible hours

    E.L.F. BEAUTY

    Oakland, CA
    2 days ago
  • $110k - $140k

     ...CATechnology - Data & AI /Full Time /...  ...We're hiring an AI Product Owner, Intelligent...  ...people processes.· Manage the product lifecycle...  ...with enterprise platforms (e.g., ERP,...  ...external vendors to evaluate solutions and determine...  ...governance, data quality, and compliance in... 
    Platform
    Quality
    Full time
    Work at office
    Work from home
    Flexible hours

    E.L.F. BEAUTY

    Oakland, CA
    2 days ago
  • $104.9k - $199.07k

     ...our core values of Quality, Integrity, and...  ...questions. Through our products, education, and...  ...healthcare cost and care management.MedInsight is a...  ...Manager with a platform engineering focus...  ...healthcare analytics and AI products. This...  ...metrics to evaluate whether platform capabilities... 
    Platform
    Quality
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Milliman

    Walnut Creek, CA
    19 hours ago
  • $190k - $239.5k

     ...PURPOSEThe Senior Staff IT Product Lead - Enterprise Platforms will lead a...  ...Communication, Content Management, Collaboration,...  ...improvement.Support the evaluation of product initiatives...  ...scalable, and high-quality enterprise...  ...robust data management & AI practices to protect... 
    Platform
    Quality
    Full time
    Work at office
    Local area
    Flexible hours

    EXELIXIS

    Alameda, CA
    4 days ago
  •  ...customer experiences.As AI agents increasingly mediate...  ...how consumers discover, evaluate, and purchase products, the quality and structure of product...  ...intersection of product experience management, AI discoverability, and...  ...across master data, PXM platforms, and channel-specific... 
    Platform
    Quality
    Live in
    Work at office
    Local area

    Accenture

    Walnut Creek, CA
    1 day ago
  • $174k - $246k

     ...Associate Principal IT Product Lead - Digital...  ...initiatives by evaluating business impact, technical...  ...):Own the management of the product lifecycle...  ...architecture, and quality assurance teams to...  ...data management & AI practices to...  ...specific technologies or platforms as relevant to the... 
    Platform
    Quality
    Full time
    Work at office
    Local area
    Flexible hours

    EXELIXIS

    Alameda, CA
    1 day ago
  • $190k - $239.5k

     ...PURPOSEThe Senior Staff IT Product Lead - Digital...  ...Operations Platforms).Own two or more digital...  ...and support the evaluation of product...  ...scalable, and high-quality digital applications...  ...research.Stakeholder Management & Cross-Functional...  ...data management & AI practices to protect... 
    Platform
    Quality
    Full time
    Work at office
    Local area
    Flexible hours

    EXELIXIS

    Alameda, CA
    19 hours ago
  •  ...Product Manager, AI & Automation | Collective Edge | Enterprise-wide (Collective Edge, Royal Ambulance...  ...and API integrations with operational platforms, you’ll identify opportunities to...  ...s cost across labor, capacity, speed, quality, and service, and set a baseline you... 
    Platform
    Quality

    Collective Edge

    San Leandro, CA
    3 days ago
  • $243.94k - $304.92k

     ...ship dbt code. As Staff Product Manager for Developer...  ...Developer Agent (our AI coding assistant inside...  ...goals, and the Fusion platform direction. Set success...  ...transparency, control, and evaluation in agentic experiences...  ...brings together high-quality talent across the globe... 
    Platform
    Quality
    Remote work
    Flexible hours

    Fivetran

    Oakland, CA
    3 days ago
  •  ...foundation for physical AI — combining a new...  ...delivering a plug-and-play platform for developers,...  ...you. The Role As Product Manager for Physical AI Agents...  ..., developer surfaces, evaluation systems, and the workflows...  ...cadences that make agent quality measurable — success... 
    Platform
    Quality
    Full time
    Shift work

    dexmate

    Fremont, CA
    4 days ago
  • $168k - $350k

     ...seeking a Director of Enterprise AI Product Management to shape and steer an...  ...functions, partnering closely with Platform Technology, AI Labs,...  ...across value streams, evaluate its broader impact, and actively...  ...data availability and quality, access, security, infrastructure... 
    Platform
    Quality
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    2 days per week
    3 days per week
    1 day per week

    Lam Research Corporation

    Fremont, CA
    4 days ago
  • $188.5k - $255k

     ...Group is looking for a Staff Product Manager to help define and scale the AI-powered experiences that...  ...Credit Karma and across the AI platforms and agents where members...  ...products. Set the quality bar. Establish and evolve evaluation frameworks for quality, accuracy... 
    Platform
    Quality
    Full time

    Intuit

    Oakland, CA
    4 days ago
  • $166.5k - $208.5k

     ...innovative team. As a Staff Product Manager on Ridgeline's Data Intellgience...  ...on our distributed query platform to enable scalable, performant...  ...other teams — and increasingly AI agents — can rely on. You...  ..., provenance, freshness, and quality signals that both people and... 
    Platform
    Quality

    Ridgeline

    San Ramon, CA
    1 day ago
  •  ...Senior Director, Product Management, Data Intelligence Platform About the Company Healthcare technology company...  ...building scalable solutions to improve quality, affordability, and experience...  ..., machine learning, and generative AI, while balancing investment priorities... 
    Platform
    Quality

    Confidential

    Oakland, CA
    4 days ago
  • $178k - $267k

     ...As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we’re...  ...join, you’ll feel it. Not just in the products we build, but in how we show up for each...  ...defect triage, track delivery and product quality metrics, and communicate progress,... 
    Platform
    Quality
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    12 days ago
  • $160k - $192.5k

     ...Senior Staff Technical Product Manager – Service...  ...backend intelligence platform that powers critical decision...  ...orchestration system that evaluates complex, interdependent...  ...behavior, decision quality, and operational outcomes...  ...a deeply technical, AI ‑ driven and analytical... 
    Platform
    Quality
    Remote job
    Full time
    Temporary work
    Work at office
    Immediate start
    Flexible hours
    3 days per week
    1 day per week

    Scout Motors

    Fremont, CA
    1 day ago
  •  ...frameworks, and enabling quality across enterprise...  ...with emerging AI technologies, we'd...  ..., framework evaluations, and automation architecture...  ....Create and manage automated test data...  ...and integrated platforms.Validate Salesforce...  ...with developers and product teams to identify... 
    Platform
    Quality

    Robert Half

    San Ramon, CA
    4 days ago
  •  ...providers. Careforce’s autonomous AI agents find, call, and...  ...access to healthcare. Technical Product Manager Your job is to build the...  ...our agentic care-coordination platform. You take ideas to MVP in...  ...have experience setting and evaluating product metrics. Adaptability... 
    Platform
    Immediate start

    CareForce

    Oakland, CA
    4 days ago
  •  ...unleashing the power of AI to create value at...  ...proprietary assets and platforms, and deep ecosystem relationships...  ...(GCC) Engineering Lead/Manager is responsible for...  ...deep expertise in product engineering, platform engineering...  ...that enable high-quality, efficient, and scalable... 
    Platform
    Quality
    Live in
    Work at office
    Local area

    Accenture

    Walnut Creek, CA
    1 day ago
  • $196k - $294k

     ...500 company and a leading AI platform for managing people, money, and agents,...  ...ll feel it. Not just in the products we build, but in how we show...  ...into scalable, secure, high-quality product experiences that...  ...Workmates and the business. Evaluate vendor and SaaS AI... 
    Platform
    Quality
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    12 days ago
  • $168k - $252k

     ...500 company and a leading AI platform for managing people, money, and agents,...  ...ll feel it. Not just in the products we build, but in how we show...  ...measurable KPIs including quality, adoption, trust, and business...  ...experimentation loops, evaluation, and iteration using qualitative... 
    Platform
    Quality
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    4 days ago
  • $115k - $130k

     ...based revenue cycle management solutions –from...  ...seeking a Senior Product Owner with strong...  ...for requirements quality across the engineering...  ...part of a broader platform transformation, you...  .... Use AI assistants and agents...  ...design discussions and evaluate trade-offs, aligning... 
    Platform
    Quality
    Work at office
    2 days per week

    Office Ally

    Danville, CA
    8 days ago
  • $140k - $210k

     ...500 company and a leading AI platform for managing people, money, and agents,...  ...ll feel it. Not just in the products we build, but in how we show...  ...filed.Research. You gather and evaluate information carefully...  ...prototyping, assessing output quality, or shipping something with... 
    Platform
    Quality
    Full time
    Work at office
    Remote work
    Worldwide
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    2 days ago
  •  ...Beauty is looking for a Product Manager, Marketing Technology...  ...of customer data, platform architecture, and activation...  ...Data Platform (CDP), AI-driven personalization...  ...with rigorous evaluation of third-party vendors...  ...governance, and data quality Ensure all customer... 
    Platform
    Quality
    Full time
    Contract work
    Work at office
    Work from home
    Flexible hours

    e.l.f. Beauty

    Oakland, CA
    3 days ago
  • $140k - $160k

     ...Job Molex is seeking a Global Product Manager to lead the strategy,...  ...next-generation connectivity platform supporting Near Package Optics...  ...Copper (NPC) architectures for AI infrastructure, hyperscale computing...  ...engineering, manufacturing, quality, sales, marketing, and... 
    Platform
    Quality
    Flexible hours

    Molex

    Fremont, CA
    3 days ago
  • $165.7k - $248.55k

     ...Engineering will join the AIX (AI for Engineering...  ...secure, governed, and production-ready AI engineering...  ..., software quality, and engineering automation...  ...enterprise engineering platforms including GitHub, Jira...  ...integrations . Research and evaluate emerging LLMs, coding... 
    Platform
    Quality
    Local area

    Cloud Software Group

    San Ramon, CA
    6 days ago
  • $201.77k - $252.21k

     ...context teams and AI systems rely on. Fivetran...  ...to deliver the products and experiences...  ...hiring a Senior Manager to lead the Product...  ...who work across dbt platform and CLI-based...  ...thoughtful, high-quality work for deeply technical...  ...the domain, evaluate tradeoffs, and partner... 
    Platform
    Quality
    Flexible hours

    Fivetran

    Oakland, CA
    19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Product Manager, AI Platform - Quality and Evaluation. Be the first to apply!