Product Manager for AI Evaluation

Owning the product strategy and roadmap for the evaluation platform, the full-time remote Product Manager for AI Evaluation will enable teams at Relativity to understand, measure, and improve AI performance through a standardized evaluation system while collaborating closely with applied scientists and legal experts. Key responsibilities Own the product vision and strategy for the Evaluations Platform, focusing on various evaluation pillars Conduct continuous discovery with teams to design a platform that allows self-measurement and improvement of AI performance Lead the development of a world-class agentic testing system to facilitate the rapid and safe deployment of new AI capabilities Required qualifications 4+ years of product management experience in a technology company, with at least 2 years focused on technical, platform, or data/ML products Solid understanding of the software development lifecycle and agile practices Experience conducting user discovery with technical audiences and translating findings into actionable roadmap decisions Experience with LLM-based products and familiarity with their evaluation methods Strong analytical skills to set metrics and adapt strategies based on evidence