Staff Applied Scientist - Dashboards

The Dashboards product is the company's unified single‑pane‑of‑glass for metrics, logs, and traces—a comprehensive treasure trove of observability data. We are transforming Dashboards into an AI‑native control surface and the central hub where every team moves seamlessly from question to insight to action—providing a guided experience that feels like having an expert SRE at your side and ensuring the entry point is never an empty canvas. What You’ll Do Own the evaluation strategy for Dashboards and related teams. Define the metrics—offline and online, quality and cost, single‑turn and multi‑turn—that the team and the broader organization optimize against. Build evaluation datasets, golden traces, and regression harnesses that catch quality changes before they hit customers, and make those assets reusable by every team that builds dashboards and widgets through agents. Drive measurable improvements to retrieval relevance, tool‑selection accuracy, and context efficiency, partnering closely with the engineers on the team. Provide technical leadership across the Dashboards team and the broader organization through design reviews, working groups, and mentorship. Who You Are Bachelor’s, Master’s, or Ph.D. in a scientific field, or equivalent experience. 10+ years of relevant engineering or applied science experience, including time as a technical lead. Proven track record of leading ML or GenAI initiatives in a product‑driven environment, from research through production. Significant experience with evaluation, experimentation, or measurement of ML systems at scale. Strong product mindset and comfortable driving initiatives across cross‑functional teams. Ability to thrive in ambiguity and make sound technical calls when the path isn’t yet defined. Benefits and Growth New hire stock equity (RSUs) and employee stock purchase plan (ESPP). Continuous professional development, product training, and career pathing. An inclusive company culture, giving programs, and the ability to join Community Guilds. Competitive global benefits and global Spring Health benefits for employees and dependents age 6+. Reasonable yearly salary range: $276,000 – $345,000 USD. Variable compensation and other benefits, such as healthcare, dental, parental planning, mental health benefits, 401(k) plan with match, paid time off, fitness reimbursements, and discounted employee stock purchase plan. Equal Opportunity The company is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. Qualified applicants are considered regardless of criminal histories, consistent with legal requirements. #J-18808-Ljbffr