Staff Data Scientist

Staff Data Scientist For over 30 years, Angi has powered the future of the home services industry, creating an environment where homeowners and pros benefit from more jobs done well. For homeowners, our platform is a reliable way to find skilled pros. For pros, we're a reliable business partner who helps them find the winnable work they want, when they want. For employees, we're an amazing place to call home. We can't wait to welcome you. Angi at a glance: Founded in 1995 as Angie's List and rebranded in 2021 Global company with 9 brands in 8 countries and employees worldwide Homeowners have turned to us for 300 million home projects and counting About the role: Angi is seeking an exceptional Staff Data Scientist to help build our agent suite for Pros, AI software that automates and runs the Pro's business for them. The first product in the suite is an AI voice and SMS agent that contacts homeowners on the Pro's behalf, qualifies the job, and books the appointment. It is live with hundreds of Pros and growing, and it is the first of several agents we intend to build. This is a data science role on a product whose core behavior is conversational and probabilistic. The work spans shaping how the agent behaves, building the evaluation systems that tell us whether it is getting better, designing the experiments that decide what we ship, and modeling the parts of the lead to job completion journey where a model is the right answer. Success in the role shows up directly in improving Pro's revenue, which is the metric that determines whether Pros see a return from Angi. What you'll do: Agent Behavior & Development: Lead improvements to how our agents converse, qualify, and book, through conversation design, prompting, and campaign logic. Success in these areas directly impacts contact rate, engagement rate, appointment set rate, and job win rate which are critical metrics for both Pro outcomes and business success. Evaluation & Measurement: Build the evaluation systems that make agent quality measurable, spanning automated checks over conversation traces, simulated conversations graded against expected outcomes, and model-based evaluation where human judgment is required. Establish the frameworks and design of experiment practices we use to decide what ships. Conversation Analysis: Work directly with real conversations to understand where the agent succeeds and where it falls short, translating that understanding into a shared taxonomy of failure modes, measured rates, and a prioritized path to improvement. Modeling & Production Ownership: Develop predictive models where they add leverage, in areas such as qualification and appointment quality, homeowner engagement, and channel and timing selection, and take them into production yourself. This team builds and operates what it designs, so your work runs in our production systems with the monitoring and testing that implies. Collaboration with Cross-Functional Teams: Work closely with a strong team of engineers, product managers, designers and operations partners to build scalable and high-impact solutions. Collaborate on the end-to-end development process, from ideation to deployment, ensuring that data-driven solutions are seamlessly integrated into our products and services. Innovation: Foster innovation within the team, exploring new approaches and techniques to solve complex business problems. Mentorship: Guide junior team members and foster a culture of continuous learning and technical excellence. Lead and encourage innovation and knowledge sharing to enhance the team's capabilities in advanced data science techniques from both industry and academia. Who you are: You have a Master's or Ph.D. in a quantitative field (e.g., Computer Science, Statistics, Mathematics, or related fields), or equivalent practical experience. You have 6+ years of experience in data science and machine learning, ideally within the tech industry and marketplace environments. You have worked on systems whose outputs are non-deterministic, such as LLM applications, conversational agents, or ranking and recommendation systems, and you have built ways to measure their quality. You are an expert in statistical thinking and experiment design, comfortable with power and sample size, sequential and non-inferiority designs, and correlated data. You enjoy working close to the raw material, including reading and categorizing large volumes of real customer interactions to find out what is actually happening. You have a proven track record of taking highly impactful work into production environments and keeping it healthy there. You are proficient in SQL and Python, and have experience with cloud ML solutions. You have excellent communication skills with the ability to convey complex technical concepts to non-technical stakeholders. Preferred Qualifications: Experience with LLM applications in production, including prompting, agent design, or evaluation tooling. Experience with voice or telephony systems, such as streaming speech recognition, turn taking, or call quality measurement. Experience with workflow orchestration for long-running processes. Background in home services, field service, or another operations-heavy marketplace. Compensation & Benefits: The salary band for this position ranges from $210,000 - $280,000, commensurate with experience and performance. Compensation may vary based on factors such as geographic location. This position will be eligible for a competitive year end performance bonus & equity package. Full medical, dental, vision package to fit your needs Flexible vacation policy; work hard and take time when you need it Pet discount plans & retirement plan with company match (401K). The rare opportunity to work with sharp, motivated teammates solving some of the most unique challenges and changing the world. We value diversity We know that the best ideas come from teams where diverse points of view uncover new solutions to hard problems. We welcome and value individuals who bring diverse life experiences, educational backgrounds, cultures, and work experiences. Our hiring process may utilize artificial intelligence (AI) tools to assist in candidate screening and assessment. Our AI tools are designed to complement, not replace, human decision-making. Angi