Tech Lead Manager, Business Agent Quality

Own the technical goal for evaluating, observing, and iterating on AI agent performance across Google’s commerce ecosystem.Lead the development of evaluation infrastructure and automated rating systems (AutoRaters) to measure conversation helpfulness and factuality at scale.Bridge applied AI and engineering excellence to transition evaluation frameworks into a self-service platform for internal partners.Solve complex reliability issues to maintain high quality standards for LLM reasoning and low-latency agent pipelines.Provide direction while remaining to mentor and grow a nimble, high-performing engineering team.Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of software engineering and architecture experience testing, and launching software products. Experience integrating generative AI tools or LLM interfaces into workflows.Experience with establishing standards for evaluation and quality metrics. Experience as a people manager.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.8 years of experience with data structures and algorithms.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Generative AI experience. Experience working with conversational AI reliability metrics (e.g., helpfulness, grounding, safety) and agent orchestration harnesses with validation protocols.Experience collaborating with Product, Data Science, and user-facing feature teams.Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.The Business Agent team drives Google’s Agentic Commerce goals, empowering seamless consumer interactions across Search, YouTube, Ads, and RCS Messaging.We are seeking a Tech Lead Manager to own the technical roadmap for evaluating, observing, and scaling AI agent performance across Google’s ecosystem. In this role, you will bridge applied AI and engineering excellence—mentoring a nimble team, building evaluation infrastructure, and scaling LLM reliability for commerce.People shop on Google more than a billion times a day - and the Commerce team is responsible for building the experiences that serve these users. The mission for Google Commerce is to be an essential part of the shopping journey for consumers - from inspiration to to a simple and secure checkout experience - and the best place for retailers/merchants to connect with consumers. We support and partner with the commerce ecosystem, from large retailers to small local merchants, to give them the tools, technology and scale to thrive in today’s digital world.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor's degree or equivalent practical experience.8 years of software engineering and architecture experience testing, and launching software products. Experience integrating generative AI tools or LLM interfaces into workflows.Experience with establishing standards for evaluation and quality metrics. Experience as a people manager.