Tech Lead Manager, AI Agent Quality & Evaluation
Google Inc.
Google is seeking a Tech Lead Manager for the Business Agent Quality team to own the technical roadmap for evaluating, observing, and scaling AI agent performance across Google’s commerce ecosystem. You will mentor a nimble engineering team, build evaluation infrastructure, and establish reliability standards for LLM reasoning and low-latency pipelines, partnering with Product, Data Science, and user-facing teams. #J-18808-Ljbffr Google Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Tech Lead Manager, AI Agent Quality & Evaluation in Mountain View, CA vacancy
- Google is hiring a Tech Lead Manager to own the technical roadmap for evaluating, observing, and scaling AI agent performance across its commerce ecosystem. You will mentor a nimble team, build evaluation infrastructure, and scale LLM reliability for commerce. The role...Quality
$2,000 per month
Elastic, the Search AI Company, enables... ...the edge, Elastic Agent and Beats are how... ...This role is the tech lead position for the Agent... ...the agent layer. Evaluate and implement new... ...high standards for quality. Engage with... ...with the product management team to prioritize...QualityLocal areaRemote workFlexible hours$207k - $300k
...technical goal for evaluating, observing, and iterating on AI agent performance across... ...commerce ecosystem.Lead the development of... ...issues to maintain high quality standards for LLM... ...as a people manager.Preferred qualifications... ...Messaging.We are seeking a Tech Lead Manager to own...QualityLocal area$170.7k - $300.2k
...better than we found it. As the Tech-Lead Manager of our dynamic group, you... ...data curation to modeling, evaluation, and deployment. This is a... ...infra teams to deliver high quality datasets for various stages... ...development of cutting‑edge AI technologies in the field of...QualityRelocation$250k - $300k
...: Glean is the Work AI platform that helps... ...Assistant, and scalable AI agents on one secure, open... ...50, and Gartner’s Tech Innovators in... ...the Role: The Tech Lead Manager of the Agentic Runtime... ...Gemini) and internal evaluation frameworks to improve quality and predictability....QualityHome officeFlexible hours- ...and profound opportunity for AI to drive positive change in the... ...Fidelity, T. Rowe Price, and other leading investorsAbout the... ...workloads: day-to-day Autonomy Evaluation that powers rapid software iteration... ...accuracy to end-to-end behavior quality. The platform empowers...QualityTemporary workImmediate startFlexible hours
$152k - $241.5k
...looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An... ..., and product teams to improve simulation quality and accelerate engineering decisions.Automating...QualityFull time- Google Mountain View, CA is hiring a Tech Lead Manager for Business Agent Quality. The role focuses on owning the technical roadmap for AI agent evaluation, observations, and scaling reliability across Google’s commerce ecosystem. Ideal candidates bring 8+ years in software...Quality
$235.03k - $352.29k
...profound opportunity for AI to drive positive... ...Price, and other leading investors.About the... ...the development of evaluation tooling that... ...lives.Intelligent Agents: Design and deploy... ...champion fast, high-quality technical execution.People Management: Experience in hiring...QualityImmediate startFlexible hours$166.5k - $291.4k
...ServiceNow is the AI control tower for business... ...teamBuild Agent is ServiceNow's AI... ...metadata types. This role leads the team... ...for the Build Agent evaluation framework, model support... ...Agent to arbitrate quality standards and drive... ...incumbent default).Manage the daily activities...QualityWork at officeImmediate startRemote workFlexible hours$133k - $149k
About Us Observe.AI is the AI Agents platform for customer experience... ..., elevate service quality, and reduce... ...foundation, Observe.AI helps leading brands like DoorDash,... ...Us As an Engagement Manager for AI Agent... ...delivery templates, evaluation frameworks, UAT processes...QualityFull timeWork at officeLocal areaRemote workFlexible hours$155k - $185k
...OpportunityWe are looking for a Senior AI Agent & LLM Engineer who combines... ...with a deep focus on AI quality. You will help build and... ...user-facing agent experiences, evaluation systems, and the shared platform... ..., Otter.ai is the world’s leading tool for meeting transcription...QualityPermanent employment$129.4k - $198.4k
...experiences. About the Organization:The Evaluation team builds and evolves the... ...and arbiters of end-to-end AV quality. We own large scale test... ...best practices. Leverage AI-assisted development tools and... ...embrace the responsibility to lead the change that will make our...QualityFull timeLocal areaRemote workWork from homeFlexible hours$262k - $365k
....7 years of experience leading technical project strategy... ...deployment, model evaluation, data processing, debugging... .../Machine Learning (AI/ML) recommendations.8 years... ..., display leadership qualities and be enthusiastic to... ...In this role, you will tech-lead a team of AI/ML software...Quality$152k - $241.5k
...mission‑driven Developer Relations Manager focused on Foundational AI Research to engage leading academic labs advancing the... ...reasoning, post‑training, model evaluation, or AI systems research. Strong... ..., compute efficiency, model quality, benchmark methodology, reproducibility...Quality$147k - $211k
...Participate in, or lead design reviews... ...service operations and quality.Minimum... ...labeling, ratings, and evaluations.Experience with Natural... ..., or Generative AI.Google's software... ...technology forward.The H2O Agents & Integrations... ...for building data management and evaluations...Quality$144.7k - $221.4k
...About the Organization The Evaluation team builds and evolves... ...of end-to-end AV quality. We own large-scale test... ...Background in modeling agent interaction and contributing... ...Experience leveraging AI-assisted development... ...the responsibility to lead the change that will make...QualityFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- ServiceNow in Santa Clara is seeking a Senior Director, AI Evaluation Platform to lead the CoreAI team within Platform and AI. You will define strategy... ...while enabling customer-facing monitoring of AI quality. You will drive verifier architectures (LLM-as-judge, rule...Quality
$207k - $301k
Act as a Tech Lead Manager (TLM) for a sub-team of approximately 6 software engineers, managing project priorities, deadlines, and deliverables... .... We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-...Quality$248.75k - $282k
Principal Tech Lead Manager - Customer Domains (Workforce) Mountain View, California, United States... ..., and ensuring the team ships high-quality, well-tested software on time. Balance short... ...input into team and org-level planning. AI‑Forward Engineering Culture: Champion AI...QualityTemporary workWork at office$192k - $279k
Lead the functional verification team for significant portions of TPU designs, developing... ...dimensions and develop monitors and checkers for quality assurance.Minimum qualifications:Bachelor'... ...role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an...QualityWorldwide$207k - $301k
...and leader within the Cloud AI Quality Evaluation team.Drive high-quality, scalable... ...for GenAI developers and lead features to enable seamless... ...to measure model and agent quality performance at scale... ...technical expertise you will manage project priorities, deadlines...Quality$135k - $185k
...powered by advanced AI, recommendation... ...engage in AI Account Management algorithm work as... ...systems (AI Agents) that run a closed... ...Reliability and Measurable Quality: Build the long-... ...offline/online evaluation that keep optimization... ...to industry-leading foundation models,...QualityFull timeWork experience placementLocal areaWork from home$298k - $368k
...U.S. states. The mission of the Waymo AI Foundations team is to develop machine learning... ..., hierarchical learning, and robust evaluation. This role follows a hybrid work... ...reports to a Research Director. You will: Lead and manage a team to build large-scale foundation models...Full timeTemporary workRemote work$185k - $230k
Senior Software Engineer, AI Agent & LLM Mountain View, CA The Opportunity... ...with a deep focus on AI quality. You will help build and... ...user-facing agent experiences, evaluation systems, and the shared platform... ..., Otter.ai is the world’s leading tool for meeting transcription...QualityPermanent employmentContract workFor contractorsFor subcontractorWork at office$207k - $301k
...efficiency of Orcas Agent Runtime... ...functionally with product managers, UX designers,... ...develop novel evaluation and... ...boundaries of model quality assessment ( Cloud Lifecycle AI Tools).Mentor and... ...of experience leading ML design and optimizing... ...bringing AI to tech, healthcare,...Quality$262k - $364k
...architecture for AI-ready data foundations... ...and summarization agents, alongside modular... ....Design automated evaluation frameworks to... ...real-time analytics.Lead the Data and AI engineering... ...identity management and access controls... ...leadership qualities and be enthusiastic...Quality$135k - $155k
...powered by advanced AI, recommendation... ...to apply LLMs and Agent technology to real... ...-house AI Account Manager System: Support the... ...Reliability and Measurable Quality: Help build and... ...offline/online evaluation pipelines that... ...Access to industry-leading foundation models,...QualityFull timeWork experience placementInternshipLocal areaWork from homeNewsBreak
Mountain View, CA18 days ago$207k - $300k
Tech Lead Manager, Google Analytics Gold Processing Backend Location: Mountain View, CA, USA. Company: Google. About the job Google's software... .... We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-...QualityFull time- ...discoveries that advance the quality of life by providing... ...measurement and asset management expertise. Job... ...trustworthy deployment of AI in the enterprise. Design-in risk management, evaluation, compliance, and other... ...deployment of AI models, agents, and applications. Conducts...QualityFull timeWorldwideShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead Manager, AI Agent Quality & Evaluation. Be the first to apply!
Related searches
- technical lead manager Mountain View, CA
- technical leader Mountain View, CA
- technical lead Mountain View, CA
- tsa agent Mountain View, CA
- state farm agent Mountain View, CA
- import export agent Mountain View, CA
- remote chat agent Mountain View, CA
- agent Mountain View, CA
- executive protection agent Mountain View, CA
- work from home chat agent Mountain View, CA