Lead Software Engineer, Machine Learning (Reinforcement Learning)

About Waymo Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. About the Role The DUE Machine Learning team builds and operates scalable machine learning and data systems, simulation workflow and insight tools, and improves and speeds up evaluation and onboard developer journeys. It combines expert human judgments and advanced machine learning models to deliver training and evaluation data for hundreds of metrics and components that make up the Waymo Driver. We are looking for researchers and software engineers who are passionate about developing machine learning techniques for the Evaluation systems on our autonomous service. These techniques will serve as a constant driver to improve the performance of our technology stack. Responsibilities Grow the end-to-end strategy for our next generation of machine learning-based evaluation metrics, promoting scientific and statistical rigor across our embodied AI applications. Architect and build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors. Lead the design, implementation, and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors. Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions. These solutions will enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies. Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system. Provide technical mentorship, guidance, and thought leadership to other engineers within the team and across collaborating groups. Guide and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—on a cohesive evaluation strategy, ensuring cross-functional alignment on goals and priorities. Requirements Education: PhD degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience. Experience: 10+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning. Management Experience: 2+ years of people management experience. Technical Expertise: Demonstrated expertise in deep learning, sequence modeling, and generative models. Strong publication record or history of impactful project delivery in RL or related areas. Programming: Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow). System Design: Experience with large-scale distributed training and data processing. Project Leadership: Proven ability to lead complex and ambiguous technical projects from conception to completion. Preferred Qualifications 12+ years of relevant experience in ML/RL research and application. Experience in the autonomous vehicles domain, robotics, or complex simulation environments. Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences). Familiarity with large-scale simulation platforms and their integration with ML training workflows. Experience designing and using metrics for evaluating complex AI systems. Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries. Excellent communication skills, with the ability to articulate complex technical concepts clearly. #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.