Technical Lead Manager, Machine Learning Runtime & Serving

Role Description

Waymo is seeking a senior Technical Lead Manager (TLM) Machine Learning Engineer to guide the technical vision of our core ML infrastructure. In this role, you will actively grow and manage a high-performing team of 6 engineers to deliver Waymo’s next-generation ML ecosystem. This critical work encompasses both the in-vehicle inference engine and the cloud-based serving infrastructure for our foundational models. You will architect scalable, high-performance ML runtime systems that operate across two extreme domains: the highly constrained edge compute environment of autonomous vehicles and our large-scale, offboard data centers.

• Guide the technical vision of our core ML infrastructure while actively growing and managing a high-performing team of 6 engineers.
• Architect scalable, high-performance ML runtime systems that operate flawlessly across two extreme domains.
• Navigate complex engineering trade-offs, driving feature development that balances real-time latency and memory limits with high-throughput demands.
• Spearhead the strategic transition of core ML workloads to a JAX-native runtime architecture.
• Partner across organizational boundaries with world-class ML researchers to analyze system-level workloads and unlock performance gains.
• Drive systemic performance excellence by designing advanced profiling and benchmarking infrastructure.

Qualifications

• B.S. or M.S. in CS, EE, Deep Learning or a related field.
• People management experience, with a proven track record of recruiting, mentoring, and guiding high-performing teams of senior engineers.
• 8+ years of professional software engineering experience architecting, building, and scaling complex ML systems and infrastructure.
• Strong production programming expertise.
• Proven track record of optimizing ML software to maximize the performance of hardware accelerators.
• Hands-on experience developing distributed backend systems that are low-latency, highly concurrent, and fault-tolerant at scale.

Requirements

• PhD in CS, EE, Deep Learning or a related field (preferred).
• Deep expertise in modifying and extending ML software stacks, including compilers, runtimes, or inference engines.
• Strong background in building and scaling LLM serving systems.
• Deep expertise in edge computing and automotive ML deployment.

Benefits

• Participation in Waymo’s discretionary annual bonus program.
• Equity incentive plan.
• Generous Company benefits program, subject to eligibility requirements.

Salary Range

The expected base salary range for this full-time position across US locations is $251,000 — $310,000 USD. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level.