Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff ML Engineer (Driver Understanding and Evaluation)

Waymo

Requirements PhD degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience

  • 10+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning
  • 2+ years of people management experience
  • Demonstrated expertise in deep learning, sequence modeling, and generative models
  • Strong publication record or history of impactful project delivery in RL or related areas
  • Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow)
  • Experience with large-scale distributed training and data processing
  • Proven ability to lead complex and ambiguous technical projects from conception to completion
  • (Desirable) 12+ years of relevant experience in ML/RL research and application
  • (Desirable) Experience in the autonomous vehicles domain, robotics, or complex simulation environments
  • (Desirable) Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences)
  • (Desirable) Familiarity with large-scale simulation platforms and their integration with ML training workflows
  • (Desirable) Experience designing and using metrics for evaluating complex AI systems
  • (Desirable) Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries
  • (Desirable) Excellent communication skills, with the ability to articulate complex technical concepts clearly
What the job involves The DUE Machine Learning team will build and operate scalable machine learning and data systems, simulation workflow and insight tools, improve and speed up the evaluation and onboard developer journeys
  • It will combine expert human judgements and advanced machine learning models to deliver training and evaluation data for hundreds of metrics and components that make up the Waymo Driver
  • We are looking for researchers and software engineers who are passionate about developing machine learning techniques
  • These techniques are for the Evaluation systems on our autonomous service
  • They will serve as a constant driver to improve the performance of our technology stack
  • Grow the end-to-end strategy for our next generation of machine learning-based evaluation metrics, promoting scientific and statistical rigor across our embodied AI applications
  • Architect and build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors
  • Lead the design, implementation, and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors
  • Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions. These solutions will enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies
  • Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system
  • Provide technical mentorship, guidance, and thought leadership to other engineers within the team and across collaborating groups
  • Guide and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—on a cohesive evaluation strategy, ensuring cross-functional alignment on goals and priorities
#J-18808-Ljbffr Waymo

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Staff ML Engineer (Driver Understanding and Evaluation) in San Francisco, CA vacancy
  • Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for CSxAI initiatives. This role requires...  ...PhD in a relevant field, extensive experience in ML/AI systems, and strong leadership in technical... 
    Senior
    Remote job

    airbnb, Inc.

    San Francisco, CA
    4 days ago
  • $141k - $249k

     ...You will... - Collaborate closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach....  ...memory to pinpoint performance bottlenecks. - Identify and evaluate emerging technologies that can be adopted into Waabi’s... 
    Senior
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    3 days ago
  •  ...Senior/Staff ML Research Engineer We're assisting a profitable Enterprise AI Customer Support startup with their search for senior/staff ML research...  ...supervised fine-tuning and RL, and working on evaluations and deployments. ~ Familiar with SFT, FL, DPO, PPO, GRPO... 
    Senior
    Work at office

    DRH Search

    San Francisco, CA
    1 day ago
  • $264.8k - $331k

     ...About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General Agents...  ...and system design to evaluation, deployment, and iteration...  ...practical experience. ~ Deep understanding of modern LLMs, prompt-,...  ...Experience deploying ML systems in cloud environments... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  • $230k - $332k

    Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence Develop...  ...to craft algorithms that understand the world. We leverage large...  ...Zoox. Drive end‑to‑end ML solutions from research...  ...preprocessing, model training, and evaluation Proficiency in Python... 
    Senior
    Full time

    jobs.frontdoordefense.com - Jobboard

    San Francisco, CA
    18 hours ago
  •  ...Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite...  ...and implementing ML algorithms and models,...  ...for model training and evaluation. System Integration...  ...Science Fundamentals: Solid understanding of statistical analysis... 
    Senior

    Lead Allies Inc.

    San Francisco, CA
    3 days ago
  • $230k - $322k

    Tensec is looking for a Staff Machine Learning Engineer in San Francisco who will lead the Commercial Content Understanding roadmap for the Monetization organization. The ideal candidate...  ...include technical mentorship, developing ML systems, and ensuring operational... 
    Flexible hours

    Tensec

    San Francisco, CA
    3 days ago
  •  ...be as short as possible What you'll do: Implement state-of-the-art open-source models to run natively in the ComfyUI core engine Design and build the native nodes that expose new model capabilities cleanly to users Work directly with our core team on architecting... 
    Senior

    ComfyUI

    San Francisco, CA
    3 days ago
  • $250k - $350k

     ...getting started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience,...  ..., voice agents, long-context chart understanding, and clinical reasoning. This isn't a...  ...contributions to ML libraries, benchmarks, or evaluation frameworks. Why Here: Our... 
    Work at office
    Immediate start
    Remote work
    Flexible hours
    3 days per week

    Ambience Healthcare

    San Francisco, CA
    2 days ago
  • $210k - $260k

     ...offers members a unique understanding of their finances and...  ...Machine Learning Engineers at Rocket Money further...  ...support strategy with ML and AI powered user experiences...  ...on end users. At the Staff level, Machine...  ..., and maintain robust evaluation frameworks. You ensure... 
    Work at office
    Local area

    Rocket Money

    San Francisco, CA
    4 days ago
  • $185.1k - $335.3k

     ...development, and performance engineering so that every cycle on...  ...automated vehicles understand and react to the world...  .... The Role As a Staff Compiler Engineer on...  ..., and effortless for ML engineers across the...  ...in a company vehicle evaluation program, through which... 
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    3 days ago
  • Airbnb, Inc. is seeking a Senior Staff Machine Learning Engineer to architect advanced machine learning solutions and lead efforts involving Large Language...  ...role. This position offers a chance to drive impactful ML applications, mentor a team of engineers, and enhance guest... 
    Senior
    Remote job

    airbnb, Inc.

    San Francisco, CA
    4 days ago
  •  ...most complex and bleeding-edge part of our engine. You'll be working on making AI models run...  ...works You think the current state of ML deployment could be way better What you'll...  ...here with the title of Member of Technical Staff, it’s long and silly for a job title). The... 
    Senior

    Comfy

    San Francisco, CA
    4 days ago
  • $245k - $272k

     ...and easy to adopt. As a Staff MLE, you'll also shape...  ...decisions, and mentor engineers across the...  ...high-impact group of ML engineers and platform...  ...safety guardrails, and evaluation infrastructure. Collaborate...  ...PMs, and Designers to understand their AI needs and deliver... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto, Inc.

    San Francisco, CA
    8 hours ago
  • $200k - $300k

    Senior/Staff Machine Learning Engineer, Agent Simulation Location: San Francisco Bay Area Compensation: $200,000 - 300,000 USD / year About The Role...  ..., metrics pipelines Fluency in Python and a basic understanding of C++ Fluency with Numpy and PyTorch, TensorFlow or... 
    Senior
    Temporary work
    Relocation package

    jobs.frontdoordefense.com - Jobboard

    San Francisco, CA
    2 days ago
  • $227.33k - $312.58k

     ...We're looking for a Staff ML Data Engineer to join Procore's AI & Frontier Models organization....  ...opportunity to shape how Procore builds, evaluates, and deploys frontier models by...  ...or inference workflows. ~ Solid understanding of data modeling, dataset lifecycle management... 
    Work at office
    Local area
    Immediate start
    3 days per week

    ProCore CPA

    San Francisco, CA
    2 days ago
  •  ...Senior ML/RL Engineer, Behavior Planning At Bot Auto, we are revolutionizing the transportation...  ...design robust reward functions and evaluation metrics that balance safety, progress...  ...Expertise in Python and PyTorch; strong understanding of modern deep learning architectures... 
    Senior
    Shift work

    Bot Auto

    San Francisco, CA
    1 day ago
  • $204k - $259k

     ...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology company...  ...the world's most trusted driver. Since its start as the...  ...will report to a Senior Staff Software Engineer. You...  ...experience Experience in ML engineering and applied... 
    Senior
    Full time
    Temporary work
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  • $152k - $228k

     ...Description Job Description Senior ML Engineer About Invoca Invoca...  .... You'll be a primary driver of the infrastructure powering...  ...— including model evaluation, versioning, and automated...  ...product and engineering to understand customer needs and ship ML... 
    Senior
    Currently hiring
    Remote work
    Flexible hours

    Invoca

    San Francisco, CA
    3 days ago
  • $300k - $430k

     ...team. About the Team The ML Infrastructure team builds...  ...infrastructure for model evaluation and experimentation, and the...  ...About the Role We're hiring a Staff ML Infrastructure Engineer to own the platforms...  ...and optimization Strong understanding of LLM inference: latency... 
    Work at office

    Decagon

    San Francisco, CA
    4 days ago
  • Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the Airbnb product. From Trust to Payments, and from Customer Service...  ...fine‑tuning and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑based learning... 
    Senior
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    airbnb, Inc.

    San Francisco, CA
    2 days ago
  • Arcada Labs Incorporated is seeking an ML Research Engineer in San Francisco to lead evaluations of AI models based on human preferences. You will design experiments and analysis pipelines to enhance our understanding of AI capabilities and contribute to user-facing tools... 

    Arcada Labs Incorporated

    San Francisco, CA
    3 days ago
  • $158k - $269k

     ...positive way. To learn more visit: As a Senior Perception Engineer, you will be at the forefront of...  ....   You will... - Prototype, evaluate, and iterate on perception...  ...traffic agents as well as semantic understanding of various traffic scenes. - Formulate... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    3 days ago
  • $240.45k - $300.3k

     ...Senior Machine Learning Engineer - Model Evaluations, Public Sector The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-critical government environments. We build evaluation frameworks... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  • $141k - $228.08k

     ...Summary We are seeking a Machine Learning Engineer to join our pioneering security team....  ...environments. ~ Proven track record of taking ML projects from initial research/...  ...Qualifications Experience with model evaluation, tuning, and handling imbalanced datasets... 
    Senior
    Full time
    Work at office

    Palo Alto Networks

    San Francisco, CA
    3 days ago
  •  ...real human preference and judgment. That lets us evaluate models on what people actually care about, not...  ...others. About the Role We’re looking for an ML Research Engineer to help us build better ways to evaluate and understand real AI capabilities. You’ll design and run... 

    Arcada Labs Incorporated

    San Francisco, CA
    3 days ago
  • $188.24k - $235.3k

     ...'s next L4, Machine Learning Engineer, Trust Intelligence Platform...  ...operate the cloud-native data and ML infrastructure that powers...  ...reproducible ML training, evaluation, and inference workflows using...  ...platform (AWS, GCP, or Azure). ~ Understanding of data modeling, distributed... 
    Local area
    Remote work
    Worldwide

    Twilio

    San Francisco, CA
    3 days ago
  •  ...a seasoned machine learning engineer specializing in AI to join our...  ...using LLMs, embeddings and other ML technologies ~ Full...  ...environment ~ A strong foundational understanding of machine learning models and practice, including model evaluation and performance ~ Strong... 
    Work at office
    Remote work

    Watershed Technology, Inc

    San Francisco, CA
    1 day ago
  • $215k - $322k

     ...Join GoFundMe as our next Staff Machine Learning Engineer (Pricing) . In this role,...  ...expertise in building production ML systems (data → training →...  ..., training, and evaluation. Build low-latency real...  ...e.g., Snowflake), with an understanding of event semantics, identity... 
    Full time
    Temporary work
    Work at office
    Flexible hours

    GoFundMe

    San Francisco, CA
    2 days ago
  •  ...Staff Machine Learning Engineer EvenUp is on a mission to close the justice gap...  ...innovation, mentor a top-tier ML team, and set the vision...  ...extraction, document structure understanding, and sophisticated...  .... Establish rigorous evaluation standards to reduce hallucinations... 
    Full time
    Temporary work
    Work at office
    Local area
    Home office
    Flexible hours

    EvenUp Inc.

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff ML Engineer (Driver Understanding and Evaluation). Be the first to apply!