Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff ML Engineer (Driver Understanding and Evaluation)

Waymo

Requirements PhD degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience

  • 10+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning
  • 2+ years of people management experience
  • Demonstrated expertise in deep learning, sequence modeling, and generative models
  • Strong publication record or history of impactful project delivery in RL or related areas
  • Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow)
  • Experience with large-scale distributed training and data processing
  • Proven ability to lead complex and ambiguous technical projects from conception to completion
  • (Desirable) 12+ years of relevant experience in ML/RL research and application
  • (Desirable) Experience in the autonomous vehicles domain, robotics, or complex simulation environments
  • (Desirable) Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences)
  • (Desirable) Familiarity with large-scale simulation platforms and their integration with ML training workflows
  • (Desirable) Experience designing and using metrics for evaluating complex AI systems
  • (Desirable) Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries
  • (Desirable) Excellent communication skills, with the ability to articulate complex technical concepts clearly
What the job involves The DUE Machine Learning team will build and operate scalable machine learning and data systems, simulation workflow and insight tools, improve and speed up the evaluation and onboard developer journeys
  • It will combine expert human judgements and advanced machine learning models to deliver training and evaluation data for hundreds of metrics and components that make up the Waymo Driver
  • We are looking for researchers and software engineers who are passionate about developing machine learning techniques
  • These techniques are for the Evaluation systems on our autonomous service
  • They will serve as a constant driver to improve the performance of our technology stack
  • Grow the end-to-end strategy for our next generation of machine learning-based evaluation metrics, promoting scientific and statistical rigor across our embodied AI applications
  • Architect and build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors
  • Lead the design, implementation, and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors
  • Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions. These solutions will enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies
  • Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system
  • Provide technical mentorship, guidance, and thought leadership to other engineers within the team and across collaborating groups
  • Guide and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—on a cohesive evaluation strategy, ensuring cross-functional alignment on goals and priorities
#J-18808-Ljbffr Waymo

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Staff ML Engineer (Driver Understanding and Evaluation) in San Francisco, CA vacancy
  • Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for CSxAI initiatives. This role requires...  ...PhD in a relevant field, extensive experience in ML/AI systems, and strong leadership in technical... 
    Senior
    Remote job

    airbnb, Inc.

    San Francisco, CA
    2 days ago
  • $200k - $240k

     ...secure world for all. The AI Engineering Team is chartered with...  ...re also deeply involved in evaluating and integrating cutting-edge...  ...faster than the market. As a Senior or Staff ML Systems Engineer - LLM , you...  ...Prometheus, OpenTelemetry) Understand and implement ML Ops best... 
    Senior
    Remote work
    Worldwide

    TRM Labs

    San Francisco, CA
    1 day ago
  •  ...Enterprise AI Customer Support startup with their search for senior/staff ML research engineers. The role will be onsite in their SF office. What...  ...supervised fine-tuning and RL, and working on evaluations and deployments. ~ Familiar with SFT, FL, DPO, PPO, GRPO... 
    Senior
    Work at office

    DRH Search

    San Francisco, CA
    2 days ago
  • $242.8k - $357k

     ...search and discovery experiences. As a Senior Staff Engineer, you will lead the technical...  ...models (LLMs). Your work will span query understanding, user and merchant representation learning...  ...content understanding. Rigorously evaluate ML and LLM models using a combination of... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Fairygodboss

    San Francisco, CA
    4 days ago
  • Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite...  ...Designing and implementing ML algorithms and models,...  ...for model training and evaluation. System Integration:...  ...Science Fundamentals: Solid understanding of statistical analysis... 
    Senior

    Lead Allies Inc

    San Francisco, CA
    4 days ago
  • $279.2k - $390.9k

    Team The ML Indexing & Retrieval Platform team at Reddit is responsible...  ..., including Content Understanding, Semantic, Lexical retrieval...  ...generation ML Indexing & Retrieval engine, integrating capabilities...  ...will use this information to evaluate your application for... 
    Senior
    For contractors
    Work experience placement
    Flexible hours

    Tensec

    San Francisco, CA
    4 days ago
  • Fairygodboss in San Francisco is looking for a Senior Staff Machine Learning Engineer to lead the personalization strategy for the consumer shopping journey. The role demands extensive experience in machine learning and architectural decision-making. With an impactful... 
    Senior

    Fairygodboss

    San Francisco, CA
    3 days ago
  • Airbnb, Inc. is seeking a Senior Staff Machine Learning Engineer to architect advanced machine learning solutions and lead efforts involving Large Language...  ...role. This position offers a chance to drive impactful ML applications, mentor a team of engineers, and enhance guest... 
    Senior
    Remote job

    airbnb, Inc.

    San Francisco, CA
    2 days ago
  • A leading travel technology company is seeking a Senior Staff Engineer to develop AI solutions for their growth platform in San Francisco. The ideal candidate will have over 12 years of experience in machine learning and strong programming skills. Responsibilities include... 
    Senior
    Remote job

    airbnb, Inc.

    San Francisco, CA
    1 day ago
  •  ...most complex and bleeding-edge part of our engine. You'll be working on making AI models run...  ...works You think the current state of ML deployment could be way better What you'll...  ...here with the title of Member of Technical Staff, it’s long and silly for a job title). The... 
    Senior

    Comfy

    San Francisco, CA
    2 days ago
  • Senior Staff Machine Learning Engineer, Post Training Remote - USA Airbnb was born in 2007 when two hosts welcomed...  ...Service to Marketing we rely on ML to ensure that guests and hosts have...  ...alignment and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑... 
    Senior
    Work experience placement
    Remote work

    airbnb, Inc.

    San Francisco, CA
    5 days ago
  • $250k - $350k

     ...just getting started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience,...  ...scribing, voice agents, long-context chart understanding, and clinical reasoning. This isn't a...  ...to ML libraries, benchmarks, or evaluation frameworks. Compensation We offer a... 
    Work at office
    Immediate start
    Remote work
    Flexible hours
    3 days per week

    Ambience Healthcare, Inc.

    San Francisco, CA
    5 days ago
  • $197.3k - $313.7k

    Staff ML Engineer, Fine Tuning - SlackSkip to main content#Staff ML Engineer, Fine Tuning -...  ...infrastructure, hyperparameter optimization, evaluation, deployment and monitoring.* Build...  ...the team.* The ability to write understandable, testable code with an eye towards maintainability... 
    Work at office

    Salesforce, Inc.

    San Francisco, CA
    4 days ago
  • $210k - $260k

     ...offers members a unique understanding of their finances and...  .... Machine Learning Engineers at Rocket Money further...  ...support strategy with ML and AI powered user experiences...  ...on end users. At the Staff level, Machine...  ..., and maintain robust evaluation frameworks. You ensure... 
    Work at office
    Local area

    Truebill

    San Francisco, CA
    4 days ago
  • $200k - $300k

    Senior/Staff Machine Learning Engineer, Agent Simulation Location: San Francisco Bay Area Compensation: $200,000 - 300,000 USD / year About The Role...  ..., metrics pipelines Fluency in Python and a basic understanding of C++ Fluency with Numpy and PyTorch, TensorFlow or... 
    Senior
    Temporary work
    Relocation package

    jobs.frontdoordefense.com - Jobboard

    San Francisco, CA
    5 days ago
  • $141k - $249k

     ...memory to pinpoint performance bottlenecks. - Identify and evaluate emerging technologies that can be adopted into Waabi’s training...  ...compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal resource usage. - Create and... 
    Senior
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    20 days ago
  • Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the Airbnb product. From Trust to Payments, and from Customer Service...  ...fine‑tuning and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑based learning... 
    Senior
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    airbnb, Inc.

    San Francisco, CA
    5 days ago
  • Arcada Labs Incorporated is seeking an ML Research Engineer in San Francisco to lead evaluations of AI models based on human preferences. You will design experiments and analysis pipelines to enhance our understanding of AI capabilities and contribute to user-facing tools... 

    Arcada Labs Incorporated

    San Francisco, CA
    1 day ago
  •  ...of my client, I am hiring for a Senior Machine Learning Engineer - End-to-End (E2E) to help develop...  ...intermediate representations Train and evaluate models using large-scale datasets...  ...compute environments Solid understanding of modern ML architectures used in end-to-end... 
    Senior

    Hydrogen UK Ltd

    San Francisco, CA
    2 days ago
  • Perplexity is seeking experienced ML engineers to design, build, and optimize the recommendation...  .... Great recommendations and user understanding are central to delighting and...  ...experience for the user. Build the data and evaluation foundations that let these systems learn... 

    Neura Market

    San Francisco, CA
    3 days ago
  • $167k - $270k

     ...Machine Learning Engineering org is looking for a seasoned Sr. Staff Data Scientist/Machine...  ....   As a Senior Staff Data Scientist...  ...insights Expand ML Capabilities –...  ...deployment, model evaluation, data processing,...  ...design ~ Strong understanding of statistics, probability... 
    Senior
    Remote job
    For contractors

    Autodesk

    San Francisco, CA
    more than 2 months ago
  • $240k - $260k

     ...training, inference, evaluation, and analytics (batch...  ...closely with the Product, Engineering, and Data teams and...  ...adjacent use cases. (Staff scope) Lead architecture...  ...Safer content understanding: detection of misleading...  ...and shipping production ML systems (or equivalent... 
    Work at office
    Remote work

    MyHealthTeam

    San Francisco, CA
    3 days ago
  •  ...real human preference and judgment. That lets us evaluate models on what people actually care about, not...  ...others. About the Role We’re looking for an ML Research Engineer to help us build better ways to evaluate and understand real AI capabilities. You’ll design and run... 

    Arcada Labs Incorporated

    San Francisco, CA
    1 day ago
  • $245k - $272k

     ...and easy to adopt. As a Staff MLE, you'll also shape...  ...decisions, and mentor engineers across the...  ...high-impact group of ML engineers and platform...  ...safety guardrails, and evaluation infrastructure. Collaborate...  ...PMs, and Designers to understand their AI needs and deliver... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    gusto

    San Francisco, CA
    a month ago
  • $200k - $250k

     ...Overview Build and operate the ML platform that powers AppFolio...  ..., GPU orchestration, and evaluation. Productionize research prototypes...  ...for LLMs and custom models, understanding quantization, batching, and...  ..., Triton, or similar). Prior staff‑level role in a company with... 
    Remote work

    AppFolio

    San Francisco, CA
    3 days ago
  •  ...integrates with the Airbnb product, understanding the customer journey and...  ...: As a machine learning engineer or scientist, your expertise...  .... We’re seeking a Senior Staff Engineer who thrives at the...  ...and faster iteration cycles. ML/AI Orchestration for Decisioning... 
    Senior
    Work experience placement
    Remote work
    Shift work

    airbnb, Inc.

    San Francisco, CA
    1 day ago
  • A leading logistics company located in South San Francisco is seeking a Senior Perception Engineer to design and implement cloud-side autonomy pipelines for their delivery systems. The role involves leveraging aerial surveys and satellite imagery to develop semantic world... 
    Senior

    Zipline

    South San Francisco, CA
    1 day ago
  •  ...are looking for a Lead AI & Algorithms Engineer to own the full lifecycle of novel spatial...  ...usable training formats, training and evaluating models, and deploying performant...  ...training and deploying real-world AI . Deep understanding of model architectures, training pipelines... 

    Dream Technologies Inc

    San Francisco, CA
    3 days ago
  • $162.8k - $203.5k

     ...pipelines, routing and ETA models, driver and passenger location...  ...efforts, we are hiring a Senior ML Engineer who will work end-to-end on...  ...learning models at scale Evaluate machine learning systems against...  ...fluency in English Strong understanding of Machine Learning... 
    Senior
    Hourly pay
    Work experience placement
    Work at office
    Local area
    3 days per week

    Israelvcforum

    San Francisco, CA
    2 days ago
  • Xcede is looking for a Member of Technical Staff focused on AI Safety to lead red-teaming efforts and ensure the robustness of next-...  ...Applicants should have deep expertise in LLM safety, strong software engineering skills, and relevant academic qualifications in AI or related... 
    Senior

    Xcede

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff ML Engineer (Driver Understanding and Evaluation). Be the first to apply!