Senior Staff ML Engineer (Driver Understanding and Evaluation)
Waymo
Requirements PhD degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience
- 10+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning
- 2+ years of people management experience
- Demonstrated expertise in deep learning, sequence modeling, and generative models
- Strong publication record or history of impactful project delivery in RL or related areas
- Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow)
- Experience with large-scale distributed training and data processing
- Proven ability to lead complex and ambiguous technical projects from conception to completion
- (Desirable) 12+ years of relevant experience in ML/RL research and application
- (Desirable) Experience in the autonomous vehicles domain, robotics, or complex simulation environments
- (Desirable) Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences)
- (Desirable) Familiarity with large-scale simulation platforms and their integration with ML training workflows
- (Desirable) Experience designing and using metrics for evaluating complex AI systems
- (Desirable) Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries
- (Desirable) Excellent communication skills, with the ability to articulate complex technical concepts clearly
- It will combine expert human judgements and advanced machine learning models to deliver training and evaluation data for hundreds of metrics and components that make up the Waymo Driver
- We are looking for researchers and software engineers who are passionate about developing machine learning techniques
- These techniques are for the Evaluation systems on our autonomous service
- They will serve as a constant driver to improve the performance of our technology stack
- Grow the end-to-end strategy for our next generation of machine learning-based evaluation metrics, promoting scientific and statistical rigor across our embodied AI applications
- Architect and build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors
- Lead the design, implementation, and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors
- Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions. These solutions will enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies
- Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system
- Provide technical mentorship, guidance, and thought leadership to other engineers within the team and across collaborating groups
- Guide and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—on a cohesive evaluation strategy, ensuring cross-functional alignment on goals and priorities
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Staff ML Engineer (Driver Understanding and Evaluation) in San Francisco, CA vacancy
- Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for CSxAI initiatives. This role requires... ...PhD in a relevant field, extensive experience in ML/AI systems, and strong leadership in technical...SeniorRemote job
$200k - $240k
...secure world for all. The AI Engineering Team is chartered with... ...re also deeply involved in evaluating and integrating cutting-edge... ...faster than the market. As a Senior or Staff ML Systems Engineer - LLM , you... ...Prometheus, OpenTelemetry) Understand and implement ML Ops best...SeniorRemote workWorldwide- ...Enterprise AI Customer Support startup with their search for senior/staff ML research engineers. The role will be onsite in their SF office. What... ...supervised fine-tuning and RL, and working on evaluations and deployments. ~ Familiar with SFT, FL, DPO, PPO, GRPO...SeniorWork at office
$242.8k - $357k
...search and discovery experiences. As a Senior Staff Engineer, you will lead the technical... ...models (LLMs). Your work will span query understanding, user and merchant representation learning... ...content understanding. Rigorously evaluate ML and LLM models using a combination of...SeniorHourly payWork at officeLocal areaRemote workFlexible hours- Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite... ...Designing and implementing ML algorithms and models,... ...for model training and evaluation. System Integration:... ...Science Fundamentals: Solid understanding of statistical analysis...Senior
$279.2k - $390.9k
Team The ML Indexing & Retrieval Platform team at Reddit is responsible... ..., including Content Understanding, Semantic, Lexical retrieval... ...generation ML Indexing & Retrieval engine, integrating capabilities... ...will use this information to evaluate your application for...SeniorFor contractorsWork experience placementFlexible hours- Fairygodboss in San Francisco is looking for a Senior Staff Machine Learning Engineer to lead the personalization strategy for the consumer shopping journey. The role demands extensive experience in machine learning and architectural decision-making. With an impactful...Senior
- Airbnb, Inc. is seeking a Senior Staff Machine Learning Engineer to architect advanced machine learning solutions and lead efforts involving Large Language... ...role. This position offers a chance to drive impactful ML applications, mentor a team of engineers, and enhance guest...SeniorRemote job
- A leading travel technology company is seeking a Senior Staff Engineer to develop AI solutions for their growth platform in San Francisco. The ideal candidate will have over 12 years of experience in machine learning and strong programming skills. Responsibilities include...SeniorRemote job
- ...most complex and bleeding-edge part of our engine. You'll be working on making AI models run... ...works You think the current state of ML deployment could be way better What you'll... ...here with the title of Member of Technical Staff, it’s long and silly for a job title). The...Senior
- Senior Staff Machine Learning Engineer, Post Training Remote - USA Airbnb was born in 2007 when two hosts welcomed... ...Service to Marketing we rely on ML to ensure that guests and hosts have... ...alignment and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑...SeniorWork experience placementRemote work
$250k - $350k
...just getting started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience,... ...scribing, voice agents, long-context chart understanding, and clinical reasoning. This isn't a... ...to ML libraries, benchmarks, or evaluation frameworks. Compensation We offer a...Work at officeImmediate startRemote workFlexible hours3 days per week$197.3k - $313.7k
Staff ML Engineer, Fine Tuning - SlackSkip to main content#Staff ML Engineer, Fine Tuning -... ...infrastructure, hyperparameter optimization, evaluation, deployment and monitoring.* Build... ...the team.* The ability to write understandable, testable code with an eye towards maintainability...Work at office$210k - $260k
...offers members a unique understanding of their finances and... .... Machine Learning Engineers at Rocket Money further... ...support strategy with ML and AI powered user experiences... ...on end users. At the Staff level, Machine... ..., and maintain robust evaluation frameworks. You ensure...Work at officeLocal area$200k - $300k
Senior/Staff Machine Learning Engineer, Agent Simulation Location: San Francisco Bay Area Compensation: $200,000 - 300,000 USD / year About The Role... ..., metrics pipelines Fluency in Python and a basic understanding of C++ Fluency with Numpy and PyTorch, TensorFlow or...SeniorTemporary workRelocation package$141k - $249k
...memory to pinpoint performance bottlenecks. - Identify and evaluate emerging technologies that can be adopted into Waabi’s training... ...compilation/deployment techniques. - Work with researchers and ML engineers on best-practices for optimal resource usage. - Create and...SeniorWork at officeWork from homeFlexible hours- Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the Airbnb product. From Trust to Payments, and from Customer Service... ...fine‑tuning and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑based learning...SeniorWork experience placementCasual workLive inWork at officeRemote work
- Arcada Labs Incorporated is seeking an ML Research Engineer in San Francisco to lead evaluations of AI models based on human preferences. You will design experiments and analysis pipelines to enhance our understanding of AI capabilities and contribute to user-facing tools...
- ...of my client, I am hiring for a Senior Machine Learning Engineer - End-to-End (E2E) to help develop... ...intermediate representations Train and evaluate models using large-scale datasets... ...compute environments Solid understanding of modern ML architectures used in end-to-end...Senior
- Perplexity is seeking experienced ML engineers to design, build, and optimize the recommendation... .... Great recommendations and user understanding are central to delighting and... ...experience for the user. Build the data and evaluation foundations that let these systems learn...
$167k - $270k
...Machine Learning Engineering org is looking for a seasoned Sr. Staff Data Scientist/Machine... .... As a Senior Staff Data Scientist... ...insights Expand ML Capabilities –... ...deployment, model evaluation, data processing,... ...design ~ Strong understanding of statistics, probability...SeniorRemote jobFor contractors$240k - $260k
...training, inference, evaluation, and analytics (batch... ...closely with the Product, Engineering, and Data teams and... ...adjacent use cases. (Staff scope) Lead architecture... ...Safer content understanding: detection of misleading... ...and shipping production ML systems (or equivalent...Work at officeRemote work- ...real human preference and judgment. That lets us evaluate models on what people actually care about, not... ...others. About the Role We’re looking for an ML Research Engineer to help us build better ways to evaluate and understand real AI capabilities. You’ll design and run...
$245k - $272k
...and easy to adopt. As a Staff MLE, you'll also shape... ...decisions, and mentor engineers across the... ...high-impact group of ML engineers and platform... ...safety guardrails, and evaluation infrastructure. Collaborate... ...PMs, and Designers to understand their AI needs and deliver...SeniorFull timeWork at officeLocal areaRemote work2 days per week3 days per week$200k - $250k
...Overview Build and operate the ML platform that powers AppFolio... ..., GPU orchestration, and evaluation. Productionize research prototypes... ...for LLMs and custom models, understanding quantization, batching, and... ..., Triton, or similar). Prior staff‑level role in a company with...Remote work- ...integrates with the Airbnb product, understanding the customer journey and... ...: As a machine learning engineer or scientist, your expertise... .... We’re seeking a Senior Staff Engineer who thrives at the... ...and faster iteration cycles. ML/AI Orchestration for Decisioning...SeniorWork experience placementRemote workShift work
- A leading logistics company located in South San Francisco is seeking a Senior Perception Engineer to design and implement cloud-side autonomy pipelines for their delivery systems. The role involves leveraging aerial surveys and satellite imagery to develop semantic world...Senior
- ...are looking for a Lead AI & Algorithms Engineer to own the full lifecycle of novel spatial... ...usable training formats, training and evaluating models, and deploying performant... ...training and deploying real-world AI . Deep understanding of model architectures, training pipelines...
$162.8k - $203.5k
...pipelines, routing and ETA models, driver and passenger location... ...efforts, we are hiring a Senior ML Engineer who will work end-to-end on... ...learning models at scale Evaluate machine learning systems against... ...fluency in English Strong understanding of Machine Learning...SeniorHourly payWork experience placementWork at officeLocal area3 days per week- Xcede is looking for a Member of Technical Staff focused on AI Safety to lead red-teaming efforts and ensure the robustness of next-... ...Applicants should have deep expertise in LLM safety, strong software engineering skills, and relevant academic qualifications in AI or related...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff ML Engineer (Driver Understanding and Evaluation). Be the first to apply!
Related searches
- research assistant engineering San Francisco, CA
- staff security engineer San Francisco, CA
- assistant mechanical engineer San Francisco, CA
- staff engineer San Francisco, CA
- assistant chief engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- staff automation engineer San Francisco, CA
- engineering aide San Francisco, CA


