Senior Staff ML Engineer (Driver Understanding and Evaluation)
Waymo
Requirements PhD degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience
- 10+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning
- 2+ years of people management experience
- Demonstrated expertise in deep learning, sequence modeling, and generative models
- Strong publication record or history of impactful project delivery in RL or related areas
- Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow)
- Experience with large-scale distributed training and data processing
- Proven ability to lead complex and ambiguous technical projects from conception to completion
- (Desirable) 12+ years of relevant experience in ML/RL research and application
- (Desirable) Experience in the autonomous vehicles domain, robotics, or complex simulation environments
- (Desirable) Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences)
- (Desirable) Familiarity with large-scale simulation platforms and their integration with ML training workflows
- (Desirable) Experience designing and using metrics for evaluating complex AI systems
- (Desirable) Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries
- (Desirable) Excellent communication skills, with the ability to articulate complex technical concepts clearly
- It will combine expert human judgements and advanced machine learning models to deliver training and evaluation data for hundreds of metrics and components that make up the Waymo Driver
- We are looking for researchers and software engineers who are passionate about developing machine learning techniques
- These techniques are for the Evaluation systems on our autonomous service
- They will serve as a constant driver to improve the performance of our technology stack
- Grow the end-to-end strategy for our next generation of machine learning-based evaluation metrics, promoting scientific and statistical rigor across our embodied AI applications
- Architect and build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors
- Lead the design, implementation, and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors
- Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions. These solutions will enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies
- Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system
- Provide technical mentorship, guidance, and thought leadership to other engineers within the team and across collaborating groups
- Guide and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—on a cohesive evaluation strategy, ensuring cross-functional alignment on goals and priorities
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Staff ML Engineer (Driver Understanding and Evaluation) in San Francisco, CA vacancy
- Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for CSxAI initiatives. This role requires... ...PhD in a relevant field, extensive experience in ML/AI systems, and strong leadership in technical...SeniorRemote job
$141k - $249k
...You will... - Collaborate closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach.... ...memory to pinpoint performance bottlenecks. - Identify and evaluate emerging technologies that can be adopted into Waabi’s...SeniorWork at officeWork from homeFlexible hours- ...Senior/Staff ML Research Engineer We're assisting a profitable Enterprise AI Customer Support startup with their search for senior/staff ML research... ...supervised fine-tuning and RL, and working on evaluations and deployments. ~ Familiar with SFT, FL, DPO, PPO, GRPO...SeniorWork at office
$264.8k - $331k
...About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General Agents... ...and system design to evaluation, deployment, and iteration... ...practical experience. ~ Deep understanding of modern LLMs, prompt-,... ...Experience deploying ML systems in cloud environments...SeniorFull time$230k - $332k
Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence Develop... ...to craft algorithms that understand the world. We leverage large... ...Zoox. Drive end‑to‑end ML solutions from research... ...preprocessing, model training, and evaluation Proficiency in Python...SeniorFull time- ...Senior / Staff / Principal Machine Learning Engineer Location: Onsite San Francisco (5 days onsite... ...and implementing ML algorithms and models,... ...for model training and evaluation. System Integration... ...Science Fundamentals: Solid understanding of statistical analysis...Senior
$230k - $322k
Tensec is looking for a Staff Machine Learning Engineer in San Francisco who will lead the Commercial Content Understanding roadmap for the Monetization organization. The ideal candidate... ...include technical mentorship, developing ML systems, and ensuring operational...Flexible hours- ...be as short as possible What you'll do: Implement state-of-the-art open-source models to run natively in the ComfyUI core engine Design and build the native nodes that expose new model capabilities cleanly to users Work directly with our core team on architecting...Senior
$250k - $350k
...getting started. The Role: As a Staff ML Engineer on the Frontier AI team at Ambience,... ..., voice agents, long-context chart understanding, and clinical reasoning. This isn't a... ...contributions to ML libraries, benchmarks, or evaluation frameworks. Why Here: Our...Work at officeImmediate startRemote workFlexible hours3 days per week$210k - $260k
...offers members a unique understanding of their finances and... ...Machine Learning Engineers at Rocket Money further... ...support strategy with ML and AI powered user experiences... ...on end users. At the Staff level, Machine... ..., and maintain robust evaluation frameworks. You ensure...Work at officeLocal area$185.1k - $335.3k
...development, and performance engineering so that every cycle on... ...automated vehicles understand and react to the world... .... The Role As a Staff Compiler Engineer on... ..., and effortless for ML engineers across the... ...in a company vehicle evaluation program, through which...Local areaRemote workWork from homeRelocation packageFlexible hours- Airbnb, Inc. is seeking a Senior Staff Machine Learning Engineer to architect advanced machine learning solutions and lead efforts involving Large Language... ...role. This position offers a chance to drive impactful ML applications, mentor a team of engineers, and enhance guest...SeniorRemote job
- ...most complex and bleeding-edge part of our engine. You'll be working on making AI models run... ...works You think the current state of ML deployment could be way better What you'll... ...here with the title of Member of Technical Staff, it’s long and silly for a job title). The...Senior
$245k - $272k
...and easy to adopt. As a Staff MLE, you'll also shape... ...decisions, and mentor engineers across the... ...high-impact group of ML engineers and platform... ...safety guardrails, and evaluation infrastructure. Collaborate... ...PMs, and Designers to understand their AI needs and deliver...SeniorFull timeWork at officeLocal areaRemote work2 days per week3 days per week$200k - $300k
Senior/Staff Machine Learning Engineer, Agent Simulation Location: San Francisco Bay Area Compensation: $200,000 - 300,000 USD / year About The Role... ..., metrics pipelines Fluency in Python and a basic understanding of C++ Fluency with Numpy and PyTorch, TensorFlow or...SeniorTemporary workRelocation package$227.33k - $312.58k
...We're looking for a Staff ML Data Engineer to join Procore's AI & Frontier Models organization.... ...opportunity to shape how Procore builds, evaluates, and deploys frontier models by... ...or inference workflows. ~ Solid understanding of data modeling, dataset lifecycle management...Work at officeLocal areaImmediate start3 days per week- ...Senior ML/RL Engineer, Behavior Planning At Bot Auto, we are revolutionizing the transportation... ...design robust reward functions and evaluation metrics that balance safety, progress... ...Expertise in Python and PyTorch; strong understanding of modern deep learning architectures...SeniorShift work
$204k - $259k
...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology company... ...the world's most trusted driver. Since its start as the... ...will report to a Senior Staff Software Engineer. You... ...experience Experience in ML engineering and applied...SeniorFull timeTemporary workRemote work$152k - $228k
...Description Job Description Senior ML Engineer About Invoca Invoca... .... You'll be a primary driver of the infrastructure powering... ...— including model evaluation, versioning, and automated... ...product and engineering to understand customer needs and ship ML...SeniorCurrently hiringRemote workFlexible hours$300k - $430k
...team. About the Team The ML Infrastructure team builds... ...infrastructure for model evaluation and experimentation, and the... ...About the Role We're hiring a Staff ML Infrastructure Engineer to own the platforms... ...and optimization Strong understanding of LLM inference: latency...Work at office- Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the Airbnb product. From Trust to Payments, and from Customer Service... ...fine‑tuning and optimization, RAG/Search, LLM evaluation and testing automation, feedback‑based learning...SeniorWork experience placementCasual workLive inWork at officeRemote work
- Arcada Labs Incorporated is seeking an ML Research Engineer in San Francisco to lead evaluations of AI models based on human preferences. You will design experiments and analysis pipelines to enhance our understanding of AI capabilities and contribute to user-facing tools...
$158k - $269k
...positive way. To learn more visit: As a Senior Perception Engineer, you will be at the forefront of... .... You will... - Prototype, evaluate, and iterate on perception... ...traffic agents as well as semantic understanding of various traffic scenes. - Formulate...SeniorFull timeWork at officeWork from homeFlexible hours$240.45k - $300.3k
...Senior Machine Learning Engineer - Model Evaluations, Public Sector The Public Sector ML team at Scale deploys advanced AI systems-including LLMs, agentic models, and multimodal pipelines-into mission-critical government environments. We build evaluation frameworks...SeniorFull time$141k - $228.08k
...Summary We are seeking a Machine Learning Engineer to join our pioneering security team.... ...environments. ~ Proven track record of taking ML projects from initial research/... ...Qualifications Experience with model evaluation, tuning, and handling imbalanced datasets...SeniorFull timeWork at office- ...real human preference and judgment. That lets us evaluate models on what people actually care about, not... ...others. About the Role We’re looking for an ML Research Engineer to help us build better ways to evaluate and understand real AI capabilities. You’ll design and run...
$188.24k - $235.3k
...'s next L4, Machine Learning Engineer, Trust Intelligence Platform... ...operate the cloud-native data and ML infrastructure that powers... ...reproducible ML training, evaluation, and inference workflows using... ...platform (AWS, GCP, or Azure). ~ Understanding of data modeling, distributed...Local areaRemote workWorldwide- ...a seasoned machine learning engineer specializing in AI to join our... ...using LLMs, embeddings and other ML technologies ~ Full... ...environment ~ A strong foundational understanding of machine learning models and practice, including model evaluation and performance ~ Strong...Work at officeRemote work
$215k - $322k
...Join GoFundMe as our next Staff Machine Learning Engineer (Pricing) . In this role,... ...expertise in building production ML systems (data → training →... ..., training, and evaluation. Build low-latency real... ...e.g., Snowflake), with an understanding of event semantics, identity...Full timeTemporary workWork at officeFlexible hours- ...Staff Machine Learning Engineer EvenUp is on a mission to close the justice gap... ...innovation, mentor a top-tier ML team, and set the vision... ...extraction, document structure understanding, and sophisticated... .... Establish rigorous evaluation standards to reduce hallucinations...Full timeTemporary workWork at officeLocal areaHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff ML Engineer (Driver Understanding and Evaluation). Be the first to apply!
Related searches
- assistant engineering manager San Francisco, CA
- staff data engineer San Francisco, CA
- staff design engineer San Francisco, CA
- engineering aide San Francisco, CA
- software engineer staff San Francisco, CA
- assistant chief engineer San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- technology administrator San Francisco, CA
- staff engineer San Francisco, CA
- senior staff engineer San Francisco, CA

