Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist, RL for Autonomous Planning & World Modeling

$204k - $259k

CapitalG

Waymo AI Foundations Team

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation.

In this hybrid role, you will report to a Principal Scientist.

You will:

  • Participate in Waymo's Foundation World Model post-training and evaluation
  • Research and develop cutting edge RL and Distillation techniques for Autonomous Vehicle Trajectory Planning
  • Integrate emerging research from the broader AI community into Waymo's internal RL infrastructure, conducting rigorous ablations to identify and scale the most promising methods
  • Partner with engineering and research teams across Waymo to share recipes, techniques, and post-training best practices to accelerate our collective know-how

You have:

  • PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field; with 3+ years of industry or post-doc research experience in Reinforcement Learning or Foundation Models
  • Demonstration of original contributions to the field through high-impact publications (ArXiv, peer-reviewed conferences like NeurIPS/ICLR/CVPR), technical blog posts, or significant open-source contributions
  • Proficiency in implementing model training flows in a scalable, distributed and performant manner such as Data parallel, FSDP and other sharding approaches
  • A willingness to work with complexity of globally distributed inference infrastructure

We prefer:

  • PhD in Computer Science, Machine Learning, or Robotics, with a research focus on Reinforcement Learning, Foundation Models, or Multi-Modal learning
  • Extensive experience designing and deploying Reinforcement Learning infrastructure, specifically for on-policy learning or alignment with human preferences
  • A consistent history of original contributions to the AI community, evidenced by first-author publications at top-tier venues (e.g., NeurIPS, ICLR, ICRA) or maintaining significant open-source ML projects
  • Experience with large scale (many-machine) training infrastructure and techniques for inference with large models such as model sharding/tensor-parallel

In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:

  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
  • Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
  • Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year

Please note that Waymo may not be able to employ remotely in all locations. Please speak with your recruiter about your preferred location for remote work when you begin the interview process

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range $204,000—$259,000 USD

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Research Scientist, RL for Autonomous Planning & World Modeling in San Francisco, CA vacancy
  • $155k - $269k

     ...leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with...  ...efficient simulation. As a Research Scientist in World Models, you will develop algorithms...  ...generative priors for downstream planning, testing, and training.... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    17 days ago
  • $117.2k - $313.7k

     ...way of life. The world of work as we...  ...Salesforce AI Research is a global leader...  ...large language models including CodeGen...  ...enterprises reason, plan, and act....  ...entrepreneurial Research Scientists who want to...  ...reinforcement learning (RL), reasoning and planning, autonomous workflows,... 
    Suggested
    Full time
    Worldwide

    Salesforce

    San Francisco, CA
    1 day ago
  • $213k - $263k

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its...  ...collaborations with other research teams in Alphabet. AI...  ..., generative modeling, Bayesian inference, hierarchical...  ..., equity incentive plan, and generous Company... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  •  ...platform built for the world's most ambitious...  .... With WRITER, autonomous agents work across...  ...the role AI research at WRITER isn't just...  ...As an AI research scientist, you'll be at the...  ...on large language models, agentic reasoning...  ...on post-training, planning, multi-step reasoning... 
    Suggested
    Full time
    Local area
    Flexible hours

    Writer Corporation

    San Francisco, CA
    1 day ago
  • $200k - $300k

     ...learned manipulation policies for real-world deployment. They’re hiring a research scientist to own their offline reinforcement...  ...team and lead the offline RL direction end to end. Some problems...  ...Background in video or image generative models Research internships at strong... 
    Suggested
    Internship
    H1b
    Remote work
    Visa sponsorship
    Relocation package

    Brahma Consulting Group

    San Francisco, CA
    7 days ago
  • $175k - $265k

     ...Applied Researcher New York City / San Francisco Today...  ...short in many real world domains. Haize Labs...  ...into environments, 2) RL on these environments,...  ...environment design, reward modeling), engineering (building...  ...customer management (scoping, planning, relationship-building)... 
    Visa sponsorship

    Haize Labs

    San Francisco, CA
    1 day ago
  • $158k - $269k

     ...Physical AI. With a world-class team, we're unlocking...  ...the next era of autonomous transportation with technology...  ...platform. As a Research Scientist on the Behaviors team...  ...next generation of models and algorithms that...  ..., foundation models, planning and search, and other... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    19 days ago
  •  ...game. We also happen to be the world's leading generative AI studio...  ...with some of the best AI researchers and engineers in the world in...  ...best image and video generation model teams in the world on data collection...  ...DevelopmentOr, putting it in RL jargon, exploration and... 
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    2 days ago
  •  ...intelligence for the physical world and make it useful to...  ...embodied foundation models, starting with a focus...  ...its DNA. Our team of researchers, roboticists, and company...  ...the foundations of autonomous driving, built next-generation...  ...as imitation learning, RL, distillation,... 

    Generalist AI Inc.

    San Francisco, CA
    2 days ago
  • $192.2k - $260k

     ...Sr. Applied Scientist Amazon is seeking an...  ...challenging real-world environments. At Amazon...  .... You will lead research that translates...  ...define the future of autonomous robotics at scale....  ...deep learning models for object detection...  ...Hardware, Navigation, Planning, and Controls... 
    Local area
    Flexible hours
    Night shift

    Amazon Technologies, Inc.

    San Francisco, CA
    2 days ago
  •  ...client. Lead applied machine learning research projects from initial idea through model training, testing and production...  ...techniques.Investigate how autonomous software agents can stay effective on extended tasks, including planning, retaining context, recovering from... 
    Shift work

    Raydar Inc

    San Francisco, CA
    2 days ago
  •  ...committed to fostering its own research and development...  ...smart electric vehicle models under the NIO brand, two...  ..., and physical world understanding. This role...  ...—including perception, planning, and control. Develop and...  ...control, or model-based RL. Passion for applying AI... 
    Worldwide

    NIO

    San Francisco, CA
    2 days ago
  • $251k - $310k

     ...Waymo is an autonomous driving technology company...  ...mission to be the world's most trusted...  ...collaborations with other research teams in Alphabet....  ..., generative modeling, Bayesian...  ...optimizations and RL recipes (preferences...  ...equity incentive plan, and generous Company... 
    Full time
    Temporary work
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  • $64 - $68 per hour

     ...is seeking an Applied Scientist intern to develop next...  ...engineering, agent-based modeling, machine learning, and...  ...applications to real-world rider products. The...  ...evaluation pipelines Prior research experience with LLM...  ..., tool use, memory, planning, or coordination in... 
    Summer work
    Internship
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    1 day ago
  •  ...Research Scientist — Vision-Language-Action Models(VLA 研究) 募集概要 Highlanders は、ヒューマノイドロボットと、フィジカルAI(現実の世界で体を動かすAI)の基盤モデル、そしてその学習データを生み出すロボットの群れを、一つの流れとして開発しています。実機が現場で働くほどデータが集まり、モデルが賢くなり、ロボットがさらに働けるようになる。このデータの循環を、日本の工場の現場とサンフランシスコの両方から回しています。 映像と言葉から、ロボットの次の動作... 

    株式会社Highlanders

    San Francisco, CA
    1 day ago
  • $300k - $320k

     ...Research Scientist, Life Sciences San Francisco, CA About Anthropic...  ...Anthropic. Our team is building a world-class research group focused...  ...biology — you'll directly improve model capabilities on scientific...  ..., evaluation design, and RL environment development. As... 
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    4 days ago
  •  ...Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small...  .... As a Research Scientist you work on the problems...  ..., post-training, or RL. Experience at proprietary...  ...remotely across the world, with the main teams... 
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Pluralis

    San Francisco, CA
    4 days ago
  •  ...AfterQuery AfterQuery is an applied research lab curating data solutions for foundation model development. We serve every...  ...Morgan Stanley - work alongside world-class engineers and researchers....  ...behavior. This includes SFT and RL-based post-training, where you'll... 
    Local area
    Shift work

    AfterQuery

    San Francisco, CA
    2 days ago
  • $250k

     ...accelerate cancer research, improve construction...  ..., digitize floor plans, preserve coral reef...  ...needed to make the world programmable with artificial...  ...train our own open models (RF-DETR). We build...  ...As a Research Scientist at Roboflow Labs,...  ..., evaluations, and RL environments that... 
    Work at office

    Roboflow, Inc

    San Francisco, CA
    2 days ago
  • $158k - $269k

     ...Research Scientist Opportunity At WaabiWaabi, founded by AI visionary Raquel Urtasun...  ...leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology...  ...scenario generation, behavior modeling, mapping, localization,... 
    Full time
    Work experience placement
    Internship
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    2 days ago
  •  ...Pantograph is training general models that start by watching...  ...methods across video games, real-world video, and our own fleet of affordable...  ...robots. We're looking for research scientists who want to scale simple...  ...conditioned, or unsupervised RL Robotics models,... 

    Pantograph

    San Francisco, CA
    5 days ago
  •  ...idler is a frontier data research lab. We build the evals...  ...environments that the world’s leading frontier labs...  ...and train their models. We closed on a multimillion...  ...the role As a Research Scientist at idler, you’ll own measuring...  ...of experience doing RL in production at a... 
    Contract work
    Work at office
    Relocation package

    Idl Experts

    San Francisco, CA
    2 days ago
  • $100k - $300k

     ...Skild AI, we are building the world's first general purpose...  ...Overview We are looking for Research Scientists to lead the effort in developing...  ...general-purpose robot foundation models. Conduct cutting edge...  ...disciplines (Perception, Robotics, RL / IL, Machine Learning, etc.)... 

    Skild AI

    San Francisco, CA
    5 days ago
  •  ...AI is a non-profit AI research institute dedicated to...  ...evaluations of frontier models (e.g. Claude 4 Opus,...  ...understanding learned planning in SokoBan and interpretable...  ...overlap between scientist and engineer roles. As...  ...existing infrastructure and world-class team. You will... 
    Full time
    Remote work
    Visa sponsorship

    Aisafety

    Berkeley, CA
    2 days ago
  • $200k - $335k

     ...The RoleAs a research scientist, you will design, implement, and optimize the...  ...possible, training state-of-the-art models for our enterprise partners....  ...with researchers to make our RL stack reliable, fast, and...  ...and complex systems to real-world problems. Our team genuinely... 
    Full time
    Work at office
    Relocation
    Visa sponsorship

    Applied Compute

    San Francisco, CA
    1 day ago
  •  ...Research Scientist Opportunity At ATGYou'll drive original research at the boundaries...  ...of AI, working on new models, algorithms, and...  ...your ideas deployed in real-world settings.Formulate and explore...  ...expertise in at least one of: LLMs, RL, agent-based systems, generative... 

    ATG intelligence

    San Francisco, CA
    1 day ago
  •  ...Role As a Research Scientist working at OpenEvidence, you will push the...  ...boundaries of what modern models are capable of, bringing a research...  ...medical AI platform in the world. In just over a year, our...  ...small group of exceptional, autonomous builders, organized along... 
    Full time

    OpenEvidence

    San Francisco, CA
    4 days ago
  •  ...architect AI that learns from and interacts with the world like humans do. We're pioneering the model architectures that will make this possible. Our...  ...experts in AI. Your Impact Conduct groundbreaking research in neural network architecture design to advance the... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    4 days ago
  • $160k - $210k

     ...The Mission: Build the world’s best robots to make life-saving...  .... We're looking for a Research Scientist specializing in robotic manipulation...  ...-language-action (VLA) models ~ High proficiency with Python...  .... Experience with planning algorithms (A, RRT, PRM, etc... 
    Work experience placement
    H1b
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours
    Shift work

    Multiply Labs

    San Francisco, CA
    29 days ago
  •  ...Research Engineer / Research Scientist, RL Frontiers Location: San Francisco, CA | New York City, NY | Seattle...  ...to reason, write code, and act autonomously over long horizons. The RL Scaling...  ...stability, and learning efficiency as models get larger, episodes get longer,... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist, RL for Autonomous Planning & World Modeling. Be the first to apply!