Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist, RL for Autonomous Planning & World Modeling

$204k - $259k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you will report to a Principal Scientist. You will:

  • Participate in Waymo’s Foundation World Model post-training and evaluation
  • Research and develop cutting edge RL and Distillation techniques for
Autonomous Vehicle Trajectory Planning * Integrate emerging research from the broader AI community into Waymo’s internal RL infrastructure, conducting rigorous ablations to identify and scale the most promising methods * Partner with engineering and research teams across Waymo to share recipes, techniques, and post-training best practices to accelerate our collective know-how You have: * PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field; with 3+ years of industry or post-doc research experience in Reinforcement Learning or Foundation Models * Demonstration of original contributions to the field through high-impact publications (ArXiv, peer-reviewed conferences like NeurIPS/ICLR/CVPR), technical blog posts, or significant open-source contributions * Proficiency in implementing model training flows in a scalable, distributed and performant manner such as Data parallel, FSDP and other sharding approaches * A willingness to work with complexity of globally distributed inference infrastructure We prefer: * PhD in Computer Science, Machine Learning, or Robotics, with a research focus on Reinforcement Learning, Foundation Models, or Multi-Modal learning * Extensive experience designing and deploying Reinforcement Learning infrastructure, specifically for on-policy learning or alignment with human preferences * A consistent history of original contributions to the AI community, evidenced by first-author publications at top-tier venues (e.g., NeurIPS, ICLR, ICRA) or maintaining significant open-source ML projects * Experience with large scale (many-machine) training infrastructure and techniques for inference with large models such as model sharding/tensor-parallel In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours
per pay period for the first five years of employment * Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
  • Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year
Please note that Waymo may not be able to employ remotely in all locations. Please speak with your recruiter about your preferred location for remote work when you begin the interview process The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. Salary Range

$204,000—$259,000 USD

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Scientist, RL for Autonomous Planning & World Modeling in San Francisco, CA vacancy
  • $155k - $269k

     ...leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with...  ...efficient simulation. As a Research Scientist in World Models, you will develop algorithms...  ...generative priors for downstream planning, testing, and training.... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    6 days ago
  • $302.4k - $378k

     ...applications, and autonomous vehicles. With our...  ...building upon our prior model evaluation work...  ..., part of Scale's Research organization,...  ...environments and RL reward signals, benchmarking...  ...across real-world scenarios and...  ...in LLM agents and planning algorithms but also... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    14 hours ago
  • $252k - $315k

     ...Machine Learning Research Scientist, Reasoning San Francisco...  ...applications, and autonomous vehicles. With our recent...  ...on our history of model evaluation with enterprise...  ...AI research and real-world implementation, with...  ...of LLMs, planning algorithms, and novel... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  •  ...and exploit probabilistic generative models that exploit to Achira’s foundation...  ...conformational sampling. Why Achira Join a world-class team of researchers, scientists, and engineers unifying...  ...learning / Bayesian optimization or RL‑style acquisition for proposal selection... 
    Suggested

    Achira

    San Francisco, CA
    2 days ago
  • Astera Institute Research Scientist: Energy based models About the Role We are seeking brilliant, unconventional...  ...neuroscience-inspired energy-based world models, with focus on...  ...that allow for parallel distributed planning. Scientific Discovery: Design experiments... 
    Suggested

    Astera Institute

    Emeryville, CA
    3 days ago
  • Pantograph in San Francisco is looking for research scientists who specialize in reinforcement learning and multimodal representation learning...  ...team to advance our goal of making robots learn through real-world exploration. We care more about your skills and contributions... 

    Pantograph

    San Francisco, CA
    1 day ago
  •  ...wrapper around existing models, we’re training our...  ...frontier AI and real-world scientific impact. Xterra...  ...We’re looking for research scientists who want to work at the...  ...language models, but strong RL backgrounds from other...  ...pipelines, search and planning methods, or AI... 

    Xterraai

    San Francisco, CA
    1 day ago
  • $204k - $259k

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its...  ...of the Waymo Applied Research team is to develop machine...  ...applied foundation model research and development...  ..., equity incentive plan, and generous Company... 
    Full time
    Remote work

    SupportFinity™

    San Francisco, CA
    2 days ago
  • $310k

    About the Team The RL and Reasoning team drives the...  ...reinforcement learning research, building next-generation generative models, and deploying them at scale...  ...Engineer/Research Scientist at OpenAI, you will advance...  ...safely deploy them to the world through our products. AI... 
    Work at office
    Relocation package

    Slope

    San Francisco, CA
    3 days ago
  • $60 per hour

     ...leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology...  ...of a team of multidisciplinary Research Scientists and Engineers using an AI-...  ...perception, prediction, motion planning, controls, simulation, mapping... 
    Hourly pay
    Work experience placement
    Internship
    Work at office

    Waabi

    San Francisco, CA
    14 hours ago
  • $104.89k - $179.81k

     ...We are looking for a Research Scientist who will advance how...  ...adapt in the physical world. In our research group...  ...foundation models, robot learning architectures...  ...solve manipulation, planning, and simulation challenges...  ...manipulation and autonomous planning Build full‑... 
    Work at office
    Local area

    Siemens Mobility

    Berkeley, CA
    1 day ago
  • $175k - $275k

     ...reason and act on the world around them. Bringing AI from research in the lab to the...  ...Foundation Model that powers all robotic...  ...sampling, ranking, motion planning, and control. As a Research Scientist at Covariant, you...  ...problems and autonomously carrying out long-running... 
    Flexible hours

    I did my part and supported the Regular Toilet

    Emeryville, CA
    1 day ago
  • $170k - $216k

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its...  .... We conduct our own research to address real-world...  ...data, to (2) develop models and model training at...  ...perception, motion planning, or decision-making systems... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    6 hours ago
  • $175k - $215k

    Waymo is an autonomous driving technology company with...  ...the mission to be the world's most trusted driver....  ...states. The Predictive Planning team (PrePlan)...  ...neural networks. These models enable the autonomous...  ...to bring cutting-edge research into production * Partner... 
    Full time
    Internship
    Remote work

    Waymo

    San Francisco, CA
    6 hours ago
  • $160k - $210k

     ...build the best robots in the world, and use them to make the...  ...manufacturing. We\'re looking for a Research Scientist specializing in robotic...  ...-language-action (VLA) models High proficiency with Python...  ...cover letter. Experience with planning algorithms (A, RRT, PRM, etc... 
    Work experience placement
    Work at office
    Worldwide
    Flexible hours

    Multiply Labs

    San Francisco, CA
    1 day ago
  • $268k - $384k

     ...Senior / Principal ML Scientist, Foundation Models for Life Sciences San Francisco, CA USA Your...  ...(LSAI), the Foundation Models team researches and develops large-scale generative...  ...executes the entire scientific method autonomously, accelerating discovery at unprecedented... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    1 day ago
  •  ...Cruise, and Pixar. The best in the world, building something the world...  ...unified multimodal foundation model, from pretraining to...  ...hardware. This is foundational research with direct physical impact. No...  ...pretraining, post-training, and RL at scale Comfort owning very... 

    Prime Recruitment Partners

    San Francisco, CA
    2 days ago
  •  ...Technical Staff - Research Scientist Patronus AI is a frontier...  ...all of the world’s intelligence. We...  ...foundation model labs and Fortune 5...  ...This is a highly autonomous role. You will tackle...  ...methods for efficient RL. Develop state-of...  ...vision insurance plans 401(k) plan + matching... 

    Patronus AI, Inc.

    San Francisco, CA
    2 days ago
  • $45 - $65 per hour

     ...Kelly® Science & Clinical is seeking a Scientist, iPSC Models for a contract-to-hire opportunity...  ...Significant experience with human stem cell research and stem cell culture techniques....  ...accelerate your biotech career in one of the world’s leading innovation hubs? Apply today... 
    Hourly pay
    Contract work

    Kelly

    San Francisco, CA
    2 days ago
  •  ...architect AI that learns from and interacts with the world like humans do. We're pioneering the model architectures that will make this possible. Our...  ...experts in AI. Your Impact Conduct groundbreaking research in neural network architecture design to advance the... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia AI, Inc.

    San Francisco, CA
    4 hours ago
  • A cutting-edge robotic systems company is seeking an AI Researcher to design and build models for robotic arms. This in-person position will involve training...  ...to hardware, and working closely with a team on real-world applications. Candidates should have experience in... 

    Droyd

    San Francisco, CA
    4 days ago
  • $150k - $230k

    EliseAI in San Francisco is seeking a junior research scientist to engage in groundbreaking research on machine learning and large language models. This position requires a Ph.D. in a quantitative field and offers responsibilities such as developing ML architectures and... 

    EliseAI

    San Francisco, CA
    4 days ago
  •  ...learn through exploration in the real world. We're looking for research scientists with strong foundations in...  ...representation learning, or large-scale model training. Qualifications: You've worked...  ..., goal-conditioned, or unsupervised RL Large-scale pretraining (language, multimodal... 

    Pantograph

    San Francisco, CA
    2 days ago
  • $250k

     ...frontier AI labs use to make their models better. We work with the world's leading labs to design high signal...  ...and measured. Working directly with research teams at top AI labs, you’ll experiment...  ...they’ve worked for/interned for any RL environment companies in the past or... 

    AfterQuery

    San Francisco, CA
    2 days ago
  •  ...AI is a non-profit AI research institute dedicated to...  ...evaluations of frontier models (e.g. Claude 4 Opus,...  ...understanding learned planning in SokoBan and interpretable...  ...overlap between scientist and engineer roles. As...  ...existing infrastructure and world-class team. You will... 
    Full time
    Remote work
    Visa sponsorship

    Aisafety

    Berkeley, CA
    1 day ago
  • $175k - $350k

    I did my part and supported the Regular Toilet is looking for a talented researcher in San Francisco to contribute to large-scale machine learning models. In this role, you will tackle fundamental research challenges and push the boundaries of model capabilities. The ideal... 

    I did my part and supported the Regular Toilet

    San Francisco, CA
    1 day ago
  •  ...mission‑critical inference for the world's most dynamic AI companies,...  ...Writer. By uniting applied AI research, flexible infrastructure, and...  ...of AI to bring cutting‑edge models into production. We're growing...  ...g., both interpretability and RL, or both systems and training... 
    Immediate start
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...internally and externally with other researchers, and be supported by a team of...  ...areas of interest: Unsupervised RL Self-supervised learning Multi-task...  ...goals and safely work in the real world. Imbue trains its own foundation models optimized for reasoning and... 

    Stars Arena

    San Francisco, CA
    4 days ago
  • $131k - $180.4k

    Machine Learning Scientist, Foundation Virtual Staining Models (Computational Microscopy - Biohub...  ...an independent nonprofit research institute that brings...  ...Francisco initially, with a planned transition to Redwood City...  ...to learn from the world’s leading scientists. Equal... 
    Flexible hours

    Second Renaissance

    San Francisco, CA
    4 days ago
  • $114.2k - $306.6k

     ...duplicating efforts.*Salesforce Research advances state-of-the-...  ..., developing models and prototypes that...  ...Salesforce. We tackle real-world problems in areas such...  ...AI Research Scientists / Research Engineers.*...  ...reinforcement learning, and autonomous workflows.* **Multimodal... 
    Full time

    Niebles

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist, RL for Autonomous Planning & World Modeling. Be the first to apply!