Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Statistical Evaluation and Sampling

$204k - $259k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.

You will:

  • Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
  • Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
  • Build systems that systematically optimize multiple objectives under resource constraints.
  • Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
  • Champion code health and best practices in a large and complex code base

You have:

  • BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
  • Fluency with probability and statistics
  • Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
  • 5+ years of experience with
    • Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
    • Performing statistical analyses
    • Building data processing pipelines
    • Writing, reviewing, and merging code following industry standards for code health and maintainability

We prefer:

  • 7+ years of industry experience (or 3+ years post-doc experience) in a quantitative engineering role. This includes a proven track record as a technical lead navigating complex, multi-language codebases (C++, Python, SQL) to drive the end-to-end experimental lifecycle: developing hypotheses, designing and executing large-scale experiments, and building robust data pipelines
  • Experience programming in C++
  • Experience developing and evaluating sampling methods
  • Experience designing, training, evaluating, and applying ML models
  • Experience working in the AV industry
  • PhD in a quantitative field

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$204,000—$259,000 USD

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Statistical Evaluation and Sampling in San Francisco, CA vacancy
  • $204k - $259k

     ...Senior Software Engineer, Quantitative Evaluations Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver...  ...Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning.... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    5 days ago
  • Waymo is seeking experienced data-minded software engineers for the Planner Evaluation team to measure and improve the Onboard software stack. You will...  ...industry experience with C++, Python, and SQL, plus strong data fluency and statistics experience. #J-18808-Ljbffr Waymo
    Senior

    Waymo

    San Francisco, CA
    3 days ago
  •  ...Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology...  ...development of the systems we use to evaluate the quality of our AI models and...  ...robust iteration Work with a small, senior team of engineers and researchers to combine... 
    Senior
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    9 hours ago
  • $281k - $356k

     ...that we can continue to evaluate safety and service...  ...technically hands‑on engineering manager with strong quantitative...  ...tools for mining and sampling data. In this hybrid...  ...you will report to a Senior Staff manager. You...  ...skills Familiarity with statistical methods including... 
    Senior
    Full time
    Work experience placement
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  • $213k - $270k

     ...U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking...  ...of physics, geometry, bayesian statistics, and machine learning ~...  ...software ~ Experience building or evaluating machine learning models in production... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    9 hours ago
  • $175k - $215k

     ...Waymo Driver. The Simulator Evaluation team faces the ultimate...  ...real"? We are looking for a Software Engineer to build the metrics and pipelines...  ...role, you will report to Senior Staff Software Engineering...  ...at the red light?") to the statistical quality of AI-generated... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    9 hours ago
  •  ...lab researchers to create evaluations, publish benchmarks, and push...  ...Work together with engineers, scientists, operators, and...  ...About the Role As a Senior Software Engineer on the Growth team...  ...flagging, A/B testing frameworks, statistical significance tooling) ~ A... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    3 days ago
  • $142.5k - $264.7k

     ...science, biology, and engineering to build innovative analytical...  ...Bioinformatics Software Engineer with expert...  ...genomics data. You will evaluate, refine, and...  ...with major tools and statistical methods used during the...  ...Access to large data sets, samples and compute resources.... 
    Senior
    Full time
    Local area
    Worldwide
    Relocation package
    3 days per week

    Genentech

    South San Francisco, CA
    4 days ago
  • $162.8k - $203.5k

     ...Our highly motivated Machine Learning Engineers work on these challenging problems and...  ...both new and existing problems Develop statistical, machine learning, or optimization...  ...launch machine learning models at scale Evaluate machine learning systems against business... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    9 hours ago
  • $162.8k - $203.5k

     ...our efforts, we are hiring a Senior ML Engineer who will work end-to-end on...  ...for someone who values software engineering best practices,...  ...existing problems Develop statistical, machine learning, or optimization...  ...models at scale Evaluate machine learning systems against... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    9 hours ago
  •  ...are a small, interdisciplinary team - engineers, data scientists, designers, product managers...  ...is safe and working. You'll own the evaluation system for the team building the coach:...  ...more effective Enough fluency in statistics and experimental design to partner with... 

    Nuna

    San Francisco, CA
    8 days ago
  • $230k - $265k

     ...About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team...  ...for model experimentation, training, evaluation, inference, and retraining that power...  ...of ML fundamentals—probability & statistics, supervised vs. unsupervised learning,... 
    Senior
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    9 hours ago
  • $210.8k - $272.8k

     ...team at Thumbtack is focused on making engineering fast, reliable, and delightful. We tackle...  ...important and complex challenges in modern software development. We’re introducing GenAI...  ...cutting-edge technologies in the industry, evaluate relevance to Thumbtack, and drive... 
    Senior
    Full time
    Part time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    9 hours ago
  • $188k - $235k

     ...provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product...  ...candidate will have a strong understanding of software engineering principles and practices, as well as... 
    Senior
    Full time
    Shift work

    Scale Ai

    San Francisco, CA
    9 hours ago
  • $180k - $210k

     ...and innovative problem-solving. BitGo is looking for a Senior Software Engineer to join our Access & Notifications team and help us build an...  ...correct bottlenecks and fix bugs Continuously discover, evaluate, and implement new technologies to maximize development efficiency... 
    Senior
    Full time
    Work at office
    Worldwide

    Bitgo

    San Francisco, CA
    9 hours ago
  • $144k - $180k

     ...modal perceptionBuild and maintain radar data collection, labeling, and evaluation pipelinesArchitect a deterministic secondary perception system with radar as a primary modalityMentor junior engineers on radar perception best practicesYou haveBachelor's or Master's... 
    Senior

    AeroVect

    San Francisco, CA
    9 hours ago
  • $188k - $235k

     ...AGI), and building upon our prior model evaluation work with enterprise customers and governments...  ...and private evaluations. About Data Engine Our Generative AI Data Engine powers...  ...that the transition from traditional software to AI is one of the most important... 
    Senior
    Full time
    Shift work

    Scale Ai

    San Francisco, CA
    1 day ago
  • Capital One in San Francisco, CA is seeking a Senior Lead AI Engineer to architect, build, and scale AI-powered solutions across platforms....  ...to deliver production-grade ML components, including model evaluation, governance, and observability. The role emphasizes strong... 
    Senior

    Capital One

    San Francisco, CA
    2 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (SDK’s: Gen AI Evaluation and MCP) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...One. Design, develop, test, deploy, and support AI software components including foundation model training, large... 
    Senior
    Full time
    Part time

    Capital One

    San Francisco, CA
    1 day ago
  • $170k - $240k

    Senior Software Engineer - Observability and ReliabilityAbout the RoleWe are growing the engineering team and looking for engineers who have...  ...site, Sigma processes your personal data for the purposes of evaluating your candidacy for employment at Sigma and as otherwise... 
    Senior
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    4 days ago
  • $148.5k - $223.9k

     ...of Salesforce.The Agentforce Engines & Experiences team is at the...  ...agents are built and run. As a Senior Member of Technical Staff,...  ...field.* 5+ years of professional software engineering experience, with...  ...our recruiters assess and evaluate candidates’ resumes and qualifications... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  • $170k - $216k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    9 hours ago
  • $117.2k - $223.9k

     ...integrations)Familiarity with Salesforce Einstein or similar AI platforms and their application to Service Cloud Voice workflowsAbility to evaluate and implement AI-based quality monitoring tools for real-time call analysisExperience using AI/ML models or data-driven approaches... 
    Senior
    Full time
    Flexible hours

    Salesforce

    San Francisco, CA
    9 hours ago
  •  ...worldwide. This position plays a key engineering role in realizing Heartflow’s vision of...  ...platform to manage heart disease. As a Senior Software Engineer, you will help design and...  ...technical debates.Innovation: Pragmatically evaluating and applying state-of-the-art... 
    Senior
    Work experience placement
    Local area
    Worldwide
    Relocation

    HeartFlow

    San Francisco, CA
    4 days ago
  • $216k - $270k

    Software is eating the world, but AI is eating software. We live in unprecedented times -...  ...pre-training, fine-tuning, and production evaluations. This is the main innovation that’s...  ...products include the Generative AI Data Engine, SGP, Donovan, and others that power the... 
    Senior
    Full time
    Live in

    Scale AI

    San Francisco, CA
    9 hours ago
  • $185k - $200k

     ...building and scaling payroll businesses.Engineering Culture at CheckAt Check, engineering...  ...is stuck.About this roleAs a Senior Software Engineer at Check, you’ll use your technical...  ...documenting clear, critical thinking and evaluating options.Grow your team by building... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours
    Night shift

    Check Technologies

    San Francisco, CA
    9 hours ago
  • $172.43k - $209k

     ...charged with fueling the future of Crusoe’s engineering muscle. We’re responsible for critical...  ..., safely, and efficiently. As a Senior Software Engineer you will contribute to large...  ...teamsTechnical Decision-Making: Expert ability to evaluate technical tradeoffs and understand how... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area

    Crusoe

    San Francisco, CA
    1 day ago
  • $216k - $270k

    Scale AI is hiring a highly skilled Senior Software Engineer to help design, build, and operate secure, scalable infrastructure that empowers...  ...the same role. This allows us to ensure a fair and thorough evaluation of all applicants.About Us:At Scale, our mission is to... 
    Senior
    Full time
    Work experience placement

    Scale AI

    San Francisco, CA
    4 days ago
  • $139k - $257.55k

     ...applications. Our mission is to enable Adobe engineers to build high-performance, scalable,...  ..., and creatively.We are looking for a Senior Software Engineer who is passionate about...  ...systems, AI orchestration frameworks, evaluation methodologies, and techniques for improving... 
    Senior
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe Systems

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...help shape a brighter way forward. About the RoleAs a Staff Software Engineer on the MarTech Engineering Team, you'll be a forward deployed...  ...rather than speculative onesOwn reliability, observability, evaluation, and cost efficiency of LLM-powered workflows in production... 
    Senior
    Full time
    Local area
    Remote work

    Jones Lang LaSalle

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!