Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Statistical Evaluation and Sampling

$204k - $259k

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.

You will:

  • Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
  • Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
  • Build systems that systematically optimize multiple objectives under resource constraints.
  • Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
  • Champion code health and best practices in a large and complex code base

You have:

  • BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
  • Fluency with probability and statistics
  • Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
  • 5+ years of experience with
    • Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
    • Performing statistical analyses
    • Building data processing pipelines
    • Writing, reviewing, and merging code following industry standards for code health and maintainability

We prefer:

  • 7+ years of industry experience (or 3+ years post-doc experience) in a quantitative engineering role. This includes a proven track record as a technical lead navigating complex, multi-language codebases (C++, Python, SQL) to drive the end-to-end experimental lifecycle: developing hypotheses, designing and executing large-scale experiments, and building robust data pipelines
  • Experience programming in C++
  • Experience developing and evaluating sampling methods
  • Experience designing, training, evaluating, and applying ML models
  • Experience working in the AV industry
  • PhD in a quantitative field

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range $204,000$259,000 USD
Required
Preferred
Job Industries
  • Other
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Statistical Evaluation and Sampling in Mountain View, CA vacancy
  • $204k - $259k

     ...S. states. The Planner Evaluation team works on one of the key...  ...improving the quality of the software that drives the car. We are...  ...experienced data-minded software engineers and data scientists to help...  ...of techniques including statistics, math, physics, algorithms and... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  •  ...About the Organization The Evaluation team builds and evolves the...  ...into clear feedback for engineering and leadership, and help accelerate...  ...autonomous driving software performance atinterfaces across...  ...Propose and develop new statistical and ML methods to quantify performance... 
    Senior
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $136k - $199.2k

    ## Senior Software Engineer, Autonomy EvaluationApplyremote type: Remote/Hybridlocations: Sunnyvale...  ...experiences.**About the Organization**The Evaluation team builds and evolves the...  ...autonomy stack.* Propose and develop new statistical and ML methods to quantify performance... 
    Senior
    Remote work
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $204k - $259k

     ...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:...  ..."real"? We are looking for aSenior Software Engineer to build the metrics and systems that...  ...this hybrid role, you will report to a Senior Staff Software Engineering Manager and... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $238k - $302k

     ...that are core to our autonomous driving software. We help our partners by offering the best...  ...lifecycle, including training and evaluation. They are geared towards both scaling models...  ...autonomous driving. We are looking for engineers with ML system expertise to help us... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $213k - $270k

     ....S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking...  ...of physics, geometry, bayesian statistics, and machine learning ~...  ...software ~ Experience building or evaluating machine learning models in production... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  •  ...Senior Software Engineer (Search / Retrieval) Palo Alto, California About Workato Workato...  ...~ Bachelors/Masters/PhD degree in Statistics, Mathematics or Computer Science, or...  ...tuning ~ Experience with relevance evaluation metrics (NDCG, MRR, MAP) ~ Experience... 
    Senior
    Remote work
    Flexible hours

    Workato

    Palo Alto, CA
    4 days ago
  • $140k - $390k

     ...What to Expect As a Software Engineer on the Autopilot Simulation team, you will play a critical...  ...is tasked with building high-trust in evaluation metrics and a test harness runtime...  ..., including sim-to-real gap, statistical analysis & numerical methods, reporting... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    4 days ago
  • $170k - $216k

     ...that powers the Waymo Driver. Our software allows the Waymo Driver to...  ...set of sensors, enabling software engineers like you to develop multi-modal models...  ...get fast and accurate performance statistics using an automated system Evaluate new hardware specifications and... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $175k - $215k

     ...Waymo Driver. The Simulator Evaluation team faces the ultimate...  ...are looking for aSoftware Engineer to build the metrics and pipelines...  ...role, you will report to Senior Staff Software Engineering Manager and...  ...at the red light?") to the statistical quality of AI-generated traffic... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $117k - $234k

     ...technical and customer-focused Senior Partner Engineer to help external developers...  ...Contribute to sample apps, libraries, documentation...  ...~6+ years of experience in software engineering, partner engineering...  ...product mindset and ability to evaluate tradeoffs between... 
    Senior
    Full time
    Contract work
    Temporary work
    Part time
    Work at office
    Flexible hours

    Walmart

    Sunnyvale, CA
    4 days ago
  •  ...Senior Software Engineer - Performance Prediction Latitude AI develops automated driving technologies...  ...builds the Machine Learning models, evaluation pipelines, and internal tools that...  ..., and analyze results with strong statistical rigor Build internal tools that help... 
    Senior
    Work at office
    Immediate start

    Latitude AI

    Palo Alto, CA
    17 hours ago
  • $213k - $263k

     ...role, you will report to an Engineering Manager. You will: Develop business logic software to evolve driving performance...  ...Develop and implement methods to evaluate and improve Waymo driving...  ...Science, Robotics, Math, Physics, Statistics (or similar technical field... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    17 hours ago
  • $179.2k - $268.8k

     ...Senior Software Engineer - ML Integration Latitude AI develops automated driving technologies,...  ...planning a proper response Measure the statistical properties and quality of predictions...  ...-of-distribution driving events Evaluate and verify the system's performance... 
    Senior
    Permanent employment
    Full time
    Work at office
    Immediate start
    Visa sponsorship

    Latitude AI

    Palo Alto, CA
    1 day ago
  • $213k - $270k

     ...guide fixes of reliability and software integrity issues. We...  ...report to a Staff Software Engineer / Tech Lead Manager. You...  ...issues and their impact on evaluation vs. onroad behavior Automate...  ...Understanding of fundamental statistical concepts and applying them... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $125k - $191.7k

     ...categorized as hybrid/Remote Role: As a Senior Software Systems Engineer on the Software Validation team...  ...for shaping the future of evaluation methodologies for AI systems and other...  ..., systems analysis, data analysis, statistical analysis, or other related fields... 
    Senior
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $117k - $234k

    Senior, Software Engineer (Partner Engineer, Solutions Engineer) Sunnyvale, CA About the Team We are...  ...and roadmap priorities. Contribute to sample apps, libraries, documentation improvements...  ...Strong product mindset and ability to evaluate tradeoffs between engineering needs,... 
    Senior
    Contract work

    Walmart

    Sunnyvale, CA
    17 hours ago
  • $126.7k - $163k

     ...Position Summary The Senior Quality Engineer will incorporate cross...  ...and validation, software and process validations...  ...include establishing statistical confidence by identifying sample size and acceptable error...  ...a timely manner. Evaluate significant product and... 
    Senior
    Contract work
    Work at office
    Flexible hours
    Night shift

    EBR Systems, Inc.

    Sunnyvale, CA
    4 days ago
  • $181.1k - $318.4k

     ...AI/ML - Senior OS Software Engineer, Evaluation For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end... 
    Senior
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $181.1k - $318.4k

     ...AIML - Sr Software Data Engineer, Evaluation Are you excited about using data to shape the experience of products used by hundreds of millions...  ...). ~ MS or BS in Computer Science, Engineering, Math, Statistics, or a related field, or equivalent practical experience... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $183k - $275k

     ...bench‑top systems to evaluate and regression test different...  ...aspects of the software and hardware integration...  ...and much much more. Engineers across the company rely...  ...detection. Statistical Analysis & Experimentation...  ...deliver, and you’ve briefed senior engineering leadership... 
    Senior
    Temporary work

    Icehouseventures

    Mountain View, CA
    4 days ago
  • $262k - $365k

     ...leading technology firm is seeking a Senior Staff Research Engineer to work on cutting-edge AI projects....  ...Responsibilities include developing evaluation frameworks, optimizing data usage,...  ...Candidates should have at least 8 years of software development experience, with strong... 
    Senior
    Full time

    Google Inc.

    Mountain View, CA
    17 hours ago
  • $213k - $263k

     ...states. Our mission within the Driver Understanding and Evaluation (DUE) team at Waymo is to develop rich metrics for...  ...the real world. In this hybrid role, you will report to a Software Engineering Manager. You will: Build the infrastructure to administer... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    17 hours ago
  •  ...AI Platform Engineer This role requires you to be in our San Francisco office (Atherton...  ...is developing models and agents to evaluate, design, and interact with hardware and...  ...EDA, semiconductor, or hardware-adjacent software environments Our AI Bullshit Meter... 
    Senior
    Internship
    Work at office

    Voltai

    Palo Alto, CA
    3 days ago
  • $213k - $263k

     ...accelerating. Our team's job is to ensure that we can continue to evaluate safety and service quality across new cities and countries,...  .... We are seeking an experienced, technically hands-on Senior Software Engineer to design and implement these core authoring APIs. In... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $185k - $230k

     ...Opportunity We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will...  ...most relevant results with the best user experience. Evaluate and optimize algorithm accuracy by focusing on key metrics.... 
    Senior
    Permanent employment

    Otter.ai

    Mountain View, CA
    1 day ago
  • $170k - $220k

     ...Senior Software Engineer We are seeking a senior software engineer to play a pivotal role in advancing our engineering efforts. The ideal...  ...development and execution. You will also aid in defining and evaluating future use cases and help craft a roadmap based on an... 
    Senior

    Autoroboto

    Mountain View, CA
    1 day ago
  • $213k - $263k

     ...Waymo Driver. We focus on transforming the Software Development Life Cycle (SDLC) through...  ...multi-agent frameworks, enabling our engineering teams to build, test, and deploy autonomous...  ...AI Models: Develop data pipelines and evaluation strategies to deploy state-of-the-art... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $160.36k - $240.54k

     ...Infrastructure team and partners deeply across every engineering organization — Autonomy, ML Platform,...  ..., and education. About You Strong software engineering fundamentals in Python or Go...  ...design skills, with the ability to evaluate and influence tradeoffs across cost,... 
    Senior

    Nuro

    Mountain View, CA
    3 days ago
  • $204k - $259k

     ...across 15+ U.S. states. Hardware Engineering is a diverse, innovative, and collaborative...  ...electrical, mechanical, reliability, software and vehicle engineers. We design, build...  ...and maintain tools, pipelines, and evaluation frameworks to rigorously assess positioning... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!