Senior Software Engineer, Statistical Evaluation and Sampling
$204k - $259kWaymo
Overview
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.
Responsibilities
- You will:
- Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
- Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
- Build systems that systematically optimize multiple objectives under resource constraints.
- Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
- Champion code health and best practices in a large and complex code base
Qualifications
- You have:
- BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
- Fluency with probability and statistics
- Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
- 5+ years of experience with
- Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
- Performing statistical analyses
- Building data processing pipelines
- Writing, reviewing, and merging code following industry standards for code health and maintainability
We prefer
- 7+ years of industry experience (or 3+ years post-doc experience) in a quantitative engineering role. This includes a proven track record as a technical lead navigating complex, multi-language codebases (C++, Python, SQL) to drive the end-to-end experimental lifecycle: developing hypotheses, designing and executing large-scale experiments, and building robust data pipelines
- Experience programming in C++
- Experience developing and evaluating sampling methods
- Experience designing, training, evaluating, and applying ML models
- Experience working in the AV industry
- PhD in a quantitative field
Compensation and Benefits
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$204,000 — $259,000 USD
#J-18808-Ljbffr- ...company based in California seeks an experienced engineer to develop importance sampling techniques for evaluation pipelines. You will collaborate with teams to... ...quantitative field is preferred, along with skills in statistical analysis and building data processing pipelines....Senior
$144.7k - $221.4k
...About the Organization The Evaluation team builds and evolves the... ...results into clear feedback for engineering and leadership, and help... ...introspect autonomous driving software performance at interfaces across... .... Propose and develop new statistical and ML methods to quantify...SeniorFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$204k - $259k
...Senior Software Engineer, Quantitative EvaluationsWaymo is an autonomous driving technology company... ...simulation across 15+ U.S. states.The Planner Evaluation team works on one of the key... ...using a range of techniques including statistics, math, physics, algorithms and...SeniorFull timeRemote work$204k - $259k
...Waymo is seeking experienced data-minded software engineers to join the Planner Evaluation team. This role focuses on measuring and improving onboard software... ...complex data to deliver evaluation products, using statistical and machine learning techniques, while collaborating...Senior- ...About the Organization: The Evaluation team builds and evolves the... ...clear, explainable insights to engineering and leadership, including... ...code reviews, and by following software-engineering best practices.... ...large-scale datasets and statistical methods. ProficiencywithPandas...SeniorLocal areaWork from home
$129.4k - $198.4k
...experiences. About the Organization:The Evaluation team builds and evolves the evaluation... ...simulation tests used for autonomous vehicle software validation. Develop and maintain GM’s... ..., and interpretable insights to engineering teams and leadership, including trend analysis...SeniorFull timeLocal areaRemote workWork from homeFlexible hours$152k - $241.5k
...can make a lasting impact on the world.We are seeking a Software Engineer - Scientific Evaluation to own a shared platform for classical testing,... ...GPU or multi-node systems, CUDA software development, statistical benchmarking, and Nsight profiling can also distinguish...SeniorFull time$281k - $356k
...that we can continue to evaluate safety and service... ...technically hands‑on engineering manager with strong quantitative... ...tools for mining and sampling data. In this hybrid... ...you will report to a Senior Staff manager. You... ...skills Familiarity with statistical methods including...SeniorFull timeWork experience placementRemote work$184k - $287.5k
...Autonomous Vehicles.We are looking for an experienced engineer to join our Planning and Control team to work on metrics and evaluation. In this role you will enable rapid planner... ..., and evaluation of our Autonomous Vehicle software.Build compelling, data driven evaluation...SeniorFull timeRemote work$224k - $356.5k
...the future of autonomous driving, and evaluation is how we know the drive is getting better... ...AI drivers!We are looking for a senior engineer to own the engine that makes it all trustworthy... ...experience).12+ years building software, with significant time in autonomous vehicles...SeniorFull timeRemote work$190k - $260k
...its commercial self-driving software to develop, test and deploy... ...recruiting an experienced Software Engineer who is passionate about... ...vehiclesStrength in statistical analysis and evaluationFamiliarity... ...applications. As part of the evaluation process, we provide Endorsed...SeniorTemporary workWork at officeVisa sponsorshipShift work$174k - $252k
...innovations.Design, run, and evaluate experiments for training... ...scalable.Work across research and engineering teams to build ML signals,... ...5 years of experience with software development in one or more programming... ...with data analysis, statistical modeling, and translating...Senior$117k - $234k
...technical and customer-focused Senior Partner Engineer to help external developers... ...priorities Contribute to sample apps, libraries,... ...6+ years of experience in software engineering, partner engineering... ...product mindset and ability to evaluate tradeoffs between engineering...SeniorFull timeContract workTemporary workPart timeWork at officeFlexible hours$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars...SeniorFull time- ...Responsibilities We are looking for an exceptional Senior Software Engineer ( Search / Retrieval ) to join our... ...~ Bachelors/Masters/PhD degree in Statistics, Mathematics or Computer Science, or... ...tuning ~ Experience with relevance evaluation metrics (NDCG, MRR, MAP) ~...SeniorRemote workFlexible hours
$183k - $275k
...bench-top systems to evaluate and regression test different... ...aspects of the software and hardware integration... ..., and much much more.Engineers across the company rely... ...regression detection.Statistical Analysis & Experimentation... ..., and you've briefed senior engineering leadership...SeniorTemporary workImmediate startFlexible hours$190k - $260k
...its commercial self-driving software to develop, test and deploy... ...recruiting an experienced Software Engineer who is passionate about... ...real-world performance Evaluate controller performance across... ...autonomous vehicles Strength in statistical analysis and evaluation...SeniorTemporary workWork at officeVisa sponsorshipFlexible hoursShift work- ...NVIDIA seeks a Software Engineer - Scientific Evaluation to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, and Python ecosystems. You will design infrastructure and indicators to deliver reproducible results, manage GPU resources...Senior
- ...NVIDIA is seeking a Software Engineer - Scientific Evaluation to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, Python, and PyTorch ecosystems. You will shape the architecture and deliver scalable infrastructure for reproducible...Senior
- ...NVIDIA is seeking a Senior Software Engineer - Scientific Evaluation (Finance) to own a shared platform for testing, benchmarking, and agentic evaluation across CUDA, C++, Python, and PyTorch ecosystems. The role covers production software engineering, rigorous measurement...Senior
- ...ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for multi-turn agent scenarios, implement calibration against human labels, and drive scalable...Senior
$160.36k - $291.15k
...leading investors. About the Role As a Senior Software Engineer, Collision Avoidance Testing, you... ...closely with the onboard autonomy, evaluation infrastructure, data science, operations... ...from naturalistic data, develop statistical models that drive strategic decisions...SeniorWork experience placementImmediate startFlexible hours- ...Moveworks is seeking a Senior Software Engineer to own the judgment layer of the Agent Eval Platform. You will design scoring, calibration, and validation for multi-step agent trajectories in enterprise environments. You will build orchestration at scale, enhance observability...Senior
$204k - $259k
...Responsibilities Develop business logic software to evolve driving... ...and implement methods to evaluate and improve Waymo driving... ...Science, Robotics, Math, Physics, Statistics (or similar technical field... ...~6+ years of Software Engineering experience in Python or C++...SeniorFull timeRemote work$161.3k - $274.2k
...workflow automation with Moveworks’ Reasoning Engine and natural language capabilities, we... ...build the judgement layer of our agent evaluation platform: the rubrics, the judges, the... ...: high-volume ingest, schema evolution, sampling and retention trade-offsgRPC/protobuf service...SeniorContract workWork at officeRemote workFlexible hours$185k - $230k
...OpportunityWe're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will... ...the most relevant results with the best user experience.Evaluate and optimize algorithm accuracy by focusing on key metrics....SeniorPermanent employment$148k - $226.2k
...Simulation group is solving one of self-driving’s most difficult problems: evaluating the performance of the autonomous driving software stack before it reaches public roads.As a software engineer on the SimCore team, you will drive the development of our simulation...SeniorFull timeLocal areaRemote workWork from home$221.35k - $253k
...establish and maintain best practices in software development; andDrive the short-term... ...Bachelor’s degree in Computer Science, Engineering, Computer Information Systems, Mathematics... ...development for model deployment, evaluation, and optimization; Reinforcement learning...SeniorFull timeTemporary workWork at office- ...Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distributed... ...Electrical Engineering, Mathematics, Statistics, or a related technical field. ~3+... ...Build robust tools, data pipelines, evaluation frameworks, and deployment systems....Senior
$193.93k - $291.15k
...investors.About the RoleWe’re looking for an Autonomy Engineer focused on onboard autonomy—the software that runs on the robot/vehicle/embedded computer and... ...with local planners (trajectory rollout, MPC, sampling-based methods) and real-time control loops.Sensor fusion...SeniorLocal areaImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!
- senior robotics software engineer Mountain View, CA
- software system engineer Mountain View, CA
- intel software engineer Mountain View, CA
- software developer fintech Mountain View, CA
- new graduate software engineer Mountain View, CA
- software development engineer aws Mountain View, CA
- information technology software engineer Mountain View, CA
- graduate software developer no experience Mountain View, CA
- software developer internship no experience Mountain View, CA
- ngo software engineer Mountain View, CA



