Software Engineer, Statistical Evaluation and Sampling
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.
You will:
- Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
- Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
- Build systems that systematically optimize multiple objectives under resource constraints.
- Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
- Champion code health and best practices in a large and complex code base
You have:
- BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
- Fluency with probability and statistics
- Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
- 2-3 years of experience with
- Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
- Performing statistical analyses
- Building data processing pipelines
- Writing, reviewing, and merging code following industry standards for code health and maintainability
We prefer:
- Experience programming in C++
- Experience developing and evaluating sampling methods
- Experience designing, training, evaluating, and applying ML models
- Experience working in the AV industry
- PhD in a quantitative field
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$170,000 - $216,000 USD
$170k - $216k
...S. states. The Planner Evaluation team works on one of the key... ...improving the quality of the software that drives the car. We are... ...experienced data-minded software engineers and data scientists to help... ...of techniques including statistics, math, physics, algorithms and...SuggestedFull timeRemote work$175k - $215k
...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge... ...is "real"? We are looking for a Software Engineer to build the metrics and pipelines... ...Did it stop at the red light?") to the statistical quality of AI-generated traffic. You will...SuggestedFull timeRemote work$170k - $216k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate...SuggestedFull timeRemote work- ...work in-person five days a week in our San Francisco, NYC, or London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next...SuggestedFull timeWork at officeRelocation package
- ...About the Team The Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology to the world.... ...In this role, you’ll lead development of the systems we use to evaluate the quality of our AI models and products. You’ll help us leverage...SuggestedFull timeWork at officeRelocation package
$238k - $302k
...states. The Large Model Evaluation team is at the nexus of Waymo... ...looking for quantitatively-minded engineers to research and propose new... ...Develop novel metrics and sampling techniques to measure the... ...experience in a heavily quantitative software engineering area ~...Full timeRemote work$204k - $259k
...simulator components, we create metrics and evaluation methodologies to measure realism. These... ...work schedule and reports to a Senior Engineering Manager. You will: Develop novel... ...experience. 5+ years of industry experience in software development. Software Engineering...$230k - $265k
...About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team... ...for model experimentation, training, evaluation, inference, and retraining that power... ...of ML fundamentals—probability & statistics, supervised vs. unsupervised learning,...Full timeWork from homeFlexible hours$127k - $223k
...To learn more visit: The Evaluation Algorithms team is responsible... ...closed-loop simulation engine built with the latest in generative... ...to support complex statistical analyses of driving performance... ...Python programming and strong software engineering fundamentals with...Full timeWork at officeWork from homeFlexible hours$213k - $270k
...U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking... ...of physics, geometry, bayesian statistics, and machine learning ~... ...software ~ Experience building or evaluating machine learning models in production...Full timeRemote work- ...challenging datasets for training and evaluating advanced models and agents.... ...terminal and real-world engineering workflows, legacy... ...experienced professionals. Sample packs of their datasets are... ...-time remote position for a Software Engineer. The role involves...Full timeRemote work
- ...believe agent development is an evolution of software development that requires new tools and... .... You’ll design systems that enable engineers and customers to build reliable, steerable... ...match the job description. We strive to evaluate all applicants consistently without...Full timeFlexible hours
$215k - $265k
...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of... ...’s assets. Frontier labs trust us to evaluate their models pre-release. It is... ...feel free to share links to relevant work samples. ~ Screening interview ~ Take-home...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours- ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated minerals company... ...experienced Senior Full Stack Software Engineer to lead critical technical initiatives... .... Conduct thorough technical evaluations of third-party software solutions, providing...Full time
- ...AI lab researchers to create evaluations, publish benchmarks, and... ...institutions Work together with engineers, scientists, operators, and... ...About the Role As a Senior Software Engineer on the Growth team,... ...flagging, A/B testing frameworks, statistical significance tooling) A...Work at officeRemote workFlexible hours
- ...depth in one of these areas: Platform Engineering You have designed, built, and... ...systems. Shared Qualities Strong software engineering background with 4-7+ years of... ...match the job description. We strive to evaluate all applicants consistently without regard...Full timeFlexible hours
- ...Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Enterprise... ..., minimal Baseten deployments within partner environments. Evaluate and implement emerging virtualization technologies to enhance...Full timeFlexible hours
- ...next-generation, AI-powered enterprise software companies. SAIGroup’s portfolio serves 2... ...Role Overview As a Software Engineer, AI Platform, you will help design, build... ..., agentic workflows, retrieval systems, evaluation pipelines, and production-grade AI infrastructure...Full timeWorldwide
- ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,...Full timeFlexible hours
$162.8k - $203.5k
..., we are hiring a Senior ML Engineer who will work end-to-end on... ...looking for someone who values software engineering best practices,... ...problems Develop statistical, machine learning, or optimization... ...learning models at scale Evaluate machine learning systems against...Hourly payFull timeWork experience placementWork at officeLocal area3 days per week$162.8k - $203.5k
...Our highly motivated Machine Learning Engineers work on these challenging problems and... ...both new and existing problems Develop statistical, machine learning, or optimization... ...launch machine learning models at scale Evaluate machine learning systems against business...Hourly payFull timeWork experience placementWork at officeLocal area3 days per week- ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,...Full timeFlexible hours
- ...Role Overview We’re looking for a Full Stack Software Engineer to design, implement, and QA large customer features, end-to-end. In this... ...rollout Partner closely with product and design, scoping and evaluating tradeoffs between technical feasibility and product experience...
- ...About the Role We are looking for a self-starter full stack engineer who can help us rapidly prototype and develop internal products or tools used by researchers, such as visualization for our evaluation of models. You should be comfortable being truly full stack, such...Full timeWork at officeRelocation package
- ...Principal Statistical Programmer Responsibilities Project lead level activities. Performs data analysis using primarily the SAS programming... ...independent judgment in developing methods, techniques and evaluation criteria for obtaining results. Works on significant and...
$170.11k - $237k
...distributed computing and make it accessible to software developers of all skill levels. We’re... ...Anyscale is actively seeking talented engineers to join our team and contribute to the... ...Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion...Full timeWork experience placementWork at officeFlexible hours$185k - $325k
...outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care... ...every task - a capability every product team depends on. Evaluation Infrastructure. Build the shared eval tooling and frameworks...Full time$213k - $263k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models... ...the new sensor HW. Maintain and run evaluations of existing or hypothetical new sensor...Full timeRemote work- ...As one of our core engineers, you’ll be critical in creating data infrastructure that will be shaping the future development of frontier... ...low‑latency pipelines. Any background in AI research, LLM evaluation, or human‑in‑the‑loop systems Experience getting your ideas...Full time
- ...Beacon Software is a permanent capital holding company which acquires and grows essential... ...York. Apply below. Senior Software Engineer, Platform Own the architecture and... ...right time Tune prompts, guardrails, and evaluation harnesses for accuracy, tone, and safety...Permanent employmentFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!
- software engineer full time San Francisco, CA
- software system engineer San Francisco, CA
- consulting software engineer San Francisco, CA
- software engineer travel San Francisco, CA
- real time software engineer San Francisco, CA
- network software engineer San Francisco, CA
- senior software engineer remote San Francisco, CA
- entry level software engineer remote San Francisco, CA
- software engineer intern San Francisco, CA
- new grad software engineer San Francisco, CA



