Software Engineer, Statistical Evaluation and Sampling
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.
You will:
- Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
- Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
- Build systems that systematically optimize multiple objectives under resource constraints.
- Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
- Champion code health and best practices in a large and complex code base
You have:
- BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
- Fluency with probability and statistics
- Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
- 2-3 years of experience with
- Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
- Performing statistical analyses
- Building data processing pipelines
- Writing, reviewing, and merging code following industry standards for code health and maintainability
We prefer:
- Experience programming in C++
- Experience developing and evaluating sampling methods
- Experience designing, training, evaluating, and applying ML models
- Experience working in the AV industry
- PhD in a quantitative field
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$170,000 - $216,000 USD
$175k - $215k
...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge... ...is "real"? We are looking for a Software Engineer to build the metrics and pipelines... ...Did it stop at the red light?") to the statistical quality of AI-generated traffic. You will...SuggestedFull timeRemote work$170k - $216k
...S. states. The Planner Evaluation team works on one of the key... ...improving the quality of the software that drives the car. We are... ...experienced data-minded software engineers and data scientists to help... ...of techniques including statistics, math, physics, algorithms and...SuggestedFull timeRemote work$170k - $216k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate...SuggestedFull timeRemote work- ...work in-person five days a week in our San Francisco, NYC, or London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next...SuggestedFull timeWork at officeRelocation package
$204k - $259k
...create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you... ...that a virtual world is "real"? We are looking for a Senior Software Engineer to build the metrics and systems that grade this hybrid environment...SuggestedFull timeRemote work- ...regulatory submission deliverables. Create statistical analysis outputs to be used in support... ...work instructions. Develop, enhance, evaluate, and validate standardized macros and utility... ...of other programming languages and database management software packages is a plus.Remote work
$300k
...running, tracking, and analyzing model evaluations. Develop evaluation libraries, distributed... ...experience in computer science, engineering, machine learning, or a related field. At least two years of post-graduate software engineering or ML engineering experience...InternshipVisa sponsorshipRelocation package$60 - $100 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering, Data Science, and Systems Design Experts Type:... ...Location: Remote Role Responsibilities Evaluate LLM-generated responses to coding and software engineering...Full timeContract workSummer workRemote work$213k - $263k
...U.S. states. The Planner Evaluation team works on one of the key... ...improving the quality of the software that drives the car. We are... ...experienced data-minded software engineers and data scientists to help... ..., streamlining curation, sampling, and slicing for training...Full timeRemote work- ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design...Full timeWork at office
- ...About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team... ...for model experimentation, training, evaluation, inference, and retraining that power... ...Knowledge of ML fundamentals—probability & statistics, supervised vs. unsupervised learning,...Flexible hours
$180k - $250k
...rely on benchmarks.bio to evaluate and improve their AI systems... ...we're scaling rapidly across engineering. We're building benchmarks... ...models. Ship fast. Here is a sample of engineering products we... ...will be working on problems in software including but not limited to...Full timeWork at officeVisa sponsorshipWork visa$235.03k - $352.29k
...role, you will lead the development of evaluation tooling that ensures our technology scales... ...with Autonomy and Infrastructure engineers to set a roadmap that unifies evaluation... .../MS/Phd in Computer Science, Robotics, Statistics, Physics, Math, or a related quantitative...Immediate startFlexible hours$127k - $223k
...To learn more visit: The Evaluation Algorithms team is responsible... ...closed-loop simulation engine built with the latest in generative... ...to support complex statistical analyses of driving performance... ...Python programming and strong software engineering fundamentals with...Full timeWork at officeWork from homeFlexible hours$190k - $240k
...operation into reproducible training and evaluation datasets. Your scope begins at the... ...training and evaluation. This is a senior software engineering role responsible for the systems after... ...systems for indexing, filtering, sampling, curation, dataset versioning, replay,...Full timeContract work$123.7k - $254.67k
...our recruiting process here.Job Title: Software Engineer II, Data Analytics and... ...workflows.Strong track record of critically evaluating and verifying AI-assisted work through... ...relevant field such as Computer Science, Statistics, Mathematics or a related discipline,...Work at officeLocal areaRemote workRelocationRelocation package- ...biological and IT-driven workflows behind sample management, analytical chemistry, and... ...bring therapies to market. As a Software Engineer at the High Seniority level, you will be... ...into technical solutions. Explore and evaluate opportunities to leverage AI and LLMs...Full timeWork at officeLocal areaImmediate startFlexible hours3 days per week
- ...business. As a Sr. Machine Learning Engineer at tvScientific, you'll build the ML and AI... ...runs in prod, not just notebooks ~ Solid statistics and ML fundamentals: you can reason about experiment design, model evaluation, and when simpler approaches beat complex ones...Full timeWork at officeRemote workRelocationRelocation package
- ...W25. About the role We’re looking for a Full-Stack Software Engineer, Reinforcement Learning to build the product surfaces, backend... ...and APIs that connect task authoring, data collection, evaluation, QA/QC, and RL training infrastructure Partner closely with...Full timeWork at officeRemote workRelocationVisa sponsorship
- ...Description Job Description Senior Software Engineer, ML Platform Location: San... ...behind model experimentation, training, evaluation, inference, and retraining is becoming... ...fundamentals, including probability, statistics, supervised and unsupervised learning,...Full timeRemote workFlexible hours
$142.5k - $264.7k
...science, biology, and engineering to build innovative analytical... ...Bioinformatics Software Engineer with expert... ...genomics data. You will evaluate, refine, and... ...with major tools and statistical methods used during the... ...Access to large data sets, samples and compute resources....Full timeLocal areaWorldwideRelocation package3 days per week- ...Job Description - Senior Full Stack Software Engineer Location: San Francisco (on-site at our offices) About Artificial Analysis... ...direction of AI. • Become a world expert in AI : You will evaluate every major model, across every major capability, as they are...Full time
$200k - $240k
..., data-driven decisions. Our Solutions Engineering team ensures customers successfully adopt... ...features, from prototype through evaluation, rollout, and iteration Design and build... ...the full CV data lifecycle: collection, sampling, labeling, and curation Experience...Full timeWork at office$204k - $259k
...role, you will report to an Engineering Manager. You will: Develop business logic software to evolve driving performance... ...Develop and implement methods to evaluate and improve Waymo driving... ...Science, Robotics, Math, Physics, Statistics (or similar technical field...Full timeRemote work- ...the Role We're looking for a strong engineer who can build agentic products that scale... ...company. Studio – We own Mercor’s evaluation system & annotation platform for RL... ...agent trajectories into insight, from statistical analysis to automated failure mode detection...Full timeWork at officeRelocation package
$250k
...We’re looking for an ML infrastructure engineer to design and build the core systems... ...training work runs on, and the inference and evaluation systems that carry models from... ...quantization, and low-latency, high-throughput sampling. Experience optimizing training performance...Full time$215k - $265k
...scheming mitigations. We're looking for a Software Engineer to build the platform that the rest of... ...’s assets. Frontier labs trust us to evaluate their models pre-release. It is... ...feel free to share links to relevant work samples. ~ Screening interview ~ Take-home...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours$122k - $240.5k
Position Summary Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a ServiceAgentic AI is moving from... ...such as orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop controlsAt least 1 year...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work- ...right. External auditors re-perform our work, so precision on sample 1 has to equal precision on sample 400, and an agent that can't... ...rather than a label in a dataset. Building the harness and the evaluation that make that tractable is the core of this role, and it would...
- ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,...Full timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!
- software developer fintech San Francisco, CA
- startup software engineer San Francisco, CA
- financial software developer San Francisco, CA
- junior software developer remote San Francisco, CA
- software engineer San Francisco, CA
- software data engineer San Francisco, CA
- freelance software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- part time software developer San Francisco, CA
- associate software developer San Francisco, CA



