Software Engineer, Statistical Evaluation and Sampling
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe before it hits the road. We build automated pipelines to solve the long tail of rare and exceptional scenarios in autonomous driving, looking for needles in a haystack under both time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team applies importance sampling techniques and machine learning to maximize the statistical efficiency of these discovery pipelines.
You will:
- Develop importance sampling techniques that enable our evaluation pipelines to deliver better signals with fewer resources.
- Find signals in our logs and simulations that might help us to more efficiently discover rare and important events.
- Build systems that systematically optimize multiple objectives under resource constraints.
- Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
- Champion code health and best practices in a large and complex code base
You have:
- BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
- Fluency with probability and statistics
- Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
- 2-3 years of experience with
- Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
- Performing statistical analyses
- Building data processing pipelines
- Writing, reviewing, and merging code following industry standards for code health and maintainability
We prefer:
- Experience programming in C++
- Experience developing and evaluating sampling methods
- Experience designing, training, evaluating, and applying ML models
- Experience working in the AV industry
- PhD in a quantitative field
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$170,000 - $216,000 USD
$170k - $216k
...states. Waymo's Release Evaluation org ensures that each version... ...Within Release Evaluation, the Sampling and Efficiency team applies... ...learning to maximize the statistical efficiency of these discovery... .... Collaborate with other engineers, data scientists, statisticians...SuggestedFull timeRemote work$204k - $259k
...Senior Software Engineer, Quantitative Evaluations Waymo is an autonomous driving technology company with the mission to be the world's most trusted... ...Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning. Use...SuggestedFull timeRemote work- ...are a small, interdisciplinary team - engineers, data scientists, designers, product managers... ...is safe and working. You'll own the evaluation system for the team building the coach:... ...more effective Enough fluency in statistics and experimental design to partner with...SuggestedFull time
- ...regulatory submission deliverables. Create statistical analysis outputs to be used in support... ...work instructions. Develop, enhance, evaluate, and validate standardized macros and utility... ...of other programming languages and database management software packages is a plus.SuggestedRemote work
$300k
...running, tracking, and analyzing model evaluations. Develop evaluation libraries, distributed... ...experience in computer science, engineering, machine learning, or a related field. At least two years of post-graduate software engineering or ML engineering experience...SuggestedFull timeInternshipVisa sponsorshipRelocation package$175k - $215k
...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge... ...is "real"? We are looking for a Software Engineer to build the metrics and pipelines... ...Did it stop at the red light?") to the statistical quality of AI-generated traffic. You will...Full timeRemote work- ...work in-person five days a week in our San Francisco, NYC, or London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next...Full timeWork at officeRelocation package
$136.44k - $265.11k
...published some of our work here.You’ll build the datasets, evaluations, and systems that help close that gap. You’ll work with scientists... ...rapidly evolving area. You’ll work at the intersection of software engineering, biology, and frontier AI: finding tasks that are...Work at officeLocal areaMonday to FridayShift work$204k - $259k
...create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you... ...that a virtual world is "real"? We are looking for a Senior Software Engineer to build the metrics and systems that grade this hybrid environment...Full timeRemote work- ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design...Full timeWork at office
- ...About The PositionWe’re looking for a software engineer to join Parafin’s Infrastructure team... ...for model experimentation, training, evaluation, inference, and retraining that power... ...Knowledge of ML fundamentals—probability & statistics, supervised vs. unsupervised learning,...Flexible hours
$238k - $302k
...states. The Large Model Evaluation team is at the nexus of Waymo... ...looking for quantitatively-minded engineers to research and propose new... ...Develop novel metrics and sampling techniques to measure the... ...experience in a heavily quantitative software engineering area ~...Full timeRemote work$127k - $223k
...To learn more visit: The Evaluation Algorithms team is responsible... ...closed-loop simulation engine built with the latest in generative... ...to support complex statistical analyses of driving performance... ...Python programming and strong software engineering fundamentals with...Full timeWork at officeWork from homeFlexible hours- ...in San Francisco is seeking a Research Engineer focused on pushing the boundaries of frontier... ...should have strong engineering and statistical skills, a red-teaming mindset, and the... ...innovative AI measurements and build evaluation environments that drive progress. #J-18...
- ...money. Jobseekers need to self-evaluate if they have the requisite... ...are looking for entry-level software programmers, Java full stack... ..., machine learning engineers for full time positions with... ...science/engineering/mathematics/statistics or science graduates or people...Full timeH1bRemote work
$180k - $250k
...rely on benchmarks.bio to evaluate and improve their AI systems... ...we're scaling rapidly across engineering. We're building benchmarks... ...models. Ship fast. Here is a sample of engineering products we... ...will be working on problems in software including but not limited to...Work at officeVisa sponsorshipWork visa- ...Description Job Description Senior Software Engineer, ML Platform Location: San... ...behind model experimentation, training, evaluation, inference, and retraining is becoming... ...fundamentals, including probability, statistics, supervised and unsupervised learning,...Full timeRemote workFlexible hours
$225.38k - $304.92k
...biological and IT-driven workflows behind sample management, analytical chemistry, and... ...bring therapies to market.As a Software Engineer at the High Seniority level, you will be... ...needs into technical solutions.Explore and evaluate opportunities to leverage AI and LLMs to...Work at officeLocal areaImmediate startFlexible hours3 days per week$142.5k - $264.7k
...science, biology, and engineering to build innovative analytical... ...Bioinformatics Software Engineer with expert... ...genomics data. You will evaluate, refine, and... ...with major tools and statistical methods used during the... ...Access to large data sets, samples and compute resources....Full timeLocal areaWorldwideRelocation package3 days per week- ...right. External auditors re-perform our work, so precision on sample 1 has to equal precision on sample 400, and an agent that can't... ...rather than a label in a dataset. Building the harness and the evaluation that make that tractable is the core of this role, and it would...
$170k - $216k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate...Full timeRemote work- ...AI lab researchers to create evaluations, publish benchmarks, and... ...institutions Work together with engineers, scientists, operators, and... ...About the Role As a Senior Software Engineer on the Growth team,... ...flagging, A/B testing frameworks, statistical significance tooling) A...Work at officeRemote workFlexible hours
$229.9k - $262.4k
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large...Full timePart timeLocal area$180k - $225k
Software is eating the world, but AI is eating software. We live in unprecedented times -... ...pre-training, fine-tuning, and production evaluations. This is the main innovation that’s... ...products include the Generative AI Data Engine, SGP, Donovan, and others that power the...Full timeLive in$230k - $390k
...believe agent development is an evolution of software development that requires new tools and... .... You’ll design systems that enable engineers and customers to build reliable, steerable... ...match the job description. We strive to evaluate all applicants consistently without...Full timeFlexible hours$230k - $390k
...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,...Full timeFlexible hours$165k - $190k
...The RoleWe're hiring fullstack Applied AI Engineers to help us build AI agents that power... ...mission to make intelligent, autonomous software a reality both internally and for our customers... ...and iterate on agent architectures, evaluation pipelines, and performance frameworks to...Work at officeFlexible hours- ...Mariana Minerals Full Stack Software Engineer Mariana Minerals is a software-first, vertically integrated minerals company on a mission... ...help build capital project faster and more efficiently. Evaluate existing software in the ecosystem to assist Mariana's internal...
- ...Full-stack Software Engineer Title of Role: Full-stack Software Engineer Location: San Francisco, CA, or New York, New York onsite... ...to systems that empower major AI organizations to train and evaluate their models. Ideal Candidate Background ~5+ years...Work at officeVisa sponsorship
$150k - $250k
...ForAt Distyl, we build AI systems using Evaluation-Driven Development—an approach where evaluation... ...AI behavior in production.AI Evaluation Engineers focus on designing and implementing the... ...in productionWhat We Require2+ years of software engineering experience Strong Python...Work at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Statistical Evaluation and Sampling. Be the first to apply!
- software engineer internship San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship no experience San Francisco, CA
- real time software engineer San Francisco, CA
- financial software developer San Francisco, CA
- part time software developer San Francisco, CA
- graduate software developer San Francisco, CA
- software engineer travel San Francisco, CA
- experienced software developer San Francisco, CA
- remote entry level software developer San Francisco, CA


