Senior Software Engineer, Quantitative Evaluations
$204k - $259kDiversityJobs Inc
Waymo is an autonomous driving technology company with the mission to be the worlds most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The Worlds Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymos fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!
This role follows a hybrid work schedule and reports to an Engineering Manager.
You will:
Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning.
Use simulation creatively and mine real world driving logs to measure driving performance.
Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.
Champion code health and best practices in a large and complex code base.
Analyze data and make recommendations on how to improve metric quality and interpretability.
Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.
You have:
BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area
Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
2-3 years of industry experience with
Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL
Performing statistical analyses
Building data processing pipelines
Writing, reviewing, and merging code following industry standards for code health and maintainability
Quant/data fluency is a top requirement
We prefer:
Experience coding in C++
Experience with ML
Experience with A/B experiment infrastructure
Experience building and validating metrics to measure quality in complex systems
Exposure to ad-hoc data analysis tools for rapid modeling and prototyping
Experience working in the AV industry
LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymos discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range $204,000 — $259,000 USD
$204k - $259k
...technology company is seeking an experienced professional to develop importance sampling techniques and find significant signals in evaluation logs. The ideal candidate has over 5 years of experience navigating complex codebases in languages like C++, Python, and SQL,...Senior$155k - $285k
...machine learning and quantitative methods, finance is quickly... ...Business Area Engineering and CTO Ref 1004... ...We are looking for a senior quantitative... ...for implementing and evaluating systematic trading strategies... ...developing software for quantitative investment...SeniorTemporary workFor contractorsWork experience placement- Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5+...Senior
$155k - $285k
A global financial services firm in San Francisco seeks a Senior Quantitative Developer to build systems for quantitative investing. The role includes developing modular frameworks for trading strategies and collaborating with quantitative researchers. Applicants should...Senior$240k - $280k
Sentry, located in San Francisco, is searching for a Senior Software Engineer to enhance its AI/ML team. In this role, you'll build the evaluation infrastructure for AI systems, ensuring they perform accurately and reliably. Responsibilities include designing datasets,...Senior$176k - $253k
Harper is seeking a Senior Member of Technical Staff, AI Quality,... ...high standards through robust evaluation processes. You'll build... ...systems, and work directly with engineers to ensure our AI systems excel... ...candidates have 3-6 years of software experience, particularly in LLM...Senior$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...Senior$162.8k - $203.5k
...our efforts, we are hiring a Senior ML Engineer who will work end‑to‑end on... ...for someone who values software engineering best practices,... ...learning models at scale Evaluate machine learning systems against... ...Computer Science or other quantitative fields or related work...SeniorHourly payWork experience placementWork at officeLocal area3 days per week- ...deployment. Work closely with our product and engineer teams, owning a large part of the... .... Experience 5+ years experience as a Software Engineer or similar role. Experience in... ...Degree in Computer Science or a related quantitative field. Kargo is an equal opportunity/...SeniorLocal area
$400k
...learning environments that frontier AI labs use to train and evaluate their coding models. Learn more at mechanize.work. Why... ...tasks but still fail at the complex, judgment-heavy parts of software engineering. We build the environments that expose those failures and help...Senior- ...About the Role As a Senior Engineer at Magical, you'll build and own the systems powering our... ..., browser automation, model calls, evaluations, observability, and human-in-the-loop... ...May Be a Fit If You have 5+ years of software development experience. You’ve built and...SeniorWork at office
- ...Enterprise-grade privacy and security. Advanced simulation and evaluation systems. Flexible A/B testing. AI scheduler and dialer. We own... ...customer requirements into highly scalable and maintainable software architecture Use AI coding agents and internal tooling to deliver...SeniorWork at officeRemote workFlexible hoursNight shift
- ...smarter and more capable. The Role We're looking for senior software engineers to help us realize TruckSmarter's vision of eliminating... ...Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product advantage...SeniorWork at officeFlexible hours
$50 - $150 per hour
...are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project... ...you to apply. Seniorit y level ~ Mid-Senior level Employment type ~ Contract...SeniorFull timeContract workPart timeFor contractorsFlexible hours$213k - $263k
...accelerating. Our team's job is to ensure that we can continue to evaluate safety and service quality across new cities and countries,... .... We are seeking an experienced, technically hands-on Senior Software Engineer to design and implement these core authoring APIs. In...SeniorFull timeRemote work- ...manufacturing, and healthcare, this is the place. The Role As a Senior Software Engineer, you will build and ship the core systems behind Hike's AI... ...and lab platform clinicians work in, from foot scan and evaluation to ordering custom devices. Hike Lab and Marketplace: the...SeniorFull timeWork at officeRemote workRelocation
- ...Founding Senior Software Engineer (SF In-Person Preferred) About Hyperscale Hyperscale is building the AI-native intelligence layer for... ...technical discussions and architecture decisions Help evaluate and integrate new technologies and tools across the rapidly...Senior
- ...training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality,... ...Project Overview What Does a Typical Day Look Like? Evaluate and refine AI-generated code to ensure that it is efficient,...SeniorFor contractorsRemote workFlexible hours
- ...Intelligence is the open platform for evaluating how AI models perform in the real world... .... We’re a team of researchers, engineers, academics, and builders from places like... ...focus. About the Role We're looking for a Senior Software Engineer to own features end-to-end...SeniorPermanent employmentWork at office
$116k - $130k
...Current Opening – Senior Software Engineer The Senior Software Engineer is a member of one of Dayspring’s engineering teams and reports to the... ...code bases with dependence on frameworks. Experience evaluating development tools and frameworks. Familiarity with frontend...SeniorFull timeWork at officeRemote work2 days per week3 days per week- ...Hims, Instacart, and Lyft. About the role We’re hiring a Senior Software Engineer to build and evolve the core product experiences that power... ...automation, internal tooling, and AI‑assisted processes A habit of evaluating new tools, frameworks, and approaches — and a willingness...SeniorSelf employmentWork at officeRemote workFlexible hours
- ...bring a turnkey, full-stack software and service experience to an... ...company with an experienced engineering team and a product that serves... ...vehicles and LLMs. We’re hiring a Senior Software Engineer to join our... ...) technical decisions Be evaluated on clarity, humility, and impact...SeniorPermanent employmentFull timeContract workWork at officeRemote workWork from homeHome office
$200k - $250k
...shape a brighter way forward. About the Role As a Staff Software Engineer on the MarTech Engineering Team, you'll be a forward deployed... ...than speculative ones Own reliability, observability, evaluation, and cost efficiency of LLM-powered workflows in production...SeniorDaily paidWork experience placementLocal areaRemote work- ...contribute to a high-performing engineering team through collaboration,... ...professional experience in software engineering* Significant... ...Computer Engineering, or a related quantitative degree**Preferred Skills:***... ...) is beneficial* Comfort evaluating AI/ML solutions...SeniorTemporary workWork at office
$117k - $209.33k
...1**Position Overview**As a global leader in 3D design, engineering, and entertainment software, Autodesk helps people imagine, design and create a better... ...to technical requirements and accurate estimates* Evaluate and recommend tools, technologies, and processes to ensure...SeniorCasual workWorldwide$164.8k - $228.4k
...Upstart’s Bank Technology team builds the software systems, automation, and internal... ...and regulatory requirements. As a Senior Software Engineer, you will design and build internal applications... ...architecture, build‑versus‑buy evaluations, and long‑term platform scalability....SeniorSummer workBank staffCurrently hiringWork at officeLocal areaRemote workWork from home- A leading AI research accelerator is looking for a skilled software engineer based in the US or Canada. This contractor role involves evaluating AI-generated code, collaborating with teams, and designing verification mechanisms. Candidates should have over 5 years of experience...SeniorFor contractorsRemote work10 hours per week
- A leading AI research accelerator in San Francisco is looking for an experienced Software Engineer to evaluate AI-generated code for efficiency and reliability. You will work closely with cross-functional teams to develop innovative coding solutions and design verification...SeniorFor contractorsRemote work10 hours per weekFlexible hours
$193.4k - $290k
...re just getting started. Role Overview As a Backend Software Engineer on the Product Engineering team at Harvey, you will own and... ...Government-level security for the world's most sensitive matters ~ Evaluating LLMs across a 10k+ leaf taxonomy of tasks ~ Internet-scale...SeniorRelocation package$148k - $185k
...The company is looking for experienced software engineers from a variety of disciplines. We are... ...delighting our passengers and drivers. As a Senior Software Engineer on the Marketplace... ...in Agentic workflows, Model Evaluation, Causal models and Anomaly detection When...SeniorHourly payWork at officeLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Quantitative Evaluations. Be the first to apply!
- software engineer amazon San Francisco, CA
- experienced software developer San Francisco, CA
- federal - software developer San Francisco, CA
- software developer internship San Francisco, CA
- senior software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- part time software developer remote San Francisco, CA
- software developer intern San Francisco, CA
- software data engineer San Francisco, CA
- fall software engineering internship San Francisco, CA

