Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Quantitative Evaluations

$204k - $259k

DiversityJobs Inc

Waymo is an autonomous driving technology company with the mission to be the worlds most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The Worlds Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymos fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!

This role follows a hybrid work schedule and reports to an Engineering Manager.

You will:

Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning.

Use simulation creatively and mine real world driving logs to measure driving performance.

Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.

Champion code health and best practices in a large and complex code base.

Analyze data and make recommendations on how to improve metric quality and interpretability.

Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.

You have:

BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area

Strong self-motivation to navigate complex systems and pursue open-ended problems to completion

2-3 years of industry experience with

Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL

Performing statistical analyses

Building data processing pipelines

Writing, reviewing, and merging code following industry standards for code health and maintainability

Quant/data fluency is a top requirement

We prefer:

Experience coding in C++

Experience with ML

Experience with A/B experiment infrastructure

Experience building and validating metrics to measure quality in complex systems

Exposure to ad-hoc data analysis tools for rapid modeling and prototyping

Experience working in the AV industry

LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymos discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range $204,000 — $259,000 USD

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Quantitative Evaluations in San Francisco, CA vacancy
  • $204k - $259k

     ...technology company is seeking an experienced professional to develop importance sampling techniques and find significant signals in evaluation logs. The ideal candidate has over 5 years of experience navigating complex codebases in languages like C++, Python, and SQL,... 
    Senior

    Waymo

    San Francisco, CA
    2 days ago
  • $155k - $285k

     ...machine learning and quantitative methods, finance is quickly...  ...Business Area Engineering and CTO Ref 1004...  ...We are looking for a senior quantitative...  ...for implementing and evaluating systematic trading strategies...  ...developing software for quantitative investment... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    San Francisco, CA
    4 days ago
  • Drata is seeking a Senior Applied Research Engineer to enhance the quality of AI systems through rigorous evaluation and experimentation. This role emphasizes applied research, focusing on information retrieval and reasoning strategies. The ideal candidate will bring 5+... 
    Senior

    jobr.pro

    San Francisco, CA
    2 days ago
  • $155k - $285k

    A global financial services firm in San Francisco seeks a Senior Quantitative Developer to build systems for quantitative investing. The role includes developing modular frameworks for trading strategies and collaborating with quantitative researchers. Applicants should... 
    Senior

    Bloomberg

    San Francisco, CA
    1 day ago
  • $240k - $280k

    Sentry, located in San Francisco, is searching for a Senior Software Engineer to enhance its AI/ML team. In this role, you'll build the evaluation infrastructure for AI systems, ensuring they perform accurately and reliably. Responsibilities include designing datasets,... 
    Senior

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  • $176k - $253k

    Harper is seeking a Senior Member of Technical Staff, AI Quality,...  ...high standards through robust evaluation processes. You'll build...  ...systems, and work directly with engineers to ensure our AI systems excel...  ...candidates have 3-6 years of software experience, particularly in LLM... 
    Senior

    Harper

    San Francisco, CA
    4 days ago
  • $240k - $280k

    A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably... 
    Senior

    Sentry

    San Francisco, CA
    1 day ago
  • $162.8k - $203.5k

     ...our efforts, we are hiring a Senior ML Engineer who will work end‑to‑end on...  ...for someone who values software engineering best practices,...  ...learning models at scale Evaluate machine learning systems against...  ...Computer Science or other quantitative fields or related work... 
    Senior
    Hourly pay
    Work experience placement
    Work at office
    Local area
    3 days per week

    United States Digital Space LLC

    San Francisco, CA
    3 days ago
  •  ...deployment. Work closely with our product and engineer teams, owning a large part of the...  .... Experience 5+ years experience as a Software Engineer or similar role. Experience in...  ...Degree in Computer Science or a related quantitative field. Kargo is an equal opportunity/... 
    Senior
    Local area

    Industrious Ventures

    San Francisco, CA
    4 days ago
  • $400k

     ...learning environments that frontier AI labs use to train and evaluate their coding models. Learn more at mechanize.work. Why...  ...tasks but still fail at the complex, judgment-heavy parts of software engineering. We build the environments that expose those failures and help... 
    Senior

    Mechanize, Inc

    San Francisco, CA
    4 days ago
  •  ...About the Role As a Senior Engineer at Magical, you'll build and own the systems powering our...  ..., browser automation, model calls, evaluations, observability, and human-in-the-loop...  ...May Be a Fit If You have 5+ years of software development experience. You’ve built and... 
    Senior
    Work at office

    Magic Al

    San Francisco, CA
    4 days ago
  •  ...Enterprise-grade privacy and security. Advanced simulation and evaluation systems. Flexible A/B testing. AI scheduler and dialer. We own...  ...customer requirements into highly scalable and maintainable software architecture Use AI coding agents and internal tooling to deliver... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Night shift

    Sela AI

    San Francisco, CA
    3 days ago
  •  ...smarter and more capable. The Role We're looking for senior software engineers to help us realize TruckSmarter's vision of eliminating...  ...Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product advantage... 
    Senior
    Work at office
    Flexible hours

    TruckSmarter

    San Francisco, CA
    3 days ago
  • $50 - $150 per hour

     ...are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project...  ...you to apply. Seniorit y level ~ Mid-Senior level Employment type ~ Contract... 
    Senior
    Full time
    Contract work
    Part time
    For contractors
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $213k - $263k

     ...accelerating. Our team's job is to ensure that we can continue to evaluate safety and service quality across new cities and countries,...  .... We are seeking an experienced, technically hands-on Senior Software Engineer to design and implement these core authoring APIs. In... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    2 days ago
  •  ...manufacturing, and healthcare, this is the place. The Role As a Senior Software Engineer, you will build and ship the core systems behind Hike's AI...  ...and lab platform clinicians work in, from foot scan and evaluation to ordering custom devices. Hike Lab and Marketplace: the... 
    Senior
    Full time
    Work at office
    Remote work
    Relocation

    Hike-Medical

    San Francisco, CA
    3 days ago
  •  ...Founding Senior Software Engineer (SF In-Person Preferred) About Hyperscale Hyperscale is building the AI-native intelligence layer for...  ...technical discussions and architecture decisions Help evaluate and integrate new technologies and tools across the rapidly... 
    Senior

    Hyperscale Systems, Inc

    San Francisco, CA
    3 days ago
  •  ...training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality,...  ...Project Overview What Does a Typical Day Look Like? Evaluate and refine AI-generated code to ensure that it is efficient,... 
    Senior
    For contractors
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    2 days ago
  •  ...Intelligence is the open platform for evaluating how AI models perform in the real world...  .... We’re a team of researchers, engineers, academics, and builders from places like...  ...focus. About the Role We're looking for a Senior Software Engineer to own features end-to-end... 
    Senior
    Permanent employment
    Work at office

    Arena Intelligence, Inc.

    San Francisco, CA
    4 days ago
  • $116k - $130k

     ...Current Opening – Senior Software Engineer The Senior Software Engineer is a member of one of Dayspring’s engineering teams and reports to the...  ...code bases with dependence on frameworks. Experience evaluating development tools and frameworks. Familiarity with frontend... 
    Senior
    Full time
    Work at office
    Remote work
    2 days per week
    3 days per week

    Dayspring Technologies, Inc.

    San Francisco, CA
    3 days ago
  •  ...Hims, Instacart, and Lyft. About the role We’re hiring a Senior Software Engineer to build and evolve the core product experiences that power...  ...automation, internal tooling, and AI‑assisted processes A habit of evaluating new tools, frameworks, and approaches — and a willingness... 
    Senior
    Self employment
    Work at office
    Remote work
    Flexible hours

    Collective

    San Francisco, CA
    3 days ago
  •  ...bring a turnkey, full-stack software and service experience to an...  ...company with an experienced engineering team and a product that serves...  ...vehicles and LLMs. We’re hiring a Senior Software Engineer to join our...  ...) technical decisions Be evaluated on clarity, humility, and impact... 
    Senior
    Permanent employment
    Full time
    Contract work
    Work at office
    Remote work
    Work from home
    Home office

    HireArt

    San Francisco, CA
    3 days ago
  • $200k - $250k

     ...shape a brighter way forward. About the Role As a Staff Software Engineer on the MarTech Engineering Team, you'll be a forward deployed...  ...than speculative ones Own reliability, observability, evaluation, and cost efficiency of LLM-powered workflows in production... 
    Senior
    Daily paid
    Work experience placement
    Local area
    Remote work

    JLL

    San Francisco, CA
    1 day ago
  •  ...contribute to a high-performing engineering team through collaboration,...  ...professional experience in software engineering* Significant...  ...Computer Engineering, or a related quantitative degree**Preferred Skills:***...  ...) is beneficial* Comfort evaluating AI/ML solutions... 
    Senior
    Temporary work
    Work at office

    GoodRx

    San Francisco, CA
    6 hours ago
  • $117k - $209.33k

     ...1**Position Overview**As a global leader in 3D design, engineering, and entertainment software, Autodesk helps people imagine, design and create a better...  ...to technical requirements and accurate estimates* Evaluate and recommend tools, technologies, and processes to ensure... 
    Senior
    Casual work
    Worldwide

    Autodesk

    San Francisco, CA
    1 day ago
  • $164.8k - $228.4k

     ...Upstart’s Bank Technology team builds the software systems, automation, and internal...  ...and regulatory requirements. As a Senior Software Engineer, you will design and build internal applications...  ...architecture, build‑versus‑buy evaluations, and long‑term platform scalability.... 
    Senior
    Summer work
    Bank staff
    Currently hiring
    Work at office
    Local area
    Remote work
    Work from home

    UpStart

    San Francisco, CA
    2 days ago
  • A leading AI research accelerator is looking for a skilled software engineer based in the US or Canada. This contractor role involves evaluating AI-generated code, collaborating with teams, and designing verification mechanisms. Candidates should have over 5 years of experience... 
    Senior
    For contractors
    Remote work
    10 hours per week

    Turing

    San Francisco, CA
    6 hours ago
  • A leading AI research accelerator in San Francisco is looking for an experienced Software Engineer to evaluate AI-generated code for efficiency and reliability. You will work closely with cross-functional teams to develop innovative coding solutions and design verification... 
    Senior
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $193.4k - $290k

     ...re just getting started. Role Overview As a Backend Software Engineer on the Product Engineering team at Harvey, you will own and...  ...Government-level security for the world's most sensitive matters ~ Evaluating LLMs across a 10k+ leaf taxonomy of tasks ~ Internet-scale... 
    Senior
    Relocation package

    Harvey

    San Francisco, CA
    2 days ago
  • $148k - $185k

     ...The company is looking for experienced software engineers from a variety of disciplines. We are...  ...delighting our passengers and drivers. As a Senior Software Engineer on the Marketplace...  ...in Agentic workflows, Model Evaluation, Causal models and Anomaly detection When... 
    Senior
    Hourly pay
    Work at office
    Local area
    3 days per week

    United States Digital Space LLC

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Quantitative Evaluations. Be the first to apply!