Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Quantitative Evaluations

$170k - $216k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.


The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!

 

This role follows a hybrid work schedule and reports to a   Sr. Staff Engineering Manager.

 

You will:


  • Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning.

  • Use simulation creatively and mine real world driving logs to measure driving performance.

  • Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.

  • Champion code health and best practices in a large and complex code base.

  • Analyze data and make recommendations on how to improve metric quality and interpretability.

  • Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.

 

You have:


  • BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area

  • Strong self-motivation to navigate complex systems and pursue open-ended problems to completion

  • 1+ years of industry experience with


    • Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL

    • Performing statistical analyses

    • Building data processing pipelines

    • Writing, reviewing, and merging code following industry standards for code health and maintainability

    • Quant/data fluency is a top requirement


 

We prefer:


  • Experience coding in C++

  • Experience with ML

  • Experience with A/B experiment infrastructure

  • Experience building and validating metrics to measure quality in complex systems

  • Exposure to ad-hoc data analysis tools for rapid modeling and prototyping

  • Experience working in the AV industry

 

#LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. 

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. 

Salary Range

$170,000 - $216,000 USD

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Software Engineer, Quantitative Evaluations in San Francisco, CA vacancy
  • $170k - $216k

     ...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the...  ...constraints. Collaborate with other engineers, data scientists, statisticians and the...  ..., Statistics, Physics, Math or another quantitative area ~ Fluency with probability and... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $204k - $259k

     ...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge...  ..."real"? We are looking for a Senior Software Engineer to build the metrics and systems that...  ...built to last. Data Intuition & Quantitative Rigor: A "Data Detective" mindset:... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $175k - $215k

     ...create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you...  ...prove that a virtual world is "real"? We are looking for a Software Engineer to build the metrics and pipelines that grade this hybrid environment... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $170k - $216k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  •  ...work in-person five days a week in our San Francisco, NYC, or London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next... 
    Suggested
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    more than 2 months ago
  •  ...the research, analytics, and investment capabilities that support clients, advisors, and investment professionals.As a Quantitative Software Engineer - Research Platform, you will help shape Schwab’s research technology ecosystem by building scalable data, analytics, and... 
    Full time
    Work at office

    The Charles Schwab Corporation

    San Francisco, CA
    2 days ago
  • $300k

     ...running, tracking, and analyzing model evaluations. Develop evaluation libraries, distributed...  ...experience in computer science, engineering, machine learning, or a related field. At least two years of post-graduate software engineering or ML engineering experience... 
    Internship
    Visa sponsorship
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    29 days ago
  •  ...platforms, data, and research capabilities that help drive investment insights and product innovation across the firm. As a Quantitative Software Engineer - Research Data & Models, you will lead a team responsible for building and modernizing research platforms, scalable... 
    Full time
    Work at office

    The Charles Schwab Corporation

    San Francisco, CA
    4 days ago
  • $60 - $100 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering, Data Science, and Systems Design Experts Type:...  ...Location: Remote Role Responsibilities Evaluate LLM-generated responses to coding and software engineering... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    more than 2 months ago
  •  ...advance the platforms, data, and research capabilities that power investment insights and product innovation.As a Director, Quantitative Software Engineer - Research Lead, you will partner closely with quantitative researchers, investment professionals, and technology teams... 
    Full time
    Work at office

    The Charles Schwab Corporation

    San Francisco, CA
    4 days ago
  • $213k - $263k

     ...U.S. states. The Planner Evaluation team works on one of the key...  ...improving the quality of the software that drives the car. We are...  ...experienced data-minded software engineers and data scientists to help...  ...with Data Science and Quantitative Analytics teams to identify... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  •  ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design... 
    Full time
    Work at office

    Anysphere

    San Francisco, CA
    14 hours ago
  • $170k - $216k

     ...is responsible for the end-to-end evaluation of our autonomous driving software. We don't just look at what...  ...simulation results. Apply software engineering best practices in order to improve...  ...software engineering experience, or a quantitative PhD with software engineering... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  •  ...MISSION We are looking for a Software Engineer specializing in Computational Geometry...  ...Applied Mathematics, or a closely related quantitative field. Core Experience & Competencies...  ...nondiscrimination in employment. We evaluate every candidate on what they can do... 
    Full time
    Contract work
    Local area
    Shift work

    Foundational Industries

    San Francisco, CA
    a month ago
  • $235.03k - $352.29k

     ...role, you will lead the development of evaluation tooling that ensures our technology scales...  ...with Autonomy and Infrastructure engineers to set a roadmap that unifies evaluation...  ...Statistics, Physics, Math, or a related quantitative field. Experience: 7+ years of industry... 
    Immediate start
    Flexible hours

    Nuro

    San Francisco, CA
    15 days ago
  • $300k - $330k

     ...motivated data scientists, data engineers, and machine learning...  ...models Strong background with quantitative finance data Proven ability...  ...skills You’ll discover and evaluate new datasets, build models to...  ...Financial Services and Software Development #J-18808-Ljbffr... 
    Full time

    Storm2

    San Francisco, CA
    2 days ago
  • As a Quantitative Engineer, you will work directly with the founders to build the trading and backtesting systems that power Conviction. You...  ...strategies Quantitative Research - Research, develop, and evaluate systematic trading strategies across equities, options, futures... 

    Socket

    San Francisco, CA
    4 days ago
  • $200k

     ...AfterQuery builds the training data and evaluation infrastructure that frontier AI labs...  ...RLHF and RLVR pipelines. You will develop quantitative frameworks for measuring dataset...  ...results ~ Former founders and early engineers at early stage startups are a plus. We... 
    Full time

    AfterQuery

    San Francisco, CA
    more than 2 months ago
  •  ...W25. About the role We’re looking for a Full-Stack Software Engineer, Reinforcement Learning to build the product surfaces, backend...  ...and APIs that connect task authoring, data collection, evaluation, QA/QC, and RL training infrastructure Partner closely with... 
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship

    Hud

    San Francisco, CA
    a month ago
  •  ...Job Description - Senior Full Stack Software Engineer Location: San Francisco (on-site at our offices) About Artificial Analysis...  ...direction of AI. • Become a world expert in AI : You will evaluate every major model, across every major capability, as they are... 
    Full time

    Artificial Analysis

    San Francisco, CA
    13 days ago
  • $174k - $252k

     ...updates and user feedback.Build the software systems, automated pipelines, evaluation harnesses, and knowledge graphs...  ...or Critique.Experience building quantitative evaluation harnesses to measure...  ...to guides).Google's software engineers develop the next-generation technologies... 

    Google

    San Francisco, CA
    2 days ago
  • $122k - $240.5k

    Position Summary Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a ServiceAgentic AI is moving from...  ...such as orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop controlsAt least 1 year... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Shift work

    Deloitte

    San Francisco, CA
    2 days ago
  •  ...believe agent development is an evolution of software development that requires new tools and...  .... You’ll design systems that enable engineers and customers to build reliable, steerable...  ...match the job description. We strive to evaluate all applicants consistently without... 
    Full time
    Flexible hours

    Sierra Limited

    San Francisco, CA
    more than 2 months ago
  •  ...next-generation, AI-powered enterprise software companies. SAIGroup’s portfolio serves 2...  ...Role Overview As a Software Engineer, AI Platform, you will help design, build...  ..., agentic workflows, retrieval systems, evaluation pipelines, and production-grade AI infrastructure... 
    Full time
    Worldwide

    Jazzx Ai

    San Francisco, CA
    more than 2 months ago
  •  ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,... 
    Full time
    Flexible hours

    Sierra Limited

    San Francisco, CA
    more than 2 months ago
  •  ..., and the economy. The opportunity Ambrook's platform engineers build the foundational systems that let the rest of the company...  ..., such as an interface for configuring agents, an evaluation system, or a harness for running agent loops. Establish a tight... 
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours
    Shift work

    Ambrook

    San Francisco, CA
    a month ago
  •  ...Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Enterprise...  ..., minimal Baseten deployments within partner environments. Evaluate and implement emerging virtualization technologies to enhance... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    more than 2 months ago
  • $150k - $250k

     ...At Distyl, we build AI systems using Evaluation-Driven Development —an approach where evaluation...  ...in production.   AI Evaluation Engineers focus on designing and implementing the...  ...production   What We Require ~2+ years of software engineering experience ~ Strong Python... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Distyl Ai

    San Francisco, CA
    a month ago
  • $100k - $200k

     ...Full-Stack Software Engineer, Reinforcement Learning Compensation: $100K–$200K Location: San Francisco, CA or Singapore — On-site...  ...dashboards and observability systems for environment quality, evaluation results, data collection, grader issues, reward signals, and... 
    Full time
    Relocation
    Visa sponsorship

    Dreams 2 Reality Recruitment

    San Francisco, CA
    5 days ago
  • $180k

     ...Full Stack Software Engineer Title of Role: Full Stack Software Engineer Location: San Francisco, onsite Company Stage of Funding...  ...technical diligence and product curiosity. Familiarity with evaluating startups, founders, or early-stage products, enhancing... 
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Quantitative Evaluations. Be the first to apply!