Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Quantitative Evaluations

$170k - $216k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.


The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you!

 

This role follows a hybrid work schedule and reports to a   Sr. Staff Engineering Manager.

 

You will:


  • Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning.

  • Use simulation creatively and mine real world driving logs to measure driving performance.

  • Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.

  • Champion code health and best practices in a large and complex code base.

  • Analyze data and make recommendations on how to improve metric quality and interpretability.

  • Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions.

 

You have:


  • BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area

  • Strong self-motivation to navigate complex systems and pursue open-ended problems to completion

  • 1+ years of industry experience with


    • Navigating and modifying a large code base containing a variety of languages, such as C++, Python and SQL

    • Performing statistical analyses

    • Building data processing pipelines

    • Writing, reviewing, and merging code following industry standards for code health and maintainability

    • Quant/data fluency is a top requirement


 

We prefer:


  • Experience coding in C++

  • Experience with ML

  • Experience with A/B experiment infrastructure

  • Experience building and validating metrics to measure quality in complex systems

  • Exposure to ad-hoc data analysis tools for rapid modeling and prototyping

  • Experience working in the AV industry

 

#LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. 

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. 

Salary Range

$170,000 - $216,000 USD

Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer, Quantitative Evaluations in San Francisco, CA vacancy
  • $204k - $259k

     ...components, we create metrics and evaluation methodologies to measure...  ...and reports to a Senior Engineering Manager. You will: Develop...  ...years of industry experience in software development. Software...  ...version control software. Quantitative Application & Metric Development... 
    Suggested

    Waymo

    San Francisco, CA
    4 days ago
  • $170k - $216k

     ...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the...  ...constraints. Collaborate with other engineers, data scientists, statisticians and the...  ..., Statistics, Physics, Math or another quantitative area ~ Fluency with probability and... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  • $175k - $215k

     ...create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge: How do you...  ...prove that a virtual world is "real"? We are looking for a Software Engineer to build the metrics and pipelines that grade this hybrid environment... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  • $170k - $216k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  •  ...work in-person five days a week in our San Francisco, NYC, or London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next... 
    Suggested
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    7 hours ago
  •  ...About the Team The Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology to the world....  ...In this role, you’ll lead development of the systems we use to evaluate the quality of our AI models and products. You’ll help us leverage... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    7 hours ago
  • $238k - $302k

     ...15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI...  ...safety-critical. We are looking for quantitatively-minded engineers to research and propose new ways to...  ...experience in a heavily quantitative software engineering area ~ Experience navigating... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  •  ...About the Role We're hiring a Quantitative Developer to help turn research ideas into...  ...alongside Poesis' Chief Scientist, CEO and engineering leadership to turn large-scale data and...  ...generation, back-testing, and model evaluation. Run experiments, summarize results,... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    3 days per week

    Poesis LLC

    San Francisco, CA
    5 days ago
  •  ...Beacon Software is a permanent capital holding company which acquires...  ...below. Senior Software Engineer, Platform Own the...  ...Tune prompts, guardrails, and evaluation harnesses for accuracy, tone...  ...translate qualitative feedback into quantitative goals and SLAs that stick... 
    Permanent employment
    Full time

    Beacon Software

    San Francisco, CA
    7 hours ago
  • $180k - $221.45k

     ...how work gets done. As a Full-Stack engineer at Airtable, you will have the...  ...Engineering (any field), or closely related quantitative discipline, and two (2) years of experience...  ...; DevOps; API design; Unit tests and Evaluations; Large Language Models.  Any suitable... 
    Full time
    For contractors
    Work experience placement
    Live in
    Work at office
    Remote work
    Flexible hours

    Airtable

    San Francisco, CA
    7 hours ago
  • $170k - $216k

     ...is responsible for the end-to-end evaluation of our autonomous driving software. We don't just look at what...  ...simulation results. Apply software engineering best practices in order to improve...  ...engineering experience, or a quantitative PhD with software engineering experience... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  •  ...RL Environments & Platform Engineering We're partnering with a fast...  ...startup building the training and evaluation infrastructure that powers...  ...for frontier models Build software to 10–100x the quality and...  ...PowerPoint building, Excel modeling, quantitative trading) Help establish... 

    Digital Waffle

    San Francisco, CA
    3 days ago
  • $200k

     ...AfterQuery builds the training data and evaluation infrastructure that frontier AI labs...  ...RLHF and RLVR pipelines. You will develop quantitative frameworks for measuring dataset...  ...results ~ Former founders and early engineers at early stage startups are a plus. We... 
    Full time

    AfterQuery

    San Francisco, CA
    7 hours ago
  • $240k - $280k

     ...A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably... 
    Full time

    Sentry

    San Francisco, CA
    1 hour ago
  •  ...believe agent development is an evolution of software development that requires new tools and...  .... You’ll design systems that enable engineers and customers to build reliable, steerable...  ...match the job description. We strive to evaluate all applicants consistently without... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    14 days ago
  •  ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    24 days ago
  •  ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated minerals company...  ...experienced Senior Full Stack Software Engineer to lead critical technical initiatives...  .... Conduct thorough technical evaluations of third-party software solutions, providing... 
    Full time

    Mariana Minerals

    San Francisco, CA
    7 hours ago
  • $300k - $385k

     ...LLMs that have been customized by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are...  ...for a technical lead who can own the development of our evaluation platform. In this role, you will: ~ Build a team of 10-20 researchers... 
    Part time

    Harvey, Inc

    San Francisco, CA
    1 hour ago
  • $204k - $259k

     ...across 15+ U.S. states. Hardware Engineering is an innovative and collaborative...  ..., mechanical, reliability, software and vehicle engineers. We design,...  ...system performance Understand and evaluate internal and external quantitative image quality metrics, and apply them... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    7 hours ago
  •  ...depth in one of these areas: Platform Engineering You have designed, built, and...  ...systems. Shared Qualities Strong software engineering background with 4-7+ years of...  ...match the job description. We strive to evaluate all applicants consistently without regard... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    24 days ago
  •  ...next-generation, AI-powered enterprise software companies. SAIGroup’s portfolio serves 2...  ...Role Overview As a Software Engineer, AI Platform, you will help design, build...  ..., agentic workflows, retrieval systems, evaluation pipelines, and production-grade AI infrastructure... 
    Full time
    Worldwide

    Jazzx Ai

    San Francisco, CA
    7 hours ago
  •  ...Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Enterprise...  ..., minimal Baseten deployments within partner environments. Evaluate and implement emerging virtualization technologies to enhance... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    7 hours ago
  •  ...Role Overview We’re looking for a Full Stack Software Engineer to design, implement, and QA large customer features, end-to-end. In this...  ...rollout Partner closely with product and design, scoping and evaluating tradeoffs between technical feasibility and product experience... 

    JustAI

    San Francisco, CA
    3 days ago
  •  ...represented within our team. We encourage you to apply even if your experience doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race, color, religion, gender, national origin, age, disability, veteran status,... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    24 days ago
  • $162.8k - $203.5k

     ..., we are hiring a Senior ML Engineer who will work end-to-end on...  ...looking for someone who values software engineering best practices,...  ...learning models at scale Evaluate machine learning systems...  ...in Computer Science or other quantitative fields or related work experience... 
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    7 hours ago
  • $162.8k - $203.5k

     ...Our highly motivated Machine Learning Engineers work on these challenging problems and...  ...launch machine learning models at scale Evaluate machine learning systems against...  ...or Ph.D. in Computer Science or other quantitative fields or related work experience ~5+... 
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    7 hours ago
  •  ...About the Role We are looking for a self-starter full stack engineer who can help us rapidly prototype and develop internal products or tools used by researchers, such as visualization for our evaluation of models. You should be comfortable being truly full stack, such... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    7 hours ago
  •  ...Frec Markets, Inc. is seeking a Quantitative Developer to create products that empower individuals to manage their finances. This role involves designing and optimizing algorithms, ensuring robust trading infrastructure, and collaborating across teams to develop innovative... 
    Flexible hours

    Frec Markets, Inc.

    San Francisco, CA
    3 days ago
  • $230k - $265k

     ...tools they need. About The Position We’re looking for a software engineer to join Parafin’s Infrastructure team and lead the evolution...  ...-friendly systems for model experimentation, training, evaluation, inference, and retraining that power underwriting and other... 
    Full time
    Work from home
    Flexible hours

    Parafin

    San Francisco, CA
    7 hours ago
  • $200k - $250k

     ...Role Fluidstack, a leading cloud provider, is looking for a Software Engineer, Infrastructure Platform to build the foundational platforms...  ...scale with organizational growth Technical Leadership Evaluate build vs. buy decisions for platform components, weighing in... 
    Full time
    Local area

    Fluidstack

    San Francisco, CA
    7 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Quantitative Evaluations. Be the first to apply!