Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Quantitative Evaluations

$204k - $259k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you! This role follows a hybrid work schedule and reports to an Engineering Manager. You will: * Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning. * Use simulation creatively and mine real world driving logs to measure driving performance. * Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.

  • Champion code health and best practices in a large and complex code base.
  • Analyze data and make recommendations on how to improve metric quality and
interpretability. * Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver evaluation products and help make data driven decisions. You have: * BS in Computer Science, Robotics, Statistics, Physics, Math or another quantitative area * Strong self-motivation to navigate complex systems and pursue open-ended problems to completion
  • 2-3 years of industry experience with
  • Navigating and modifying a large code base containing a variety of
languages, such as C++, Python and SQL
  • Performing statistical analyses
  • Building data processing pipelines
  • Writing, reviewing, and merging code following industry standards for code
health and maintainability * Quant/data fluency is a top requirement We prefer:
  • Experience coding in C++
  • Experience with ML
  • Experience with A/B experiment infrastructure
  • Experience building and validating metrics to measure quality in complex
systems
  • Exposure to ad-hoc data analysis tools for rapid modeling and prototyping
  • Experience working in the AV industry
#LI-Hybrid The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. Salary Range

$204,000—$259,000 USD

Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Quantitative Evaluations in San Francisco, CA vacancy
  • $204k - $259k

     ...components, we create metrics and evaluation methodologies to measure...  ...schedule and reports to a Senior Engineering Manager. You will:...  ...of industry experience in software development. Software Engineering...  ...version control software. Quantitative Application & Metric... 
    Senior

    Waymo

    San Francisco, CA
    4 days ago
  •  ...Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology...  ...development of the systems we use to evaluate the quality of our AI models and...  ...robust iteration Work with a small, senior team of engineers and researchers to combine... 
    Senior
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    10 hours ago
  •  ...RL Environments & Platform Engineering We're partnering with a fast...  ...startup building the training and evaluation infrastructure that powers...  ...for frontier models Build software to 10–100x the quality and...  ...PowerPoint building, Excel modeling, quantitative trading) Help establish... 
    Senior

    Digital Waffle

    San Francisco, CA
    3 days ago
  • $170k - $216k

     ...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the...  ...constraints. Collaborate with other engineers, data scientists, statisticians and the...  ..., Statistics, Physics, Math or another quantitative area ~ Fluency with probability and... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    10 hours ago
  • $162.8k - $203.5k

     ...Our highly motivated Machine Learning Engineers work on these challenging problems and...  ...launch machine learning models at scale Evaluate machine learning systems against...  ...or Ph.D. in Computer Science or other quantitative fields or related work experience ~5+... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    10 hours ago
  • $162.8k - $203.5k

     ...our efforts, we are hiring a Senior ML Engineer who will work end-to-end on...  ...for someone who values software engineering best practices,...  ...learning models at scale Evaluate machine learning systems against...  ...Computer Science or other quantitative fields or related work... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    10 hours ago
  •  ...Beacon Software is a permanent capital holding company which...  ...New York. Apply below. Senior Software Engineer, Platform Own the architecture...  ...prompts, guardrails, and evaluation harnesses for accuracy,...  ...qualitative feedback into quantitative goals and SLAs that stick... 
    Senior
    Permanent employment
    Full time

    Beacon Software

    San Francisco, CA
    10 hours ago
  •  ...develop and deploy tomorrow’s hardware & software solutions and help revolutionize...  .... Work closely with our product and engineer teams, owning a large part of the process...  ...Degree in Computer Science or a related quantitative field. Kargo is an equal opportunity... 
    Senior
    Full time
    Local area

    Kargo

    San Francisco, CA
    10 hours ago
  • $213k - $270k

     ...simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking new ways. We...  ...or scientific software ~ Experience building or evaluating machine learning models in production ~ Experience... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    10 hours ago
  • $210.8k - $272.8k

     ...team at Thumbtack is focused on making engineering fast, reliable, and delightful. We tackle...  ...important and complex challenges in modern software development. We’re introducing GenAI...  ...cutting-edge technologies in the industry, evaluate relevance to Thumbtack, and drive... 
    Senior
    Full time
    Part time
    Seasonal work
    Local area

    Thumbtack

    San Francisco, CA
    10 hours ago
  • $188k - $235k

     ...provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product...  ...candidate will have a strong understanding of software engineering principles and practices, as well as... 
    Senior
    Full time
    Shift work

    Scale Ai

    San Francisco, CA
    10 hours ago
  • $180k - $210k

     ...and innovative problem-solving. BitGo is looking for a Senior Software Engineer to join our Access & Notifications team and help us build an...  ...correct bottlenecks and fix bugs Continuously discover, evaluate, and implement new technologies to maximize development efficiency... 
    Senior
    Full time
    Work at office
    Worldwide

    Bitgo

    San Francisco, CA
    10 hours ago
  • $127k - $223k

     ...positive way. To learn more visit: The Evaluation Algorithms team is responsible for...  ...highly realistic closed-loop simulation engine built with the latest in generative AI technologies...  ...in Python programming and strong software engineering fundamentals with real-world... 
    Senior
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    a month ago
  • $188k - $235k

     ...AGI), and building upon our prior model evaluation work with enterprise customers and governments...  ...and private evaluations. About Data Engine Our Generative AI Data Engine powers...  ...that the transition from traditional software to AI is one of the most important... 
    Senior
    Full time
    Shift work

    Scale Ai

    San Francisco, CA
    10 hours ago
  •  ...As a Senior Software Engineer, Infrastructure and Platform, you will design and build the core infrastructure that powers data generation, evaluation, and agentic systems. You will be responsible for the shared platforms that enable engineers and research teams to run... 
    Senior

    Key Talent Solutions LLC

    San Francisco, CA
    3 days ago
  •  ...About the Role As a Senior Engineer at Magical, you'll build and own the systems powering our...  ..., browser automation, model calls, evaluations, observability, and human-in-the-loop...  ...May Be a Fit If You have 5+ years of software development experience. You’ve built and... 
    Senior
    Work at office

    Magic Al

    San Francisco, CA
    1 day ago
  •  ...Enterprise-grade privacy and security. Advanced simulation and evaluation systems. Flexible A/B testing. AI scheduler and dialer. We own...  ...customer requirements into highly scalable and maintainable software architecture Use AI coding agents and internal tooling to deliver... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Night shift

    Sela AI

    San Francisco, CA
    5 days ago
  •  ...dramatically smarter and more capable. The Role We’re looking for senior software engineers to help us realize TruckSmarter’s vision of eliminating...  .... Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product... 
    Senior
    Work at office
    Flexible hours

    TruckSmarter

    San Francisco, CA
    3 days ago
  • $170k - $216k

     ...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the...  ...set of sensors, enabling software engineers like you to develop multi-modal models and...  ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    10 hours ago
  • $175k - $215k

     ...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:...  ...is "real"? We are looking for a Software Engineer to build the metrics and pipelines that...  ...thing?" In this role, you will report to Senior Staff Software Engineering Manager and... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    10 hours ago
  • $193.4k - $290k

     ...close to our customers — from leadership to engineers — and work together to solve real...  ...started. Role Overview As a Backend Software Engineer on the Product Engineering team...  ...the world's most sensitive matters ~ Evaluating LLMs across a 10k+ leaf taxonomy of tasks... 
    Senior
    Full time
    Relocation package

    Harvey

    San Francisco, CA
    10 hours ago
  •  ...designers, developer relations and other engineers to translate developer needs and product...  ...continuous improvement. Continuously evaluate and optimize existing implementations for...  ...industry experience. 5+ years of professional software development experience, with a proven... 
    Senior
    Remote work
    Flexible hours

    Workato

    San Francisco, CA
    3 days ago
  •  ...unstructured emails, PDFs, and legacy software. CommodityAI serves as a...  ...are currently scaling our engineering team in San Francisco to...  ...structured extraction pipelines, and evaluation frameworks that turn chaotic...  ...Are We are looking for a senior- or staff-level engineer... 
    Senior
    Relocation

    CommodityAI

    San Francisco, CA
    3 days ago
  • $225k - $250k

     ...Technology has been engaged to conduct a search for an experienced Senior Software Engineer for our client, an AI-driven software company transforming...  ..., and scalability in production environments. Continuously evaluate and adopt new technologies while contributing to a... 
    Senior
    Full time

    The Bronx Inc

    San Francisco, CA
    15 hours ago
  • $213k - $263k

     ...scaling challenge. Our mission is to deliver simulation solutions that power evaluation and training across a diverse range of challenging requirements. We are looking for a Senior Software Engineer who is passionate about solving complex evaluation problems with... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    10 hours ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform for modern engineering...  ...role Flow is seeking AI-focused senior software engineers to build AI-powered capabilities...  ..., and validate requirements.​ Evaluate and integrate language models and related... 
    Senior
    Full time
    Flexible hours

    Flow Engineering

    San Francisco, CA
    10 hours ago
  • $117.2k - $223.9k

    ## Senior Software EngineerApplyremote type: Office Tech-Flexiblelocations: California - San Franciscotime type: Full timeposted on: Posted...  ...application to Service Cloud Voice workflows* Ability to evaluate and implement AI-based quality monitoring tools for real-time... 
    Senior
    Work at office
    Flexible hours

    Salesforce

    San Francisco, CA
    3 days ago
  •  ...define modern fintech and enterprise software, including Spark Capital, Ten Coves Capital...  ...highly motivated and results-driven Senior Software Engineer to play a pivotal role in designing...  ...the engineering team. Continuously evaluate and integrate emerging technologies... 
    Senior
    Full time
    Work from home
    Flexible hours

    BoostEd Finance

    San Francisco, CA
    3 days ago
  •  ...Hims, Instacart, and Lyft. About the role We’re hiring a Senior Software Engineer to build and evolve the core product experiences that power...  ...automation, internal tooling, and AI‑assisted processes A habit of evaluating new tools, frameworks, and approaches — and a willingness... 
    Senior
    Self employment
    Work at office
    Remote work
    Flexible hours

    Collective

    San Francisco, CA
    5 days ago
  •  ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated...  ...Minerals is looking for an experienced Senior Full Stack Software Engineer to lead critical technical...  ...strategies. Conduct thorough technical evaluations of third-party software solutions,... 
    Senior
    Full time

    Mariana Minerals

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Quantitative Evaluations. Be the first to apply!