Senior Software Engineer, Quantitative Evaluations
$204k - $259kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key challenges in autonomous driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve how we characterize and evaluate changes to the Onboard software stack (Planner, Perception, etc). If you are passionate about autonomous vehicles and how to use rich, complex data to drive decision making, this is the role for you! This role follows a hybrid work schedule and reports to an Engineering Manager. You will: * Develop signals to measure the performance and driving qualities of the Waymo driver, using a range of techniques including statistics, math, physics, algorithms and machine learning. * Use simulation creatively and mine real world driving logs to measure driving performance. * Design and implement methods to make a stronger connection between onboard software changes and simulated outcomes.
- Champion code health and best practices in a large and complex code base.
- Analyze data and make recommendations on how to improve metric quality and
- 2-3 years of industry experience with
- Navigating and modifying a large code base containing a variety of
- Performing statistical analyses
- Building data processing pipelines
- Writing, reviewing, and merging code following industry standards for code
- Experience coding in C++
- Experience with ML
- Experience with A/B experiment infrastructure
- Experience building and validating metrics to measure quality in complex
- Exposure to ad-hoc data analysis tools for rapid modeling and prototyping
- Experience working in the AV industry
$204,000—$259,000 USD
$204k - $259k
...components, we create metrics and evaluation methodologies to measure... ...schedule and reports to a Senior Engineering Manager. You will:... ...of industry experience in software development. Software Engineering... ...version control software. Quantitative Application & Metric...Senior- ...Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology... ...development of the systems we use to evaluate the quality of our AI models and... ...robust iteration Work with a small, senior team of engineers and researchers to combine...SeniorFull timeWork at officeRelocation package
- ...RL Environments & Platform Engineering We're partnering with a fast... ...startup building the training and evaluation infrastructure that powers... ...for frontier models Build software to 10–100x the quality and... ...PowerPoint building, Excel modeling, quantitative trading) Help establish...Senior
$170k - $216k
...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the... ...constraints. Collaborate with other engineers, data scientists, statisticians and the... ..., Statistics, Physics, Math or another quantitative area ~ Fluency with probability and...SuggestedFull timeRemote work$162.8k - $203.5k
...Our highly motivated Machine Learning Engineers work on these challenging problems and... ...launch machine learning models at scale Evaluate machine learning systems against... ...or Ph.D. in Computer Science or other quantitative fields or related work experience ~5+...SeniorHourly payFull timeWork experience placementWork at officeLocal area3 days per week$162.8k - $203.5k
...our efforts, we are hiring a Senior ML Engineer who will work end-to-end on... ...for someone who values software engineering best practices,... ...learning models at scale Evaluate machine learning systems against... ...Computer Science or other quantitative fields or related work...SeniorHourly payFull timeWork experience placementWork at officeLocal area3 days per week- ...Beacon Software is a permanent capital holding company which... ...New York. Apply below. Senior Software Engineer, Platform Own the architecture... ...prompts, guardrails, and evaluation harnesses for accuracy,... ...qualitative feedback into quantitative goals and SLAs that stick...SeniorPermanent employmentFull time
- ...develop and deploy tomorrow’s hardware & software solutions and help revolutionize... .... Work closely with our product and engineer teams, owning a large part of the process... ...Degree in Computer Science or a related quantitative field. Kargo is an equal opportunity...SeniorFull timeLocal area
$213k - $270k
...simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking new ways. We... ...or scientific software ~ Experience building or evaluating machine learning models in production ~ Experience...SeniorFull timeRemote work$210.8k - $272.8k
...team at Thumbtack is focused on making engineering fast, reliable, and delightful. We tackle... ...important and complex challenges in modern software development. We’re introducing GenAI... ...cutting-edge technologies in the industry, evaluate relevance to Thumbtack, and drive...SeniorFull timePart timeSeasonal workLocal area$188k - $235k
...provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product... ...candidate will have a strong understanding of software engineering principles and practices, as well as...SeniorFull timeShift work$180k - $210k
...and innovative problem-solving. BitGo is looking for a Senior Software Engineer to join our Access & Notifications team and help us build an... ...correct bottlenecks and fix bugs Continuously discover, evaluate, and implement new technologies to maximize development efficiency...SeniorFull timeWork at officeWorldwide$127k - $223k
...positive way. To learn more visit: The Evaluation Algorithms team is responsible for... ...highly realistic closed-loop simulation engine built with the latest in generative AI technologies... ...in Python programming and strong software engineering fundamentals with real-world...SeniorFull timeWork at officeWork from homeFlexible hours$188k - $235k
...AGI), and building upon our prior model evaluation work with enterprise customers and governments... ...and private evaluations. About Data Engine Our Generative AI Data Engine powers... ...that the transition from traditional software to AI is one of the most important...SeniorFull timeShift work- ...As a Senior Software Engineer, Infrastructure and Platform, you will design and build the core infrastructure that powers data generation, evaluation, and agentic systems. You will be responsible for the shared platforms that enable engineers and research teams to run...Senior
- ...About the Role As a Senior Engineer at Magical, you'll build and own the systems powering our... ..., browser automation, model calls, evaluations, observability, and human-in-the-loop... ...May Be a Fit If You have 5+ years of software development experience. You’ve built and...SeniorWork at office
- ...Enterprise-grade privacy and security. Advanced simulation and evaluation systems. Flexible A/B testing. AI scheduler and dialer. We own... ...customer requirements into highly scalable and maintainable software architecture Use AI coding agents and internal tooling to deliver...SeniorWork at officeRemote workFlexible hoursNight shift
- ...dramatically smarter and more capable. The Role We’re looking for senior software engineers to help us realize TruckSmarter’s vision of eliminating... .... Stay ahead of emerging AI frameworks and technologies, evaluating and introducing them when they create real product...SeniorWork at officeFlexible hours
$170k - $216k
...technology that powers the Waymo Driver. Our software allows the Waymo Driver to perceive the... ...set of sensors, enabling software engineers like you to develop multi-modal models and... ...-scale, mission-critical automation and evaluation frameworks that establish the "ultimate...Full timeRemote work$175k - $215k
...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:... ...is "real"? We are looking for a Software Engineer to build the metrics and pipelines that... ...thing?" In this role, you will report to Senior Staff Software Engineering Manager and...Full timeRemote work$193.4k - $290k
...close to our customers — from leadership to engineers — and work together to solve real... ...started. Role Overview As a Backend Software Engineer on the Product Engineering team... ...the world's most sensitive matters ~ Evaluating LLMs across a 10k+ leaf taxonomy of tasks...SeniorFull timeRelocation package- ...designers, developer relations and other engineers to translate developer needs and product... ...continuous improvement. Continuously evaluate and optimize existing implementations for... ...industry experience. 5+ years of professional software development experience, with a proven...SeniorRemote workFlexible hours
- ...unstructured emails, PDFs, and legacy software. CommodityAI serves as a... ...are currently scaling our engineering team in San Francisco to... ...structured extraction pipelines, and evaluation frameworks that turn chaotic... ...Are We are looking for a senior- or staff-level engineer...SeniorRelocation
$225k - $250k
...Technology has been engaged to conduct a search for an experienced Senior Software Engineer for our client, an AI-driven software company transforming... ..., and scalability in production environments. Continuously evaluate and adopt new technologies while contributing to a...SeniorFull time$213k - $263k
...scaling challenge. Our mission is to deliver simulation solutions that power evaluation and training across a diverse range of challenging requirements. We are looking for a Senior Software Engineer who is passionate about solving complex evaluation problems with...SeniorFull timeRemote work- ...About Flow Flow Engineering is an AI-native requirements platform for modern engineering... ...role Flow is seeking AI-focused senior software engineers to build AI-powered capabilities... ..., and validate requirements. Evaluate and integrate language models and related...SeniorFull timeFlexible hours
$117.2k - $223.9k
## Senior Software EngineerApplyremote type: Office Tech-Flexiblelocations: California - San Franciscotime type: Full timeposted on: Posted... ...application to Service Cloud Voice workflows* Ability to evaluate and implement AI-based quality monitoring tools for real-time...SeniorWork at officeFlexible hours- ...define modern fintech and enterprise software, including Spark Capital, Ten Coves Capital... ...highly motivated and results-driven Senior Software Engineer to play a pivotal role in designing... ...the engineering team. Continuously evaluate and integrate emerging technologies...SeniorFull timeWork from homeFlexible hours
- ...Hims, Instacart, and Lyft. About the role We’re hiring a Senior Software Engineer to build and evolve the core product experiences that power... ...automation, internal tooling, and AI‑assisted processes A habit of evaluating new tools, frameworks, and approaches — and a willingness...SeniorSelf employmentWork at officeRemote workFlexible hours
- ...Mariana Minerals Mariana Minerals is a software-first, vertically integrated... ...Minerals is looking for an experienced Senior Full Stack Software Engineer to lead critical technical... ...strategies. Conduct thorough technical evaluations of third-party software solutions,...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Quantitative Evaluations. Be the first to apply!
- software engineer full time San Francisco, CA
- software system engineer San Francisco, CA
- consulting software engineer San Francisco, CA
- software engineer travel San Francisco, CA
- real time software engineer San Francisco, CA
- network software engineer San Francisco, CA
- senior software engineer remote San Francisco, CA
- entry level software engineer remote San Francisco, CA
- software engineer intern San Francisco, CA
- new grad software engineer San Francisco, CA


