Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Simulator Evaluation

$238k - $302k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymo’s simulator is one of the most complex virtual environments ever built. It blends deterministic logic, physical dynamics, and state-of-the-art Generative AI to create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:  How do you mathematically prove that a virtual world is "real"?

We are looking for a Staff Software Engineer to act as the Technical Architect for this domain. You will work at the intersection of software engineering and AI, ensuring that our simulated worlds—whether driven by explicit rules or foundation models—provide a trustworthy representation of reality.

In this Staff-level role, you will report to a Senior Staff Software Engineering Manager and act as a Technical Lead, bridging the gap between deep technical metrics and high-level product strategy.

You will:


  • Architect the Eval Rubric: You will define the "Definition of Done" for simulation realism. You will look ahead at product goals (e.g., launching in snow, highway driving) and architect the evaluation roadmap that ensures our simulation fidelity matures in lockstep with onboard needs.

  • The "Critic" for the System: You will design the comprehensive mathematical frameworks that validate our hybrid world. You will decide how we balance distinct evaluation needs—from verifying logical rules and dynamics to measuring the distribution quality of generative AI models.

  • Build at Scale: You will lead the design of large-scale, extensible evaluation platforms (C++/Python). You ensure our metric pipelines are not just scripts, but robust distributed systems capable of providing clear, reproducible signals on petabytes of data.

  • Strategic, Cross-functional Leadership You will act as the technical bridge between organizations. You will partner closely with AI research and other simulation teams, as the eval workflows you build will drive rapid innovation and research roadmaps.

You have:


  • System-Level Engineering:


    • 8+ years of industry experience, with a focus on building complex data systems, evaluation platforms, or back-end infrastructure.

    • Expertise in designing systems that scale (C++, Python, distributed computing), with a strong focus on API design and maintainability.

  • Advanced Quantitative Intuition:


    • You don't just calculate metrics; you design frameworks. You can debate the merits of different statistical approaches (e.g., determining the right confidence intervals for safety-critical validation) and apply them to complex, non-deterministic systems.

    • You have experience designing and implementing evaluation frameworks for complex systems or machine learning models.

  • Product-Aware Leadership:


    • Experience creating technical strategies that span multiple teams. You can translate high-level product requirements into concrete engineering problems (e.g., "To launch in snow, we need X specific friction metrics by Q2").

We prefer:


  • Background in fields that blend code, math, and simulation: Autonomous Vehicles, Algorithmic Trading, AdTech/Search Ranking, Machine Learning, or Robotics.

  • Familiarity with the validation of Generative AI (LLMs, Diffusion models) and/or classical simulation systems (Agent-based modeling, heuristics).

  • Experience driving technical roadmaps for large-scale systems or validation frameworks.

  • Experience guiding a team or system through a major architectural shift.

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. 

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. 

Salary Range

$238,000 - $302,000 USD

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Simulator Evaluation in San Francisco, CA vacancy
  • $204k - $259k

     ...roads and tens of billions in simulation across 15+ U.S. states....  ...Waymo Driver. The Simulator Evaluation team faces the ultimate data...  ...We are looking for a Senior Software Engineer to build the metrics and systems...  ...you will report to a Senior Staff Software Engineering Manager... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $251k - $310k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key...  ...improving the quality of the software that drives the car. We are looking...  ...data-minded software engineers and data scientists to help us improve... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  •  ...trust to grow their business.   We are seeking a Software Engineer to build out our simulation and AI capabilities. You'll design and implement systems...  ...Develop counterfactual and what-if frameworks for evaluating bidding strategies, budget allocation, and pacing algorithms... 
    Suggested
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    more than 2 months ago
  • $170k - $216k

     ...million miles on public roads and tens of billions in simulation across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the Waymo...  ...resource constraints. Collaborate with other engineers, data scientists, statisticians and the leadership... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $213k - $263k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The Challenge...  ...simulation solutions that power evaluation and training across a diverse range of...  ...requirements. We are looking for a Senior Software Engineer who is passionate about solving complex... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $170k - $216k

     ...roads and tens of billions in simulation across 15+ U.S. states....  ...powers the Waymo Driver. Our software allows the Waymo Driver to perceive...  ...sensors, enabling software engineers like you to develop multi-...  ...-critical automation and evaluation frameworks that establish the... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $170k - $216k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The...  ...effective Simulation-based products that evaluate the Waymo Driver's software stack at a massive scale. We solve...  ...broad range of customers Software Engineers, Product, Data Science, System... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $204k - $259k

     ...roads and tens of billions in simulation across 15+ U.S. states....  ...This role reports to an Engineering Manager.   You will:...  ...generation, model training, and evaluation. Collaborate cross-functionally...  ...~5+ years of professional software engineering experience, with... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform for modern...  ...the role Flow is seeking staff software engineers to build AI-powered capabilities...  ...engineers” explore designs, simulate changes, and validate requirements.​ Evaluate and integrate language models... 
    Full time
    Flexible hours

    Flow Engineering

    San Francisco, CA
    more than 2 months ago
  • $200k - $250k

     ...its commercial self-driving software to develop, test and...  ...Kodiak is recruiting a Staff Software Engineer to join our Planning team...  ...Perception, Controls, Systems, and Simulation teams to define interfaces...  .... As part of the evaluation process, we provide Endorsed... 
    Full time
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    San Francisco, CA
    more than 2 months ago
  • $159k - $268k

     ...way. To learn more visit: Simulation is at the core of Waabi’s approach...  .... Our closed-loop simulation engine built with the latest in...  ...environment for training and evaluating self-driving systems. The Simulation...  ...and implement orchestration software between simulation... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    24 days ago
  • $200k - $400k

     ...experimental, frontier-style engineering. The team continuously...  ...feedback loops through offline evaluation and online experimentation,...  ...About the Role As a Staff Software Engineer on the Agent Orchestration...  ..., testing, and simulation systems to ensure safe, measurable... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    more than 2 months ago
  •  ...London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data...  ...and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity... 
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    more than 2 months ago
  • $180k - $260k

     ...looking for a deeply technical software engineer to join the Autonomy...  ...validation — enabling both simulation at scale and rigorous scenario...  ...how system behavior should be evaluated. Systems and data engineers...  ...Engineer: $180,000 - $220,000 Staff Software Engineer: $220,000... 
    Local area

    Zipline

    San Francisco, CA
    22 days ago
  • $251k - $310k

     ...roads and tens of billions in simulation across 15+ U.S. states. You...  ..., system design, and software implementation to solve multi...  ...identify opportunities, and evaluate hypotheses and counterfactual...  ...UX, Data Science, and other Engineering teams to develop and improve... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...its commercial self-driving software to develop, test and deploy...  ...Kodiak is recruiting a Staff Software Engineer to lead design and development...  ...safe, efficient missions Evaluate the effectiveness of the...  ...Perception, Controls, Systems, Simulation, and Product teams to... 
    Full time
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    San Francisco, CA
    3 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators united by...  ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build...  ...-model development, sim-to-real evaluation, and machine-learning... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    2 days ago
  • $165k - $265k

     ...development, to traditional software development, to non-technical...  ...hands-on senior software engineers to build the AI tooling, agents...  ...our autonomy codebase, simulation environments, ML training pipelines...  ...work well for Waabi. Evaluate new AI tools, models, and agent... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    9 days ago
  • $60 - $100 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineering, Data Science, and Systems Design Experts Type:...  ...Location: Remote Role Responsibilities Evaluate LLM-generated responses to coding and software engineering... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    more than 2 months ago
  • $204k - $259k

     ...on public roads and tens of billions in simulation across 15+ U.S. states. The...  ...a diverse, and collaborative group of software engineers, machine learning (ML) engineers, and data...  ...this role, you will report to a  Senior Staff Engineering Manager.   You will:... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    more than 2 months ago
  • $203k - $275k

     ...The opportunity We're hiring a Staff Cloud Infrastructure Engineer to join the Cloud Infrastructure &...  ...backup automation, and leading DR simulation exercises. Lead infrastructure...  ...Productivity Define the strategy for evaluating, integrating, and governing AI-... 
    Full time
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    4 days ago
  • $180k - $260k

     ....We’re looking for a deeply technical software engineer to join the Autonomy Validation team —...  ...platforms for validation — enabling both simulation at scale and rigorous scenario testing...  ...how system behavior should be evaluated.Systems and data engineers, to ensure... 
    Local area

    Zipline

    South San Francisco, CA
    4 days ago
  •  ...interventions. You will bridge the gap between clinical science and software engineering, building the engine that helps millions of members retrain...  ...bleeding edge of AI and software engineering, constantly evaluating emerging technologies to optimize performance and improve... 
    Full time
    Immediate start

    Hinge Health, Inc.

    San Francisco, CA
    more than 2 months ago
  •  ...and how we use AI in our recruiting process here . As a Staff Software Engineer at Pinterest, you will help define and drive the technical...  ...how and when each should be used. ~ Proven ability to evaluate complex systems, define pragmatic architectural direction,... 
    Full time
    Work at office
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    a month ago
  •  ...his first company to LinkedIn. About the Role As a Staff Software Engineer, you’ll shape the technical direction of Magical’s AI agent...  ...queues, run state, browser automation, model calls, system evaluations, observability, and human-in-the-loop recovery. You'... 
    Full time
    Work at office

    Magical

    San Francisco, CA
    more than 2 months ago
  •  ...centers. About the Role At Watney, full stack engineers own our software ecosystem end-to-end, meaning you will regularly cross the...  ...software at the intersection of physical hardware, complex simulations, or autonomous vehicles. We’re committed to... 
    Full time

    Watney

    San Francisco, CA
    a month ago
  • $241k - $284k

     ...reliability and performance at scale. As a Staff Frontend Engineer on the App Platform team, you will...  ...practices into how we build and ship software. Our mission is to provide the...  ...learning systems (AI Tools), to assist in evaluating applicants’ qualifications and... 
    Full time
    Work at office
    Home office
    Flexible hours
    3 days per week

    Glossgenius

    San Francisco, CA
    more than 2 months ago
  • $217k - $289k

     ...Experience team exists to make our ~120 engineers (and growing) measurably faster and...  ...their day better. We are looking for a Staff Software Engineer to set technical direction for...  ...notice, explain how it works and what it evaluates, and obtain consent beforehand. New... 
    Full time
    Live in
    Remote work
    Home office
    Flexible hours
    Day shift
    3 days per week

    Grow Therapy

    San Francisco, CA
    a month ago
  • $163k - $204k

     ...interview process. We’re looking for a seasoned full-stack software engineer to join Gusto’s Growth team and lead the next generation of...  ...early concepts and technical direction through launch, evaluation, iteration, and long-term ownership in production. On this... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    more than 2 months ago
  • $231k - $340k

     ...close to our customers — from leadership to engineers — and work together to solve real...  ...AI features rapidly and safely. As a Software Engineer on the Developer Experience team...  ...benchmarking infrastructure essential for evaluating and optimizing the performance of AI-native... 
    Full time

    Harvey

    San Francisco, CA
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Simulator Evaluation. Be the first to apply!