Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Simulator Evaluation

$238k - $302k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymo’s simulator is one of the most complex virtual environments ever built. It blends deterministic logic, physical dynamics, and state-of-the-art Generative AI to create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge:  How do you mathematically prove that a virtual world is "real"?

We are looking for a Staff Software Engineer to act as the Technical Architect for this domain. You will work at the intersection of software engineering and AI, ensuring that our simulated worlds—whether driven by explicit rules or foundation models—provide a trustworthy representation of reality.

In this Staff-level role, you will report to a Senior Staff Software Engineering Manager and act as a Technical Lead, bridging the gap between deep technical metrics and high-level product strategy.

You will:


  • Architect the Eval Rubric: You will define the "Definition of Done" for simulation realism. You will look ahead at product goals (e.g., launching in snow, highway driving) and architect the evaluation roadmap that ensures our simulation fidelity matures in lockstep with onboard needs.

  • The "Critic" for the System: You will design the comprehensive mathematical frameworks that validate our hybrid world. You will decide how we balance distinct evaluation needs—from verifying logical rules and dynamics to measuring the distribution quality of generative AI models.

  • Build at Scale: You will lead the design of large-scale, extensible evaluation platforms (C++/Python). You ensure our metric pipelines are not just scripts, but robust distributed systems capable of providing clear, reproducible signals on petabytes of data.

  • Strategic, Cross-functional Leadership You will act as the technical bridge between organizations. You will partner closely with AI research and other simulation teams, as the eval workflows you build will drive rapid innovation and research roadmaps.

You have:


  • System-Level Engineering:


    • 8+ years of industry experience, with a focus on building complex data systems, evaluation platforms, or back-end infrastructure.

    • Expertise in designing systems that scale (C++, Python, distributed computing), with a strong focus on API design and maintainability.

  • Advanced Quantitative Intuition:


    • You don't just calculate metrics; you design frameworks. You can debate the merits of different statistical approaches (e.g., determining the right confidence intervals for safety-critical validation) and apply them to complex, non-deterministic systems.

    • You have experience designing and implementing evaluation frameworks for complex systems or machine learning models.

  • Product-Aware Leadership:


    • Experience creating technical strategies that span multiple teams. You can translate high-level product requirements into concrete engineering problems (e.g., "To launch in snow, we need X specific friction metrics by Q2").

We prefer:


  • Background in fields that blend code, math, and simulation: Autonomous Vehicles, Algorithmic Trading, AdTech/Search Ranking, Machine Learning, or Robotics.

  • Familiarity with the validation of Generative AI (LLMs, Diffusion models) and/or classical simulation systems (Agent-based modeling, heuristics).

  • Experience driving technical roadmaps for large-scale systems or validation frameworks.

  • Experience guiding a team or system through a major architectural shift.

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. 

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. 

Salary Range

$238,000 - $302,000 USD

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Simulator Evaluation in San Francisco, CA vacancy
  • $204k - $259k

     ...roads and tens of billions in simulation across 15+ U.S. states....  ...Waymo Driver. The Simulator Evaluation team faces the ultimate data...  ...We are looking for a Senior Software Engineer to build the metrics and systems...  ...you will report to a Senior Staff Software Engineering Manager... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • Skyrocket Ventures is looking for engineers who are proficient in Python and willing...  ...role focuses on building and improving simulation and evaluation platforms for AI agents in San...  ...will have 5-10 years of experience in software engineering, particularly in backend... 
    Suggested

    Skyrocket Ventures

    San Francisco, CA
    2 days ago
  • $170k - $216k

     ...million miles on public roads and tens of billions in simulation across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the Waymo...  ...resource constraints. Collaborate with other engineers, data scientists, statisticians and the leadership... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  •  ...trust to grow their business.   We are seeking a Software Engineer to build out our simulation and AI capabilities. You'll design and implement systems...  ...Develop counterfactual and what-if frameworks for evaluating bidding strategies, budget allocation, and pacing algorithms... 
    Suggested
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $204k - $259k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The Planner Evaluation team works on one of the key...  ...improving the quality of the software that drives the car. We are looking...  ...data-minded software engineers and data scientists to help us improve... 
    Suggested
    Full time
    Remote work

    Waymo

    San Francisco, CA
    15 hours ago
  • $213k - $263k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The Challenge...  ...simulation solutions that power evaluation and training across a diverse range of...  ...requirements. We are looking for a Senior Software Engineer who is passionate about solving complex... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $170k - $216k

     ...roads and tens of billions in simulation across 15+ U.S. states....  ...powers the Waymo Driver. Our software allows the Waymo Driver to perceive...  ...sensors, enabling software engineers like you to develop multi-...  ...-critical automation and evaluation frameworks that establish the... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $200k - $250k

     ...its commercial self-driving software to develop, test and...  ...Kodiak is recruiting a Staff Software Engineer to join our Planning team...  ...Perception, Controls, Systems, and Simulation teams to define interfaces...  .... As part of the evaluation process, we provide Endorsed... 
    Full time
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    San Francisco, CA
    15 hours ago
  • $170k - $216k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The...  ...effective Simulation-based products that evaluate the Waymo Driver's software stack at a massive scale. We solve...  ...broad range of customers Software Engineers, Product, Data Science, System... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...experimental, frontier-style engineering. The team continuously...  ...feedback loops through offline evaluation and online experimentation,...  ...About the Role As a Staff Software Engineer on the Agent Orchestration...  ..., testing, and simulation systems to ensure safe, measurable... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    15 hours ago
  • $159k - $268k

     ...way. To learn more visit: Simulation is at the core of Waabi’s approach...  .... Our closed-loop simulation engine built with the latest in...  ...environment for training and evaluating self-driving systems. The Simulation...  ...and implement orchestration software between simulation... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    4 days ago
  •  ...London offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data...  ...and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity... 
    Full time
    Work at office
    Relocation package

    Mercor

    San Francisco, CA
    1 day ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform for...  ...the role Flow is seeking staff software engineers to build AI-powered capabilities...  ...engineers" explore designs, simulate changes, and validate requirements. Evaluate and integrate language models... 
    Flexible hours

    Flow Engineering

    San Francisco, CA
    2 days ago
  • $251k - $310k

     ...public roads and tens of billions in simulation across 15+ U.S. states. The Planner...  ...Waymo Driver’s behavior. We are the software engineering team responsible for Waymo's high-level...  ..., research, simulation, and evaluation Mentor engineers in leading adoption... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    15 hours ago
  • An innovative company is seeking a skilled software engineer to enhance its autonomous driving technology. In this hybrid role, you will develop and improve simulation data pipelines to evaluate the driving capabilities of a cutting-edge driver system. Your expertise in... 

    Waymo

    San Francisco, CA
    2 days ago
  • Waymo is seeking experienced data-minded software engineers for the Planner Evaluation team to measure and improve the Onboard software stack. You will develop signals, use simulations and real-world logs to assess driving performance, and design methods to connect changes... 

    Waymo

    San Francisco, CA
    14 hours ago
  • $251k - $310k

     ...Waymo Software Engineer Waymo is an autonomous driving technology company with the mission...  ...public roads and tens of billions in simulation across 15+ U.S. states. Software Engineering...  ...; develop tools, algorithms and evaluation mechanisms; scale them to Google-sized... 
    Full time
    Remote work

    Latent Logic

    San Francisco, CA
    5 days ago
  •  ...patients worldwide.We’re a team of engineers, clinicians, and innovators united by...  ...DescriptionPrimary Function of PositionAs a Senior Software Engineer - Simulation & ML Platform, you will build...  ...-model development, sim-to-real evaluation, and machine-learning... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    1 day ago
  • $204k - $259k

     ...on public roads and tens of billions in simulation across 15+ U.S. states. The...  ...a diverse, and collaborative group of software engineers, machine learning (ML) engineers, and data...  ...this role, you will report to a  Senior Staff Engineering Manager.   You will:... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $210k - $300k

     ...hardcore and obsessed team of the world's best engineers and operators. If you are obsessed with...  ...About the Role We're looking for a Software Engineer to join our ML Infrastructure...  ...reviews with peers and stakeholders to evaluate technical tradeoffs and select... 
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    18 days ago
  • $180k - $260k

     ....We’re looking for a deeply technical software engineer to join the Autonomy Validation team —...  ...platforms for validation — enabling both simulation at scale and rigorous scenario testing...  ...how system behavior should be evaluated.Systems and data engineers, to ensure... 
    Local area

    Zipline

    South San Francisco, CA
    4 days ago
  • $208.73k - $253k

     ...charged with fueling the future of Crusoe’s engineering muscle. We’re responsible for critical...  ...the future state of Crusoe’s evolving software development efforts and eliminate the friction...  ...Decision-Making: Expert ability to evaluate technical tradeoffs and understand how... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    1 day ago
  •  ...his first company to LinkedIn. About the Role As a Staff Software Engineer, you’ll shape the technical direction of Magical’s AI agent...  ...queues, run state, browser automation, model calls, system evaluations, observability, and human-in-the-loop recovery. You'... 
    Full time
    Work at office

    Magical

    San Francisco, CA
    15 hours ago
  •  ...and how we use AI in our recruiting process here . As a Staff Software Engineer at Pinterest, you will help define and drive the technical...  ...how and when each should be used. ~ Proven ability to evaluate complex systems, define pragmatic architectural direction,... 
    Full time
    Work at office
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    15 hours ago
  • $240k - $270k

     ...architecture. Hence, we are growing the engineering team and looking for engineers who are...  ...cases on top of modern warehouses Build software using the latest developer tools and...  ...your personal data for the purposes of evaluating your candidacy for employment at Sigma... 
    Full time
    Work at office
    Flexible hours

    Sigma Computing

    San Francisco, CA
    1 day ago
  • $220k - $250k

     ...About the Role: We are actively seeking an exceptional Staff Software Engineer for our cloud software team who will contribute to the operations...  ...to proposals and architecture documents. You will evaluate tools and frameworks, carefully considering their impact on... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    15 hours ago
  • $163k - $204k

     ...interview process. We’re looking for a seasoned full-stack software engineer to join Gusto’s Growth team and lead the next generation of...  ...early concepts and technical direction through launch, evaluation, iteration, and long-term ownership in production. On this... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    15 hours ago
  • $217k - $289k

     ...Experience team exists to make our ~120 engineers (and growing) measurably faster and...  ...their day better. We are looking for a Staff Software Engineer to set technical direction for...  ...notice, explain how it works and what it evaluates, and obtain consent beforehand. New... 
    Full time
    Live in
    Remote work
    Home office
    Flexible hours
    Day shift
    3 days per week

    Grow Therapy

    San Francisco, CA
    1 day ago
  •  ...sits at the intersection of product and engineering– you'll own features end-to-end, from...  ...work reliably in production, building evaluation frameworks to measure quality, and iterating...  ...Qualifications ~4+ years of software engineering experience, with at least 1... 
    Full time

    Emergence Capital Partners

    San Francisco, CA
    1 day ago
  • $231k - $340k

     ...close to our customers — from leadership to engineers — and work together to solve real...  ...AI features rapidly and safely. As a Software Engineer on the Developer Experience team...  ...benchmarking infrastructure essential for evaluating and optimizing the performance of AI-native... 
    Full time

    Harvey

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Simulator Evaluation. Be the first to apply!