Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, ML Evaluation Infra and Efficiency

$238k - $302k

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Waymo ML Frameworks & Efficiency team partners closely with Research and Production teams across Waymo to develop and deploy models in Perception and Planning that are core to our autonomous driving software. We help our partners by offering the best frameworks for the entire model development lifecycle, including training and evaluation. They are geared towards both scaling models with efficiency and solving problems unique to ML for autonomous driving.

We are looking for engineers with ML system expertise to help us train, evaluate and improve pre-trained models to be deployed into Waymo Driver, and potential future products. You'll work closely with researchers and modeling engineers across the company, and tackle the challenges of different evaluation scenarios for Waymo drivers, building large-scale evaluation platforms that can scale across compute, data, and environments to improve model intelligence and alignment with human drivers.

You Will:

  • Design and build distributed evaluation platforms for large-scale ML evaluation workloads.

  • Profile evaluation platforms, identify performance bottlenecks (CPU, memory, I/O, network), and implement optimizations to improve inference speed and resource utilization.

  • Collaborate with ML engineers to understand evaluation requirements and scenarios, and improve DevX of the evaluation infrastructure.

  • Improve runtime goodput of ML inference workload and efficiency of metrics computations, ensuring scalability and reliability across distributed environments.

  • Implement and maintain advanced ML infrastructure tools, including ML Pathways, JAX, Flume and TensorFlow.

You Have:

  • B.S. in Computer Science, Math, or 3+ years equivalent real-world experience.

  • Proficient in distributed systems design with an understanding of ML efficiency.

  • Experience with ML frameworks, including TensorFlow, JAX, XLA.

  • Solid programming skills in Python and C++.

  • Practical familiarity with profiling tools to uncover performance bottlenecks.

We Prefer:

  • MS in Computer Science, Math

  • Familiarity with large-scale evaluation platforms for LLMs.

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range $238,000$302,000 USD
Required
Preferred
Job Industries
  • Other
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, ML Evaluation Infra and Efficiency in Mountain View, CA vacancy
  • $238k - $302k

     ...states. The Waymo ML Infrastructure team...  ...our autonomous driving software. We help our partners...  ...will improve the runtime efficiency of input data...  ...with researchers and ML engineers to resolve bottlenecks...  ...JAX, and TensorFlow. Evaluate and integrate modern technologies... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    5 days ago
  • $204k - $259k

     ...states. Waymo's Release Evaluation org ensures that each version...  ...Evaluation, the Sampling and Efficiency team applies importance sampling...  .... Collaborate with other engineers, data scientists,...  ...training, evaluating, and applying ML models ~ Experience working... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago
  • $160.36k - $240.54k

     ...Senior Software Engineer, Cloud Efficiency & Cost Optimization Mountain View, California (HQ) Who We Are...  ...engineering organization — Autonomy, ML Platform, Simulation, Perception, Behavior...  ...design skills, with the ability to evaluate and influence tradeoffs across cost... 
    Senior

    Nuro

    Mountain View, CA
    3 days ago
  • $160.36k - $240.54k

     ...Senior Software Engineer – GenAI Infrastructure & Agent Systems for Engineering Efficiency Mountain View, California (HQ) Who We Are Nuro...  ..., knowledge discovery, and ML model improvement. We...  ...systems that run experiments, evaluate results, and propose... 
    Senior

    Nuro

    Mountain View, CA
    3 days ago
  • $204k - $259k

     ...and deploying advanced ML models that interpret...  ...essential for safe and efficient autonomous operation....  ...you will report to the Senior Engineering Manager of Semantics....  ...features in the VLM data infra and validate the...  ...experience in the field of software engineering ~... 
    Senior
    Full time
    Work at office
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $204k - $259k

     ....S. states. The Planner Evaluation team works on one of the key...  ...improving the quality of the software that drives the car. We are looking...  ...data-minded software engineers and data scientists to help us...  ...coding in C++ Experience with ML Experience with A/B... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  •  ...About the Organization The Evaluation team builds and evolves the...  ...results into clear feedback for engineering and leadership, and help...  ...introspect autonomous driving software performance atinterfaces across...  ...develop new statistical and ML methods to quantify performance... 
    Senior
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $213k - $263k

     ...Senior Machine Learning Engineer (Infra), Driver Understanding and Evaluation Waymo is an autonomous driving technology company with the...  ...looking for researchers and software engineers who are passionate about...  ...systems covering the ML lifecycle, supporting planet-scale... 
    Senior
    Full time

    Waymo

    Mountain View, CA
    4 days ago
  • $140k - $390k

     ...What to Expect As a Software Engineer on the Autopilot Simulation team...  ...with building high-trust in evaluation metrics and a test harness runtime...  ...automation to improve the efficiency, accuracy, and coverage of...  ...experience, preferably in ML-based evaluation systems, robotics... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    4 days ago
  • $170k - $216k

     ...the Waymo Driver. Our software allows the Waymo Driver...  ..., enabling software engineers like you to develop multi...  ...automated system Evaluate new hardware specifications...  ..., and evaluation of ML products ~ Strong...  ...in C++ with robust and efficient code We prefer:... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $204k - $259k

     ...S. states. The Waymo ML Frameworks & Efficiency team partners with Research...  ...to our autonomous driving software. We help our partners by...  ...driving. We are looking for engineers with ML system expertise...  ...by the rollouts. Build evaluations, analyze experimental... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago
  • $213k - $263k

     ...the Driver Understanding and Evaluation (DUE) team at Waymo is to...  ...role, you will report to a Software Engineering Manager. You will:...  ...driving behavior. Apply ML models from partner teams, and...  ...them yourself, to improve the efficiency of our "virtual driver's test... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    10 hours ago
  • $213k - $263k

     ...ensure that we can continue to evaluate safety and service quality...  ..., technically hands-on Senior Software Engineer to design and implement these...  ..., sim and analysis infra teams to translate ambiguous...  ...complexity, computationally efficient, and highly reliable. Mentor... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago
  • $190k - $220k

     ..., auditable data that software can understand and act...  ...some of the strongest AI Engineers and Machine Learning...  ..., and production ML infrastructure. We build...  ...quality, edge cases, evaluation, and real customer data...  ...optimized for high cost efficiency. Lead cross-functional... 
    Senior
    Work at office

    Landing AI

    Mountain View, CA
    5 days ago
  • $162k - $260k

     ...bring a safer, more efficient, and more accessible...  ...responsible for the software that safely and accurately...  ...are searching for a Senior Software Engineer to join us in solving...  ...Rigorously evaluate and test solutions to...  ...Prior experience with ML solutions and/or GPU... 
    Senior
    Work at office
    Local area
    3 days per week

    Aurora Innovation

    Mountain View, CA
    2 days ago
  • $204k - $259k

     ...across 15+ U.S. states. Software Engineering builds the brains of Waymo's...  ...tools, algorithms and evaluation mechanisms; scale them to Google...  ...~ BS in Computer Science, ML, Robotics, similar technical...  ...experience programming in C++ with efficient code ~ Experience... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    4 days ago
  • $181.1k - $318.4k

     ...AIML - Sr. Software Development Engineer, Evaluation At Apple, we create world-class innovative...  ...seeking an experienced Senior Backend Software Engineer...  ...of Apple's AI/ML features. Responsibilities...  ...allowing ML engineers to efficiently evaluate and train machine... 
    Senior
    Immediate start
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $179.2k - $268.8k

     ...Senior Software Engineer - ML Integration Latitude AI develops automated driving technologies, including...  ...compute environments, and writing efficient software architectures that take...  ...out-of-distribution driving events Evaluate and verify the system's performance... 
    Senior
    Permanent employment
    Full time
    Work at office
    Immediate start
    Visa sponsorship

    Latitude AI

    Palo Alto, CA
    1 day ago
  • $296.3k

     ...About the team: The AV ML Infra team at GM builds ML infrastructure...  ...more. We enable scalable and efficient ML experimentation, enhance the productivity of ML engineers, and drive the adoption of...  ...participate in a company vehicle evaluation program, through which you... 
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  • $117k - $234k

     ...Senior Software Engineer Multiple locations Regular/ Permanent Salaried...  ...engineer will integrate AI/ML capabilities, drive continuous...  ...business needs are being met by evaluating the ongoing effectiveness...  ...suggestions for improving efficiency and cost-effectiveness; and... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Part time
    Remote work

    Sam's Club

    Sunnyvale, CA
    4 days ago
  • $153k - $222k

     ...for both infrastructure engineers with expertise in...  ...learning pipelines and ML engineers that want to...  ...to join the Data & ML infra group. This role will work...  ...training frameworks, compute, evaluation, and deployment) and...  ...degree in Computer Science, Software Engineering, or... 
    Senior
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    4 days ago
  • $213k - $263k

     ...across 15+ U.S. states. The ML Ops team, part of Waymo ML...  ...via data store and data infra ecosystem. Work closely with...  ...data store. Improve the efficiency of data storage, data...  ...experience in the field of software engineering ~ Experience programming in... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    10 hours ago
  • $181.1k - $318.4k

     ...AI/ML - Senior OS Software Engineer, Evaluation For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end... 
    Senior
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $110k - $190k

     ...Overview We are hiring a Senior Software & AI Engineer to build production-grade...  ...agent-based workflows Evaluate tradeoffs between...  ...systems are reliable, cost-efficient, observable, and safe in real...  ...world use Apply traditional ML techniques where appropriate... 
    Senior

    Covalent

    Sunnyvale, CA
    3 days ago
  • $120k - $200k

    We are hiring software engineers with extensive industry experience and expertise...  ...of software engineering, AI/ML/NLP engineering, and data...  ...and unstructured data to evaluate system performance, generate...  ...APIs. ~Ability to craft efficient algorithms and data pipelines... 
    Senior
    Remote work

    Solomon Page

    Palo Alto, CA
    3 days ago
  • $272k - $431.25k

     ...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA...  ...As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $175k - $215k

     ...next generation of operational efficiency for Waymo's rapidly expanding...  ...simulation, and integrating ML models in production at scale...  ..., including hardware design engineers, failure analysis engineers,...  ...needs. Experience in training, evaluating, and deploying machine... 
    Full time
    Contract work
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $170k - $216k

     ...15+ U.S. states. The Perception Evaluation team at Waymo is at the forefront of autonomous...  ...operation. We are seeking a Software Engineer play a pivotal role in shaping the future...  ...evaluation infrastructure for better efficiency, scalability, and reliability. Collaborate... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago
  • $140k - $252k

     ...What to Expect As a Software Engineer within the Supercomputing AI Infrastructure team, you will...  ...that cluster resources are utilized efficiently and that engineers can iterate quickly...  ...job throughput Work closely with the ML team to understand workload patterns and... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    4 days ago
  • $213k - $263k

     ...We focus on transforming the Software Development Life Cycle (SDLC)...  ...agent frameworks, enabling our engineering teams to build, test, and...  ...: Develop data pipelines and evaluation strategies to deploy state-of...  ...robust software Advanced AI/ML: Strong expertise in Large Language... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, ML Evaluation Infra and Efficiency. Be the first to apply!