Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Bulk/Interactive Inference

$170k - $216k
Full-time

Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The ML Ops team, part of Waymo ML Platform team, builds tools and infrastructure to realize the ML flywheel at Waymo. This includes building automation and orchestration solutions to make complex ML workflows manageable and reliable. This team also partners closely with the modeling team to realize solutions to speed up developer velocity.

We’re looking for a software engineer to join the team to build and maintain the critical data and ML pipelines that powers ML development at Waymo.

In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.

You will:

  • Develop Waymo's inference platform to make it scalable, high throughput, and low latency
  • Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs
  • Improving the efficiency of running inference on these large models to increase throughput and save cost
  • Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling

You have:

  • 5+ years of professional experience in the field of software engineering
  • Experience in programming C++
  • Experience with building highly scalable distributed system

We prefer:

  • Passionate about building internal infra and tools
  • Experience with building model hosting and inference solutions
  • Experience with handling datasets in the order of exabytes

#LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$213,000—$263,000 USD

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Bulk/Interactive Inference in Mountain View, CA vacancy
  • $129.4k - $198.4k

    Job DescriptionSenior Software Engineer — Interactive ExperienceJob SummaryWe are seeking a highly skilled and experienced Senior Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will design and deliver production... 
    Senior
    Full time
    Local area
    Work from home
    Flexible hours
    Shift work

    General Motors

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...Senior Software Engineer for Quantized InferenceNVIDIA is seeking software engineers to accelerate...  ...and deployment of efficient inference recipes for LLMs. A recipe defines which...  ...to further optimize throughput and interactivity on target workloads. This work is a... 
    Senior

    NVIDIA

    Santa Clara, CA
    18 hours ago
  • $165k - $242k

     ...Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    17 hours ago
  • $139k - $204k

     ...What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to...  ...orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    17 hours ago
  • $139k - $204k

    What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency...  ..., and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $193.93k - $291.15k

     ...RoleWe’re looking for an Autonomy Engineer focused on onboard autonomy—the software that runs on the robot/vehicle/...  ..., lane/route following, docking, interaction behaviors).Implement and maintain...  ...and field telemetry.Experience in inference optimizationAt Nuro, we celebrate... 
    Senior
    Local area
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $152k - $241.5k

     ...most challenging problems. We're seeking talented and motivated engineers to join our TensorRT team in developing the industry-leading deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT team, you will be responsible... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $210.3k - $273.4k

     ...Senior Software EngineerAt Unity, we're shaping the future of real-time 3D technology...  ...authoring tools to new ways of interacting with content, we're engineering the next generation of pipelines...  ..., powering asset generation, LLM inference, and the ML-driven tools that bring... 
    Senior
    Temporary work
    Work at office

    Unity

    Mountain View, CA
    2 days ago
  • $152k - $241.5k

    We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $193.93k - $291.15k

     ...driverless autonomy. We are looking for strong software engineers to research, develop, and implement...  ...best solutions from cross-functional interactions.Desire to work at the edge of research...  ...systems, distributed training, or inference optimization.At Nuro, we celebrate... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  •  ...NVIDIA is seeking a Senior Software Engineer for Deep Learning Inference to help build a state-of-the-art inference framework on NVIDIA GPUs, accelerating large language models. You will join the TensorRT Workflows team and tackle scalable, real-time inferencing challenges... 
    Senior

    NVIDIA AI

    Santa Clara, CA
    17 hours ago
  • $193.3k - $261.5k

     ...learn from real-world customer interactions to become more helpful,...  ...operational excellence* Raise the engineering bar through technical...  ...non-internship professional software development experience- 5+ years...  ...architecture, training/inference lifecycles, and optimization... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Palo Alto, CA
    2 days ago
  • $184k - $287.5k

    We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...edge AI technology for safety-critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and other specialized platforms. Your expertise... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    12 hours ago
  • $193.3k - $261.5k

     ...Amazon builds Amazon Neuron, the software development kit used to...  ...JAX enabling unparalleled ML inference and training performance.The...  ...hardware-software boundary, our engineers build systematic infrastructure...  ...-sharing and mentorship. Our senior members enjoy one-on-one... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $200k - $300k

     ...delivering truly magical, meaningful interactions through the services...  ..., and raising the bar for engineering excellence. You'll fit right...  ...model hosting (self‑hosted inference servers, serverless GPUs, or...  ...10–15 years of professional software engineering experience.... 
    Senior
    Work at office
    Relocation
    Flexible hours
    Weekend work

    MetAntz

    Palo Alto, CA
    17 hours ago
  • $174k - $252k

     ...development, and optimization of software components critical for Large Language Model (LLM) inference serving on GDC. This includes...  ...Kubernetes, Google Kubernetes Engine (GKE)), networking...  ...of users connect, explore, and interact with information and one another... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • Cerebras Systems, Inc. is looking for a Senior Performance Engineer to enhance the performance benchmarking and competitive pricing models for their...  ...candidate will have extensive experience with open-source inference frameworks and an understanding of ML systems. This role... 
    Senior

    Cerebras Systems, Inc.

    Sunnyvale, CA
    1 day ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...About The RoleWe are hiring a Senior Performance Engineer to join our Product team....  ..., KV-cache strategies—interact with the realities of GPU...  ...CerebrasPeople who are serious about software make their own hardware.... 
    Senior
    Contract work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...for the next generation of interactive world models. We work with the...  ...of research and systems engineering, where we turn new ideas into...  ...simulation, rendering, and real-time inference from prototype through...  ....8+ years of relevant software engineering experience.Experience... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    12 hours ago
  • $140k - $200k

     ...Senior Software Engineer – Zero Trust for Agentic AI Cyberattacks on critical infrastructure, government...  ...inputs, outputs, tool calls, and API interactions. Implement Deterministic Access...  ...), and implementing low‑latency inference at the proxy/gateway level. AI/LLM... 
    Senior
    Contract work
    Worldwide
    Visa sponsorship

    xage, inc

    Palo Alto, CA
    17 hours ago
  • $193.93k - $352.29k

     ...components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $139k - $204k

     ...CoreWeave is seeking a Senior Engineer to lead designs and enhance engineering standards within their Kubernetes-native inference platform. Responsibilities include driving architecture, defining SLIs/SLOs, and mentoring engineers, with 3-8 years of experience preferred... 
    Senior
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    17 hours ago
  • $165k - $242k

     ...A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed... 
    Senior

    CoreWeave

    Sunnyvale, CA
    17 hours ago
  •  ...Inc. is looking for a Sr. Member of Technical Staff to design software features that enhance system resiliency and high availability...  ...distributed environments. The role includes developing scalable AI inference services and deploying cloud-based workflows. Ideal candidates... 
    Senior

    Cerebras Systems, Inc.

    Sunnyvale, CA
    12 hours ago
  • $193.93k - $291.15k

     ...build solutions to unify and simplify the interactions of complex systems.Work across a large...  ....Collaborate closely with autonomy engineers and build an understanding of how autonomy...  ...have 3+ years of experience working in software engineering or related fields.You are a... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $193.3k - $261.5k

    We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational...  ...scale inference workloadsReal-Time & Interactive Runtime• Own the real-time serving...  ...years of non-internship professional software development experience- 5+ years of programming... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    2 days ago
  • $174k - $253k

     ...high-performance features.Collaborate with engineers across various teams to understand...  ...practical experience.5 years of experience in software development for core system-level...  ...billions of users connect, explore, and interact with information and one another. Our products... 
    Senior

    Google

    Sunnyvale, CA
    12 hours ago
  • $137.1k - $188.3k

     ...innovative Dolby Imaging/Video algorithms and software.  You will contribute to new technical...  ...in Computer Science and/or Electrical Engineering with an emphasis and passion for...  ...plus.  Experience with implementing C++ inference support for ONNYX models using onnxruntime... 
    Senior
    Full time
    Local area
    Worldwide
    Flexible hours

    Dolby

    Sunnyvale, CA
    2 days ago
  • $230k - $250k

    Cerebras Systems is seeking a Sr. Member of Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Bulk/Interactive Inference. Be the first to apply!