Senior Software Engineer, Bulk/Interactive Inference
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The ML Ops team, part of Waymo ML Platform team, builds tools and infrastructure to realize the ML flywheel at Waymo. This includes building automation and orchestration solutions to make complex ML workflows manageable and reliable. This team also partners closely with the modeling team to realize solutions to speed up developer velocity.
We’re looking for a software engineer to join the team to build and maintain the critical data and ML pipelines that powers ML development at Waymo.
In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.
You will:
- Develop Waymo's inference platform to make it scalable, high throughput, and low latency
- Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs
- Improving the efficiency of running inference on these large models to increase throughput and save cost
- Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling
You have:
- 5+ years of professional experience in the field of software engineering
- Experience in programming C++
- Experience with building highly scalable distributed system
We prefer:
- Passionate about building internal infra and tools
- Experience with building model hosting and inference solutions
- Experience with handling datasets in the order of exabytes
#LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$213,000—$263,000 USD
$129.4k - $198.4k
Job DescriptionSenior Software Engineer — Interactive ExperienceJob SummaryWe are seeking a highly skilled and experienced Senior Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will design and deliver production...SeniorFull timeLocal areaWork from homeFlexible hoursShift work$152k - $241.5k
...Senior Software Engineer for Quantized InferenceNVIDIA is seeking software engineers to accelerate... ...and deployment of efficient inference recipes for LLMs. A recipe defines which... ...to further optimize throughput and interactivity on target workloads. This work is a...Senior$165k - $242k
...Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$139k - $204k
...What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to... ...orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency... ..., and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$193.93k - $291.15k
...RoleWe’re looking for an Autonomy Engineer focused on onboard autonomy—the software that runs on the robot/vehicle/... ..., lane/route following, docking, interaction behaviors).Implement and maintain... ...and field telemetry.Experience in inference optimizationAt Nuro, we celebrate...SeniorLocal areaImmediate startFlexible hours$152k - $241.5k
...most challenging problems. We're seeking talented and motivated engineers to join our TensorRT team in developing the industry-leading deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT team, you will be responsible...SeniorFull time$210.3k - $273.4k
...Senior Software EngineerAt Unity, we're shaping the future of real-time 3D technology... ...authoring tools to new ways of interacting with content, we're engineering the next generation of pipelines... ..., powering asset generation, LLM inference, and the ML-driven tools that bring...SeniorTemporary workWork at office$152k - $241.5k
We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA...SeniorFull time$193.93k - $291.15k
...driverless autonomy. We are looking for strong software engineers to research, develop, and implement... ...best solutions from cross-functional interactions.Desire to work at the edge of research... ...systems, distributed training, or inference optimization.At Nuro, we celebrate...SeniorImmediate startFlexible hours- ...NVIDIA is seeking a Senior Software Engineer for Deep Learning Inference to help build a state-of-the-art inference framework on NVIDIA GPUs, accelerating large language models. You will join the TensorRT Workflows team and tackle scalable, real-time inferencing challenges...Senior
$193.3k - $261.5k
...learn from real-world customer interactions to become more helpful,... ...operational excellence* Raise the engineering bar through technical... ...non-internship professional software development experience- 5+ years... ...architecture, training/inference lifecycles, and optimization...SeniorInternshipLocal areaFlexible hours$184k - $287.5k
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry...SeniorFull time$152k - $241.5k
...edge AI technology for safety-critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and other specialized platforms. Your expertise...SeniorFull time$193.3k - $261.5k
...Amazon builds Amazon Neuron, the software development kit used to... ...JAX enabling unparalleled ML inference and training performance.The... ...hardware-software boundary, our engineers build systematic infrastructure... ...-sharing and mentorship. Our senior members enjoy one-on-one...SeniorWork experience placementInternshipLocal areaFlexible hours$200k - $300k
...delivering truly magical, meaningful interactions through the services... ..., and raising the bar for engineering excellence. You'll fit right... ...model hosting (self‑hosted inference servers, serverless GPUs, or... ...10–15 years of professional software engineering experience....SeniorWork at officeRelocationFlexible hoursWeekend work$174k - $252k
...development, and optimization of software components critical for Large Language Model (LLM) inference serving on GDC. This includes... ...Kubernetes, Google Kubernetes Engine (GKE)), networking... ...of users connect, explore, and interact with information and one another...Senior- Cerebras Systems, Inc. is looking for a Senior Performance Engineer to enhance the performance benchmarking and competitive pricing models for their... ...candidate will have extensive experience with open-source inference frameworks and an understanding of ML systems. This role...Senior
- ...industry-leading training and inference speeds; over 10 times... ...About The RoleWe are hiring a Senior Performance Engineer to join our Product team.... ..., KV-cache strategies—interact with the realities of GPU... ...CerebrasPeople who are serious about software make their own hardware....SeniorContract workShift work
$184k - $287.5k
...for the next generation of interactive world models. We work with the... ...of research and systems engineering, where we turn new ideas into... ...simulation, rendering, and real-time inference from prototype through... ....8+ years of relevant software engineering experience.Experience...SeniorFull time$140k - $200k
...Senior Software Engineer – Zero Trust for Agentic AI Cyberattacks on critical infrastructure, government... ...inputs, outputs, tool calls, and API interactions. Implement Deterministic Access... ...), and implementing low‑latency inference at the proxy/gateway level. AI/LLM...SeniorContract workWorldwideVisa sponsorship$193.93k - $352.29k
...components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro...SeniorImmediate startFlexible hours$139k - $204k
...CoreWeave is seeking a Senior Engineer to lead designs and enhance engineering standards within their Kubernetes-native inference platform. Responsibilities include driving architecture, defining SLIs/SLOs, and mentoring engineers, with 3-8 years of experience preferred...SeniorRemote workFlexible hours$165k - $242k
...A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed...Senior- ...Inc. is looking for a Sr. Member of Technical Staff to design software features that enhance system resiliency and high availability... ...distributed environments. The role includes developing scalable AI inference services and deploying cloud-based workflows. Ideal candidates...Senior
$193.93k - $291.15k
...build solutions to unify and simplify the interactions of complex systems.Work across a large... ....Collaborate closely with autonomy engineers and build an understanding of how autonomy... ...have 3+ years of experience working in software engineering or related fields.You are a...SeniorImmediate startFlexible hours$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational... ...scale inference workloadsReal-Time & Interactive Runtime• Own the real-time serving... ...years of non-internship professional software development experience- 5+ years of programming...SeniorInternshipLocal areaFlexible hours$174k - $253k
...high-performance features.Collaborate with engineers across various teams to understand... ...practical experience.5 years of experience in software development for core system-level... ...billions of users connect, explore, and interact with information and one another. Our products...Senior$137.1k - $188.3k
...innovative Dolby Imaging/Video algorithms and software. You will contribute to new technical... ...in Computer Science and/or Electrical Engineering with an emphasis and passion for... ...plus. Experience with implementing C++ inference support for ONNYX models using onnxruntime...SeniorFull timeLocal areaWorldwideFlexible hours$230k - $250k
Cerebras Systems is seeking a Sr. Member of Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Bulk/Interactive Inference. Be the first to apply!
- senior robotics software engineer Mountain View, CA
- software system engineer Mountain View, CA
- intel software engineer Mountain View, CA
- software developer fintech Mountain View, CA
- new graduate software engineer Mountain View, CA
- software development engineer aws Mountain View, CA
- information technology software engineer Mountain View, CA
- graduate software developer no experience Mountain View, CA
- software developer internship no experience Mountain View, CA
- ngo software engineer Mountain View, CA


