Software Engineer, Bulk/Interactive Inference
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The ML Ops team, part of Waymo ML Platform team, builds tools and infrastructure to realize the ML flywheel at Waymo. This includes building automation and orchestration solutions to make complex ML workflows manageable and reliable. This team also partners closely with the modeling team to realize solutions to speed up developer velocity.
We’re looking for a software engineer to join the team to build and maintain the critical data and ML pipelines that powers ML development at Waymo.
In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.
You will:
- Develop Waymo's inference platform to make it scalable, high throughput, and low latency
- Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs
- Improving the efficiency of running inference on these large models to increase throughput and save cost
- Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling
You have:
- 2+ years of professional experience in the field of software engineering
- Experience in programming C++
- Experience with building highly scalable distributed system
We prefer:
- Passionate about building internal infra and tools
- Experience with building model hosting and inference solutions
- Experience with handling datasets in the order of exabytes
#LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$170,000—$216,000 USD
$2,000 per month
...architecture and design of the Sohu host software stack Implement high-performance,... ...handling continuous batching and real time inference Implement inference-time... ...person team in Cupertino, and greatly value engineering skills. We do not have boundaries between...SuggestedFull timeWork at officeRelocation package- ...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks’ Foundation Model API. You’ll work at the intersection of research and production, ensuring our large language...SuggestedFull time
$92k - $135k
...intelligence that drives innovation. What You’ll Do: Join the Inference team to ship production features that improve latency,... ...practices, and grow quickly with mentorship from experienced engineers. About the role: Implement well-scoped features and...SuggestedPermanent employmentFull timeTemporary workCasual workInternshipWork at officeRemote workFlexible hours$170k - $216k
...products that evaluate the Waymo Driver's software stack at a massive scale. We solve... ...for a broad range of customers Software Engineers, Product, Data Science, System Engineering... ...You will: Build and evolve ML inference infrastructure for simulations. Be responsible...SuggestedFull timeRemote work- ...is transforming how robots interact with the real world. We are building... ...skilled and motivated MLOps Engineer to join our engineering team.... ..., training, evaluation, inference and deployment workflows.... ...ML components into robotics software systems. What You Have...SuggestedFull timeWork experience placementRemote work
$120k - $180k
...Role We are looking for a high-agency Software Engineer to help build the core systems behind... ...This is a system where software directly interacts with a physical network. Latency,... ...ML systems in production (especially inference pipelines) You should be comfortable...Full timeWork at office- ...claims and support over 200 million patient interactions. Our latest $70M raise at a $7B... ...About the Role We're hiring a Software Engineer II to join Air Billing , the team behind... ...rebuilding the claims workspace, making bulk operations safe over tens of thousands...Full timeLive inWork at officeImmediate start
- ...frameworks. Strong track record of working with machine learning systems and/or platforms. Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them. Experience serving fine-tuned LLMs (PEFT, DPO, RL...Full time
$300k - $405k
...group of committed researchers, engineers, policy experts, and... ...engineering teams to optimize interactions between our workloads and underlying... ..., or related low-level software engineering Understand... ...VM configurations to reduce inference latency for large language models...Full timeWork at officeVisa sponsorshipFlexible hours- ...compounds across the platform. Engineers here use AI as a force... ...that handle real customer interactions and business workflows end-to... ...About the Role As a Software Engineer, you’ll work directly... ...that supports production-level inference, evaluation, and monitoring...Full timeTemporary workWork at officeFlexible hours
$200k - $250k
...experience, and we’re looking for a Senior MLOps Engineer to help us run them reliably and... ..., and scaling — across a custom-built inference platform powering a live conversational... ...For ~5–8+ years of experience in software, ML, platform, or infrastructure engineering...Full timeRemote workFlexible hours- ...we build. We're an AI-first engineering team that uses the latest models... ...runs at active mines Interact directly with users to deeply... ...~2+ years of professional software engineering experience (high... ...with computer vision or ML inference pipelines Experience integrating...Permanent employmentFull timeInternshipRemote workFlexible hoursNight shift
- ...architect AI that learns from and interacts with the world like humans... ...innovation and systems engineering paired with a design-minded... ...models, and we're looking for a Software Engineer to help build the... ...systems, model training, and inference — it is not a siloed data...Full timeWork at officeVisa sponsorshipFlexible hours
$165k - $242k
...platform that gives network engineers, fleet engineers, and operations... ...The goal is to build bespoke software to model our infrastructure... ...support the data density and interaction speed the frontend demands, including... ...filtering, aggregation, and bulk operations across large...Permanent employmentFull timeTemporary workCasual workWork at officeRemote workFlexible hours$320k
...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the role The Cloud Inference team scales and optimizes Claude to serve... ...qualifications Have significant software engineering experience, with a strong background...Full timeWork at officeVisa sponsorshipFlexible hours$184.03k
...position What you can expect As a Software Engineer, you will play a key role in designing... ...-end development and have experience interacting with the front-end. About the team... ...data pipelines for model training and inference, including data validation, transformation...Work at officeRemote work$100k - $200k
...hear from you! We are looking for a Software Engineer (early career to senior level) to join... ...TensorFlow) deep learning models for fast inference performance Contribute technically... ...content for proposals and reports Interact with customers (e.g., at project...Full timeWork experience placementCasual workWork at officeFlexible hours$150k - $230k
...billion events and run millions of AI inference queries, transforming raw feedback and... ...actionable product insights. As a senior software engineer, you’ll own and evolve the backend... ...product surface that UX researchers and PMs interact with. The team operates across the...Full timeWork at officeFlexible hours$120k - $240k
...tech company of scientists and engineers, developing machine learning... ...of custom-tailored software solutions with small, high performing... ...learnings from customer interactions and rapid prototyping of solutions... ...(eg. model training, model inference, hardware accelerations)...Full timeWork experience placementWork at officeRemote workFlexible hours$193.93k - $291.15k
...driverless autonomy. We are looking for strong software engineers to research, develop, and implement... ...best solutions from cross-functional interactions. Desire to work at the edge of... ...critical systems, distributed training, or inference optimization. At Nuro, we celebrate...Full timeImmediate start- Role Description In the Senior Engineer role, you will own meaningful subsystems of Stack AV's inference platform and drive them from design through production. You will... .... This position may also involve working with software and technologies subject to U.S. export...Full time
$90k - $210k
...technology. MORSE boasts a specially selected team of scientists, engineers, and software developers to deliver best-in-class technical solutions... ...page UIs from design documents Write backend APIs that interact with cloud services Work closely with team members to...Full time- ...our product daily. We build with AI, not around it. Our engineering team uses Claude Code and agentic coding tools as our primary... ...specifically Claude Code, and are proficient with its various modes (Interactive, Plan, Headless, Agent Teams, Delegate) You're "AI-pilled"...Remote jobFull time
- ...taxpayers — deserve good government. Yet today, interacting with government services is often... ...agencies. GovWell replaces legacy software for municipalities and counties, empowering... ...is hiring a Full-Stack Software Engineer to help build our core platform that powers...Full timeWork at officeLocal areaImmediate startRemote workFlexible hours3 days per week
$125k - $150k
...ultimate goal of enabling human life on Mars. FULL STACK SOFTWARE ENGINEER, OBSERVABILITY (STARLINK) At SpaceX we’re leveraging our experience... ...in real time Develop frontend visualizations, interactive dashboards, and UI components that present processed data in...Permanent employmentFull timeTemporary workInternshipWorldwideWeekend work$110k - $270k
...unit (GPNPU) architecture. Quadric's co-optimized software and hardware is targeted to run neural network (NN) inference workloads in a wide variety of edge and... ...and control code. Role The Full-Stack Engineer is key to making the Quadric product and toolchain...Full timeWork at officeLocal areaImmediate startWorldwideFlexible hours$150k - $190k
...everything our lawyers do, so that the lawyers can focus on human interaction. We're starting with negotiating commercial contracts, and... ...ChatGPT. Description General Legal is seeking a software engineer who has the passion and drive to move fast, learn new things...Full timeContract workHome office- ...and research in domains such as Finance, Strategy Consulting, Engineering, Material Sciences, and more. We’re looking for strong... ...application. We are researching and developing entirely new kinds of interactive interfaces for analysts to collect, map out, synthesise, and...Full timeRemote work
$150k - $220k
...robotics (Penn, Caltech, CMU) and enterprise software development (Palantir, Stripe, Oracle,... ...our employees (including software engineers) visiting customer sites — ask us about... ...are not afraid to pick up new skills or interact across the technical stack to do so. ~...Full timeWork experience placementWork at office2 days per week- ...Looking for mid to senior engineers for a full stack contribution to a mission management... ...remarkable surveillance augmentation software. Newer UI components are written in React... ...opportunities for travel and direct interaction with operators on military aircraft and...Full timeCasual workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Bulk/Interactive Inference. Be the first to apply!
- software engineer full time Remote
- software system engineer Remote
- consulting software engineer Remote
- software engineer travel Remote
- software engineer mainframe Remote
- software engineer unity Remote
- real time software engineer Remote
- network software engineer Remote
- senior software engineer remote Remote
- entry level software engineer remote Remote



