Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Bulk/Interactive Inference

$170k - $216k
Full-time

Waymo


Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The ML Ops team, part of Waymo ML Platform team, builds tools and infrastructure to realize the ML flywheel at Waymo. This includes building automation and orchestration solutions to make complex ML workflows manageable and reliable. This team also partners closely with the modeling team to realize solutions to speed up developer velocity.

We’re looking for a software engineer to join the team to build and maintain the critical data and ML pipelines that powers ML development at Waymo.

In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.

 

You will:


  • Develop Waymo's inference platform to make it scalable, high throughput, and low latency

  • Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs

  • Improving the efficiency of running inference on these large models to increase throughput and save cost

  • Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling

 

You have:


  • 2+ years of professional experience in the field of software engineering

  • Experience in programming C++

  • Experience with building highly scalable distributed system

 

We prefer:


  • Passionate about building internal infra and tools

  • Experience with building model hosting and inference solutions

  • Experience with handling datasets in the order of exabytes

#LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. 

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. 

Salary Range

$170,000—$216,000 USD

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Bulk/Interactive Inference in Remote vacancy
  •  ...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks’ Foundation Model API. You’ll work at the intersection of research and production, ensuring our large language... 
    Suggested
    Full time

    Databricks

    Remote
    1 day ago
  • $2,000 per month

     ...architecture and design of the Sohu host software stack Implement high-performance,...  ...handling continuous batching and real time inference Implement inference-time...  ...person team in Cupertino, and greatly value engineering skills. We do not have boundaries between... 
    Suggested
    Full time
    Work at office
    Relocation package

    Etched

    Remote
    1 day ago
  • $129.4k - $198.4k

    Job DescriptionSenior Software Engineer — Interactive ExperienceJob SummaryWe are seeking a highly skilled and experienced Senior Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will design and deliver production... 
    Suggested
    Full time
    Local area
    Work from home
    Flexible hours
    Shift work

    General Motors

    Sunnyvale, TX
    5 days ago
  • $188k - $275k

     ...Do Description of the team: The Inference team is responsible for delivering high-...  ...role: We are looking for an Applied AI Engineer to help us understand, measure, and...  ...systems architecture, and hardware choices interact in production inference workloads. You... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Core Weave

    Remote
    1 day ago
  • $92k - $135k

     ...intelligence that drives innovation.  What You’ll Do: Join the Inference team to ship production features that improve latency,...  ...practices, and grow quickly with mentorship from experienced engineers. About the role: Implement well-scoped features and... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Internship
    Work at office
    Remote work
    Flexible hours

    Coreweave

    Washington DC
    1 day ago
  •  ...SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The application software team is the central nervous system of SpaceX - we create mission critical... 
    Permanent employment
    Temporary work
    Remote work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today’s most sophisticated AI applications. Our team is responsible... 
    Full time
    Remote work

    Nvidia

    Texas
    1 day ago
  • $160k - $240k

    Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref # 10050779 Description & Requirements Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    5 days ago
  • $170k - $216k

     ...products that evaluate the Waymo Driver's software stack at a massive scale. We solve...  ...for a broad range of customers Software Engineers, Product, Data Science, System Engineering...  ...You will: Build and evolve ML inference infrastructure for simulations. Be responsible... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $189.3k - $290.7k

    Job DescriptionJob Summary We are seeking a Staff Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will...  ...camera and sensor inputs, on-device perception and inference, driver-state interpretation, vehicle interfaces... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Milford, MI
    1 day ago
  • $165.2k - $223.6k

     ...Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep...  ...and JAX enabling unparalleled ML inference and training performance.The Inference Enablement...  ...the hardware-software boundary, our engineers build systematic infrastructure, innovate... 
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    23 hours ago
  • $113k - $163k

     ...infrastructure, including hardware, software, and network components....  ...for orchestration, feature engineering, model deployment, and...  ...supporting high traffic agent interactions, retrieval operations, and real...  ...for low-latency inference; GPU/accelerator utilization... 
    Full time
    Temporary work
    Local area
    Flexible hours

    John Hancock

    Toronto, OH
    3 days ago
  • $139k - $204k

    What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to...  ...orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    5 days ago
  • $165k - $242k

    Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    5 days ago
  • $165k - $242k

     ...degradation, rollback/traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing...  ...(Prometheus, Grafana, OpenTelemetry). Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming... 
    Permanent employment
    Temporary work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    5 days ago
  •  ...frameworks. Strong track record of working with machine learning systems and/or platforms. Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them. Experience serving fine-tuned LLMs (PEFT, DPO, RL... 
    Full time

    Snowflake

    Remote
    1 day ago
  •  ...claims and support over 200 million patient interactions. Our latest $70M raise at a $7B...  ...About the Role We're hiring a Software Engineer II to join Air Billing , the team behind...  ...rebuilding the claims workspace, making bulk operations safe over tens of thousands... 
    Full time
    Live in
    Work at office
    Immediate start

    Commure

    Remote
    1 day ago
  • $120k - $180k

     ...Role We are looking for a high-agency Software Engineer to help build the core systems behind...  ...This is a system where software directly interacts with a physical network. Latency,...  ...ML systems in production (especially inference pipelines) You should be comfortable... 
    Full time
    Work at office

    Constellation Space

    Remote
    1 day ago
  • $100k - $150k

     ...Description We are seeking a Full-Stack Software Engineer who combines deep platform engineering...  ...novel data flow patterns, system interaction models, and process automation methods...  ...features into product surfaces, working with inference APIs, or building human-in-the-loop... 
    Full time
    Temporary work

    Salute Inc.

    Remote
    1 day ago
  •  ...is transforming how robots interact with the real world. We are building...  ...skilled and motivated MLOps Engineer to join our engineering team....  ..., training, evaluation, inference and deployment workflows....  ...ML components into robotics software systems. What You Have... 
    Full time
    Work experience placement
    Remote work

    Fieldai

    Irvine, CA
    1 day ago
  • $187.36k - $265.9k

    Why Sony Interactive Entertainment?Sony Interactive Entertainment isn’t just the Best Place...  ...excellence and creativity.Senior Software Engineer, Machine Learning PlatformSan Diego, CARole...  ...lead the design of next-generation ML inference infrastructure to support globally... 
    Remote work
    Work from home

    Sony Interactive Entertainment America

    San Diego, CA
    4 days ago
  • $152k - $241.5k

     ...company”.We are looking for an AI & Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning & AI Compiler (DLC) team...  ...of AI, our DLC has been the backbone of NVIDIA’s inference engine, spanning across data centers, personal devices,... 
    Full time
    Remote work

    Nvidia

    Austin, TX
    5 days ago
  • $300k - $405k

     ...group of committed researchers, engineers, policy experts, and...  ...engineering teams to optimize interactions between our workloads and underlying...  ..., or related low-level software engineering Understand...  ...VM configurations to reduce inference latency for large language models... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    Remote
    1 day ago
  • $100 per hour

    Role Description We’re looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code... 
    Contract work
    Immediate start

    G2i Inc.

    Remote
    3 days ago
  • $200k - $250k

     ...experience, and we’re looking for a Senior MLOps Engineer to help us run them reliably and...  ..., and scaling — across a custom-built inference platform powering a live conversational...  ...For ~5–8+ years of experience in software, ML, platform, or infrastructure engineering... 
    Full time
    Remote work
    Flexible hours

    Wizard

    United States
    1 day ago
  • $145k - $275k

     ...placing the best product managers, software, and hardware talent at...  ...help them hire. Software Engineer – Edge AI Systems...  ...autonomous systems Optimize model inference across CPUs, GPUs, and specialized...  ...AI platforms that directly interact with drones, sensors, robotics... 
    Full time
    Remote work

    Recruiting From Scratch

    Remote
    1 day ago
  •  ...compounds across the platform. Engineers here use AI as a force...  ...that handle real customer interactions and business workflows end-to...  ...About the Role As a Software Engineer, you’ll work directly...  ...that supports production-level inference, evaluation, and monitoring... 
    Full time
    Temporary work
    Work at office
    Flexible hours

    Baton

    Remote
    1 day ago
  •  ...we build. We're an AI-first engineering team that uses the latest models...  ...runs at active mines Interact directly with users to deeply...  ...~2+ years of professional software engineering experience (high...  ...with computer vision or ML inference pipelines Experience integrating... 
    Permanent employment
    Full time
    Internship
    Remote work
    Flexible hours
    Night shift

    Realm

    United States
    1 day ago
  • $320k

     ...growing group of committed researchers, engineers, policy experts, and business leaders working...  .... About the role The Cloud Inference team scales and optimizes Claude to serve...  ...qualifications Have significant software engineering experience, with a strong background... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    Remote
    1 day ago
  • $184.03k - $275.4k

     ...this positionWhat you can expectAs a Software Engineer, you will play a key role in designing...  ...back-end development and have experience interacting with the front-end.About the teamThe...  ...data pipelines for model training and inference, including data validation, transformation... 
    Full time
    Work at office
    Remote work

    Zoom

    Seattle, WA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Bulk/Interactive Inference. Be the first to apply!