Software Engineer, ML Inference, Simulation Infrastructure
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Simulation Infrastructure team creates reliable, scalable, and cost-effective Simulation-based products that evaluate the Waymo Driver's software stack at a massive scale. We solve complex technical challenges to build services and tools for a broad range of customers Software Engineers, Product, Data Science, System Engineering, and more. So if you want to build the next generation of Simulation products and infrastructure, we'd love to hear from you!
In this hybrid role you will report to the Software Engineering Manager.
You will:
- Build and evolve ML inference infrastructure for simulations.
- Be responsible for the reliability, latency, and user experience of ML model deployment and serving.
You have:
- B.Sc. in Computer Science, or a related field, or equivalent years of experience
- 3+ years of experience C++ and/or Golang programming experience
- Experience in developing and maintaining distributed systems.
We prefer:
- Experience working with large-scale distributed inference service.
- Experience working with popular ML frameworks, TPUs and optimizing models for serving.
- Experience with distributed systems principles, including scheduling, load balancing, and fault tolerance.
- Experience working with large FAANG scale distributed systems.
#LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range $170,000—$216,000 USD- ...About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier... ...GPU orchestration, large-scale inference systems, performance optimization,... .... Familiarity with GPU-based ML workloads or distributed training/...SuggestedInternshipImmediate start
$204k - $259k
...Senior Software Engineer, Simulation ML Infrastructure Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver...SuggestedFull timeRemote work$200k - $240k
...veteran operators and engineers, alumni of Sonos,... ...'re looking for a Software Engineer, Build Infrastructure and Test who thrives... ...our software and ML engineers to build... ...performance, low-latency AI inference in the field.... ...architecting simulation pipelines, hardware...SuggestedLocal areaRemote work$187.5k - $395k
...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and... ...our goal with reliable & scalable infrastructure, which is going to become the differentiating... ...with high performance large scale ML systems ( ~100 GPUs) ~ Experience...Suggested$142.2k - $204.6k
...-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and... ...with federated, distributed inference infrastructure - orchestrate across nodes, balance... ...systems Solid understanding of ML inference internals: attention,...SuggestedLocal areaWorldwide- ...language models are changing how engineers write code. Our vision is a... ...with building systems and infrastructure that are as simple as possible... ...underpin our product surface, model inference, and evaluation suite. You'll... ...love, moved and scaled AI/ML systems into production, and...Flexible hours
- ...Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible for... ...performance of our platform and LLM inference serving as we rapidly grow traffic.... ...distributed databases, retrieval systems, and ML models. Develop and maintain core...Full timeFlexible hours
$168k - $213k
...Senior Infrastructure Engineer Bretton AI is the leading AI agent platform for financial services... ...model capacity needs for low-latency AI inference. Architect and automate secure... ...regulated industries. Experience with AI/ML infrastructure and model deployment at...Flexible hours- ...updates on our news and engineering blogs and join us as... ...the future of AI and ML at Whatnot. You’ll... ...design and scale the core infrastructure that powers machine... ...& high-throughput GPU inference. What you'll do:... ...experience. ~3+ years of software engineering experience...Work experience placementWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
$200k - $400k
...as a team. About the Team The ML Infrastructure team builds the systems that power every... ..., and the routing layer that manages inference across multiple providers. We work... ...'re hiring a Senior ML Infrastructure Engineer to own the platforms powering Decagon'...Full timeWork at officeLocal area- ...persistent challenges in data infrastructure: extracting accurate,... ...small, fast-growing team of engineers in San Francisco powering Fortune... ...low-latency, high-throughput inference for OCR and multimodal models... ...in performance engineering or ML systems Strong Python, plus C++...Work at officeVisa sponsorshipRelocation package
- ...Background Specter is creating a software-defined "control plane" for... ...become the perception engine for a company's physical footprint... ...Specter is hiring an ML infrastructure engineer to build and scale... ...power real-time perception and inference across our edge-cloud platform...
$250k - $330k
...a team. About the Team The Infrastructure team builds and operates the... ...power Decagon: networking, data, ML serving, developer platform,... ...‑serving platforms for LLM inference with multi‑provider routing and... ...a Senior Infrastructure Engineer to design, build, and operate...Work at office- ...powers mission-critical inference for the world's most... ...AI research, flexible infrastructure, and seamless developer... ...build the platform engineers turn to to ship AI products... ...As an Infrastructure Software Engineer at Baseten,... ...maintain components of our ML inference platform...Flexible hours
$160k - $230k
...Senior Software Engineer - Together Cloud Infrastructure San Francisco About the Role Together AI is building... ...lifecycle, combining the fastest LLM inference engine with state-of-the-art AI... ...infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField...Full timeRemote work- ...Full time Location Type Hybrid Department Inference Model Serving Who are we? Our mission... .... Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...engineering experience running production infrastructure at a large scale Experience designing...Full timeWork experience placementWork at officeRemote workFlexible hours
$250k - $380k
...and running OpenAI's LLM training and inference infrastructure that powers frontier models at massive... ...About the Role We are looking for an engineer to design and implement the dataset infrastructure... ...(if not glamorous) part of the ML stack. Bonus points if you:...$320k
...committed researchers, engineers, policy experts, and... ...the Role The Cloud Inference team scales and... ...This is high-leverage infrastructure work: validation has to... ...serving; prior inference or ML experience is not... ...Have significant software engineering experience...Work at officeVisa sponsorshipFlexible hours- ...enterprise ecosystem. Our ML Platforms, Solutions, and Services... ...are looking for talented Software Engineers who are passionate about... ...systems and large-scale infrastructure to build and operate world-... ...technical direction of ML/Data/Inference platform capabilities,...
$127k - $223k
...evaluation criteria, and simulation teams to leverage... ...closed-loop simulation engine built with the latest... ...Develop the tooling, infrastructure, and pipelines to support... ...programming and strong software engineering... ...in evaluating complex ML models or self-driving...Full timeWork at officeWork from homeFlexible hours- A well-funded AI infrastructure startup in San Francisco is seeking a Founding Engineer to design and scale distributed backend systems integral to training advanced AI agents. Ideal candidates will have experience in ML pipelines, systems thinking, and a strong foundation...
$180k - $210k
...product is a scalable risk engine. We stay when... ...different approach. We simulate how real-world catastrophes... ...and support, infrastructure and CI/CD reliability,... ...simulation, digital twin, and ML pipelines through... ...supporting training, inference, and continuous improvement...Full timeTemporary workH1bWork at officeVisa sponsorshipWork visaFlexible hours- ...Simulation Platform Engineering Intern At Stand, you'll help build a new class of... ...is excited by zero-to-one infrastructure in a fast-moving startup environment... ...across simulation, ML, and infrastructure, with... ...to support training and inference pipelines Documenting pipelines...Temporary workInternshipH1bWork at officeRelocationVisa sponsorshipWork visaFlexible hoursShift work
- ...model innovation and systems engineering paired with a design‑minded... ...models, and we’re looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits... ..., model training, and inference — it is not a siloed data org...Work at officeVisa sponsorshipFlexible hours
- ...We are seeking a highly technical Inference Engine Engineer to optimize the performance and... ...optimizing GPU kernels and supporting infrastructure for next-generation generative and agentic... ...performance bottlenecks across the software and hardware stack, and implement targeted...WorldwideFlexible hours
$175k - $215k
...roads and tens of billions in simulation across 15+ U.S. states.... ...We are looking for aSoftware Engineer to build the metrics and pipelines... ...will report to Senior Staff Software Engineering Manager and... ...components of our data processing infrastructure. You will write and maintain...Full timeRemote work- ...powers mission‑critical inference for the world's most... ...AI research, flexible infrastructure, and seamless developer... ...build the platform engineers turn to to ship AI products... ...across product, software development, performance... ...due to its relevance in ML projects. Drive...Work experience placementFlexible hours
$148.1k - $250k
...how work gets done. Airtable’s infrastructure is evolving to meet the needs of our fast growing engineering org. We are looking for... ...and delivering cost efficient ML-ready datasets to power Airtable... ...projects. We are looking for software engineers experienced in shipping...For contractorsWork at officeRemote workRelocationFlexible hours- ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning... ...of AI. The Role As a Software Engineer on our... ...Points Experience with AI/ML workloads and infrastructure....Work at officeWork from home1 day per week
$215k - $265k
...Software Engineer Opportunity Apollo Research's mission is to reduce the risks from scheming... .... Build and maintain Apollo's cloud infrastructure . This means IaC, networking, environment... ...or building platforms that support AI/ML workflows Familiarity with GPU...Full timeWork experience placementWork at officeImmediate startVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference, Simulation Infrastructure. Be the first to apply!
- graduate software developer San Francisco, CA
- rust software engineer San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer student San Francisco, CA
- software engineer amazon San Francisco, CA
- software developer positions San Francisco, CA
- software engineer full time San Francisco, CA
- software qa engineer San Francisco, CA
- new graduate software engineer San Francisco, CA
- junior software developer San Francisco, CA


