Software Engineer, ML Inference, Simulation Infrastructure
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Simulation Infrastructure team creates reliable, scalable, and cost-effective Simulation-based products that evaluate the Waymo Driver's software stack at a massive scale. We solve complex technical challenges to build services and tools for a broad range of customers Software Engineers, Product, Data Science, System Engineering, and more. So if you want to build the next generation of Simulation products and infrastructure, we'd love to hear from you!
In this hybrid role you will report to the Software Engineering Manager.
You will:
- Build and evolve ML inference infrastructure for simulations.
- Be responsible for the reliability, latency, and user experience of ML model deployment and serving.
You have:
- B.Sc. in Computer Science, or a related field, or equivalent years of experience
- 3+ years of experience C++ and/or Golang programming experience
- Experience in developing and maintaining distributed systems.
We prefer:
- Experience working with large-scale distributed inference service.
- Experience working with popular ML frameworks, TPUs and optimizing models for serving.
- Experience with distributed systems principles, including scheduling, load balancing, and fault tolerance.
- Experience working with large FAANG scale distributed systems.
#LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range $170,000—$216,000 USD- ...Software Engineer Intern (AI Infrastructure / Training / Inference) About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems... ...container orchestration. Familiarity with GPU‑based ML workloads or distributed training/inference systems...SuggestedInternshipImmediate start
$204k - $259k
...Senior Software Engineer, Simulation ML Infrastructure Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver...SuggestedFull timeRemote work$200k - $240k
...veteran operators and engineers, alumni of Sonos,... ...'re looking for a Software Engineer, Build Infrastructure and Test who thrives... ...our software and ML engineers to build... ...performance, low-latency AI inference in the field.... ...architecting simulation pipelines, hardware...SuggestedLocal areaRemote work$187.5k - $395k
...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and... ...our goal with reliable & scalable infrastructure, which is going to become the differentiating... ...with high performance large scale ML systems ( ~100 GPUs) ~ Experience...Suggested$142.2k - $204.6k
...-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and... ...with federated, distributed inference infrastructure - orchestrate across nodes, balance... ...systems Solid understanding of ML inference internals: attention,...SuggestedLocal areaWorldwide- ...persistent challenges in data infrastructure: extracting accurate,... ...small, fast-growing team of engineers in San Francisco powering Fortune... ...low-latency, high-throughput inference for OCR and multimodal models... ...in performance engineering or ML systems Strong Python, plus C++...Work at officeVisa sponsorshipRelocation package
- ...powers mission-critical inference for the world's most... ...AI research, flexible infrastructure, and seamless developer... ...build the platform engineers turn to to ship AI products... ...As an Infrastructure Software Engineer at Baseten,... ...maintain components of our ML inference platform...Flexible hours
$168k - $213k
...and more. The Role As a Senior Infrastructure Engineer , you will own the foundation that... ...model capacity needs for low-latency AI inference. Architect and automate secure... ...regulated industries. Experience with AI/ML infrastructure and model deployment at...Flexible hours- ...models are changing how engineers write code. Our vision... ...building systems and infrastructure that are as simple as... ...product surface, model inference, and evaluation suite.... ..., moved and scaled AI/ML systems into... .... You should have: Software experience: ~ Bachelor...Flexible hours
- ...Staff+ Software Engineer, Inference Runtime Remote-Friendly (Travel-Required)... ...counterpart to Anthropic's central Infrastructure org on the compilers,... ...in systems engineering or ML infrastructure, with the... ...with deterministic or simulation-based testing for hardware...Work at officeRemote workVisa sponsorshipFlexible hours
- ...group working across engineering, product, research, and... ...looking for an experienced Software Engineer to help build the machine learning infrastructure that powers OpenAI’s... ...work across the full ML lifecycle, from large-... ...and improve real-time inference and serving...
- ...updates on our news and engineering blogs and join us as... ...the future of AI and ML at Whatnot. You’ll... ...design and scale the core infrastructure that powers machine... ...& high-throughput GPU inference. What you'll do:... ...experience. ~3+ years of software engineering experience...Work experience placementWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
- ...powers mission-critical inference for the world’s most... ...AI research, flexible infrastructure, and seamless developer... ...build the platform engineers turn to to ship AI products... ...THE ROLE As a Senior Software Engineer – Model... ...years of experience in ML infrastructure, distributed...Flexible hours
$250k - $330k
...as a team. About the Team The Infrastructure team builds and operates the... ...power Decagon: networking, data, ML serving, developer platform,... ...‑serving platforms for LLM inference with multi‑provider routing... ...hiring a Senior Infrastructure Engineer to design, build, and operate...Work at office- ...Background Specter is creating a software-defined "control plane" for... ...become the perception engine for a company's physical... ...Responsibilities Specter is hiring an ML infrastructure engineer to build and scale... ...real-time perception and inference across our edge-cloud...
- ...Full time Location Type Hybrid Department Inference Model Serving Who are we? Our mission... .... Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...engineering experience running production infrastructure at a large scale Experience designing...Full timeWork experience placementWork at officeRemote workFlexible hours
- ...Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible... ...performance of our platform and LLM inference serving as we rapidly grow traffic.... ...distributed databases, retrieval systems, and ML models. Develop and maintain core...Full timeFlexible hours
$160k - $230k
...lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior AI... ...infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s,... ...Design and build out the IaaS software layer for a new GB200 data center...Full timeRemote work- ...A well-funded AI infrastructure startup in San Francisco is seeking a Founding Engineer to design and scale distributed backend systems integral to training advanced AI... ...agents. Ideal candidates will have experience in ML pipelines, systems thinking, and a strong foundation...
$200k - $400k
...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering... ...that power Decagon: networking, data, ML serving, developer platform, and real‑... ...GPU and model‑serving platforms for LLM inference with multi‑provider routing and...Full timeWork at officeLocal area$250k - $380k
...and running OpenAI's LLM training and inference infrastructure that powers frontier models at massive... ...About the Role We are looking for an engineer to design and implement the dataset infrastructure... ...(if not glamorous) part of the ML stack. Bonus points if you:...$320k
...Staff + Sr. Software Engineer, Cloud Inference San Francisco, CA About Anthropic Anthropic's mission... ...build, and own backend services and infrastructure that serve Claude across multiple... ...about LLM serving; prior inference or ML experience is not required Thrive...Work at officeVisa sponsorshipFlexible hours- ...model innovation and systems engineering paired with a design‑minded... ...models, and we’re looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits... ..., model training, and inference — it is not a siloed data org...Work at officeVisa sponsorshipFlexible hours
$155.58k - $320.32k
...We are seeking a Sr. Software Engineer to build out our simulation and AI capabilities. You... ...build, test, and deploy ML systems. What you’ll do:... ...direction for simulation and AI infrastructure and mentor engineers on... ...modeling systems Causal inference — uplift modeling,...Work at officeRelocationRelocation package$180k - $210k
...product is a scalable risk engine, our Stand World Model... ...approach. We simulate how real-world catastrophes... ...and support, infrastructure and CI/CD reliability,... ...simulation, digital twin, and ML pipelines through automated... ...supporting training, inference, and continuous...Full timeTemporary workH1bWork at officeVisa sponsorshipWork visaFlexible hours- ...powers mission‑critical inference for the world's most... ...AI research, flexible infrastructure, and seamless developer... ...build the platform engineers turn to to ship AI products... ...across product, software development, performance... ...due to its relevance in ML projects. Drive...Work experience placementFlexible hours
- ...product is a scalable risk engine. We stay when... ...different approach. We simulate how real‑world catastrophes... ...by zero‑to‑one infrastructure in a fast‑moving startup... ...engineers across simulation, ML, and infrastructure,... ...support training and inference pipelines Documenting...Temporary workInternshipH1bWork at officeRelocationVisa sponsorshipWork visaFlexible hoursShift work
$230k - $385k
...Simulation Applications Engineer | OpenAI Robotics - San Francisco About the Team Our... ...cutting‑edge hardware and software to explore a broad range of... ..., and the runtime infrastructure to run simulations at scale... ...and measurable part of our ML and robotics workflows. This...$175k - $215k
...roads and tens of billions in simulation across 15+ U.S. states.... ...We are looking for aSoftware Engineer to build the metrics and pipelines... ...will report to Senior Staff Software Engineering Manager and... ...components of our data processing infrastructure. You will write and maintain...Full timeRemote work$122.4k - $180k
...the right candidate for us. Simulation at Cruise is responsible for... ...testing our autonomous vehicle software against billions of miles of... ...about Sim here!: As a software engineer on the Simulation team, you... ...execution to accelerate training of ML models and end‑to‑end...Local areaImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference, Simulation Infrastructure. Be the first to apply!
- software developer internship no experience San Francisco, CA
- federal - software developer San Francisco, CA
- research software engineer San Francisco, CA
- software engineer contract San Francisco, CA
- part time software developer San Francisco, CA
- software engineer healthcare San Francisco, CA
- network software engineer San Francisco, CA
- ngo software engineer San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship San Francisco, CA

