Software Engineer, Bulk/Interactive Inference
$170k - $216kWaymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The ML Ops team, part of Waymo ML Platform team, builds tools and infrastructure to realize the ML flywheel at Waymo. This includes building automation and orchestration solutions to make complex ML workflows manageable and reliable. This team also partners closely with the modeling team to realize solutions to speed up developer velocity.
We’re looking for a software engineer to join the team to build and maintain the critical data and ML pipelines that powers ML development at Waymo.
In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer.
You will:
- Develop Waymo's inference platform to make it scalable, high throughput, and low latency
- Work closely with other teams across Waymo in hosting both internal and external ML models, including LLMs
- Improving the efficiency of running inference on these large models to increase throughput and save cost
- Deploy and integrate model inference solutions across a variety of use cases, such as distillation, eval, dataset generation, active learning, and auto-labeling
You have:
- 2+ years of professional experience in the field of software engineering
- Experience in programming C++
- Experience with building highly scalable distributed system
We prefer:
- Passionate about building internal infra and tools
- Experience with building model hosting and inference solutions
- Experience with handling datasets in the order of exabytes
#LI-Hybrid
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range
$170,000—$216,000 USD
- ...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks’ Foundation Model API. You’ll work at the intersection of research and production, ensuring our large language...SuggestedFull time
$2,000 per month
...architecture and design of the Sohu host software stack Implement high-performance,... ...handling continuous batching and real time inference Implement inference-time... ...person team in Cupertino, and greatly value engineering skills. We do not have boundaries between...SuggestedFull timeWork at officeRelocation package$129.4k - $198.4k
Job DescriptionSenior Software Engineer — Interactive ExperienceJob SummaryWe are seeking a highly skilled and experienced Senior Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will design and deliver production...SuggestedFull timeLocal areaWork from homeFlexible hoursShift work$188k - $275k
...Do Description of the team: The Inference team is responsible for delivering high-... ...role: We are looking for an Applied AI Engineer to help us understand, measure, and... ...systems architecture, and hardware choices interact in production inference workloads. You...SuggestedPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$92k - $135k
...intelligence that drives innovation. What You’ll Do: Join the Inference team to ship production features that improve latency,... ...practices, and grow quickly with mentorship from experienced engineers. About the role: Implement well-scoped features and...SuggestedPermanent employmentFull timeTemporary workCasual workInternshipWork at officeRemote workFlexible hours- ...SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The application software team is the central nervous system of SpaceX - we create mission critical...Permanent employmentTemporary workRemote workWorldwideWeekend work
$152k - $241.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build, and optimize the GPU-accelerated software that powers today’s most sophisticated AI applications. Our team is responsible...Full timeRemote work$160k - $240k
Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref # 10050779 Description & Requirements Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference...Temporary workFor contractorsWork experience placement$170k - $216k
...products that evaluate the Waymo Driver's software stack at a massive scale. We solve... ...for a broad range of customers Software Engineers, Product, Data Science, System Engineering... ...You will: Build and evolve ML inference infrastructure for simulations. Be responsible...Full timeRemote work$189.3k - $290.7k
Job DescriptionJob Summary We are seeking a Staff Software Engineer to join our ADAS HMI team within the Interactive Experience platform. In this role, you will... ...camera and sensor inputs, on-device perception and inference, driver-state interpretation, vehicle interfaces...Full timeLocal areaWork from homeFlexible hours$165.2k - $223.6k
...Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep... ...and JAX enabling unparalleled ML inference and training performance.The Inference Enablement... ...the hardware-software boundary, our engineers build systematic infrastructure, innovate...Work experience placementInternshipLocal areaFlexible hours$113k - $163k
...infrastructure, including hardware, software, and network components.... ...for orchestration, feature engineering, model deployment, and... ...supporting high traffic agent interactions, retrieval operations, and real... ...for low-latency inference; GPU/accelerator utilization...Full timeTemporary workLocal areaFlexible hours$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to... ...orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$165k - $242k
Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence...Permanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$165k - $242k
...degradation, rollback/traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing... ...(Prometheus, Grafana, OpenTelemetry). Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming...Permanent employmentTemporary workWork at officeRemote workFlexible hoursShift work- ...frameworks. Strong track record of working with machine learning systems and/or platforms. Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them. Experience serving fine-tuned LLMs (PEFT, DPO, RL...Full time
- ...claims and support over 200 million patient interactions. Our latest $70M raise at a $7B... ...About the Role We're hiring a Software Engineer II to join Air Billing , the team behind... ...rebuilding the claims workspace, making bulk operations safe over tens of thousands...Full timeLive inWork at officeImmediate start
$120k - $180k
...Role We are looking for a high-agency Software Engineer to help build the core systems behind... ...This is a system where software directly interacts with a physical network. Latency,... ...ML systems in production (especially inference pipelines) You should be comfortable...Full timeWork at office$100k - $150k
...Description We are seeking a Full-Stack Software Engineer who combines deep platform engineering... ...novel data flow patterns, system interaction models, and process automation methods... ...features into product surfaces, working with inference APIs, or building human-in-the-loop...Full timeTemporary work- ...is transforming how robots interact with the real world. We are building... ...skilled and motivated MLOps Engineer to join our engineering team.... ..., training, evaluation, inference and deployment workflows.... ...ML components into robotics software systems. What You Have...Full timeWork experience placementRemote work
$187.36k - $265.9k
Why Sony Interactive Entertainment?Sony Interactive Entertainment isn’t just the Best Place... ...excellence and creativity.Senior Software Engineer, Machine Learning PlatformSan Diego, CARole... ...lead the design of next-generation ML inference infrastructure to support globally...Remote workWork from home$152k - $241.5k
...company”.We are looking for an AI & Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning & AI Compiler (DLC) team... ...of AI, our DLC has been the backbone of NVIDIA’s inference engine, spanning across data centers, personal devices,...Full timeRemote work$300k - $405k
...group of committed researchers, engineers, policy experts, and... ...engineering teams to optimize interactions between our workloads and underlying... ..., or related low-level software engineering Understand... ...VM configurations to reduce inference latency for large language models...Full timeWork at officeVisa sponsorshipFlexible hours$100 per hour
Role Description We’re looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code...Contract workImmediate start$200k - $250k
...experience, and we’re looking for a Senior MLOps Engineer to help us run them reliably and... ..., and scaling — across a custom-built inference platform powering a live conversational... ...For ~5–8+ years of experience in software, ML, platform, or infrastructure engineering...Full timeRemote workFlexible hours$145k - $275k
...placing the best product managers, software, and hardware talent at... ...help them hire. Software Engineer – Edge AI Systems... ...autonomous systems Optimize model inference across CPUs, GPUs, and specialized... ...AI platforms that directly interact with drones, sensors, robotics...Full timeRemote work- ...compounds across the platform. Engineers here use AI as a force... ...that handle real customer interactions and business workflows end-to... ...About the Role As a Software Engineer, you’ll work directly... ...that supports production-level inference, evaluation, and monitoring...Full timeTemporary workWork at officeFlexible hours
- ...we build. We're an AI-first engineering team that uses the latest models... ...runs at active mines Interact directly with users to deeply... ...~2+ years of professional software engineering experience (high... ...with computer vision or ML inference pipelines Experience integrating...Permanent employmentFull timeInternshipRemote workFlexible hoursNight shift
$320k
...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the role The Cloud Inference team scales and optimizes Claude to serve... ...qualifications Have significant software engineering experience, with a strong background...Full timeWork at officeVisa sponsorshipFlexible hours$184.03k - $275.4k
...this positionWhat you can expectAs a Software Engineer, you will play a key role in designing... ...back-end development and have experience interacting with the front-end.About the teamThe... ...data pipelines for model training and inference, including data validation, transformation...Full timeWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Bulk/Interactive Inference. Be the first to apply!
- senior robotics software engineer Remote
- software system engineer Remote
- part time software developer Remote
- security software engineer Remote
- intel software engineer Remote
- software developer fintech Remote
- new graduate software engineer Remote
- software development engineer aws Remote
- information technology software engineer Remote
- associate software developer Remote



