Software Engineer, ML Inference Platform
$160.36k - $240.54kFull-time
Nuro
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors. About The Role The ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots! About The Work
- Design and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models.
- Develop and maintain continuous testing and monitoring systems for core ML infrastructure components.
- Develop observability to track ML model lifecycles from data generation to on-road validation.
- Maintain an in-house ML inference platform to serve large language models efficiently.
- Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.
- You have a degree in BS, MS.c or Ph.D with 1+ years of relevant experience
- Strong proficiency in Python or similar languages. Familiarity with c++.
- Technical excellence: Develop with a high standard for performance, scalability, and code quality.
- Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systems
- Independence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.
- Strong proficiency in C++ or other high-performance low-level languages
- Experience working with large-scale distributed systems
- Experience with system & framework design
- Experience with data workflow orchestration platforms
- Experience with ML compilers
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML Inference Platform in California vacancy
$230k - $390k
About usSierra is the leading platform for customer-facing AI... ...reason and act in real time. The Inference team builds the systems that... ...and efficient at scale.As a Software Engineer on Inference, you’ll help... ...AI. You don’t need to be an ML researcher—we’re looking for...PlatformFull timeFlexible hoursSierra
San Francisco, CA4 days ago$165.2k - $223.6k
...the AWS Neuron SDK, the software development kit used... ...accelerators.The Neuron Inference organization is at the... ...for a wide range of ML models and model architectures... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformInternshipLocal areaFlexible hoursAmazon
Cupertino, CA3 days ago$184k - $287.5k
...diffusion models for maximal inference efficiency using techniques... ...as developing an innovative software platform (TRT Model Optimizer). Our software... ...externally by research and engineering teams alike developing best-... ..., PyTorch, and related ML tools (e.g. HuggingFace)....PlatformFull timeNvidia
Santa Clara, CA1 day ago$193.3k - $261.5k
...builds AWS Neuron, the software development kit used... ...Inferentia and Trainium ML accelerators. This... ...enabling unparalleled ML inference and training performance... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformWork experience placementInternshipLocal areaFlexible hoursAmazon
Cupertino, CA5 days ago$157k - $235k
...Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically... ...privacy at the forefront.We’re looking for a Software Engineer to join the Core Inference team, part of the core ML Platform organization. Our team builds and owns the machine...PlatformFull timeLive inWork at officeLocal areaSnap
Los Angeles, CA23 hours ago$165.2k - $223.6k
...builds.We're looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving... ...-level data-movement software that transfers KV cache... ...is welcome.Prior AI/ML experience is not required... ...broadly adopted cloud platform. We pioneered cloud...PlatformInternshipLocal areaFlexible hoursAmazon
Cupertino, CA22 hours ago$192k - $278k
...optimization of the hardware/software stack to enable... ...and serving of large ML models.Collaborate with... ...degree in Electrical Engineering, Computer Engineering,... ...optimizations for ML training and inference.Experience with deep... ...the essential platforms that enable developers...PlatformWorldwideGoogle
Sunnyvale, CA3 days ago- ...industry-leading training and inference speeds; over 10 times... ...the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize... ...knowledge across accelerator platforms. Experience modifying or... ...LLM, or another open-source ML systems project....Platform
$165k - $330k
...BASETEN Baseten powers mission‑critical inference for the world’s most dynamic AI... ...Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE As... ...developer-oriented tools Interest in ML/AI infrastructure and willingness to learn...PlatformFlexible hours- About us Sierra is the leading platform for customer-facing AI... ...reason and act in real time. The Inference team builds the systems that... ...efficient at scale. As a Software Engineer on Inference, you’ll help define... ...AI. You don’t need to be an ML researcher—we’re looking for...PlatformFull timeFlexible hours
- ...industry-leading training and inference speeds; over 10 times faster than... ....About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns... ...Influence. Partner with ML, Product, Infrastructure, and...Platform
Cerebras Systems
Sunnyvale, CA3 days ago $160.36k - $240.54k
...why we’re building a universal autonomy platform: self-driving for all roads and all rides... ...other leading investors.About the RoleThe ML Infrastructure team is responsible for building... ...-road validation.Maintain an in-house ML inference platform to serve large language models...PlatformImmediate startFlexible hoursNuro
Mountain View, CA2 days ago$192k - $278k
...Hardware/Software Co-Design Engineer, Inference Share Hardware/Software Co-Design Engineer, Inference Google... ...or performance optimizations for ML training and inference. Experience... ..., and providing the essential platforms that enable developers to build the...PlatformWorldwide$190.9k - $232.8k
P-1285About This RoleAs a staff software engineer for GenAI inference, you will lead the architecture, development... ...cross-team collaboration: with platform engineers, cloud infrastructure, and... ...decisions end-to-endDeep understanding of ML inference internals: attention, MLPs...PlatformLocal areaWorldwideDataBricks
San Francisco, CA5 days ago$190k - $265k
...best data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer-obsessed — we... ...generation of AI.The Foundation Model Inference team is the backbone of... ...with platform, infra, and ML teams to deliver seamless end...PlatformLocal areaWorldwideDataBricks
San Francisco, CA5 days ago$246.5k
...is the #1 TV streaming platform in the U.S., Canada,... ...Machine Learning and Inference Platform that powers the... ...span across hardware, software, and models. We’re looking... ...deep experience in ML serving, high-... ...someone excited to mentor engineers, innovate at scale, and...PlatformWork at officeLocal areaRemote workMonday to ThursdayFlexible hoursRoku
San Jose, CA4 days ago- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud... ...'ll partner closely with ML, Product and Infrastructure... ...+ years of experience in software engineering, with...Platform
Cerebras Systems
Sunnyvale, CA5 days ago - ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Staff Engineer to own major areas of... ...of our Inference Cloud Platform. This team owns the cloud... .... Partner with ML, Product, Infrastructure... ...years of experience in software engineering, with substantial...Platform
Cerebras Systems
Sunnyvale, CA5 days ago $180k - $275k
...level intelligence. Its robots are engineered to perform a variety of tasks in... ...We are looking for a Staff AI Inference & Acceleration Engineer to join the Platform Software team and own the on-board... ...Partner closely with the AI/ML team to define model architecture...PlatformFull timeFigure
California9 days ago$193.3k - $261.5k
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join... ...on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state...InternshipLocal areaFlexible hoursAmazon
Cupertino, CA5 days ago$184k - $287.5k
...a unified production platform. Autonomous driving is... ...with Large-scale model inference architectureContribute... ...Deep knowledge of E2E AV software integration from... ...See:We’re looking for engineers who can build systems... ...models or large-scale ML systemsHelped drive End...PlatformFull timeNvidia
Santa Clara, CA1 day ago$174k - $252k
Direct full-stack Software (SW) role, focusing on ML compiler and inference infrastructure. Design and develop ML compiler... ...:PhD degree in Computer Engineering, Computer Science, or a related... ...building a next-generation compute platform for AI inference workloads, with...PlatformGoogle
Mountain View, CA1 day ago$184k - $287.5k
NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You will push workloads toward practical performance limits on NVIDIA GPU-accelerated...PlatformFull timeNvidia
Santa Clara, CA2 days ago- ...that mission: making AMD the platform of choice for the most... ...:We're looking for a senior software engineer who combines deep systems performance... ...distributed training and inference.You'll join a core team of... ...CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as...PlatformShift work
AMD
Santa Clara, CA4 days ago - ...motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive... ...that enable state-of-the-art AI training and inference workloads on AMD GPU platforms. You will work at the intersection of compiler...Platform
AMD
San Jose, CA3 days ago - ...critical to AMD’s AI software roadmap.AMD GPUs are an... ...scale AI training and inference.In this role you will... ...Triton/Gluon kernels for ML kernels powering the... ...GPUs the best-in-class platform for Triton-powered AI... ...architecture, and performance engineering. You are comfortable...Platform
AMD
San Jose, CA1 day ago $221k - $331k
...others.AppLovin is seeking a Software Engineer with strong machine learning... ...across our advertising platform, which reaches more than 1 Billion... .... You will work across the ML stack from user signal and... ...requirements.Improve training and inference efficiency by identifying...PlatformAppLovin
Palo Alto, CA2 days ago- ...models, and training/inference performance across multi... ...and advanced engineering principles to drive continuous... ...integrating graph compilers. Software Engineering Best... ...multi-GPU and multi-platform performance. Deep Learning... ...compute into ML frameworks (e.g., PyTorch...Platform
AMD
Santa Clara, CA5 days ago $177k - $270k
Foster City, CASoftware - Software Systems /Full-time /On-siteZoox... ...executing this mission. The ML Platform team at Zoox plays a crucial... ...a team of strong software engineers and act as a force multiplier... ...cutting-edge ML Training OR Inference performance optimization techniques...PlatformFull timeTemporary workRelocation packageZoox
San Mateo, CA2 days ago$129.3k - $172.3k
...for forward-thinking engineers who will envision, design... ...American is seeking software engineering candidates... ...core Title & Settlement Platform using modern... ...evaluation harnesses, and inference infrastructure that serve... ...solution architects, AI/ML practitioners, and...PlatformFull timeLocal areaRemote workFirst American Financial Corporation
Santa Ana, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!
Related searches
- intel software engineer California
- director software engineering California
- software engineer California
- senior robotics software engineer California
- financial software developer California
- part time software developer remote California
- software engineer remote California
- part time software developer California
- ngo software engineer California
- software development engineer aws California