Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, ML Inference Platform

$160.36k - $240.54k

Nuro

Who We Are 

Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.

Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.

With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.

Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.

About the Role

The ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!

About the Work

  • Design and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. 
  • Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. 
  • Develop observability to track ML model lifecycles from data generation to on-road validation.
  • Maintain an in-house ML inference platform to serve large language models efficiently.
  • Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.

About You

  • You have a degree in BS, MS.c or Ph.D with 1+ years of relevant experience
  • Strong proficiency in Python or similar languages. Familiarity with c++.
  • Technical excellence: Develop with a high standard for performance, scalability, and code quality.
  • Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systems
  • Independence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.

Bonus Points

  • Strong proficiency in C++ or other high-performance low-level languages
  • Experience working with large-scale distributed systems
  • Experience with system & framework design
  • Experience with data workflow orchestration platforms
  • Experience with ML compilers

At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.

At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML Inference Platform in Mountain View, CA vacancy
  •  ...industry-leading training and inference speeds; over 10 times...  ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize...  ...knowledge across accelerator platforms.Experience modifying or contributing...  ..., or another open-source ML systems project.Experience... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...on the Cerebras Wafer-Scale Engine.We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous...  ...features into the serving platform.Integrate serving components.... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    17 hours ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...team builds the software systems that power engineering workflows across Cerebras...  ...tools, and reusable software platforms that allow engineers to build...  ...platform, CI, release, quality, ML systems, and product... 
    Platform
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    17 hours ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...RoleWe’re hiring a Senior Software Engineer for our Inference Cloud team...  ...operation, partnering closely with ML, Product, and Infrastructure...  ...:Build a breakthrough AI platform beyond the constraints of... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $192k - $278k

     ...optimization of the hardware/software stack to enable...  ...and serving of large ML models.Collaborate with...  ...degree in Electrical Engineering, Computer Engineering,...  ...optimizations for ML training and inference.Experience with deep...  ...the essential platforms that enable developers... 
    Platform
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ....About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns...  ...Influence. Partner with ML, Product, Infrastructure, and... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $160.36k - $240.54k

     ...why we’re building a universal autonomy platform: self-driving for all roads and all rides...  ...other leading investors.About the RoleThe ML Infrastructure team is responsible for building...  ...-road validation.Maintain an in-house ML inference platform to serve large language models... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $165.2k - $223.6k

     ...the AWS Neuron SDK, the software development kit used...  ...accelerators.The Neuron Inference organization is at the...  ...for a wide range of ML models and model architectures...  ...boundary, our engineers build systematic infrastructure...  ..., TensorRT or similar platforms in production... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $127.1k - $185k

     ...the AWS Neuron SDK, the software development kit used...  ...accelerators.The Neuron Inference organization is at the...  ...for a wide range of ML models and model architectures...  ...boundary, our engineers build systematic infrastructure...  ...productivity, cloud platforms (preferably AWS),... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    17 hours ago
  • $213k - $263k

     ...applied to a range of vehicle platforms and product use cases. The...  ...across 15+ U.S. states. The ML Ops team, part of Waymo ML Platform...  .... We’re looking for a software engineer to join the team to build...  ...You will: Develop Waymo's inference platform to make it scalable... 
    Platform
    Full time
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ...on the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to build and evolve the ML API layer that makes this...  ...services and Cerebras inference platform to deliver a consistent experience... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    17 hours ago
  • $139k - $204k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost...  ...We are looking for Senior Software Engineer to help us understand... 
    Platform
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    a month ago
  • $193.3k - $261.5k

     ...builds AWS Neuron, the software development kit used...  ...Inferentia and Trainium ML accelerators. This...  ...enabling unparalleled ML inference and training performance...  ...boundary, our engineers build systematic infrastructure...  ..., TensorRT or similar platforms in production... 
    Platform
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $152k - $204k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...What You'll Do: Senior engineers are area owners who lead designs...  ...evolve our Kubernetes-native inference platform and meet strict P99...  ...performance. ~ Optimize end-to-end ML system performance by... 
    Platform
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Sunnyvale, CA
    a month ago
  • $120k - $160k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost...  ...About the role As a Junior Software Engineer (IC1/IC2) on the Inference... 
    Platform
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    2 days ago
  • $165.2k - $223.6k

     ...builds.We're looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving...  ...-level data-movement software that transfers KV cache...  ...is welcome.Prior AI/ML experience is not required...  ...broadly adopted cloud platform. We pioneered cloud... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $160.36k - $240.54k

     ...why we're building a universal autonomy platform: self-driving for all roads and all rides...  ...leading investors. About the Role The ML Infrastructure team is responsible for...  ...road validation. Maintain an in-house ML inference platform to serve large language models... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    9 days ago
  • $142k - $177.5k

     ...Infrastructure team builds the software that helps engineers understand and improve the ML models behind our driving systems...  ...trust. Within Autonomy's AI Platform organization, we connect model...  ...similar frameworks, such as running inference or analyzing prediction errors;... 
    Platform
    Full time
    Contract work
    Local area

    Rivian

    Palo Alto, CA
    17 hours ago
  • $128.37k - $185.86k

     ...CARIAD , an automotive software development team with...  ...creating a unified software platform for over 10 million new...  ...: ​ The Sr Software Engineer, Integration integrates...  ...middleware, and AI inference components into CARIAD'...  ...hardware. Collaborate with ML engineers to validate... 
    Platform
    Permanent employment
    Temporary work
    Remote work

    Cariad, Inc.

    Mountain View, CA
    27 days ago
  • $280k - $350k

     ...InworldInworld is a research lab and inference provider focused on realtime...  ...it from an API into a full platform: one place where a team can...  ...it.As a Staff or Principal Software Engineer, you'll design that platform...  ..., SGLang, TensorRT-LLM) or ML training infrastructure.... 
    Platform
    Full time
    Work at office
    Relocation

    Inworld AI

    Mountain View, CA
    17 hours ago
  • $221k - $331k

     ...others.AppLovin is seeking a Software Engineer with strong machine learning...  ...across our advertising platform, which reaches more than 1 Billion...  .... You will work across the ML stack from user signal and...  ...requirements.Improve training and inference efficiency by identifying... 
    Platform

    AppLovin

    Palo Alto, CA
    3 days ago
  • $174k - $252k

    Direct full-stack Software (SW) role, focusing on ML compiler and inference infrastructure. Design and develop ML compiler...  ...:PhD degree in Computer Engineering, Computer Science, or a related...  ...building a next-generation compute platform for AI inference workloads, with... 
    Platform

    Google

    Mountain View, CA
    4 days ago
  • $193.93k - $291.15k

     ...building a universal autonomy platform: self-driving for all...  ...’re a team applying ML to push autonomy...  ...forward. As a Perception ML Engineer, you’ll develop and improve...  ...quality and onboard inference runtimeTailor Your...  ...area.4+ years of industry software engineering experience... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $174k - $252k

     ...implement, and prototype novel software algorithms.Oversee...  ...with Machine Learning (ML) hardware accelerators and ML inference software.Preferred qualifications...  ...:PhD in Computer Engineering, Computer Science, or a...  ...next-generation compute platform for cutting-edge AI... 
    Platform

    Google

    Mountain View, CA
    3 days ago
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than...  ...Infrastructure team builds the software systems that power engineering workflows across Cerebras.Our infrastructure...  ...tools, and reusable software platforms that allow engineers to build, test... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $193.3k - $261.5k

     ...massive scale.As a Senior Software Development Engineer, you will lead the design and...  ...and build scalable platforms that transform billions of...  ...Experience with CUDA kernels or ML/low-level kernelsPreferred...  ...including architecture, training/inference lifecycles, and... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Palo Alto, CA
    1 day ago
  • $193.93k - $291.15k

     ...building a universal autonomy platform: self-driving for all roads...  .... We are looking for strong software engineers to research, develop, and...  ...generalizable and scalable ML planner that can power L4 driving...  ..., distributed training, or inference optimization.At Nuro, we... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $174k - $252k

     ...the cost per token of Gemini inference by optimizing throughput,...  ...degree in Computer Science, Software Engineering, Mathematics, or a related STEM...  ...programming, or applied ML engineering or equivalent education...  ...and next-generation TPU platforms. We work across the entire stack... 
    Platform
    Work experience placement
    Internship

    Google

    Mountain View, CA
    1 day ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...PositionThe Interaction Software Engineering (ISE) organization...  ...embedded modules to platform infrastructure, and...  ...(data pipelines, edge inference, inter-process and...  ...edge data processing, ML inference pipelines, and... 
    Platform
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    1 day ago
  • $170.6k - $261.3k

    Job DescriptionAs a Senior Software Engineer on the SimCore team, you will...  ...build and deploy applied AI/ML solutions that directly support...  ...robust, high-performance inference pipelines. This role is not...  ...Familiarity with GCP or other cloud platforms, Kubernetes, Docker, and... 
    Platform
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!