Software Engineer, ML Infrastructure
$160.36k - $240.54kNuro
Job Description
Job Description
Who We Are
Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that's why we're building a universal autonomy platform: self-driving for all roads and all rides.
Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors About the Role
Nuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team . In this role, you will focus on building and evolving the core platform that provides researchers and engineers with seamless access to compute and data resources. You will be responsible for executing the technical strategy for automated resource provisioning, high-performance workload scheduling, and efficient feature management to accelerate the Nuro Driver™ development lifecycle.
About the Work
You will build the foundation that powers Nuro's model development from experimentation to production. Key responsibilities include:
- Resource Provisioning & IaC: Scaling automated infrastructure-as-code (IaC) pipelines to manage thousands of GPU/CPU nodes across diverse environments.
- Intelligent Scheduling: Designing and optimizing workload orchestration to maximize hardware utilization, minimize job wait times, and handle massive-scale distributed training.
- Data & ETL: Designing robust pipelines for the extraction and transformation of petabyte-scale sensor and telemetry data into ML-ready formats.
- Feature Management: Implementing robust feature caching and storage solutions to reduce redundant computations and ensure low-latency access to pre-computed features.
- Platform Abstraction: Contributing to a unified ML platform that abstracts complex cloud infrastructure for end-users.
About You
- Experience: 3+ years of professional experience in ML Infrastructure, Backend Platform Engineering, or Distributed Systems.
- Resource Provisioning: Deep familiarity with modern Infrastructure-as-Code and provisioning tools such as Terraform, Pulumi, or Crossplane.
- Workload Scheduling: Hands-on experience building or managing large-scale orchestrators for compute-heavy workloads (e.g., Kubernetes, KubeRay, Ray, Slurm, or Volcano).
- Distributed Data Processing: Proficiency in at least one distributed processing framework, such as Apache Spark or Apache Beam, for large-scale data extraction and transformation.
- Feature Management: Experience implementing or maintaining feature stores and caching layers (e.g., Feast, Hopsworks, or Redis-based custom caching).
- Systems Design: A strong understanding of distributed systems, networking, and storage bottlenecks in the context of high-performance computing.
Bonus Points
- Active contributor to open-source projects in the MLOps or Cloud-Native ecosystem (e.g., CNCF, Ray, or Kubeflow communities).
- Experience with high-performance storage systems (e.g., Lustre, Ceph, or specialized NVMe caching) for ML data loading.
- Knowledge of cost-optimization strategies for large-scale GPU clusters in public clouds (AWS, GCP, or Azure).
At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.
At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
$152k - $228k
...test different aspects of the software and hardware integration... ...every autonomy code change, from ML model updates to radius of map... ...the road. You will own the infrastructure that makes this possible.... ...tools, and much much more. Engineers across the company rely on this...SuggestedFull timeTemporary work$147k - $211k
...computing concepts, consensus algorithms (e.g., Paxos).Google's software engineers develop the next-generation technologies that change how... ...performant bulk data loading pathways(essential for emerging AI/ML workloads), introducing advanced mutation semantics and data life...Suggested$193.93k - $352.29k
...What is not fungible is the infrastructure that decides whether an autonomous... ...inside Nuro's own engineering organization, under the same... ...and why.About You3+ years of software engineering experience (or 2... ...whether it helped.Experience with ML training or research...SuggestedImmediate startFlexible hours$157k - $235k
...Saturn, and other digital services.Snap Engineering teams build fun and technically... ...the forefront.We’re looking for a Software Engineer to join the ML Platform Experience team, part of the... ...What you’ll do:Design and optimize infrastructure systems for machine learning...SuggestedFull timeLive inWork at officeLocal area$160.36k - $240.54k
...investors.About the RoleThe Autonomy ML Infrastructure team is responsible for building & improving... ...and model pruning.Work with autonomy engineers to optimize, validate, and deploy... ...framework, FTL.Write robust, high-quality software to increase our confidence in our...SuggestedWork experience placementImmediate startFlexible hours$193.93k - $291.15k
.... Rowe Price, and other leading investorsAbout the RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team. In this role, you will focus on building and evolving...Immediate startFlexible hours$174k - $252k
...concrete technical priorities and engineering roadmaps.Navigate open-ended... ...across the broader Compute Infrastructure organization to drive... ....5 years of experience with software development in one or more programming... ...scheduling of virtually all ML and non-ML workloads across...Worldwide$204k - $259k
...U.S. states. The Onboard Software Performance team ensures that... ...of experience as a software engineer or similar roles ~5 years of... ...We prefer: 2 years in infrastructure/systems/performance domain optimizing... ..., frameworks (SIMD/CUDA) and ML performance/frameworks...Full timeWork at officeRemote work$147k - $210k
...experience.2 years of experience with software development or 1 year of experience... ...experience with developing large-scale infrastructure, distributed systems or networks, or... ...privacy or security.Experience in AI/ML related engineering, developing, deploying, managing, and...Worldwide$145k - $200k
...CompanyPalantir builds the world’s leading software for data-driven decisions and... ...more.The Role We are a software engineering team with expertise in enabling ML models in production. We deploy... ...problems at the intersection of infrastructure and machine learning that...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$175k - $270k
...robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI... ...the Role: Glean is looking for software engineers to help build the world's best search... ...Design, build, and improve AI/ML systems and data pipelines infrastructure...Full timeWork at officeHome officeFlexible hours3 days per week$147k - $211k
...., cluster management teams, ML teams, hardware platform teams... ....2 years of experience with software development or 1 year of experience... ...with developing large-scale infrastructure, distributed systems or... ...operating systems.Google's software engineers develop the next-generation...Worldwide$147k - $211k
...experience with developing large - scale infrastructure, distributed systems or networking,... ..., diagnosis and resolution, and software test engineering.Google's software engineers develop the... ...and enhance software solutions. The ML, Systems, and Cloud AI (MSCA) organization...$193.93k - $291.15k
...team of high-output generalists where ML and systems engineering converge to push autonomy... ...forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical... ...~ BS/MS in Computer Science , Software Engineering, Robotics, or a related...Full time$174k - $252k
...experience.5 years of experience with software development in one or more... ...and developing large-scale infrastructure or distributed systems.1 year... ...Rust, or Java.Experience in ML model coding languages (e.g., Python).Google's software engineers develop the next-generation...$160.36k - $240.54k
...autonomous driving technology. In an ML-first system, the overall... ...a scalable and reliable data infrastructure. This infrastructure is... ...collaborates closely with system engineers to thoroughly validate the... ...best practices across broader software organizationA bachelor's degree...Immediate startFlexible hours$147k - $210k
...components of scalable machine learning (ML) and agentic AI infrastructure for manufacturing.Maintain and... ...:Bachelor's degree in Electrical Engineering, Computer Science, relevant technical... ....2 years of experience with software development in one or more programming...- Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distributed AI-RAN Environments) We challenge conventional limits... ...with C/C++. Strong working knowledge of major AI/ML frameworks (PyTorch, TensorFlow, JAX, or similar). Solid...
- Role Overview We are hiring a Founding ML Infrastructure Engineer to own the end-to-end deployment, optimization, and operation of our suits of... ...infrastructure, systems engineering, or production ML roles. Strong software engineering fundamentals; ability to write robust,...Work at officeVisa sponsorship
- Join to apply for the Software Engineer, Infrastructure role at Simular . Get AI-powered advice on this job and more exclusive features. Where multiple... ...-end. Bonus: you’ve touched GPU scheduling, large-scale ML infra, or scaling SaaS systems. Seniority level Entry...Full time
- ...About the job At Coram AI, our infrastructure isn’t just your typical cloud-only stack... ...devices. Coram AI is looking for a talented engineer who will be responsible for a large... ...build and maintain the custom in-house software that we use for these purposes. Being...Full timeRemote work
$160.36k - $240.54k
...connected future. About the Role Our software team is growing, and we are looking for talented engineers to join us and be instrumental to one of the following... ...: Data Platform, Simulation, and Technical Infrastructure. Data Platform: The Data Platform serves...Full time$175k - $220k
...re building the future of generative AI infrastructure. Fireworks offers the generative AI platform... ...: As a Training Infrastructure Engineer, you'll design, build, and optimize the... ...experience with distributed systems and ML infrastructure ~ Experience with...Full time$160.36k - $240.54k
...and other leading investors.About the RoleOur software team is growing, and we are looking for talented engineers to join us and be instrumental to one of the following... ...: Data Platform, Simulation, and Technical Infrastructure.Data Platform: The Data Platform serves as a...Immediate startFlexible hours$180k - $300k
...expertise on both data research and data engineering necessary to solve this incredibly... ...the RoleWe're looking for an experienced Infrastructure Engineer to join as a member of our core... ...fast-growing startup.Experience building ML/DL infrastructure and/or data infrastructure...Work at officeWork from homeRelocation package- ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ....The Lambda Infrastructure Engineering organization forges the... ...looking for an experienced Senior Software Engineer to join our storage... ...to HaveExperience with AI/ML workloads and the unique...Work at officeLocal areaWork from homeFlexible hours
$168k - $264.5k
...the world.Join NVIDIA’s CAD Infrastructure team and be part of something... ...are building a next-generation software platform for semiconductor... ...ambitious endeavor, and we need engineers who thrive in a hands-on... ...GNN-based systems.Exposure to ML or agentic tooling, particularly...Full time$188.5k - $282.7k
...opportunity for innovation and solving complex engineering problems for our customers.About Role:... .... What you’ll do:Responsibilities:Software Development: Understand and enhance the... ...businesses with their data when infrastructure is attacked.Rubrik provides equal employment...Local area- The RoleWe're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on tight schedules...Home officeFlexible hours
$185k - $230k
The OpportunityAre you an experienced Senior Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a talented engineer to lead the development, deployment...Permanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infrastructure. Be the first to apply!
- agile software developer Mountain View, CA
- software developer internship no experience Mountain View, CA
- software engineer staff Mountain View, CA
- experienced software developer Mountain View, CA
- work from home software developer Mountain View, CA
- software developer fintech Mountain View, CA
- software data engineer Mountain View, CA
- financial software developer Mountain View, CA
- software developer internship Mountain View, CA
- software engineer Mountain View, CA


