Software Engineer, ML Infrastructure
$160.36k - $240.54kNuro
Who We Are
Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver™, to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale—empowering a safer, richer, and more connected future.
About the Role
Nuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team . In this role, you will focus on building and evolving the core platform that provides researchers and engineers with seamless access to compute and data resources. You will be responsible for executing the technical strategy for automated resource provisioning, high-performance workload scheduling, and efficient feature management to accelerate the Nuro Driver™ development lifecycle.
About the Work
You will build the foundation that powers Nuro’s model development from experimentation to production. Key responsibilities include:
- Resource Provisioning & IaC: Scaling automated infrastructure-as-code (IaC) pipelines to manage thousands of GPU/CPU nodes across diverse environments.
- Intelligent Scheduling: Designing and optimizing workload orchestration to maximize hardware utilization, minimize job wait times, and handle massive-scale distributed training.
- Data & ETL: Designing robust pipelines for the extraction and transformation of petabyte-scale sensor and telemetry data into ML-ready formats.
- Feature Management: Implementing robust feature caching and storage solutions to reduce redundant computations and ensure low-latency access to pre-computed features.
- Platform Abstraction: Contributing to a unified ML platform that abstracts complex cloud infrastructure for end-users.
About You
- Experience: 3+ years of professional experience in ML Infrastructure, Backend Platform Engineering, or Distributed Systems.
- Resource Provisioning: Deep familiarity with modern Infrastructure-as-Code and provisioning tools such as Terraform, Pulumi, or Crossplane.
- Workload Scheduling: Hands-on experience building or managing large-scale orchestrators for compute-heavy workloads (e.g., Kubernetes, KubeRay, Ray, Slurm, or Volcano).
- Distributed Data Processing: Proficiency in at least one distributed processing framework, such as Apache Spark or Apache Beam, for large-scale data extraction and transformation.
- Feature Management: Experience implementing or maintaining feature stores and caching layers (e.g., Feast, Hopsworks, or Redis-based custom caching).
- Systems Design: A strong understanding of distributed systems, networking, and storage bottlenecks in the context of high-performance computing.
Bonus Points
- Active contributor to open-source projects in the MLOps or Cloud-Native ecosystem (e.g., CNCF, Ray, or Kubeflow communities).
- Experience with high-performance storage systems (e.g., Lustre, Ceph, or specialized NVMe caching) for ML data loading.
- Knowledge of cost-optimization strategies for large-scale GPU clusters in public clouds (AWS, GCP, or Azure).
At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.
At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
$170k - $216k
...S. states. The Simulation Infrastructure team creates reliable, scalable... ...evaluate the Waymo Driver's software stack at a massive scale. We... ...range of customers Software Engineers, Product, Data Science, System... ...will: Build and evolve ML inference infrastructure for...SuggestedFull timeRemote work- ...team of proven drug hunters, deep learning researchers, and software engineers united by a common mission — drive AI innovation in... ...of CPUs. About the Role We’re seeking experienced ML infrastructure engineers to join the team and lead engineering efforts focused...SuggestedFull timeTemporary work
- ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning... ...of AI. The Role As a Software Engineer on our... ...Points Experience with AI/ML workloads and infrastructure....SuggestedFull timeWork at officeWork from home1 day per week
- ...Culture doc here . We are seeking a seasoned Software Engineer to build and scale the foundational compute infrastructure that powers our state-of-the-art AI models—from... ...Kubernetes and Ray . ~ Experience with core ML frameworks such as PyTorch, TensorFlow, or JAX...SuggestedFull time
$145k - $200k
...native workflow orchestration engine looking for dedicated... ...growing team. Our goal is to make infrastructure simple for enterprises and public... ...We are looking for a skilled software engineer with a strong... ...Experience working with AI/ML tools and products, with an understanding...SuggestedFull timeWork at office- ...manufacturing, and we're looking for engineers who want to get their hands... ...Role We're looking for a Software Engineer to build and maintain the infrastructure that powers our AI and machine learning... ...thinks in systems but speaks ML: you understand what researchers...Full timeFlexible hours
$180k - $300k
...expertise on both data research and data engineering necessary to solve this incredibly... ...Role We're looking for an experienced Infrastructure Engineer to join as a member of our core... ...growing startup. Experience building ML/DL infrastructure and/or data infrastructure...Full timeWork at officeRelocation package$152k - $228k
...test different aspects of the software and hardware integration... ...every autonomy code change, from ML model updates to radius of map... ...the road. You will own the infrastructure that makes this possible.... ...tools, and much much more. Engineers across the company rely on this...Full timeTemporary work$149k - $350k
...come make with us! We’re looking for engineers with a Machine Learning and Artificial... ...capabilities. You will be building the core infrastructure to serve and deploy models efficiently,... ...principles approach to design and build ML infrastructure that will improve Figma’s...Full timeTemporary workRemote workWork from home- ...our team! Why Join Us The Platform Engineering organization at Rad AI builds the... ...safely, and at scale. Within Platform, the Infrastructure team owns our core cloud infrastructure,... ...leadership, product engineering, data, and ML teams to design systems that are robust,...Full timeWork at officeRemote workFlexible hours
$196k - $339.9k
...to transform how work gets done. Airtable’s infrastructure is evolving to meet the needs of our fast growing engineering org. We are looking for backend engineers to join... ...data governance, and delivering cost efficient ML-ready datasets to power Airtable’s native AI...Remote jobFull timeFor contractorsWork at officeRelocationFlexible hours$175k - $270k
...robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI... ...the Role: Glean is looking for software engineers to help build the world's best search... ...Design, build, and improve AI/ML systems and data pipelines infrastructure...Full timeHome officeFlexible hours3 days per week$202k - $237k
...computing and make it accessible to software developers of all skill levels. We’re... ...developer or data scientist can scale an ML application from their laptop to the... ...Anyscale is looking for a Software Engineer to join the Infrastructure team. Anyscale aims to provide the next...Full timeWork at officeFlexible hours$204k - $259k
...U.S. states. The Onboard Software Performance team ensures that... ...of experience as a software engineer or similar roles ~5 years of... ...We prefer: 2 years in infrastructure/systems/performance domain optimizing... ..., frameworks (SIMD/CUDA) and ML performance/frameworks...Full timeWork at officeRemote work$180k - $300k
...expertise on both data research and data engineering necessary to solve this incredibly... ...We’re looking for an experienced Cloud Infrastructure Engineer to join our core team at DatologyAI... ...infrastructure support for training large-scale ML models Ensure our infrastructure...Full timeWork at officeRelocation package$157.6k - $197k
...About the Company Armada is a full-stack edge infrastructure company delivering compute, connectivity, and sovereign AI/ML to some of the world’s most remote places.... ...a highly skilled and motivated Senior Software Engineer to play a key role in the design and implementation...Work at officeRemote workFlexible hours$193.93k - $291.15k
...team of high-output generalists where ML and systems engineering converge to push autonomy... ...forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical... ...~ BS/MS in Computer Science , Software Engineering, Robotics, or a related...Full time$153k - $376k
...foundational systems that power analytics, AI/ML, and data-driven decision-making across... ...AI researchers, machine learning engineers, data scientists, product engineers, and... ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing...Full timeRemote workWork from home- ...deep expertise in model innovation and systems engineering paired with a design-minded product... ...lifeblood of our models, and we're looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits at the intersection...Full timeWork at officeVisa sponsorshipFlexible hours
$180k - $300k
...has the deep expertise on both data research and data engineering necessary to solve this incredibly challenging... ...the technical lead of a Data Engineering / Platform / Infrastructure Team. Experience building ML/DL systems and/or data infrastructure that feeds into...Full timeWork at officeVisa sponsorshipRelocation package$153k - $222k
...company is creating the digital infrastructure needed to bring intelligence... ...looking for infrastructure engineers with expertise in scaling open... ...to join the Data & ML infra group. This role will work... ...Develop and deploy high‑quality software using modern tooling and frameworks...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- ...AI for enterprise data, and this role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence... ...Build Agentic Runtimes: Help build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency...Full time
$109k - $160k
...enterprises, CoreWeave combines superior infrastructure performance with deep technical... ...Learn more at . About the role A Software Engineer contributes to the design, implementation... ...HPC Experience. Experience with AI/ML infrastructure and training / inference...Permanent employmentFull timeTemporary workCasual workWork at officeRemote workFlexible hours- ...About the job At Coram AI, our infrastructure isn’t just your typical cloud-only stack... ...devices. Coram AI is looking for a talented engineer who will be responsible for a large... ...build and maintain the custom in-house software that we use for these purposes. Being...Full timeRemote work
- ...responsibility seriously. The role We're building Helsing's first U.S.-based engineering team in Washington, DC. As an early member of this team, you'll architect and build the infrastructure foundation that enables our mission in the U.S. market. This is a rare...Full timeLocal areaRemote workFlexible hours
- ...revolutionizing AI deployment with cutting-edge inference infrastructure. Backed by premier investors such as IVP ,... ...journey! THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI...Full timeRemote work
$238k - $302k
...manual techniques and build the infrastructure to store, process, and... ...utilization improvements of our software stack, own resource planning... ...infrastructure for state of the art ML models - all in service of... ...Lead a team of software engineers to help us scale our mapping...Full timeRemote work$186.07k - $218.9k
...Senior Software Engineer, Developer Infrastructure What you’ll be doing (job duties) Design, build, and operate core developer‑infrastructure services — spanning CI and build systems, deployment orchestration, and test infrastructure — that are fast, reliable, and secure...Local areaRemote work$280k
...Anthropic is seeking talented and experienced Infrastructure Engineers to join our team and support the development, scaling, and maintenance... ...systems design tradeoffs, keeping track of rapidly evolving software systems Deadline to apply: None. Applications will be reviewed...Work at officeHome officeVisa sponsorshipRelocation package$10k
...Any Mission Is Possible Position: Software Engineer (AI and Cloud) ***(Active Clearance... ...will work across frontend, backend, and infrastructure components to develop scalable... ...with modern technologies, including AI/ML-enabled applications, cloud environments...Extra incomeFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infrastructure. Be the first to apply!
- software engineer full time Remote
- software system engineer Remote
- consulting software engineer Remote
- software engineer travel Remote
- software engineer mainframe Remote
- software engineer unity Remote
- real time software engineer Remote
- network software engineer Remote
- senior software engineer remote Remote
- entry level software engineer remote Remote


