Software Engineer, ML Infrastructure
$160.36k - $240.54kNuro
Who We Are
Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver™, to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale—empowering a safer, richer, and more connected future.
About the Role
Nuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team . In this role, you will focus on building and evolving the core platform that provides researchers and engineers with seamless access to compute and data resources. You will be responsible for executing the technical strategy for automated resource provisioning, high-performance workload scheduling, and efficient feature management to accelerate the Nuro Driver™ development lifecycle.
About the Work
You will build the foundation that powers Nuro’s model development from experimentation to production. Key responsibilities include:
- Resource Provisioning & IaC: Scaling automated infrastructure-as-code (IaC) pipelines to manage thousands of GPU/CPU nodes across diverse environments.
- Intelligent Scheduling: Designing and optimizing workload orchestration to maximize hardware utilization, minimize job wait times, and handle massive-scale distributed training.
- Data & ETL: Designing robust pipelines for the extraction and transformation of petabyte-scale sensor and telemetry data into ML-ready formats.
- Feature Management: Implementing robust feature caching and storage solutions to reduce redundant computations and ensure low-latency access to pre-computed features.
- Platform Abstraction: Contributing to a unified ML platform that abstracts complex cloud infrastructure for end-users.
About You
- Experience: 3+ years of professional experience in ML Infrastructure, Backend Platform Engineering, or Distributed Systems.
- Resource Provisioning: Deep familiarity with modern Infrastructure-as-Code and provisioning tools such as Terraform, Pulumi, or Crossplane.
- Workload Scheduling: Hands-on experience building or managing large-scale orchestrators for compute-heavy workloads (e.g., Kubernetes, KubeRay, Ray, Slurm, or Volcano).
- Distributed Data Processing: Proficiency in at least one distributed processing framework, such as Apache Spark or Apache Beam, for large-scale data extraction and transformation.
- Feature Management: Experience implementing or maintaining feature stores and caching layers (e.g., Feast, Hopsworks, or Redis-based custom caching).
- Systems Design: A strong understanding of distributed systems, networking, and storage bottlenecks in the context of high-performance computing.
Bonus Points
- Active contributor to open-source projects in the MLOps or Cloud-Native ecosystem (e.g., CNCF, Ray, or Kubeflow communities).
- Experience with high-performance storage systems (e.g., Lustre, Ceph, or specialized NVMe caching) for ML data loading.
- Knowledge of cost-optimization strategies for large-scale GPU clusters in public clouds (AWS, GCP, or Azure).
At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.
At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
$179.2k - $268.8k
...operations, systems and safety engineering – all dedicated to making a... ...Meet the team: The Bench Infrastructure team is responsible for... ...are seeking a talented Senior Software Engineer to join the team and... ...edge devices, robotics, or ML-driven applications Experience...SuggestedPermanent employmentFull timeWork at officeImmediate startVisa sponsorship$170k - $216k
...S. states. The Simulation Infrastructure team creates reliable, scalable... ...evaluate the Waymo Driver's software stack at a massive scale. We... ...range of customers Software Engineers, Product, Data Science, System... ...will: Build and evolve ML inference infrastructure for...SuggestedFull timeRemote work- ...design, build, and optimize the AI infrastructure that powers Ambient.ai ’s real-time... ...with a strong blend of infrastructure engineering, production ML systems, LLM/LVM inference,... ...background, especially in Python, with solid software engineering fundamentals. ~...SuggestedFull timeWork at officeLocal areaFlexible hours3 days per week
$145k - $200k
...native workflow orchestration engine looking for dedicated... ...growing team. Our goal is to make infrastructure simple for enterprises and public... ...We are looking for a skilled software engineer with a strong... ...Experience working with AI/ML tools and products, with an understanding...SuggestedFull timeWork at office$180k - $300k
...expertise on both data research and data engineering necessary to solve this incredibly... ...Role We're looking for an experienced Infrastructure Engineer to join as a member of our core... ...growing startup. Experience building ML/DL infrastructure and/or data infrastructure...SuggestedFull timeWork at officeRelocation package- ...team of proven drug hunters, deep learning researchers, and software engineers united by a common mission — drive AI innovation in... ...of CPUs. About the Role We’re seeking experienced ML infrastructure engineers to join the team and lead engineering efforts focused...Full timeTemporary work
$209k - $235k
...The Role We're looking for a Senior Software Engineer to join our ML Infrastructure team and support the foundational infrastructure that powers Gridmatic. Our platform challenges are shaped by the nature of energy markets: forecasts and trading decisions run on...Full timeHome officeFlexible hours$190k - $246k
...and maintain scalable machine learning (ML) infrastructure to support experimentation, training,... ...support the needs of machine learning engineers across multiple business units. Design... ...cross-functional teams, including software engineers, data engineers, and ML engineers...Full timeWork experience placementRemote work$1,000 - $2,030 per month
...do Work on the Machine Learning and AI Infrastructure team, which is focused on providing infrastructure for data scientists and other engineers to use ML and AI technologies effectively. Build and maintain software and tools for classical ML stack which helps...Full timeTemporary workWork at officeFlexible hours$183k - $275k
...test different aspects of the software and hardware integration... ...every autonomy code change, from ML model updates to radius of map... ...the road. You will own the infrastructure that makes this possible.... ...tools, and much much more. Engineers across the company rely on this...Full timeTemporary work- ...is building the foundational infrastructure for the next generation of AI development. We provide AI engineers and data scientists with lightning... ...of AI. The Role As a Software Engineer on our... ...Points Experience with AI/ML workloads and infrastructure....Full timeWork at officeWork from home1 day per week
$137.1k - $201.6k
...Platform and builds the shared infrastructure that helps DoorDash, Wolt,... ...model serving and inference engines, fine-tuning and training pipelines... ...the technical bar for — ML engineers, product engineers,... ...years of industry experience in software engineering ~ Deep backend...Hourly payWork at officeLocal areaRemote workFlexible hours$175k - $270k
...robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI... ...the Role: Glean is looking for software engineers to help build the world's best search... ...Design, build, and improve AI/ML systems and data pipelines infrastructure...Full timeHome officeFlexible hours3 days per week$195k - $255k
...serve and Affirm-optimized compute solution to enable ML, Product, and Financial Engineering success. Our team is responsible for building and maintaining... ...reliable and high availability frameworks. If solving infrastructure challenges at scale excites you, come join us! What...Remote jobFull timeWork at officeFlexible hours$157k - $235k
...Saturn, and other digital services.Snap Engineering teams build fun and technically... ...the forefront.We’re looking for a Software Engineer to join the ML Platform Experience team, part of the... ...What you’ll do:Design and optimize infrastructure systems for machine learning...Full timeLive inWork at officeLocal area- ...Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ....The Lambda Infrastructure Engineering organization forges the... ...looking for an experienced Senior Software Engineer to join our storage... ...to HaveExperience with AI/ML workloads and the unique...Work at officeLocal areaWork from homeFlexible hours
$293k - $385k
About the TeamThe GPT Infrastructure team builds systems that turn advances... ...and runtimes, performance engineering, secure partner integrations... ...the RoleWe are seeking a software engineer to help build the platform... ...inference, distributed ML systems, or inference-...Work at officeLocal areaRemote workFlexible hours$147k - $210k
...computing concepts, consensus algorithms (e.g., Paxos).Google's software engineers develop the next-generation technologies that change how... ...performant bulk data loading pathways(essential for emerging AI/ML workloads), introducing advanced mutation semantics and data life...- ...Platform and builds the shared infrastructure that helps DoorDash, Wolt,... ...model serving and inference engines, fine-tuning and training pipelines... ...the technical bar for — ML engineers, product engineers,... ...years of industry experience in software engineeringDeep backend...Hourly payWork at officeLocal areaRemote workFlexible hours
$200k - $250k
...our customers — from leadership to engineers — and work together to solve real problems... .... Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you'll play a... ...Experience building infrastructure for AI/ML workloads or high-throughput...Full timeInternshipRelocation package$145k - $200k
...CompanyPalantir builds the world’s leading software for data-driven decisions and... ...more.The Role We are a software engineering team with expertise in enabling ML models in production. We deploy... ...problems at the intersection of infrastructure and machine learning that...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$180k - $300k
...expertise on both data research and data engineering necessary to solve this incredibly... ...We’re looking for an experienced Cloud Infrastructure Engineer to join our core team at DatologyAI... ...infrastructure support for training large-scale ML models Ensure our infrastructure...Full timeWork at officeRelocation package$147k - $210k
....2 years of experience with software development in one or more programming... ...malware analysis, detection engineering, or incident response).... ...forward.The Secure Network Infrastructure (SecNI) team aims to secure... ...devices, including AI/ML and optical fabrics, and are...Remote work$143.5k - $212.85k
...solutions spanning all phases of the Software Development Lifecycle (SDLC).... ...level issues, guiding junior engineers, operating with little... ...velocity of Venmo's Cloud Infrastructure and DevOps engineering teams.... ...engineering teams to leverage LLM and ML capabilities in their own...Full timeWork at officeLocal areaImmediate startFlexible hours$193.93k - $291.15k
...team of high-output generalists where ML and systems engineering converge to push autonomy... ...forward. As a Senior Perception ML Data Infrastructure Engineer, you will own the critical... ...~ BS/MS in Computer Science , Software Engineering, Robotics, or a related...Full time$180k - $300k
...has the deep expertise on both data research and data engineering necessary to solve this incredibly challenging... ...the technical lead of a Data Engineering / Platform / Infrastructure Team. Experience building ML/DL systems and/or data infrastructure that feeds into...Full timeWork at officeVisa sponsorshipRelocation package$153k - $376k
...foundational systems that power analytics, AI/ML, and data-driven decision-making across... ...AI researchers, machine learning engineers, data scientists, product engineers, and... ...ML Datalake, orchestration and pipeline infrastructure, and large-scale data ingestion and processing...Full timeRemote workWork from home$253k - $416k
...Bellevue, WA. LinkedIn’s Data Infrastructure team builds and operates some... ...are seeking a Distinguished Engineer with deep expertise in Online... ...~10+ years of experience in software engineering, with a focus on... ...and the use of AI/ML in production systems ~ Ability...Full timeFor contractorsWork at officeFlexible hours- ...deep expertise in model innovation and systems engineering paired with a design-minded product... ...lifeblood of our models, and we're looking for a Software Engineer to help build the training data and ML data infrastructure at Cartesia. This role sits at the intersection...Full timeWork at officeVisa sponsorshipFlexible hours
$165k - $225k
...delivers high-performance AI infrastructure for organizations running... ...and subnet configuration, and software-designed networking orchestration... ...that enable researchers and engineering teams to programmatically... ...computing platforms and AI/ML infrastructure requirements...Full timeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infrastructure. Be the first to apply!
- associate software developer Remote
- software engineer part time Remote
- software developer intern Remote
- software developer fintech Remote
- software support engineer Remote
- ngo software engineer Remote
- software engineer - web development Remote
- intel software engineer Remote
- IT software engineer Remote
- machine learning software engineer Remote

