Software Engineer, ML Inference Platform
$160.36k - $240.54kNuro
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors. About The Role The ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots! About The Work Design and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. Develop observability to track ML model lifecycles from data generation to on-road validation. Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms. About You You have a degree in BS, MS.c or Ph.D with 1+ years of relevant experience Strong proficiency in Python or similar languages. Familiarity with c++. Technical excellence: Develop with a high standard for performance, scalability, and code quality. Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systems Independence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems. Bonus Points Strong proficiency in C++ or other high-performance low-level languages Experience working with large-scale distributed systems Experience with system & framework design Experience with data workflow orchestration platforms Experience with ML compilers At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package. At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics. #J-18808-Ljbffr Nuro
- ...industry-leading training and inference speeds; over 10 times... ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize... ...knowledge across accelerator platforms.Experience modifying or contributing... ..., or another open-source ML systems project.Experience...Platform
$157k - $235k
...Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically... ...privacy at the forefront.We’re looking for a Software Engineer to join the Core Inference team, part of the core ML Platform organization. Our team builds and owns the machine...PlatformFull timeLive inWork at officeLocal area- Google DeepMind is seeking engineers for a role focusing on ML accelerators, compiler stacks, and high-performance inference infrastructure. You will contribute to bridging AI workloads... ...optimization efforts across our compute platform. The position emphasizes initiative and...Platform
$192k - $278k
...optimization of the hardware/software stack to enable... ...and serving of large ML models.Collaborate with... ...degree in Electrical Engineering, Computer Engineering,... ...optimizations for ML training and inference.Experience with deep... ...the essential platforms that enable developers...PlatformWorldwide- ...industry-leading training and inference speeds; over 10 times faster than... ....About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns... ...Influence. Partner with ML, Product, Infrastructure, and...Platform
$160.36k - $240.54k
...why we’re building a universal autonomy platform: self-driving for all roads and all rides... ...other leading investors.About the RoleThe ML Infrastructure team is responsible for building... ...-road validation.Maintain an in-house ML inference platform to serve large language models...PlatformImmediate startFlexible hours$192k - $278k
...Hardware/Software Co-Design Engineer, Inference Share Hardware/Software Co-Design Engineer, Inference Google... ...or performance optimizations for ML training and inference. Experience... ..., and providing the essential platforms that enable developers to build the...PlatformWorldwide$157k - $235k
...more human in addition to Bitmoji Saturn and other digital services. Were looking for a Software Engineer to join the Core Inference team part of the core ML Platform organization. Our team builds and owns the machine learning infrastructure that powers...PlatformFull timeWork at officeLocal area$165.2k - $223.6k
...the AWS Neuron SDK, the software development kit used... ...accelerators.The Neuron Inference organization is at the... ...for a wide range of ML models and model architectures... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformInternshipLocal areaFlexible hours$184k - $287.5k
...diffusion models for maximal inference efficiency using techniques... ...as developing an innovative software platform (TRT Model Optimizer). Our software... ...externally by research and engineering teams alike developing best-... ..., PyTorch, and related ML tools (e.g. HuggingFace)....PlatformFull time$165.2k - $223.6k
...builds AWS Neuron, the software development kit used... ...Inferentia and Trainium ML accelerators. This... ...enabling unparalleled ML inference and training performance... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformWork experience placementInternshipLocal areaFlexible hours$188k - $275k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...at What You’ll Do The Inference team builds and operates CoreWeave... ...The Role As a Staff Software Engineer (IC5) on the Inference team,... ...Exposure to large-scale AI/ML infrastructure or hyperscale...PlatformFull timeTemporary workFlexible hours$165.2k - $223.6k
...builds.We're looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving... ...-level data-movement software that transfers KV cache... ...is welcome.Prior AI/ML experience is not required... ...broadly adopted cloud platform. We pioneered cloud...PlatformInternshipLocal areaFlexible hours$148k - $324k
...systematically rebuilding the AI software stack from the ground... ...role: In the Cloud Inference team, we are focused... ...productive, low toil platform for managing these... ...alike. We're seeking engineers who are passionate... ...working on high scale ML inference infrastructure...PlatformFull timeWork experience placementWork at officeLocal areaRemote work- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud... ...'ll partner closely with ML, Product and Infrastructure... ...+ years of experience in software engineering, with...Platform
- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Staff Engineer to own major areas of... ...of our Inference Cloud Platform. This team owns the cloud... .... Partner with ML, Product, Infrastructure... ...years of experience in software engineering, with substantial...Platform
$240k - $333k
...architecture for the hardware/software stack, ensuring... ...and serving of large ML models.Act as the technical... ...across hardware engineering, compiler development,... ...scale ML training and inference.Experience with deep learning... ...the essential platforms that enable developers...PlatformWorldwideShift work- Modular is seeking an experienced backend engineer to shape end-to-end distributed inference deployments on a multi-cloud platform. You will build scalable services, improve observability... ..., and close collaboration with product and ML teams. Remote-friendly role with offices in...PlatformRemote job
$240k - $333k
...Technical Lead, Hardware/Software Codesign, TPU Inference Share Technical Lead, Hardware... ...'s degree in Electrical Engineering, Computer Engineering,... ...optimizations for massive-scale ML training and inference.... ...providing the essential platforms that enable developers to...PlatformWorldwideShift work- ...industry-leading training and inference speeds; over 10 times faster than... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML API layer that makes this... ...services and Cerebras inference platform to deliver a consistent experience...Platform
- DoorDash’s GenAI Platform team builds shared infrastructure to enable GenAI-powered products... ...stack, real-time GPU endpoints, batch inference, and fine-tuning pipelines, while... ...performance tradeoffs. You will collaborate with ML engineers, data scientists, and platform teams to...Platform
- Cerebras Systems is seeking a Staff Engineer to lead the Inference Platform team, owning orchestration across datacenter clusters and connecting cloud components with ML services. You will solve hard problems in Kubernetes operators, security policies, and CI/CD, driving...Platform
$174k - $252k
Direct full-stack Software (SW) role, focusing on ML compiler and inference infrastructure. Design and develop ML compiler... ...:PhD degree in Computer Engineering, Computer Science, or a related... ...building a next-generation compute platform for AI inference workloads, with...Platform$174k - $252k
...implement, and prototype novel software algorithms.Oversee... ...with Machine Learning (ML) hardware accelerators and ML inference software.Preferred qualifications... ...:PhD in Computer Engineering, Computer Science, or a... ...next-generation compute platform for cutting-edge AI...Platform$221k - $331k
...others.AppLovin is seeking a Software Engineer with strong machine learning... ...across our advertising platform, which reaches more than 1 Billion... .... You will work across the ML stack from user signal and... ...requirements.Improve training and inference efficiency by identifying...Platform$193.93k - $291.15k
...building a universal autonomy platform: self-driving for all roads... .... We are looking for strong software engineers to research, develop, and... ...generalizable and scalable ML planner that can power L4 driving... ..., distributed training, or inference optimization.At Nuro, we...PlatformImmediate startFlexible hours$193.3k - $261.5k
...massive scale.As a Senior Software Development Engineer, you will lead the design and... ...and build scalable platforms that transform billions of... ...Experience with CUDA kernels or ML/low-level kernelsPreferred... ...including architecture, training/inference lifecycles, and...PlatformInternshipLocal areaFlexible hours$169k - $338k
...summary:As a Distinguished Software Engineer, you will lead the design and... ...develops scalable, cloud-native platforms for real-time data... ...scale AdTech problems using ML (e.g., transformer model) and... ...model training and real-time inference on GPU backed infrastructure...PlatformFull timeTemporary workPart time$170.6k - $261.3k
Job DescriptionAs a Senior Software Engineer on the SimCore team, you will... ...build and deploy applied AI/ML solutions that directly support... ...robust, high-performance inference pipelines. This role is not... ...Familiarity with GCP or other cloud platforms, Kubernetes, Docker, and...PlatformFull timeLocal areaWork from homeFlexible hours$119.8k - $234.7k
...Less than 25%Profession: Software EngineeringDiscipline: Software... ...as a Service, Azure ML, Cognitive Services, and... ...for a Principal Software Engineer - Responsible AI who is passionate... ...: Safety and governance platforms for AI models and agents Inference, routing, orchestration,...PlatformOngoing contractWork at officeLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!
- software engineer amazon Mountain View, CA
- information technology software engineer Mountain View, CA
- federal - software developer Mountain View, CA
- graduate software developer Mountain View, CA
- rust software engineer Mountain View, CA
- software development engineer (robotics engineer) Mountain View, CA
- software engineer remote Mountain View, CA
- junior software developer internship Mountain View, CA
- remote entry level software developer Mountain View, CA
- software engineer contract Mountain View, CA



