Software Engineer, ML Inference Platform
$160.36k - $240.54kNuro
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!About the WorkDesign and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.About YouYou have a degree in BS, MS.c or Ph.D with 1+ years of relevant experienceStrong proficiency in Python or similar languages. Familiarity with c++.Technical excellence: Develop with a high standard for performance, scalability, and code quality.Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systemsIndependence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.Bonus PointsStrong proficiency in C++ or other high-performance low-level languagesExperience working with large-scale distributed systemsExperience with system & framework designExperience with data workflow orchestration platformsExperience with ML compilersAt Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
- ...industry-leading training and inference speeds; over 10 times faster than... ...the Role We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns... ...Technical Influence. Partner with ML, Product, Infrastructure, and...PlatformFull time
$160.36k - $240.54k
...why we're building a universal autonomy platform: self-driving for all roads and all rides... ...leading investors. About the Role The ML Infrastructure team is responsible for... ...road validation. Maintain an in-house ML inference platform to serve large language models...PlatformImmediate startFlexible hours- ...industry-leading training and inference speeds; over 10 times... ...We're hiring a Staff Engineer to own major areas of... ...of our Inference Cloud Platform. This team owns the... ...Influence. Partner with ML, Product, Infrastructure... ...years of experience in software engineering, with substantial...PlatformFull time
$152k - $204k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...What You'll Do: Senior engineers are area owners who lead designs... ...evolve our Kubernetes-native inference platform and meet strict P99... ...performance. ~ Optimize end-to-end ML system performance by...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShift work$92k - $135k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...What You'll Do: Join the Inference team to ship production features... ...mentorship from experienced engineers. About the role: Implement... ...that deployed a microservice or ML inference demo. Coursework...PlatformPermanent employmentFull timeTemporary workCasual workInternshipWork at officeFlexible hours- ...Software Engineer DeepInfra is building the infrastructure layer for the next generation of... ...locked into proprietary providers. Our inference platform serves trillions of tokens every week... ...AI systems. If you're excited about AI/ML, have built and shipped projects, and...PlatformFull time
- ...media. Our team includes engineers, artists, and product... ...Pika's web and multi-platform products Develop... ...Looking For ~5+ years of software engineering experience... ...the stack and into ML infrastructure (Python... ...agentic workflows, or ML inference (Python/PyTorch)...PlatformWork at officeImmediate start
$140k - $150k
...Software Engineer DeepInfra is building the infrastructure layer for the next generation of... ...locked into proprietary providers. Our inference platform serves trillions of tokens every week... ...AI systems. If you're excited about AI/ML, have taken related courses or built...PlatformFull timeInternship- ...Senior Software Engineer At Toyota Research Institute (TRI), we're on a mission... ...advanced autonomy systems on vehicle platforms. As a software generalist with... ...in C++ and Python, that supports ML training, evaluation, and inference workflows. Build and maintain...PlatformShift work
$150k - $224k
...others. AppLovin is seeking a Software Engineer with strong machine learning... ...across our advertising platform, which reaches more than 1 Billion... .... You will work across the ML stack from user signal and... .... Improve training and inference efficiency by identifying...Platform$165.45k - $259.75k
...Senior Software Engineer HP is seeking a Senior Software Engineer to help develop software platforms within HP's device and services ecosystem. This... ...engineering, and AI/ML engineering to deliver scalable... ...data preprocessing, inference pipelines, evaluation, and...PlatformFull timeTemporary workLocal areaFlexible hoursShift work$61k - $101k
...training or certification in software engineering concepts, plus 3+ years of... ...experience, with a strong focus on ML systems. We need hands-on... ...one or more public cloud platforms, such as AWS or GCP. We... ...Serving, or Triton Inference Server. Preferred: familiarity...PlatformFull time$193.93k - $291.15k
...building a universal autonomy platform: self-driving for all roads... .... We are looking for strong software engineers to research, develop, and... ...generalizable and scalable ML planner that can power L4 driving... ..., distributed training, or inference optimization. At Nuro,...PlatformImmediate startFlexible hours$139k - $204k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...that powers AI training and inference at scale. This is an opportunity... ...What You'll Do As a Senior Software Engineer I (IC3), you will own... ...GPU-based applications, or ML pipelines. Knowledge of scheduling...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$182k - $242k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost-... ...computing, GPU/accelerator software, or performance-critical systems...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$182k - $242k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...We're looking for a Senior Engineer to be a driving force on CoreWeave... ...distributed training and inference workloads. You will own how we... ...ideally for infrastructure or ML systems rather than general-purpose...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$229.9k - $262.4k
Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital One, we are creating responsible... ...time, our applications of AI & ML are bringing humanity and simplicity... ..., test, deploy, and support AI software components including foundation model...PlatformFull timePart timeLocal area$229.9k - $262.4k
...Sr. Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are... ...our applications of AI & ML are bringing humanity and... ...customers. Our AI models and platforms empower teams across Capital... ..., deploy, and support AI software components including foundation...PlatformFull timePart timeLocal area- ...industry-leading training and inference speeds; over 10 times... ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize... ...knowledge across accelerator platforms.Experience modifying or contributing... ..., or another open-source ML systems project.Experience...Platform
$188k - $275k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...more at What You'll Do: Inference Platform Team The... ...About the role: As a Staff Software Engineer (IC5) on the Inference team,... ...Exposure to large-scale AI/ML infrastructure or hyperscale...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$150.4k - $277.6k
...Multimodal GenAI researchers and engineers to develop world-class audio-... ...within a large production software stack. Deep understanding of machine learning inference and performance oriented development... ...for mobile and embedded platforms Developing and integrating...PlatformRelocation$165.2k - $223.6k
...builds AWS Neuron, the software development kit used... ...Inferentia and Trainium ML accelerators. This... ...enabling unparalleled ML inference and training performance... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformWork experience placementInternshipLocal areaFlexible hours$170k - $205k
...Senior Software Engineer The Crusoe Cloud Managed AI team seeks an ambitious... ...teams to define the AI platform roadmap, influence the long-... ...stage projects quickly. ~ AI/ML Expertise: Experience with... ...infrastructure (training, inference, ETL pipelines). ~ Software...PlatformTemporary workWork at office$120k - $400k
...is on a mission to be the compute platform for AGI. We are developing vertically... ...to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily... ...degree Possess outstanding software engineering skills with a focus on efficiency...PlatformFull timeWork experience placementLocal area$250k - $413k
...We build and operate the platforms that let product engineering teams ship with confidence... ...Role We're looking for a Software Engineer (L4) to help... ...agentic AI-driven analysis, inference, and orchestration systems... ...understand model internals and ML methodologies well enough...PlatformHourly payFull timeImmediate startFlexible hours- ...About the role As a Motion Planning Engineer on the Fallback Stack team, you will design... ...will: Design and implement classical or ML motion planners for fallback and minimal-... ...Contribute to a reusable fallback platform used across trucking and other autonomy programs...PlatformOdd jobFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
$120.75k - $161k
...decisions. We’re looking for a Software Engineer to design and build highly... ...managers, designers, and AI/ML engineers to bring... ...and APIs that support model inference, orchestration, and tool execution... ...Evaluation Familiarity with cloud platforms (AWS, GCP, or Azure)...PlatformFull timeWork at officeRemote workFlexible hours$150k - $250k
...next-generation cybersecurity platform. Working at the intersection... ...security researchers and software engineers to develop, productize, and... ...architectures, AI agents, model inference, and serving optimization.... ...processing systems, and production ML pipelines. ~ Strong...PlatformFull time$10,000 per month
...Palantir builds the world’s leading software for data-driven decisions and... ...the people who need it, our platforms empower our partners to... ...The Role Software Engineers at Palantir build software at... ...planning tools driven by rich-ML models. Our customers use our...PlatformWork experience placementInternshipWork at officeRemote workWork from home$274k - $304k
...Saviynt's AI-powered identity platform manages and governs human and non-human access... ..., please visit AI Platform Engineer - Training & Inference Saviynt's AI-powered identity platform... ...AI model at Saviynt. We need an ML Platform Engineer to own distributed...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!
- software developer positions Mountain View, CA
- senior software engineer remote Mountain View, CA
- software engineer contract Mountain View, CA
- cybersecurity software engineer Mountain View, CA
- part time software developer remote Mountain View, CA
- junior software developer internship Mountain View, CA
- software system engineer Mountain View, CA
- software engineer remote Mountain View, CA
- software engineer visa sponsorship Mountain View, CA
- work from home software developer Mountain View, CA




