Software Engineer, ML Inference Platform
$160.36k - $240.54kNuro
Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!About the WorkDesign and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.About YouYou have a degree in BS, MS.c or Ph.D with 1+ years of relevant experienceStrong proficiency in Python or similar languages. Familiarity with c++.Technical excellence: Develop with a high standard for performance, scalability, and code quality.Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systemsIndependence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.Bonus PointsStrong proficiency in C++ or other high-performance low-level languagesExperience working with large-scale distributed systemsExperience with system & framework designExperience with data workflow orchestration platformsExperience with ML compilersAt Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
$92k - $135k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...What You'll Do: Join the Inference team to ship production features... ...mentorship from experienced engineers. About the role: Implement... ...that deployed a microservice or ML inference demo. Coursework...PlatformPermanent employmentFull timeTemporary workCasual workInternshipWork at officeFlexible hours$184k - $287.5k
...diffusion models for maximal inference efficiency using techniques... ...as developing an innovative software platform (TRT Model Optimizer). Our software... ...externally by research and engineering teams alike developing best-... ..., PyTorch, and related ML tools (e.g. HuggingFace)....PlatformFull time$165.2k - $223.6k
...builds AWS Neuron, the software development kit used... ...Inferentia and Trainium ML accelerators. This... ...enabling unparalleled ML inference and training performance... ...boundary, our engineers build systematic infrastructure... ..., TensorRT or similar platforms in production...PlatformWork experience placementInternshipLocal areaFlexible hours$184k - $287.5k
...seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale... ...pareto frontier for the field of ML Systems; survey recent publications... .../CRI-O/CRIU.Experience with cloud platforms (AWS/GCP/Azure), infrastructure as...PlatformFull time$152k - $241.5k
## Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa Claratime type: Full... ...software that can be scaled to multiple platforms for functionality and performance*... ...TensorFlow, ONNX Runtime or other ML frameworks.NVIDIA is widely...Platform- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud... ...'ll partner closely with ML, Product and Infrastructure... ...+ years of experience in software engineering, with...Platform
- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Staff Engineer to own major areas of... ...of our Inference Cloud Platform. This team owns the cloud... .... Partner with ML, Product, Infrastructure... ...years of experience in software engineering, with substantial...Platform
$188k - $275k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...more at What You'll Do: Inference Platform Team The... ...About the role: As a Staff Software Engineer (IC5) on the Inference team,... ...Exposure to large-scale AI/ML infrastructure or hyperscale...PlatformPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$195k - $261k
...by two former Navy electrical engineers with a proven track record in robotics and software. We are developing an autonomous... ...Embedded Software Engineer - Inference AI/ML to own the end-to-end process... ...knowledge of embedded or edge platforms such as NVIDIA Jetson,...PlatformLocal area- Cerebras Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure. You will deploy scalable inference services, optimize... ...environments. You will collaborate with ML engineers to validate accuracy and performance...Platform
$174k - $252k
...implement, and prototype novel software algorithms.Oversee... ...with Machine Learning (ML) hardware accelerators and ML inference software.Preferred qualifications... ...:PhD in Computer Engineering, Computer Science, or a... ...next-generation compute platform for cutting-edge AI...Platform$174k - $252k
Direct full-stack Software (SW) role, focusing on ML compiler and inference infrastructure. Design and develop ML compiler... ...:PhD degree in Computer Engineering, Computer Science, or a related... ...building a next-generation compute platform for AI inference workloads, with...Platform$174k - $252k
...one or more specialized ML areas, leverage ML... ...and use cases on edge platforms.Enable on-device deployment... ...of on-device model inference via optimizations in the... ...of experience with software development in one or... ...ML.Google's software engineers develop the next-generation...Platform$193.93k - $291.15k
...building a universal autonomy platform: self-driving for all roads... .... We are looking for strong software engineers to research, develop, and... ...generalizable and scalable ML planner that can power L4 driving... ..., distributed training, or inference optimization.At Nuro, we...PlatformImmediate startFlexible hours$102.1k - $202.2k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... .... We host the training and inference platforms behind many of Microsoft’s... ...the company.As a Software Engineer on the AI infrastructure... ...experience with production ML systems, large-scale training...PlatformOngoing contractLocal area3 days per week$193.3k - $261.5k
...Architect and build scalable ML infrastructure... ...excellence* Raise the engineering bar through technical... ...internship professional software development experience... ..., TensorRT or similar platforms in production environments... ..., training/inference lifecycles, and optimization...PlatformInternshipLocal areaFlexible hours$170.6k - $261.3k
Job DescriptionAs a Senior Software Engineer on the SimCore team, you will... ...build and deploy applied AI/ML solutions that directly support... ...robust, high-performance inference pipelines. This role is not... ...Familiarity with GCP or other cloud platforms, Kubernetes, Docker, and...PlatformFull timeLocal areaWork from homeFlexible hours$165.2k - $223.6k
...talented scientists and engineers to innovate on behalf... ...team builds a unified platform for large-scale LLM... ...internship professional software development experience... ...architecture, training/inference lifecycles, and... ...qualification - Knowledge of ML frameworks including...PlatformInternshipLocal areaFlexible hours$119.8k - $234.7k
...Less than 25%Profession: Software EngineeringDiscipline: Software... ...as a Service, Azure ML, Cognitive Services, and... ...for a Principal Software Engineer - Responsible AI who is passionate... ...: Safety and governance platforms for AI models and agents Inference, routing, orchestration,...PlatformOngoing contractWork at officeLocal area3 days per week$180k - $258.75k
...Models.We are looking for a Senior Software Engineer to join our end-to-end automated... ...autonomy systems on vehicle platforms. As a software generalist with deep... ...in C++ and Python, that supports ML training, evaluation, and inference workflows.Build and maintain ML tooling...PlatformFull timeLocal areaShift work$165.2k - $223.6k
...consistency of product identity and to infer relationships between... ...'s Item and Relationship Platform group is looking for an innovative and customer-focused software engineer to help us make the world's best... ...you to Agentic solutions, AI/ML, data traceability, data...PlatformHourly payInternshipLocal areaWorldwideFlexible hours$193.93k - $352.29k
...why we're building a universal autonomy platform: self-driving for all roads and all rides... ...leading investors. About the Role The ML Infrastructure team is responsible for... ...road validation. Maintain an in-house ML inference platform to serve large language models...PlatformImmediate startFlexible hours$147k - $210k
...services for the GDC Agent Platform, focusing on enabling... ...designers, and other engineering teams within GDC and... ...of experience with software development or 1 year... ...Experience building AI/ML systems and large-scale... ...workloads beyond basic inference. We are building the foundational...Platform$193.93k - $352.29k
...a universal autonomy platform: self-driving for all... ...autonomously inside Nuro's own engineering organization, under... ....About You3+ years of software engineering experience... ...under the hood at inference. Attention and KV-cache... ....Experience with ML training or research infrastructure...PlatformImmediate startFlexible hours$157k - $235k
..., and other digital services.Snap Engineering teams build fun and technically sophisticated... ...the forefront.We’re looking for a Software Engineer to join the ML Platform Experience team, part of the core... ...high-performance inference systems to ensure fast and efficient...PlatformFull timeLive inWork at officeLocal area- ...Software Engineer, AI Compute InfrastructureLos Angeles, Palo Alto, San Francisco... ..., efficient, and scalable platform that enables our research... ...thousands of devices for inference, training, data processing and... ...Ray.Experience with core ML frameworks such as PyTorch,...PlatformFull time
- ...Senior Lead Software EngineerBe an integral part of an agile... ...As a Senior Lead Software Engineer at JPMorgan Chase within the... ...Sector, Infrastructure Platforms team, you are an integral... ...transformer architecture, ML training, and inference.Experience with Infrastructure...PlatformFor contractors
$170.6k - $261.3k
...Senior Software EngineerAs a Senior Software Engineer on the SimCore team, you will build and deploy applied AI/ML solutions that directly support simulation... ..., high-performance inference pipelines. This role is... ...with GCP or other cloud platforms, Kubernetes, Docker, and...PlatformFlexible hours$153k - $222k
...for both infrastructure engineers with expertise in... ...learning pipelines and ML engineers that want to... ...in Computer Science, Software Engineering, or equivalent... ...a company-wide platform for ML training, evaluation... ...Serving, NVIDIA Triton inference server, etc.)Compensation...PlatformFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift$151.8k - $332.2k
...you can expect We are looking for an AI Inference Engineer with a solid background in speech... ...the most unique AI-powered collaboration platform to users across the globe.ResponsibilitiesDeveloping... ...shell scripts, C/C++; familiarity with ML frameworks such as PyTorch and...PlatformFull timeWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!
- cybersecurity software engineer Mountain View, CA
- graduate software engineer Mountain View, CA
- software developer fintech Mountain View, CA
- senior robotics software engineer Mountain View, CA
- software engineer visa sponsorship Mountain View, CA
- network software engineer Mountain View, CA
- software engineer remote Mountain View, CA
- part time software developer remote Mountain View, CA
- software engineer full time Mountain View, CA
- entry level software engineer remote Mountain View, CA


