Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, ML Inference Platform

$160.36k - $240.54k

Nuro

Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!About the WorkDesign and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.About YouYou have a degree in BS, MS.c or Ph.D with 1+ years of relevant experienceStrong proficiency in Python or similar languages. Familiarity with c++.Technical excellence: Develop with a high standard for performance, scalability, and code quality.Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systemsIndependence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.Bonus PointsStrong proficiency in C++ or other high-performance low-level languagesExperience working with large-scale distributed systemsExperience with system & framework designExperience with data workflow orchestration platformsExperience with ML compilersAt Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML Inference Platform in Mountain View, CA vacancy
  • $92k - $135k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...What You'll Do: Join the Inference team to ship production features...  ...mentorship from experienced engineers. About the role: Implement...  ...that deployed a microservice or ML inference demo. Coursework... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Internship
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $184k - $287.5k

     ...diffusion models for maximal inference efficiency using techniques...  ...as developing an innovative software platform (TRT Model Optimizer). Our software...  ...externally by research and engineering teams alike developing best-...  ..., PyTorch, and related ML tools (e.g. HuggingFace).... 
    Platform
    Full time

    Nvidia

    Santa Clara, CA
    5 hours ago
  • $165.2k - $223.6k

     ...builds AWS Neuron, the software development kit used...  ...Inferentia and Trainium ML accelerators. This...  ...enabling unparalleled ML inference and training performance...  ...boundary, our engineers build systematic infrastructure...  ..., TensorRT or similar platforms in production... 
    Platform
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $184k - $287.5k

     ...seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale...  ...pareto frontier for the field of ML Systems; survey recent publications...  .../CRI-O/CRIU.Experience with cloud platforms (AWS/GCP/Azure), infrastructure as... 
    Platform
    Full time

    Nvidia

    Santa Clara, CA
    10 hours ago
  • $152k - $241.5k

    ## Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa Claratime type: Full...  ...software that can be scaled to multiple platforms for functionality and performance*...  ...TensorFlow, ONNX Runtime or other ML frameworks.NVIDIA is widely... 
    Platform

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud...  ...'ll partner closely with ML, Product and Infrastructure...  ...+ years of experience in software engineering, with... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    10 hours ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...'re hiring a Staff Engineer to own major areas of...  ...of our Inference Cloud Platform. This team owns the cloud...  .... Partner with ML, Product, Infrastructure...  ...years of experience in software engineering, with substantial... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    10 hours ago
  • $188k - $275k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...more at What You'll Do: Inference Platform Team The...  ...About the role: As a Staff Software Engineer (IC5) on the Inference team,...  ...Exposure to large-scale AI/ML infrastructure or hyperscale... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $195k - $261k

     ...by two former Navy electrical engineers with a proven track record in robotics and software. We are developing an autonomous...  ...Embedded Software Engineer - Inference AI/ML to own the end-to-end process...  ...knowledge of embedded or edge platforms such as NVIDIA Jetson,... 
    Platform
    Local area

    Allen Control Systems

    Mountain View, CA
    3 days ago
  • Cerebras Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure. You will deploy scalable inference services, optimize...  ...environments. You will collaborate with ML engineers to validate accuracy and performance... 
    Platform

    Cerebras

    Sunnyvale, CA
    4 days ago
  • $174k - $252k

     ...implement, and prototype novel software algorithms.Oversee...  ...with Machine Learning (ML) hardware accelerators and ML inference software.Preferred qualifications...  ...:PhD in Computer Engineering, Computer Science, or a...  ...next-generation compute platform for cutting-edge AI... 
    Platform

    Google

    Mountain View, CA
    5 hours ago
  • $174k - $252k

    Direct full-stack Software (SW) role, focusing on ML compiler and inference infrastructure. Design and develop ML compiler...  ...:PhD degree in Computer Engineering, Computer Science, or a related...  ...building a next-generation compute platform for AI inference workloads, with... 
    Platform

    Google

    Mountain View, CA
    5 hours ago
  • $174k - $252k

     ...one or more specialized ML areas, leverage ML...  ...and use cases on edge platforms.Enable on-device deployment...  ...of on-device model inference via optimizations in the...  ...of experience with software development in one or...  ...ML.Google's software engineers develop the next-generation... 
    Platform

    Google

    Sunnyvale, CA
    1 day ago
  • $193.93k - $291.15k

     ...building a universal autonomy platform: self-driving for all roads...  .... We are looking for strong software engineers to research, develop, and...  ...generalizable and scalable ML planner that can power L4 driving...  ..., distributed training, or inference optimization.At Nuro, we... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    10 hours ago
  • $102.1k - $202.2k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:...  .... We host the training and inference platforms behind many of Microsoft’s...  ...the company.As a Software Engineer on the AI infrastructure...  ...experience with production ML systems, large-scale training... 
    Platform
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    3 days ago
  • $193.3k - $261.5k

     ...Architect and build scalable ML infrastructure...  ...excellence* Raise the engineering bar through technical...  ...internship professional software development experience...  ..., TensorRT or similar platforms in production environments...  ..., training/inference lifecycles, and optimization... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Palo Alto, CA
    10 hours ago
  • $170.6k - $261.3k

    Job DescriptionAs a Senior Software Engineer on the SimCore team, you will...  ...build and deploy applied AI/ML solutions that directly support...  ...robust, high-performance inference pipelines. This role is not...  ...Familiarity with GCP or other cloud platforms, Kubernetes, Docker, and... 
    Platform
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $165.2k - $223.6k

     ...talented scientists and engineers to innovate on behalf...  ...team builds a unified platform for large-scale LLM...  ...internship professional software development experience...  ...architecture, training/inference lifecycles, and...  ...qualification - Knowledge of ML frameworks including... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Palo Alto, CA
    4 days ago
  • $119.8k - $234.7k

     ...Less than 25%Profession: Software EngineeringDiscipline: Software...  ...as a Service, Azure ML, Cognitive Services, and...  ...for a Principal Software Engineer - Responsible AI who is passionate...  ...: Safety and governance platforms for AI models and agents Inference, routing, orchestration,... 
    Platform
    Ongoing contract
    Work at office
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    1 day ago
  • $180k - $258.75k

     ...Models.We are looking for a Senior Software Engineer to join our end-to-end automated...  ...autonomy systems on vehicle platforms. As a software generalist with deep...  ...in C++ and Python, that supports ML training, evaluation, and inference workflows.Build and maintain ML tooling... 
    Platform
    Full time
    Local area
    Shift work

    Toyota Research Institute

    Los Altos, CA
    4 days ago
  • $165.2k - $223.6k

     ...consistency of product identity and to infer relationships between...  ...'s Item and Relationship Platform group is looking for an innovative and customer-focused software engineer to help us make the world's best...  ...you to Agentic solutions, AI/ML, data traceability, data... 
    Platform
    Hourly pay
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Sunnyvale, CA
    10 hours ago
  • $193.93k - $352.29k

     ...why we're building a universal autonomy platform: self-driving for all roads and all rides...  ...leading investors. About the Role The ML Infrastructure team is responsible for...  ...road validation. Maintain an in-house ML inference platform to serve large language models... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $147k - $210k

     ...services for the GDC Agent Platform, focusing on enabling...  ...designers, and other engineering teams within GDC and...  ...of experience with software development or 1 year...  ...Experience building AI/ML systems and large-scale...  ...workloads beyond basic inference. We are building the foundational... 
    Platform

    Google

    Sunnyvale, CA
    3 days ago
  • $193.93k - $352.29k

     ...a universal autonomy platform: self-driving for all...  ...autonomously inside Nuro's own engineering organization, under...  ....About You3+ years of software engineering experience...  ...under the hood at inference. Attention and KV-cache...  ....Experience with ML training or research infrastructure... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $157k - $235k

     ..., and other digital services.Snap Engineering teams build fun and technically sophisticated...  ...the forefront.We’re looking for a Software Engineer to join the ML Platform Experience team, part of the core...  ...high-performance inference systems to ensure fast and efficient... 
    Platform
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  •  ...Software Engineer, AI Compute InfrastructureLos Angeles, Palo Alto, San Francisco...  ..., efficient, and scalable platform that enables our research...  ...thousands of devices for inference, training, data processing and...  ...Ray.Experience with core ML frameworks such as PyTorch,... 
    Platform
    Full time

    HeyGen

    Palo Alto, CA
    5 days ago
  •  ...Senior Lead Software EngineerBe an integral part of an agile...  ...As a Senior Lead Software Engineer at JPMorgan Chase within the...  ...Sector, Infrastructure Platforms team, you are an integral...  ...transformer architecture, ML training, and inference.Experience with Infrastructure... 
    Platform
    For contractors

    Hackajob

    Palo Alto, CA
    5 days ago
  • $170.6k - $261.3k

     ...Senior Software EngineerAs a Senior Software Engineer on the SimCore team, you will build and deploy applied AI/ML solutions that directly support simulation...  ..., high-performance inference pipelines. This role is...  ...with GCP or other cloud platforms, Kubernetes, Docker, and... 
    Platform
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  • $153k - $222k

     ...for both infrastructure engineers with expertise in...  ...learning pipelines and ML engineers that want to...  ...in Computer Science, Software Engineering, or equivalent...  ...a company-wide platform for ML training, evaluation...  ...Serving, NVIDIA Triton inference server, etc.)Compensation... 
    Platform
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago
  • $151.8k - $332.2k

     ...you can expect We are looking for an AI Inference Engineer with a solid background in speech...  ...the most unique AI-powered collaboration platform to users across the globe.ResponsibilitiesDeveloping...  ...shell scripts, C/C++; familiarity with ML frameworks such as PyTorch and... 
    Platform
    Full time
    Work at office
    Remote work

    Zoom

    San Jose, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!