Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, ML Inference Platform

$160.36k - $240.54k

Nuro

Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!About the WorkDesign and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models. Develop and maintain continuous testing and monitoring systems for core ML infrastructure components. Develop observability to track ML model lifecycles from data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.About YouYou have a degree in BS, MS.c or Ph.D with 1+ years of relevant experienceStrong proficiency in Python or similar languages. Familiarity with c++.Technical excellence: Develop with a high standard for performance, scalability, and code quality.Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systemsIndependence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.Bonus PointsStrong proficiency in C++ or other high-performance low-level languagesExperience working with large-scale distributed systemsExperience with system & framework designExperience with data workflow orchestration platformsExperience with ML compilersAt Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML Inference Platform in Mountain View, CA vacancy
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ....About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns...  ...Influence. Partner with ML, Product, Infrastructure, and... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $165.2k - $223.6k

     ...builds AWS Neuron, the software development kit used...  ...Inferentia and Trainium ML accelerators. This...  ...enabling unparalleled ML inference and training performance...  ...boundary, our engineers build systematic infrastructure...  ..., TensorRT or similar platforms in production... 
    Platform
    Full time
    Work experience placement
    Internship
    Local area
    Flexible hours

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    1 day ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...the Cerebras Wafer-Scale Engine.We are hiring a Software Engineer to productionize...  ...knowledge across accelerator platforms.Experience modifying or contributing...  ..., or another open-source ML systems project.Experience... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $165.2k - $223.6k

     ...builds.We're looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving...  ...-level data-movement software that transfers KV cache...  ...is welcome.Prior AI/ML experience is not required...  ...broadly adopted cloud platform. We pioneered cloud... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...'re hiring a Staff Engineer to own major areas of...  ...of our Inference Cloud Platform. This team owns the cloud...  .... Partner with ML, Product, Infrastructure...  ...years of experience in software engineering, with substantial... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud...  ...'ll partner closely with ML, Product and Infrastructure...  ...+ years of experience in software engineering, with... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $150k - $224k

     ...others.AppLovin is seeking a Software Engineer with strong machine learning...  ...across our advertising platform, which reaches more than 1 Billion...  .... You will work across the ML stack from user signal and...  ...requirements.Improve training and inference efficiency by identifying... 
    Platform

    AppLovin

    Palo Alto, CA
    3 days ago
  • $193.93k - $291.15k

     ...building a universal autonomy platform: self-driving for all roads...  .... We are looking for strong software engineers to research, develop, and...  ...generalizable and scalable ML planner that can power L4 driving...  ..., distributed training, or inference optimization.At Nuro, we... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $193.3k - $261.5k

     ...massive scale.As a Senior Software Development Engineer, you will lead the design and...  ...and build scalable platforms that transform billions of...  ...Experience with CUDA kernels or ML/low-level kernelsPreferred...  ...including architecture, training/inference lifecycles, and... 
    Platform
    Internship
    Local area
    Flexible hours

    Amazon

    Palo Alto, CA
    1 day ago
  • $170.6k - $261.3k

    Job DescriptionAs a Senior Software Engineer on the SimCore team, you will...  ...build and deploy applied AI/ML solutions that directly support...  ...robust, high-performance inference pipelines. This role is not...  ...Familiarity with GCP or other cloud platforms, Kubernetes, Docker, and... 
    Platform
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $169k - $338k

     ...OfficeRole summary:The Distinguished Software Engineer is the senior-most technical...  ...bar of the discovery platforms that serve customers across...  .... The organization spans ML Engineering, Data Science, Data...  ...AI; low-latency online inference and model monitoring for drift... 
    Platform
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    1 day ago
  • $160.36k - $240.54k

     ...why we're building a universal autonomy platform: self-driving for all roads and all rides...  ...leading investors. About the Role The ML Infrastructure team is responsible for...  ...road validation. Maintain an in-house ML inference platform to serve large language models... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    29 days ago
  • $193.93k - $352.29k

     ...a universal autonomy platform: self-driving for all...  ...autonomously inside Nuro's own engineering organization, under...  ....About You3+ years of software engineering experience...  ...under the hood at inference. Attention and KV-cache...  ....Experience with ML training or research infrastructure... 
    Platform
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $140k - $150k

     ...locked into proprietary providers. Our inference platform serves trillions of tokens every week...  .... We are looking for early-career Software Engineers (0-2 years of experience, including...  ...systems. If you're excited about AI/ML, have taken related courses or built projects... 
    Platform
    Full time
    Internship

    Deep Infra

    Palo Alto, CA
    9 hours ago
  • $160k - $240k

     ...looking for self-motivated engineers to build the next-generation...  ...Autonomy team, hardware teams, AI Platform team, and systems/safety...  ...Collaborate with other software teams to build foundational...  ...frameworks Robotics experience, ML inference optimization experience,... 
    Platform

    Nuro - Mountain View, CA, US

    Mountain View, CA
    4 days ago
  • $145k - $200k

     ...builds the world’s leading software for data-driven...  ...people who need it, our platforms empower our partners to...  ...Role We are a software engineering team with expertise in enabling ML models in production. We...  ...across the full stack, from inference engines, GPU scheduling... 
    Platform
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package

    Palantir Technologies

    Palo Alto, CA
    2 days ago
  • $246.5k

     ...is the #1 TV streaming platform in the U.S., Canada,...  ...Machine Learning and Inference Platform that powers the...  ...span across hardware, software, and models. We’re looking...  ...deep experience in ML serving, high-...  ...someone excited to mentor engineers, innovate at scale, and... 
    Platform
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    9 hours ago
  • $165.2k - $223.6k

     ...high quality and fresh ML model training data, and...  ...infrastructure. This platform provides the ML training...  ...responsibilitiesAs an ML Engineer you will:Lead...  ...deployment to our large scale inference services. You will build...  ...internship professional software development experience-... 
    Platform
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Palo Alto, CA
    2 days ago
  • $61k - $101k

     ...training or certification in software engineering concepts, plus 3+ years of...  ...experience, with a strong focus on ML systems. We need hands-on...  ...one or more public cloud platforms, such as AWS or GCP. We...  ...Serving, or Triton Inference Server. Preferred: familiarity... 
    Platform
    Full time

    J.P. Morgan

    Palo Alto, CA
    9 days ago
  • $139k - $204k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...that powers AI training and inference at scale. This is an opportunity...  ...What You'll Do As a Senior Software Engineer I (IC3), you will own...  ...GPU-based applications, or ML pipelines. Knowledge of scheduling... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    a month ago
  • $182k - $242k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...About the Role As a Senior Software Engineer II (IC4) on the AI Workload...  ...modern AI training and inference workflows. It complements SUNK...  ...Familiarity with GPU-based workloads, ML training, or inference... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    a month ago
  •  ...opportunity for you to take your software engineering career to the next level. As...  ..., with emphasis on ML systems.Hands-on experience...  ...with one or more public cloud platforms (AWS, GCP)Experience with system...  ...TensorFlow Serving, Triton Inference Server)Familiarity with distributed... 
    Platform

    JP Morgan Chase

    Palo Alto, CA
    4 days ago
  • $120k - $195k

     ...model training, feature engineering and serving with...  ..., data infra, compute software, and hardware to harness...  ...state-of-the-art Feature Platform, which empowers AI...  ...cloud, enable GPU based inference for a large variety of...  ...with hundreds of new ML models per quarter using... 
    Platform
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  •  ...possible, with the ultimate goal of enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The application software team is the...  ....Our team maintains a high-performance AI inference platform that serves the best models internally at SpaceX to accelerate... 
    Platform
    Permanent employment
    Temporary work
    Remote work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    9 hours ago
  • $165.2k - $223.6k

     ...Neuron is the complete software stack for the AWS...  ...Software Development Engineer for the Neuron Runtime...  ...workloads across hardware platforms such as Trainium and Inferentia...  ...performance of ML Kernels and ML...  ...distributed training and inference solutions. This organization... 
    Platform
    Full time
    Internship
    Local area
    Work from home
    Flexible hours

    Annapurna Labs (U.S.) Inc.

    Cupertino, CA
    1 day ago
  • $182k - $242k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...We're looking for a Senior Engineer to be a driving force on CoreWeave...  ...distributed training and inference workloads. You will own how we...  ...ideally for infrastructure or ML systems rather than general-purpose... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    22 days ago
  •  ...deliver top-notch technology products. As a Software Engineer III at JPMorganChase within the Commercial...  ...problems Understanding in common ML tools and frameworks such Python, Spark, Air flow and cloud platforms Understanding in Cloud platforms (preferably... 
    Platform
    For contractors

    JPMorgan Chase & Co.

    Palo Alto, CA
    1 day ago
  • $207k - $300k

    Analyze and optimize AI inference workloads across the application,...  ...in Computer Science, Computer Engineering, Electrical Engineering, Applied...  ....8 years of experience in software development.Experience in Python...  ...workloads using standard ML profilers (e.g., PyTorch profiler... 

    Google

    Mountain View, CA
    1 day ago
  • $193.3k - $261.5k

    We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join...  ...on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  •  ...'s models get served - integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping...  ...RDMA (RoCE, InfiniBand, NVLink). High-performance large-scale ML systems (100+ GPUs). CUDA, and FFmpeg or multimedia... 

    Luma

    Redwood City, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, ML Inference Platform. Be the first to apply!