Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI/ML Inference Engineer (Neuron)

Amazon Locker

Annapurna Labs (U.S.) Inc. is seeking an experienced software engineer to design, develop, and optimize ML models for AWS Neuron on Inferentia and Trainium accelerators. You will work across frameworks and kernels, collaborating with compiler, runtime, and customer teams to maximize performance. You will lead high-performance kernel development, analyze system-wide bottlenecks, and mentor engineers in a startup-like environment with a strong focus on performance and scale. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI/ML Inference Engineer (Neuron) in Cupertino, CA vacancy
  • $193.3k - $261.5k

     ...Services (AWS) builds AWS Neuron, the software...  ...performance for AWS's custom ML accelerators. Working at...  ...software boundary, our engineers craft high-performance...  ...of what's possible in AI acceleration.The AWS Neuron...  ...unparalleled ML inference and training performance... 
    Senior
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  •  ...Cerebras Systems is hiring a Software Engineer to build and evolve the ML API layer for a new generation of disaggregated AI inference systems. You will work across inference APIs, model integration, request routing, and Cerebras runtime components to deliver a consistent... 
    Senior

    Cerebras

    Sunnyvale, CA
    2 days ago
  • XPENG, a leading smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade Python code, build end-to-end pipelines, and work with research, systems, and in-vehicle... 
    Senior

    XPENG

    Santa Clara, CA
    4 days ago
  • Wayve is building the leading AI platform for autonomous driving with a mapless,...  ...approach. This role focuses on performance engineering across ML systems, GPU compute and distributed...  ...shaping optimisations for training and cloud inference. You will profile workloads, implement... 
    Senior

    Wayve

    Sunnyvale, CA
    5 days ago
  •  ...ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead the AI inference platform on Kubernetes. You will own the end-to-end lifecycle, from onboarding models to deployment of optimized engines across backends, and you will architect an intelligent... 
    Senior

    ServiceNow

    Santa Clara, CA
    4 days ago
  •  ...CrowdStrike is seeking a Sr. Machine Learning Engineer for the AIDR Engineering Team in Sunnyvale...  ...engineering to support safe enterprise AI interactions. You will collaborate across...  ...build scalable pipelines, apply advanced ML methods, and mentor engineers while maintaining... 
    Senior
    Remote work

    DataJobs.com

    Sunnyvale, CA
    3 days ago
  •  ...Amazon is seeking a Senior Software Development Engineer to own the design and implementation of the inference data plane for large models on custom hardware. You will build high...  ...hardware targets. You will integrate backends into ML serving frameworks, contribute to CI/CD, and... 
    Senior

    Amazon

    Cupertino, CA
    4 days ago
  •  ...data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and...  ...decisions, lead performance optimizations, and own the inference engine to scale research and production workloads.... 
    Senior

    Sanas

    Palo Alto, CA
    4 days ago
  •  ...JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology...  ...design, develop, and deploy secure, scalable ML-powered software solutions, with emphasis on production-grade inference and fast, low-latency web services. The role... 
    Senior

    Testing Site - JPMC

    Palo Alto, CA
    2 days ago
  • $193.3k - $261.5k

    Do you want to be part of AI revolution? At AWS our vision is...  ...solutions that make it possible. AWS Neuron is the SDK that optimizes the performance of complex ML models executed on AWS...  ...workloadsThis role is for a senior software engineer in the Compiler team for AWS... 
    Senior
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    7 days ago
  • $173k - $253k

    Matterport - Senior ML Ops Engineer Job Description CoStar Group is a leading global provider of...  ...to analyze model performance, optimize inference speed and resource utilization, and...  ..., hardware acceleration, and efficient AI.Contribute to the continuous improvement... 
    Senior
    Full time
    Work at office
    Work from home

    Matterport

    Sunnyvale, CA
    7 days ago
  •  ...Introducing Inworld Inference, built for consumer AI. Nearly 8× faster time to first token than most other providers. Senior Machine Learning Engineer, Inference Inworld is a research lab and...  ...experience building backend or ML systems. Who Thrives Here... 
    Senior
    Full time
    Work at office
    Relocation package

    Inworld, Inc.

    Mountain View, CA
    1 day ago
  •  ...Amazon's Annapurna Labs seeks a Sr. ML Kernel Performance Engineer to advance AWS Neuron on Inferentia and Trainium. You will design high-performance kernels...  ...throughput. This role offers exposure to cutting-edge AI acceleration and opportunities to mentor engineers while... 
    Senior

    Amazon

    Cupertino, CA
    4 days ago
  • $165.2k - $223.6k

     ...ML Compiler EngineerAWS Machine Learning accelerators...  ...all enabled by the AWS Neuron Software Development Kit...  ....As an ML Compiler Engineer with the Annapurna Neuron...  ...grow your skills alongside senior engineers. You want to work...  ...in Machine Learning, AI accelerators, or Kernel... 
    Internship
    Local area
    Relocation
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...A tech company in AI/ML is seeking a Senior Software Engineer specializing in ML Serving to build robust infrastructure for ML models. The ideal candidate has 5+ years of experience in software engineering, with a focus on ML serving. Proficiency in Python and knowledge... 
    Senior
    Full time

    Alldus

    San Jose, CA
    4 days ago
  • Nebius in Palo Alto is seeking a Senior MLE to own end-to-end model and endpoint optimization...  ..., GPU performance, and production ML engineering, debugging serving problems and delivering...  ...teams to push the performance frontier of AI workloads. #J-18808-Ljbffr Nebius
    Senior

    Nebius

    Palo Alto, CA
    4 days ago
  • $193.3k - $261.5k

    We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join...  ...on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 days ago
  • $200k - $240k

     ...Security Force: autonomous machines, AI-driven software, and elite...  ...ICM 2.0 audio/video detection engine, currently built by a third-...  ...team on model serving and inference infrastructure. Partner with...  ...Qualifications ~7+ years in ML engineering with production computer... 
    Senior
    Full time

    Knightscope, Inc

    Sunnyvale, CA
    3 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...a large fraction of the total inference market, which is worth tens of...  ...qualifications, we’re looking for strong engineers with great taste. The most...  ...on experience with modern ML frameworks such as PyTorch or... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $195.2k - $262.2k

     ...infrastructure for the global AI economy. We are building a...  ...large in-house AI/ML infrastructure. Built by engineers, for engineers. From large...  ...scale GPU orchestration to inference optimization, we own the hard...  ...production engineering. A Senior MLE owns substantial model... 
    Senior
    Temporary work
    Immediate start
    Remote work

    Nebius

    Palo Alto, CA
    4 days ago
  • $193.3k - $261.5k

     ...DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the...  ...compute kernels for a custom ML accelerator architecture,...  ...Demonstrated early adopter of AI-assisted development tools -... 
    Senior
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    7 days ago
  • $193.3k - $261.5k

     ...Amazon builds AWS Neuron, the software development...  ...and Trainium ML accelerators. This...  ...enabling unparalleled ML inference and training...  ...software boundary, our engineers build systematic...  ...what's possible in AI acceleration.As part...  ...and mentorship. Our senior members enjoy one-on... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 days ago
  • $144.7k - $261.3k

     ...environments, cloud infrastructure, and ML/AI GPU platforms for AV research and...  ...The Role GM is looking for a Senior Performance Engineer to join the AV Capacity and Performance...  ...reliability of large‑scale ML training and inference environments. Your skills &... 
    Senior
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    General Motors LLC

    Sunnyvale, CA
    2 days ago
  • $170.6k - $261.3k

     ...About the Role We are looking for a mathematically rigorous engineer to own model numerics: how we measure, bound, and reason about...  ...state. Experience in quantization, compiler toolchains, or inference-time numerical parity. Experience building or scaling evaluation... 
    Senior
    Local area
    Work from home
    Flexible hours

    General Motors Company

    Sunnyvale, CA
    1 day ago
  • $250k - $350k

    About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment... 
    Work at office
    3 days per week

    Pika

    Palo Alto, CA
    4 days ago
  • $174.72k - $295.68k

     ...innovation, integrating advanced AI and autonomous driving...  ...a full-time Machine Learning Engineer - AI Foundation, with deep knowledge...  ...towards establishing a state-of-art ML infrastructure for training...  ...accelerating model training/inference.Our mission is to solve the... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    4 days ago
  • $174.72k - $295.68k

     ...forefront of innovation, integrating advanced AI and autonomous driving technologies into...  ...model fine tuning, PTQ, QAT, on-vehicle inference and related fields.Key...  ....Strong Python programming and software engineering skills.Ability to work effectively across... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    8 days ago
  • $224k - $356.5k

    NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache...  ...scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and...  ...with GPUs. You will apply the latest ML/AI methods to empower enterprises to migrate... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...ML Systems Research EngineerAdvance your career. Advance the world.At...  ...scientific discovery to powering AI and the technologies people rely on...  ...We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago
  •  ...XPENG is seeking a full-time Machine Learning Engineer - AI Foundation to build state-of-the-art ML infrastructure for training very large foundation models and speeding training/inference. You will join a team of engineers and researchers focused on advancing autonomous... 
    Full time

    XPENG

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI/ML Inference Engineer (Neuron). Be the first to apply!