Senior AI/ML Inference Engineer (Neuron)
Amazon Locker
Annapurna Labs (U.S.) Inc. is seeking an experienced software engineer to design, develop, and optimize ML models for AWS Neuron on Inferentia and Trainium accelerators. You will work across frameworks and kernels, collaborating with compiler, runtime, and customer teams to maximize performance. You will lead high-performance kernel development, analyze system-wide bottlenecks, and mentor engineers in a startup-like environment with a strong focus on performance and scale. #J-18808-Ljbffr
$193.3k - $261.5k
...Services (AWS) builds AWS Neuron, the software... ...performance for AWS's custom ML accelerators. Working at... ...software boundary, our engineers craft high-performance... ...of what's possible in AI acceleration.The AWS Neuron... ...unparalleled ML inference and training performance...SeniorInternshipLocal areaWork from homeFlexible hours- ...Cerebras Systems is hiring a Software Engineer to build and evolve the ML API layer for a new generation of disaggregated AI inference systems. You will work across inference APIs, model integration, request routing, and Cerebras runtime components to deliver a consistent...Senior
- XPENG, a leading smart technology company, seeks a qualified engineer to advance VLA inference and model quantization for next-gen XPENG Turing AI chip. You will develop production-grade Python code, build end-to-end pipelines, and work with research, systems, and in-vehicle...Senior
- Wayve is building the leading AI platform for autonomous driving with a mapless,... ...approach. This role focuses on performance engineering across ML systems, GPU compute and distributed... ...shaping optimisations for training and cloud inference. You will profile workloads, implement...Senior
- ...ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead the AI inference platform on Kubernetes. You will own the end-to-end lifecycle, from onboarding models to deployment of optimized engines across backends, and you will architect an intelligent...Senior
- ...CrowdStrike is seeking a Sr. Machine Learning Engineer for the AIDR Engineering Team in Sunnyvale... ...engineering to support safe enterprise AI interactions. You will collaborate across... ...build scalable pipelines, apply advanced ML methods, and mentor engineers while maintaining...SeniorRemote work
- ...Amazon is seeking a Senior Software Development Engineer to own the design and implementation of the inference data plane for large models on custom hardware. You will build high... ...hardware targets. You will integrate backends into ML serving frameworks, contribute to CI/CD, and...Senior
- ...data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and... ...decisions, lead performance optimizations, and own the inference engine to scale research and production workloads....Senior
- ...JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology... ...design, develop, and deploy secure, scalable ML-powered software solutions, with emphasis on production-grade inference and fast, low-latency web services. The role...Senior
$193.3k - $261.5k
Do you want to be part of AI revolution? At AWS our vision is... ...solutions that make it possible. AWS Neuron is the SDK that optimizes the performance of complex ML models executed on AWS... ...workloadsThis role is for a senior software engineer in the Compiler team for AWS...SeniorLocal areaFlexible hours$173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar Group is a leading global provider of... ...to analyze model performance, optimize inference speed and resource utilization, and... ..., hardware acceleration, and efficient AI.Contribute to the continuous improvement...SeniorFull timeWork at officeWork from home- ...Introducing Inworld Inference, built for consumer AI. Nearly 8× faster time to first token than most other providers. Senior Machine Learning Engineer, Inference Inworld is a research lab and... ...experience building backend or ML systems. Who Thrives Here...SeniorFull timeWork at officeRelocation package
- ...Amazon's Annapurna Labs seeks a Sr. ML Kernel Performance Engineer to advance AWS Neuron on Inferentia and Trainium. You will design high-performance kernels... ...throughput. This role offers exposure to cutting-edge AI acceleration and opportunities to mentor engineers while...Senior
$165.2k - $223.6k
...ML Compiler EngineerAWS Machine Learning accelerators... ...all enabled by the AWS Neuron Software Development Kit... ....As an ML Compiler Engineer with the Annapurna Neuron... ...grow your skills alongside senior engineers. You want to work... ...in Machine Learning, AI accelerators, or Kernel...InternshipLocal areaRelocationFlexible hours- ...A tech company in AI/ML is seeking a Senior Software Engineer specializing in ML Serving to build robust infrastructure for ML models. The ideal candidate has 5+ years of experience in software engineering, with a focus on ML serving. Proficiency in Python and knowledge...SeniorFull time
- Nebius in Palo Alto is seeking a Senior MLE to own end-to-end model and endpoint optimization... ..., GPU performance, and production ML engineering, debugging serving problems and delivering... ...teams to push the performance frontier of AI workloads. #J-18808-Ljbffr NebiusSenior
$193.3k - $261.5k
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join... ...on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-...SeniorInternshipLocal areaFlexible hours$200k - $240k
...Security Force: autonomous machines, AI-driven software, and elite... ...ICM 2.0 audio/video detection engine, currently built by a third-... ...team on model serving and inference infrastructure. Partner with... ...Qualifications ~7+ years in ML engineering with production computer...SeniorFull time$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...a large fraction of the total inference market, which is worth tens of... ...qualifications, we’re looking for strong engineers with great taste. The most... ...on experience with modern ML frameworks such as PyTorch or...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$195.2k - $262.2k
...infrastructure for the global AI economy. We are building a... ...large in-house AI/ML infrastructure. Built by engineers, for engineers. From large... ...scale GPU orchestration to inference optimization, we own the hard... ...production engineering. A Senior MLE owns substantial model...SeniorTemporary workImmediate startRemote work$193.3k - $261.5k
...DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the... ...compute kernels for a custom ML accelerator architecture,... ...Demonstrated early adopter of AI-assisted development tools -...SeniorLocal areaFlexible hours$193.3k - $261.5k
...Amazon builds AWS Neuron, the software development... ...and Trainium ML accelerators. This... ...enabling unparalleled ML inference and training... ...software boundary, our engineers build systematic... ...what's possible in AI acceleration.As part... ...and mentorship. Our senior members enjoy one-on...SeniorWork experience placementInternshipLocal areaFlexible hours$144.7k - $261.3k
...environments, cloud infrastructure, and ML/AI GPU platforms for AV research and... ...The Role GM is looking for a Senior Performance Engineer to join the AV Capacity and Performance... ...reliability of large‑scale ML training and inference environments. Your skills &...SeniorWork at officeLocal areaRemote workWork from homeFlexible hours3 days per week$170.6k - $261.3k
...About the Role We are looking for a mathematically rigorous engineer to own model numerics: how we measure, bound, and reason about... ...state. Experience in quantization, compiler toolchains, or inference-time numerical parity. Experience building or scaling evaluation...SeniorLocal areaWork from homeFlexible hours$250k - $350k
About the RoleWe are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment...Work at office3 days per week$174.72k - $295.68k
...innovation, integrating advanced AI and autonomous driving... ...a full-time Machine Learning Engineer - AI Foundation, with deep knowledge... ...towards establishing a state-of-art ML infrastructure for training... ...accelerating model training/inference.Our mission is to solve the...SeniorFull time$174.72k - $295.68k
...forefront of innovation, integrating advanced AI and autonomous driving technologies into... ...model fine tuning, PTQ, QAT, on-vehicle inference and related fields.Key... ....Strong Python programming and software engineering skills.Ability to work effectively across...SeniorFull time$224k - $356.5k
NVIDIA is looking for a Machine Learning Engineer to join the GPU accelerated Apache... ...scale workloads for ETL, SQL, and ML/DL model training and inference pipelines, spanning many domains and... ...with GPUs. You will apply the latest ML/AI methods to empower enterprises to migrate...SeniorFull time- ...ML Systems Research EngineerAdvance your career. Advance the world.At... ...scientific discovery to powering AI and the technologies people rely on... ...We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind...
- ...XPENG is seeking a full-time Machine Learning Engineer - AI Foundation to build state-of-the-art ML infrastructure for training very large foundation models and speeding training/inference. You will join a team of engineers and researchers focused on advancing autonomous...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI/ML Inference Engineer (Neuron). Be the first to apply!
- machine learning ai engineer Cupertino, CA
- ai developer Cupertino, CA
- ai ml engineer Cupertino, CA
- senior ai engineer Cupertino, CA
- ai engineer Cupertino, CA
- senior ml engineer Cupertino, CA
- data scientist machine learning engineer Cupertino, CA
- machine learning software engineer Cupertino, CA
- machine learning engineer Cupertino, CA
- computer vision machine learning engineer Cupertino, CA



