Senior SDE: Neuron Inference for LLM Acceleration
Amazon Locker
Amazon AWS Neuron is seeking a senior software engineer for the Machine Learning Inference Applications team in Seattle. You will develop and optimize core building blocks of LLM inference on Neuron chips, including attention, MLP, quantization, speculative decoding, and Mixture of Experts.
Responsibilities include applying the latest research in LLM optimization to extract top performance from open source and internal models, and working across teams to deliver scalable, high-performance
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior SDE: Neuron Inference for LLM Acceleration in Seattle, WA vacancy
- ...Amazon Inc. in Seattle, WA is seeking a senior software engineer to join the Machine Learning Inference Applications team, focusing on development and performance... ...optimization of core building blocks for LLM inference on Neuron devices. The role collaborates with chip...Senior
Amazon
Seattle, WA5 days ago $236k - $330k
...trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in... ...Snowflake AI Research team and advance the state of the art in LLM inference systems and optimization.Our mission is to build the next generation...SeniorSnowflake
Bellevue, WA1 day ago$168.1k - $227.4k
AWS Neuron is the complete software stack for AWS Inferentia... ..., AWS purpose-built accelerators for cloud-scale machine learning. This senior software engineering... ...the Machine Learning Inference Applications team and focuses... ...deliver best-in-class LLM serving performance.The...SeniorWork experience placementInternshipLocal areaFlexible hoursAmazon
Seattle, WA5 days ago- NVIDIA is seeking a Sr. Inference Engineer to push GPU kernel optimization for LLM inference. The role focuses on silicon-measured kernel benchmarking, model-level performance projection, and agentic optimization systems that improve kernels at the assembly level. You...Senior
- Snowflake is building the next generation of AI-native inference systems. We seek experienced researchers and systems developers to advance LLM inference, optimization, and platform-wide performance across GPUs, CPUs, and distributed runtimes. You will collaborate with...Senior
- NVIDIA is seeking best-in-class ASIC Verification Engineers to verify the design and implementation of the world's leading inference accelerator. You will help build high-performance processor elements for programmable compute and graphics. As part of the ASIC Verification...Senior
$320k
...Staff + Senior Software Engineer, InferenceSan Francisco... ....About the RoleOur Inference team is responsible... ...orchestration across diverse AI accelerators.The team has a dual... ...with LLM inference optimization... ...Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute...SeniorWork at officeWorldwideVisa sponsorshipFlexible hoursanthropic
Seattle, WA4 days ago$200k - $287.5k
...to how you solve problems and accelerate your impact. We look for low-... ...future of how work gets done.Senior Software Engineer — Cortex... ...Snowflake. Cortex Training is our LLM post-training platform: it... ...orchestration, multi-node training and inference, fault tolerance, and...SeniorSnowflake
Bellevue, WA4 days ago$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference... ...three interconnected systems, all aimed at accelerating NVIDIA's LLM inference stack. The first is...SeniorFull timeNvidia
Seattle, WA1 day ago- Apple Inc. is seeking a Senior Software Engineer to build the next generation of inference routing for Private Cloud Compute, shaping routing and scheduling across a global fleet of servers with privacy guarantees. You will own design decisions from architecture through...Senior
- ...technology products. As a Senior Lead Software Engineer at JPMorgan... ...review/refactoring, test acceleration, release readiness, incident/... ..., ML training, and inference. Experience with Infrastructure... ...and scaling a high-performance LLM inference platform—leveraging...SeniorFor contractors
JPMorgan Chase & Co.
Seattle, WA1 hour ago $184k - $287.5k
...understanding performance aspects related to tasks like large scale LLM training and inference.Conducting regular technical customer meetings for... ....Understanding of systems architecture including AI accelerators and networking as it relates to the performance of an overall...SeniorFull timeNvidia
Seattle, WA1 day ago$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software and Services... .... Description Routing LLM inference at Apple's scale... ...between latency, throughput and accelerator use ~ Experience with network...SeniorRemote workWorldwideRelocationApple Inc.
Seattle, WA1 hour ago$168.1k - $227.4k
Shape the Future of AI Accelerators at AWS NeuronWe build Amazon Neuron, the software development kit... ...and Trainium.As a Senior Software Engineer on our... ...in building distributed inference support for Pytorch in the... ...of Machine Learning and LLM fundamentals, including transformer...SeniorInternshipWork from homeFlexible hoursAmazon
Seattle, WA4 days ago- ...About AZX Our mission is to accelerate positive impact in critical industries through AI... ...anchors on two systems. The first is our inference control plane — open-weight models and... ...experience deploying or operating open-weight LLM serving infrastructure (vLLM/SGLang or...SeniorFull timeRemote workWork visaFlexible hoursDay shift
AZX
Seattle, WA5 days ago $500 per month
...The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers... ...scale at which our services operate, accelerate our ability to reliably launch new... ...serving millions of usersAre curious about LLM serving; prior inference or ML...SeniorWork at officeHome officeRelocation packageFlexible hoursAnthropic
Seattle, WA4 days ago- ...NVIDIA is seeking a Senior Research Engineer passionate about Generative AI inference to join our team in the United States. You will design routing policies for LLM traffic, run agentic benchmarks, and contribute to open-source design docs and code reviews to improve...Senior
NVIDIA Gruppe
Seattle, WA4 days ago $175k - $265k
...shape the endless possibilities of AI. Senior Staff Inference Performance Engineer Location: Santa... ...across d-Matrix Corsair accelerators and GPUs, with more heterogeneous architectures... ...closing the gap. Working knowledge of LLM inference serving, including batching,...SeniorPermanent employmentRemote workShift work$262.7k - $355.4k
As a Principal Engineer on Arm’s AI Inference Cloud team, you will shape the technical direction... ...AI infrastructure, model serving, or accelerator-backed workloads.Familiarity with... ...PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and...Work at officeLocal areaVisa sponsorshipRelocation packageARM
Seattle, WA2 days ago- ...U.S., Inc. in Seattle, WA, is seeking a Senior Product Manager - Technical to own the end... ...-to-end product strategy for EC2 AI/ML accelerated compute. You will lead the definition of... ...for high-performance training and inference workloads, collaborating with AWS, NVIDIA...Senior
Amazon
Seattle, WA4 days ago - ...Amazon Development Center U.S., Inc. is seeking a Senior Product Manager for EC2 accelerated computing, focusing on AI/ML workloads and accelerator instances... ...solutions including GPUs and Trainium‑based offerings for training, inference, and generative #J-18808-LjbffrSenior
Amazon
Seattle, WA1 day ago $500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers... ...and cheap enough to run on the same accelerators that serve customers, trustworthy enough... ...description Have a strong interest in LLM serving; prior inference or ML...SeniorWork at officeHome officeRelocation packageFlexible hours- SoFi is seeking a Senior Staff AI Engineer to lead hands-on AI initiatives within its Independent Risk organization... .... You’ll architect scalable AI platforms, orchestrate LLM-based workflows, and optimize inference and observability while collaborating with #J-18808-Ljbffr...Senior
- ...About the Role We are looking for a Senior Data Scientist - Experimentation & Causal Inference to serve as the statistical brain behind our rapidly growing... ...assistants to automate repetitive analytical tasks, accelerate code development, and build self-serve tooling...SeniorFull time
ByLabs
Seattle, WA1 day ago $208k - $327.75k
Running GPU-accelerated Kubernetes reliably is deceptively hard. A small change to a driver, kernel, operator, or Kubernetes version can... ...across accelerators, clouds, and workloads, from training and inference to agentic AI.Keep the stack current and trustworthy, turning...SeniorFull timeNvidia
Seattle, WA1 day ago$184k - $287.5k
We are seeking a Senior Developer Relations Manager to build the developer ecosystem around... ...open-source framework for distributed AI inference. In this senior individual contributor... ...the ecosystem with vLLM, SGLang, Mooncake, llm-d, and other inference projects through...SeniorFull timeWork at officeNvidia
Seattle, WA2 days ago- ...build tooling, automation, and analysis capabilities for the AI inference platform, focusing on benchmarking, capacity projection models... ...planners to forecast needs months in advance, and help accelerate data-driven decisions for scaling AI workloads. #J-18808-Ljbffr...Senior
- ...seeking an experienced engineer to design, build, and operate the high-performance inference infrastructure that serves Claude globally. You will own distributed systems across multiple accelerators and cloud platforms, implementing intelligent routing, autoscaling, and...Senior
$249.6k - $312k
...layer underneath DigitalOcean's inference platform.DigitalOcean is the... ...(vLLM, SGLang, TensorRT-LLM) that make it all go. As context... ...access across heterogeneous accelerator poolsDriving the unit economics... ...design review, mentorship of senior and staff engineers, and...Local areaRemote workWorldwideFlexible hoursDigitalOcean
Seattle, WA3 days ago$190k - $225k
...the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2... ...Speech-to-text | Streaming speech-to-text | Speech Understanding | LLM Gateway Try the Playground Our $50M Series C fundraise Check us...SeniorAssemblyAI
Seattle, WA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior SDE: Neuron Inference for LLM Acceleration. Be the first to apply!
Related searches
- senior living Seattle, WA
- senior associate vice president Seattle, WA
- senior app developer Seattle, WA
- senior manufacturing engineer Seattle, WA
- senior ml engineer Seattle, WA
- senior data analyst Seattle, WA
- senior executive director Seattle, WA
- senior application support engineer Seattle, WA
- senior recruitment consultant Seattle, WA
- senior manager data analytics Seattle, WA