Software Engineer, Neuron Containers

Salary: $165,600 - 165,600 per year Requirements:

• We require 3+ years of non-internship professional software development experience
• We require 2+ years of non-internship experience in design or architecture for new and existing systems, including design patterns, reliability, and scaling
• We require programming experience in at least one software language
• We prefer 3+ years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
• We prefer a bachelors degree in computer science or an equivalent background
• We prefer experience with distributed systems or large-scale cluster infrastructure
• We prefer familiarity with ML training and inference workflows, including distributed training and collective operations
• We prefer experience with AWS compute services such as EC2, EKS, ECS, and ECR
• We prefer hands-on experience with Helm, Prometheus, or Kubernetes operator frameworks
• We prefer experience with container image pipelines, Deep Learning Containers, or Deep Learning AMIs
• We prefer contributions to open-source projects, especially within the Kubernetes ecosystem

• We design and implement container platform integrations, including device plugins, DRA drivers, and operators for ML accelerator resource management
• We build and maintain Neuron DLCs and DLAMIs for customer deployment across EKS, ECS, EC2, and SageMaker
• We diagnose and resolve performance and scalability issues across large customer clusters
• We simplify systems by retiring legacy software and reducing complexity in container delivery pipelines
• We deliver software across the full development lifecycle, from design documentation and implementation through testing, deployment, and operations
• We collaborate with teams across the Neuron organization and with customers to support current and next-generation accelerators
• We participate in architecture reviews, triage test failures, resolve operational issues, and contribute to upstream Kubernetes projects
• We debug platform integration issues involving container runtimes, orchestrators, and scheduling systems at scale

• AI
• AWS
• EC2
• Helm
• Support
• Kubernetes
• Prometheus
• Cloud
• DevOps

More:

We are AWS Neuron, the complete software stack for Inferentia and Trainium ML accelerators, powering large-scale AI workloads on AWS. Our Neuron Containers team focuses on building platform integrations that let customers run distributed training and inference at scale. We own integration with Kubernetes, ECS, and Slurm, including device allocation, fault tolerance, auto-scaling, and cluster orchestration. We also deliver Neuron Deep Learning Containers and Deep Learning AMIs to package the Neuron SDK for deployment on Trainium and Inferentia instances. Our compensation package includes sign-on payments, restricted stock units, and comprehensive benefits such as medical, dental, and vision coverage, life insurance, mental health support, paid time off, parental leave, and 401(k) matching. This role is based in Cupertino, California, USA, with a listed base salary of 165,600.00 USD annually.

last updated 33 week of 2026