Software Development Engineer, Generative AI

Salary: $158,100 - 213,800 per year Requirements:

• We require 3 years of non-internship professional software development experience.
• We require 2 years of non-internship experience in design or architecture for new and existing systems, including design patterns, reliability, and scaling.
• We require 1 year of software development engineer or related occupational experience.
• We require 1 year of experience designing and developing large-scale, multi-tiered, multi-threaded, embedded, or distributed software applications, tools, systems, or services using C#, C++, Java, or Perl.
• We require 1 year of object-oriented design experience.
• We require a bachelors degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• We require experience programming with at least one software programming language.
• We require 3 years of broad engineering experience.
• We require core computer science knowledge, including object-oriented design, data structures, and performance analysis, along with experience in at least 2 programming languages.
• We require hands-on technical experience in the Generative AI space.
• We require knowledge of professional software engineering practices across the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• We require experience in one or more of the following areas: ML compilers, production coding agents, GenAI model architecture, model training, neural network optimization, or applied math.
• We require a strong focus on customer experience and usability, including experience delivering self-service tools and automated management or optimization services.

• We research implementations that create the best possible customer experience.
• We work to reduce the time and effort needed to port and optimize machine learning workloads on Neuron.
• We build and operate agentic evaluation frameworks, monitoring systems, and feedback loops that support correctness, reliability, and ongoing improvement of AI agents.
• We design, implement, test, deploy, and maintain software solutions that improve service performance, durability, cost, and security.
• We develop high-quality, highly available, always-on products.
• We may contribute intellectual property through patents.
• We collaborate with other Neuron Software teams, Science, AWS AI Services, external partners, and customers to support this work.

• AI
• AI Agents
• AWS
• C#
• Embedded
• Support
• Java
• Machine Learning
• Model Training
• Network
• Perl
• Security
• Cloud
• EC2
• Fabric
• Hardware

More:

We are a dynamic team working at the cutting edge of the GenAI revolution by applying AI to AI. Our mission is to build agents, tools, and models that simplify and accelerate customer adoption of Neuron, the software stack supporting Amazons Machine Learning silicon, Trainium. We partner with internal and external customers to identify obstacles and opportunities that help accelerate migration to AWS ML silicon. Our team in New York City is an important part of Annapurna Labs location strategy, creating an additional hub to attract top talent from varied backgrounds to solve challenging problems using state-of-the-art tooling. As part of Amazon Annapurna Labs within AWS UC, we build innovation in silicon and software for Amazon customers across machine learning, networking, security, and compute, including Neuron, Inferentia, Trainium, Nitro, ENA, EFA, and Graviton. We offer comprehensive benefits including health coverage, 401(k) matching, paid time off, parental leave, and additional compensation components such as sign-on payments and RSUs, with a base salary range of 158,100.00 to 213,800.00 USD annually for New York, NY.

last updated 37 week of 2026