Software Development Engineer, Generative AI

Salary: $158,800 - 158,800 per year Requirements:

• We are looking for 3+ years of non-internship professional software development experience.
• We need 2+ years of design or architecture experience for new and existing systems, including design patterns, reliability, and scaling.
• We are seeking 1+ years of software development engineer or related occupational experience.
• We require 1+ years of experience designing and developing large-scale, multi-tiered, multi-threaded, embedded, or distributed applications, tools, systems, or services using C#, C++, Java, or Perl.
• We expect 1+ years of Object-Oriented Design experience.
• We require a bachelors degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• We need experience programming with at least one software language.
• We are looking for 3+ years of broad, relevant engineering experience.
• We expect core Computer Science knowledge, including object-oriented design, data structures, and performance analysis across at least 2 programming languages.
• We require hands-on technical experience in Generative AI.
• We value knowledge of professional software engineering practices across the full software development lifecycle, including coding standards, code reviews, source control, build processes, testing, and operations.
• We are looking for experience in one or more of the following: ML compilers, production coding agents, GenAI model architecture, model training, neural network optimization, or applied math.
• We want a strong customer-experience mindset, including delivery of self-service tools and automated service management or optimization, along with a strong services orientation.
• Preferred: 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Preferred: bachelors degree in computer science or equivalent.
• Preferred: bachelors or masters degree in computer science or equivalent.
• Preferred: 2+ years in machine learning or other computational modeling environments, with emphasis on hosting, building, or optimizing models for diverse hardware platforms.
• Preferred: proven track record building AI agents that automate ML workload optimization, ML compiler tuning, distributed inference and training, or ML kernel authoring and optimization.
• Preferred: experience working with open-source software communities in optimization or related areas.
• Preferred: domain-level knowledge of AWS services.
• Preferred: knowledge of state-of-the-art technology in the Machine Learning space and its mathematical foundations.

• We will work with other Neuron Software teams, Science, AWS AI Services, external partners, and customers on high-impact initiatives.
• We will research implementations that provide the best possible customer experience.
• We will improve the time and effort required to port and optimize machine learning workloads on Neuron.
• We will build and operate agentic evaluation frameworks, monitoring systems, and feedback loops that ensure correctness, reliability, and continuous improvement of AI agents.
• We will design, implement, test, deploy, and maintain software solutions that improve service performance, durability, cost, and security.
• We will build high-quality, highly available, always-on products.
• We may contribute intellectual property through patents.
• We will help shape the use of Generative AI to accelerate Neuron adoption and support Amazons ML silicon strategy.

• AI
• AI Agents
• AWS
• C#
• Embedded
• Hardware
• Support
• Java
• Machine Learning
• Model Training
• Network
• Perl
• Security
• Cloud
• EC2
• Fabric

More:

We are a dynamic team working at the cutting edge of the GenAI revolution, applying AI to AI to accelerate customer adoption of Neuron, the software stack supporting Amazons Trainium machine learning silicon. Our team partners with internal and external customers to identify obstacles and opportunities that speed migration to AWS ML silicon, and we play a key role in Amazons Generative AI business. We are part of Amazon Annapurna Labs within AWS UC, where we build innovation in silicon and software across machine learning, networking, security, and compute. The NYC team is being established as an additional hub to attract top talent to work on challenging problems using state-of-the-art tooling. We offer comprehensive benefits including health insurance, 401(k) matching, paid time off, parental leave, sign-on payments, and restricted stock units, and the listed base salary range for New York, NY is 158,800.00 USD annually.

last updated 38 week of 2026