AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS
$165.2k - $223.6kAmazon Locker
AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS
AWS's Trainium and Inferentia chips power the world's largest machine learning clusters. Our team builds C++ models of these custom SoCs that RTL designers, verification engineers, and software teams depend on throughout the silicon development lifecycle. We're looking for a modeling engineer to build and own models that directly impact how our chips are designed, verified, and brought to production.
What you'll do:
- Develop and maintain high-fidelity functional model of AI/ML accelerator and its SoC subsystems, including compute engines, memory hierarchies, on-chip interconnects, and data paths — translating architecture specs and RTL behavior into accurate, testable C++ models
- Validate model behavior against RTL simulations, emulation platforms, or silicon measurements; debug discrepancies and drive model-to-RTL correlation to high fidelity
- Partner with design verification teams to integrate models into pre-silicon validation environments and catch architectural bugs early in the design cycle
- Collaborate with architects/micro-architects, RTL design engineers, ML SW engineers, and compiler engineers to evaluate architecture and microarchitecture tradeoffs and help make hardware design decisions
- Contribute to cycle-approximate performance model effort enabling architectural exploration ahead of RTL availability, early software development
- Quantify system-level tradeoffs across compute, memory bandwidth, networking, and storage to influence reference architectures and long-term silicon strategy
- Build and improve modeling infrastructure: simulation frameworks, regression suites, automated correlation checks, and coverage-driven validation flows
- Develop modeling methodologies and tools that scale across multiple IP blocks and SoC generations, improving team efficiency and model reuse
Why this role is interesting:
- Your models are used to verify silicon before it's built — bugs you catch save months of schedule and millions of dollars
- You'll work at the intersection of software engineering and chip design, with deep visibility into how custom ML accelerators are architected
- As the team scales, there's a clear path into architectural modeling — using your models to influence chip design decisions, not just validate them
- Small team, high ownership, direct impact on AWS's most strategic silicon programs
You will thrive in this role if you:
- Have built functional or performance models of SoCs, ASICs, GPUs, CPUs, or IP blocks
- Are comfortable working with architectural / design specifications or reference implementations and translating them into C++ or SystemC models
- Understand verification concepts and have worked with DV teams or in pre-silicon validation environments
- Care about model fidelity and have experience correlating models against RTL or silicon
- Are interested in expanding into architectural performance modeling as the team grows
- Enjoy working on a small, high-impact team where you own significant pieces of the stack
No ML background needed. You'll learn the ML accelerator domain on the job.
This role can be based in Cupertino, CA or Austin, TX.
Basic Qualifications
- Experience programming languages such as C/C++, Python, Java or Perl
- 2+ years writing functional or performance models of hardware (SoCs, ASICs, GPUs, CPUs, IP blocks)
- Familiarity with SoC, CPU, GPU, and/or ASIC architecture and micro-architecture
Preferred Qualifications
- 2+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Experience working with DV teams or integrating models into verification flows
- Experience with SystemC or TLM-based modeling
- Experience correlating functional models against RTL simulation or emulation
- Experience developing or calibrating performance models
- Familiarity with Modern C++ (20 and beyond)
- Experience with PyTest, GoogleTest, or similar test frameworks
- Experience with multi-threaded simulation
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at
USA, CA, Cupertino - 165,200.00 - 223,600.00 USD annually
USA, TX, Austin - 143,700.00 - 194,400.00 USD annually
Important FAQs for current Government employees
Before proceeding, please review the following FAQs
#J-18808-Ljbffr$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SOCs that are used to power today’s AI workloads in datacenters all around the world... ...Design Verification Engineers to build the next generation... ...Team CultureHere at AWS, we embrace our...Amazon Web ServiceLocal areaWork from homeFlexible hours$193.3k - $261.5k
Custom SoCs (System on Chips)... ...brains behind AWS’s Machine Learning servers. Our... ...functional models of these... ...custom-designed accelerator SoCs for use... ...Modeling Engineer to join the... ...reusedAnnapurna Labs, our... ...generative AI services and... ...AWS portfolio.Annapurna Labs (our organization...Amazon Web ServiceInternshipLocal areaFlexible hours$165.2k - $223.6k
AWS designs custom SoCs (System on Chips) that power the... ...world's largest machine learning training and inference... ...Software Engineer who wants to work... ...team develops SoC models and... ...SoC validation, accelerate system software... ...teammatesAnnapurna Labs, our organization...Amazon Web ServiceLocal areaFlexible hours$183k - $247.6k
AWS Utility Computing (UC) provides product innovations... ...their cloud services.Annapurna Labs (our organization... ...and software that accelerates innovation. Customers... ...a Hardware Design Engineer with role in the definition... ....As a member of the Machine Learning Acceleration team you...Amazon Web ServiceLocal areaFlexible hours- ...Sr. Hardware Engineer - ML Acceleration, Annapurna Labs AWS Utility Computing (UC) provides product innovations — from foundational services such... ...AWS datacenter technology. As a member of the Machine Learning Acceleration team you’ll be responsible for the design...Amazon Web ServiceWork from home
$193.3k - $261.5k
...The Senior SoC Software DevOps Engineer role centers on... ...advanced custom machine learning chips. This position... ...large scale AI training at AWS. The engineer... ...layers and modeling tools. This involves... ...that accelerate team productivity... ...organization within Annapurna Labs (AWS). Our...Amazon Web ServiceLocal areaImmediate startFlexible hours- ...Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services (AWS) job located in... ...innovation in machine learning acceleration software. AWS Neuron... ...of machine learning models and integration with... ...contribute to and influence engineering discussions around...Amazon Web Service
$206.9k - $279.9k
AWS Neuron is looking for an experienced... ...innovation in machine learning acceleration software. AWS... ...ML frameworks, model architectures, and... ...to and influence engineering discussions... ...professional.About Amazon Annapurna Labs:Amazon Annapurna... ...of generative AI services and...Amazon Web ServiceFlexible hours$165.2k - $223.6k
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the... ...development kit used to accelerate deep learning and GenAI... ...’s custom machine learning accelerators... ...wide range of models and supporting... ...boundary, our engineers build... ...s possible in AI acceleration.As...Amazon Web ServiceWork experience placementInternshipLocal areaFlexible hours$208.3k - $281.8k
AWS Trainium is deployed at scale... ...of frontier models. AWS Neuron... ...to run deep learning and generative AI workloads with... ...partner with engineering teams building... ...About Amazon Annapurna Labs Amazon... ...performance machine learning with... .../ML training accelerators and hardware,...Amazon Web ServiceLocal areaFlexible hours$183k - $247.6k
Our Machine Learning Acceleration (MLA) team develops the Inferentia... ...and Trainium SoCs that are used to power today’s AI workloads in datacenters... ...a Sr. SoC Power Engineer, you’ll... ...ground level by modeling and estimating power... ...measurements in the lab and correlate...Local areaFlexible hours$122.6k - $185k
...backbone of Generative AI cloud at AWS? Do you want to build... ...in the cloud for AI model training for multi... ...you. The AWS Hardware Engineering team creates server designs... .../new designs for AWS Accelerated server solutions for... ...’s in our nature to learn and be curious. Our...Amazon Web ServiceLocal areaFlexible hours$165.2k - $223.6k
AWS's Trainium and Inferentia chips power the world's largest machine learning clusters. Our team builds virtual... ...C++ and SystemC models of these custom SoCs — that let software... ...looking for a software engineer to build and own... ...'ll learn the ML accelerator domain on the job...Amazon Web ServiceLocal areaFlexible hours$183k - $247.6k
Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud... ...the world.Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of... ...ASIC Physical Design Engineer to help us trail-blaze...Amazon Web ServiceLocal areaFlexible hours- ...Sr. ASIC Design Engineer, Cloud-Scale Machine Learning Acceleration team - Annapurna Labs Annapurna Labs designs silicon and software that accelerates... ...change the world. Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member...Amazon Web Service
$183k - $247.6k
Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud... ...the world.Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of... ...members develop your engineering expertise so you feel...Amazon Web ServiceLocal areaFlexible hours$157.3k - $212.8k
As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and... ...including technologies such as AWS Inferentia which is a machine learning... ...qualifications- Bachelor's degree in Electrical Engineering or a related field- Block Design...Amazon Web ServiceLocal areaFlexible hours$157.3k - $212.8k
As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and... ...including technologies such as AWS Inferentia which is a machine learning... ...qualifications- Bachelor's degree in Electrical Engineering or a related field- Minimum of 3+...Amazon Web ServiceLocal areaFlexible hours$193.3k - $261.5k
Annapurna Labs stands at the forefront of hardware... ...Web Services (AWS) but across the... ...best-in-class machine learning products that accelerate customer... ...the future of AI accelerationAt... ...experienced C/C++ engineer to join our embedded... ...neural network model execution...Amazon Web ServiceLocal areaFlexible hours$193.3k - $261.5k
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the... ...development kit used to accelerate deep learning and GenAI... ...'s custom machine learning accelerator... ...-scale models on Trainium without... ...boundary, our engineers build the... ...direction of AI acceleration technology...Amazon Web ServiceInternshipLocal areaFlexible hours$193.3k - $261.5k
...an experienced engineer to work on distributed AI/ML systems. This... ...multiple accelerators & servers. Most... ...the largest AI models.The org you would... ...be joining is Annapurna Labs, an integral part of AWS and develops hardware... ...that for Machine Learning (ML) and High-Performance...Amazon Web ServiceInternshipLocal areaFlexible hours$157.3k - $212.8k
Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and optimization... ...’re looking for an ASIC Design Engineer to help us trail-blaze new...Amazon Web ServiceInternshipLocal areaWork from homeFlexible hours$127.1k - $185k
...talented early-career engineer to join our team that owns... ...for EC2 distributed AI/ML systems. You'll work... ...the world's largest AI models to train across massive... ...computing, networking, and machine learning infrastructure -... ...libraries running on custom AWS hardware - Build and...Amazon Web ServiceInternshipLocal areaFlexible hours$212.7k - $287.7k
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the... ...development kit used to accelerate deep learning and GenAI... ...’s custom machine learning accelerators... ...boundary, our engineers craft high-... ...s possible in AI acceleration.... ...enable their models and ensure...Amazon Web ServiceLocal areaWork from homeFlexible hours$176.6k - $239k
Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully... ...including silicon engineering, hardware... ...Trainium ML Accelerators, and in storage... ...Product: AWS Machine Learning accelerators... ..., and now in AI and Machine Learning... ...Learning models and integrate...Amazon Web ServiceLocal areaFlexible hours$165.2k - $223.6k
...an experienced engineer to work on distributed AI/ML systems. This... ...multiple accelerators & servers. Most... ...the largest AI models.The org you would... ...be joining is Annapurna Labs, an integral part of AWS and develops hardware... ...that for Machine Learning (ML) and High-Performance...Amazon Web ServiceInternshipLocal areaFlexible hours$165.2k - $223.6k
The AWS Neuron Compiler team is... ...compiler engineers to join our efforts... ...the-art deep learning compiler... ...application models across diverse... ...custom-built Machine Learning accelerators, including Inferentia... ...Generative AI. In this role... ...co-design.Annapurna Labs (our...Amazon Web ServiceInternshipLocal areaFlexible hours$193.3k - $261.5k
The Product: AWS Machine Learning accelerators are at the forefront of AWS... ...Generative AI on AWS. The Inferentia... ...whole, the Amazon Annapurna Labs team is responsible... ...including silicon engineering, hardware design and... ...complex neural net models on our custom-built...Amazon Web ServiceInternshipLocal areaWork from homeRelocationFlexible hours$185k - $215k
...- Internship in Machine LearningAt Bosch,... ...students in the machine learning and software... ...as a Staff AI Systems Engineer, setting technical... ...dataset curation, model training, fine-tuning... ...frameworks and acceleration libraries such as... ...orchestration tools (e.g., AWS, Azure, GCP,...Amazon Web ServiceOdd jobWork experience placementInternshipLocal areaWorldwide$157.3k - $212.8k
...Reliability (MQR) Team is part of AWS Annapurna Labs focused on Machine Learning products that designs cutting AI platforms for the world’s... .... As a Senior Reliability Engineer you will engage with an... ...-tech start-up- Reliability modeling and materials characterization...Amazon Web ServiceWork experience placementLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS. Be the first to apply!

