Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS

$165.2k - $223.6k

Amazon Locker

AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS

AWS's Trainium and Inferentia chips power the world's largest machine learning clusters. Our team builds C++ models of these custom SoCs that RTL designers, verification engineers, and software teams depend on throughout the silicon development lifecycle. We're looking for a modeling engineer to build and own models that directly impact how our chips are designed, verified, and brought to production.

What you'll do:

  • Develop and maintain high-fidelity functional model of AI/ML accelerator and its SoC subsystems, including compute engines, memory hierarchies, on-chip interconnects, and data paths — translating architecture specs and RTL behavior into accurate, testable C++ models
  • Validate model behavior against RTL simulations, emulation platforms, or silicon measurements; debug discrepancies and drive model-to-RTL correlation to high fidelity
  • Partner with design verification teams to integrate models into pre-silicon validation environments and catch architectural bugs early in the design cycle
  • Collaborate with architects/micro-architects, RTL design engineers, ML SW engineers, and compiler engineers to evaluate architecture and microarchitecture tradeoffs and help make hardware design decisions
  • Contribute to cycle-approximate performance model effort enabling architectural exploration ahead of RTL availability, early software development
  • Quantify system-level tradeoffs across compute, memory bandwidth, networking, and storage to influence reference architectures and long-term silicon strategy
  • Build and improve modeling infrastructure: simulation frameworks, regression suites, automated correlation checks, and coverage-driven validation flows
  • Develop modeling methodologies and tools that scale across multiple IP blocks and SoC generations, improving team efficiency and model reuse

Why this role is interesting:

  • Your models are used to verify silicon before it's built — bugs you catch save months of schedule and millions of dollars
  • You'll work at the intersection of software engineering and chip design, with deep visibility into how custom ML accelerators are architected
  • As the team scales, there's a clear path into architectural modeling — using your models to influence chip design decisions, not just validate them
  • Small team, high ownership, direct impact on AWS's most strategic silicon programs

You will thrive in this role if you:

  • Have built functional or performance models of SoCs, ASICs, GPUs, CPUs, or IP blocks
  • Are comfortable working with architectural / design specifications or reference implementations and translating them into C++ or SystemC models
  • Understand verification concepts and have worked with DV teams or in pre-silicon validation environments
  • Care about model fidelity and have experience correlating models against RTL or silicon
  • Are interested in expanding into architectural performance modeling as the team grows
  • Enjoy working on a small, high-impact team where you own significant pieces of the stack

No ML background needed. You'll learn the ML accelerator domain on the job.

This role can be based in Cupertino, CA or Austin, TX.

Basic Qualifications

  • Experience programming languages such as C/C++, Python, Java or Perl
  • 2+ years writing functional or performance models of hardware (SoCs, ASICs, GPUs, CPUs, IP blocks)
  • Familiarity with SoC, CPU, GPU, and/or ASIC architecture and micro-architecture

Preferred Qualifications

  • 2+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Experience working with DV teams or integrating models into verification flows
  • Experience with SystemC or TLM-based modeling
  • Experience correlating functional models against RTL simulation or emulation
  • Experience developing or calibrating performance models
  • Familiarity with Modern C++ (20 and beyond)
  • Experience with PyTest, GoogleTest, or similar test frameworks
  • Experience with multi-threaded simulation

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at

USA, CA, Cupertino - 165,200.00 - 223,600.00 USD annually

USA, TX, Austin - 143,700.00 - 194,400.00 USD annually

Important FAQs for current Government employees

Before proceeding, please review the following FAQs

#J-18808-Ljbffr
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS in Cupertino, CA vacancy
  • $183k - $247.6k

    Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SOCs that are used to power today’s AI workloads in datacenters all around the world...  ...Design Verification Engineers to build the next generation...  ...Team CultureHere at AWS, we embrace our... 
    Amazon Web Service
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $193.3k - $261.5k

    Custom SoCs (System on Chips)...  ...brains behind AWS’s Machine Learning servers. Our...  ...functional models of these...  ...custom-designed accelerator SoCs for use...  ...Modeling Engineer to join the...  ...reusedAnnapurna Labs, our...  ...generative AI services and...  ...AWS portfolio.Annapurna Labs (our organization... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $165.2k - $223.6k

    AWS designs custom SoCs (System on Chips) that power the...  ...world's largest machine learning training and inference...  ...Software Engineer who wants to work...  ...team develops SoC models and...  ...SoC validation, accelerate system software...  ...teammatesAnnapurna Labs, our organization... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $183k - $247.6k

    AWS Utility Computing (UC) provides product innovations...  ...their cloud services.Annapurna Labs (our organization...  ...and software that accelerates innovation. Customers...  ...a Hardware Design Engineer with role in the definition...  ....As a member of the Machine Learning Acceleration team you... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...Sr. Hardware Engineer - ML Acceleration, Annapurna Labs AWS Utility Computing (UC) provides product innovations — from foundational services such...  ...AWS datacenter technology. As a member of the Machine Learning Acceleration team you’ll be responsible for the design... 
    Amazon Web Service
    Work from home

    Amazon

    Cupertino, CA
    13 hours ago
  • $193.3k - $261.5k

     ...The Senior SoC Software DevOps Engineer role centers on...  ...advanced custom machine learning chips. This position...  ...large scale AI training at AWS. The engineer...  ...layers and modeling tools. This involves...  ...that accelerate team productivity...  ...organization within Annapurna Labs (AWS). Our... 
    Amazon Web Service
    Local area
    Immediate start
    Flexible hours

    Amazon Web Services (AWS)

    Cupertino, CA
    13 hours ago
  •  ...Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services (AWS) job located in...  ...innovation in machine learning acceleration software. AWS Neuron...  ...of machine learning models and integration with...  ...contribute to and influence engineering discussions around... 
    Amazon Web Service

    Downtown Boulder Partnership

    Cupertino, CA
    2 days ago
  • $206.9k - $279.9k

    AWS Neuron is looking for an experienced...  ...innovation in machine learning acceleration software. AWS...  ...ML frameworks, model architectures, and...  ...to and influence engineering discussions...  ...professional.About Amazon Annapurna Labs:Amazon Annapurna...  ...of generative AI services and... 
    Amazon Web Service
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $165.2k - $223.6k

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the...  ...development kit used to accelerate deep learning and GenAI...  ...’s custom machine learning accelerators...  ...wide range of models and supporting...  ...boundary, our engineers build...  ...s possible in AI acceleration.As... 
    Amazon Web Service
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $208.3k - $281.8k

    AWS Trainium is deployed at scale...  ...of frontier models. AWS Neuron...  ...to run deep learning and generative AI workloads with...  ...partner with engineering teams building...  ...About Amazon Annapurna Labs Amazon...  ...performance machine learning with...  .../ML training accelerators and hardware,... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $183k - $247.6k

    Our Machine Learning Acceleration (MLA) team develops the Inferentia...  ...and Trainium SoCs that are used to power today’s AI workloads in datacenters...  ...a Sr. SoC Power Engineer, you’ll...  ...ground level by modeling and estimating power...  ...measurements in the lab and correlate... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $122.6k - $185k

     ...backbone of Generative AI cloud at AWS? Do you want to build...  ...in the cloud for AI model training for multi...  ...you. The AWS Hardware Engineering team creates server designs...  .../new designs for AWS Accelerated server solutions for...  ...’s in our nature to learn and be curious. Our... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $165.2k - $223.6k

    AWS's Trainium and Inferentia chips power the world's largest machine learning clusters. Our team builds virtual...  ...C++ and SystemC models of these custom SoCs — that let software...  ...looking for a software engineer to build and own...  ...'ll learn the ML accelerator domain on the job... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $183k - $247.6k

    Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud...  ...the world.Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of...  ...ASIC Physical Design Engineer to help us trail-blaze... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  •  ...Sr. ASIC Design Engineer, Cloud-Scale Machine Learning Acceleration team - Annapurna Labs Annapurna Labs designs silicon and software that accelerates...  ...change the world. Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member... 
    Amazon Web Service

    Amazon

    Cupertino, CA
    13 hours ago
  • $183k - $247.6k

    Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud...  ...the world.Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of...  ...members develop your engineering expertise so you feel... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $157.3k - $212.8k

    As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and...  ...including technologies such as AWS Inferentia which is a machine learning...  ...qualifications- Bachelor's degree in Electrical Engineering or a related field- Block Design... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $157.3k - $212.8k

    As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and...  ...including technologies such as AWS Inferentia which is a machine learning...  ...qualifications- Bachelor's degree in Electrical Engineering or a related field- Minimum of 3+... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $193.3k - $261.5k

    Annapurna Labs stands at the forefront of hardware...  ...Web Services (AWS) but across the...  ...best-in-class machine learning products that accelerate customer...  ...the future of AI accelerationAt...  ...experienced C/C++ engineer to join our embedded...  ...neural network model execution... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $193.3k - $261.5k

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the...  ...development kit used to accelerate deep learning and GenAI...  ...'s custom machine learning accelerator...  ...-scale models on Trainium without...  ...boundary, our engineers build the...  ...direction of AI acceleration technology... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $193.3k - $261.5k

     ...an experienced engineer to work on distributed AI/ML systems. This...  ...multiple accelerators & servers. Most...  ...the largest AI models.The org you would...  ...be joining is Annapurna Labs, an integral part of AWS and develops hardware...  ...that for Machine Learning (ML) and High-Performance... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $157.3k - $212.8k

    Custom SoCs (System on Chip) live at the heart of AWS Machine Learning servers. As a member of the Cloud-Scale Machine Learning Acceleration team you’ll be responsible for the design and optimization...  ...’re looking for an ASIC Design Engineer to help us trail-blaze new... 
    Amazon Web Service
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $127.1k - $185k

     ...talented early-career engineer to join our team that owns...  ...for EC2 distributed AI/ML systems. You'll work...  ...the world's largest AI models to train across massive...  ...computing, networking, and machine learning infrastructure -...  ...libraries running on custom AWS hardware - Build and... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $212.7k - $287.7k

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the...  ...development kit used to accelerate deep learning and GenAI...  ...’s custom machine learning accelerators...  ...boundary, our engineers craft high-...  ...s possible in AI acceleration....  ...enable their models and ensure... 
    Amazon Web Service
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $176.6k - $239k

    Annapurna Labs was a startup company acquired by AWS in 2015, and is now fully...  ...including silicon engineering, hardware...  ...Trainium ML Accelerators, and in storage...  ...Product: AWS Machine Learning accelerators...  ..., and now in AI and Machine Learning...  ...Learning models and integrate... 
    Amazon Web Service
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $165.2k - $223.6k

     ...an experienced engineer to work on distributed AI/ML systems. This...  ...multiple accelerators & servers. Most...  ...the largest AI models.The org you would...  ...be joining is Annapurna Labs, an integral part of AWS and develops hardware...  ...that for Machine Learning (ML) and High-Performance... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $165.2k - $223.6k

    The AWS Neuron Compiler team is...  ...compiler engineers to join our efforts...  ...the-art deep learning compiler...  ...application models across diverse...  ...custom-built Machine Learning accelerators, including Inferentia...  ...Generative AI. In this role...  ...co-design.Annapurna Labs (our... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $193.3k - $261.5k

    The Product: AWS Machine Learning accelerators are at the forefront of AWS...  ...Generative AI on AWS. The Inferentia...  ...whole, the Amazon Annapurna Labs team is responsible...  ...including silicon engineering, hardware design and...  ...complex neural net models on our custom-built... 
    Amazon Web Service
    Internship
    Local area
    Work from home
    Relocation
    Flexible hours

    Amazon

    Cupertino, CA
    8 hours ago
  • $185k - $215k

     ...- Internship in Machine LearningAt Bosch,...  ...students in the machine learning and software...  ...as a Staff AI Systems Engineer, setting technical...  ...dataset curation, model training, fine-tuning...  ...frameworks and acceleration libraries such as...  ...orchestration tools (e.g., AWS, Azure, GCP,... 
    Amazon Web Service
    Odd job
    Work experience placement
    Internship
    Local area
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    8 hours ago
  • $157.3k - $212.8k

     ...Reliability (MQR) Team is part of AWS Annapurna Labs focused on Machine Learning products that designs cutting AI platforms for the world’s...  .... As a Senior Reliability Engineer you will engage with an...  ...-tech start-up- Reliability modeling and materials characterization... 
    Amazon Web Service
    Work experience placement
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI SoC Modeling Engineer, Annapurna Labs Machine Learning Accelerators, AWS. Be the first to apply!