Principal Engineer: AI Training & Inference on Neuron

Amazon Locker

Amazon Web Services (AWS) is seeking a Principal Engineer for Annapurna Labs Training and Inference to drive AI model performance across pre-training, post-training, and inference on Trainium. You will write code, own the forward and backward paths, and influence across the Neuron stack and partner teams.

You will lead with deep hands‑on expertise in one area, mentor senior engineers, and shape architecture decisions that boost model performance, scale, and cost efficiency at customer scale on

#J-18808-Ljbffr

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Principal Engineer: AI Training & Inference on Neuron in Cupertino, CA vacancy

Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK
$230.1k - $311.2k
At Amazon, Principal Engineers are both technical leaders and hands... ...customers. On the AWS Neuron SDK team within Annapurna... ...Labs, that mandate is AI model performance on... ...on AWS Trainium — pre-training, post-training and alignment, and inference serving — with deep hands...
Training
Internship
Local area
Flexible hours
Amazon
Cupertino, CA
1 day ago
Principal Engineer, AI Ecosystem
$307k - $427k
...Principal EngineerGoogle Cloud accelerates organizations... ...Today, the rapid rise of AI and ML workloads is... ...undisputed best place to train and serve accelerated and... ...on daily.As Principal Engineer, you will be in a... ...complex LLM training and inference workloads at massive scale...
Training
Temporary work
Worldwide
Shift work
CompliancePoint
Sunnyvale, CA
4 days ago
Software Engineer II - AI/ML, Neuron Inference, Neuron Inference
...Software Engineer II - Ai/MlThe Annapurna Labs team at Amazon Web Services (AWS) builds the AWS Neuron SDK, the software development kit used to... ...accelerators. The Neuron Inference organization is at the forefront... ..., including architecture, training/inference lifecycles, and...
Training
Internship
Amazon
Cupertino, CA
4 days ago
Principal Core Infrastructure Engineer
$114.6k - $234.6k
...measurement, analytics, and inference systems for data center and WAN... ...failure scenarios. Apply AI-assisted software development... ...operational analysis while maintaining engineering, security, and quality... ...including data preparation, training and evaluation, deployment,...
Training
Temporary work
Flexible hours
Oracle Corporation
Santa Clara, CA
4 days ago
Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron
$193.3k - $261.5k
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud... ....As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard... ...fundamentals, including architecture, training/inference lifecycles, and optimization...
Training
Internship
Local area
Flexible hours
Amazon
Cupertino, CA
4 days ago
Principal Machine Learning Engineer
$163.2k - $264k
...and Inclusion. We weave AI into the fabric of... ...Summary The Team Engineering - Our engineering team... ...Job Summary As a Principal Software Engineer, you... ...initial development and training to production deployment and real-time inference. Build and maintain...
Training
Full time
Work at office
PaloAlto Networks
Santa Clara, CA
1 day ago
Software Development Engineer, AI/ML, AWS Neuron, Model Inference
$165.2k - $223.6k
...Web Services (AWS) builds AWS Neuron, the software development... ...JAX enabling unparalleled ML inference and training performance. The Inference... ...-software boundary, our engineers build systematic infrastructure... ...boundaries of what's possible in AI acceleration. As part of...
Training
Work experience placement
Internship
Local area
Flexible hours
Annapurna Labs
Cupertino, CA
17 hours ago
Systems Performance Principal Engineer, AI Solutions Lab
$186.9k - $275k
...Across enterprise, cloud and AI, and carrier architectures, our... ...is breadth of ownership: engineers here aren't limited to validating... ...across AI serving and training stacks using leading models and... ...scope spans both training and inference stacks.• Strong Python and Linux...
Training
Permanent employment
Internship
Work from home
Marvell
Santa Clara, CA
17 hours ago
Sr. Engineering Manager, AI on Sensor (Hybrid)
$194k - $349k
...with the world’s most advanced AI-native platform. We work on... ...environments. This is a Sr. Engineering Manager role in the CTIO... ...delivering efficient on-device inference, and you will partner closely... ...projects as well as hiring, training and growing your team. You...
Training
Permanent employment
Work experience placement
Work at office
Local area
Remote work
Sunnyvale, CA
25 days ago
Principal Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles
$272k - $431.25k
...are seeking an exceptional Principal Perception Engineer to lead the design and productization... ...best practices for training and evaluation, using... ...and optimizing training or inference pipelines through custom CUDA... ...existing vacancy. NVIDIA uses AI tools in its recruiting...
Training
NVIDIA Corporation
Santa Clara, CA
4 days ago
Sr Principal Engineer AI/ML
$171k - $325k
...We are seeking an experienced CPU IP Design Engineer. Responsible for Defining, leading and owning RTL development of our latest AI-enabled RISC-V CPU core. The candidate will... ...including recruitment, selection, training, utilization, promotion, compensation, benefits...
Training
Full time
Local area
Globalfoundries
Santa Clara, CA
1 day ago
Engineering Manager, AI/ML Training Infra
$207k - $300k
...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related... ...critical scheduling features supporting training and inference across Alphabet. You will support key... ...immediate business delivery needs.The AI and Infrastructure team is redefining...
Training
Immediate start
Worldwide
Google
Sunnyvale, CA
4 days ago
Principal Engineer - ML / AI - Foundation Models
$302k
...particular focus on building large-scale Foundation Models trained on Uber's proprietary marketplace data.Unlike general-... ...new capabilities.We are looking for an exceptional Principal Engineer, Machine Learning / AI to help lead this effort.This is a highly strategic, hands...
Training
Full time
Work at office
Remote work
Uber
Sunnyvale, CA
1 day ago
Principal Site Reliability Engineer
$248k - $396.75k
Site Reliability Engineering (SRE) at NVIDIA is an engineering discipline... ...environments.As a Principal SRE, you will shape the technical... ...direction of NVIDIA’s AI Platform Runtime and lead reliability... ..., GPU infrastructure, inference systems, training environments, or high-...
Training
Full time
Nvidia
Santa Clara, CA
2 days ago
Principal Silicon Product Engineer
$281k - $391k
...Share Principal Silicon Product Engineer corporate_fare Google place Sunnyvale, CA, USA bar_chart Director+... .../thermal interfaces, and custom AI accelerator hardware bottlenecks.... ...experience, and relevant education or training. US: $281000 - $391000 (USD) + 30%...
Training
Contract work
Google
Sunnyvale, CA
4 days ago
Engineering Manager, SDET - AI Detection and Response (AIDR) (Hybrid)
$164k - $295k
...security with the world’s most advanced AI-native platform. We work on large scale distributed... ...is seeking an experienced SDET Engineering Manager to lead our quality engineering efforts... ...--including recruitment, selection, training, compensation, benefits, discipline, promotions...
Training
Permanent employment
Contract work
Work experience placement
Work at office
Local area
Worldwide
2 days per week
3 days per week
Sunnyvale, CA
a month ago
Principal Engineer/Architect - Generative AI & Edge Systems, Automotive
$171.2k - $286.6k
Principal Engineer/Architect - Generative AI & Edge Systems, AutomotiveCategoryAlgorithm & ArchitectureLocationSan... ...) and framework level to maximize inference performance within embedded... ...based platforms. • Familiarity with training data preparation, curation, and open...
Training
Temporary work
MediaTek
San Jose, CA
17 hours ago
Principal Machine Learning Engineer, Driving Product
...billion machines will run on in the future. Very few people in AI can say this. Every role here, whatever the team, plugs into that... ...workshops and labs Learning and development budgets with support for training, conferences and growth Comprehensive benefits including health...
Training
Work at office
Remote work
Visa sponsorship
Relocation package
Flexible hours
Shift work
Wayve
Sunnyvale, CA
3 days ago
Principal Developer, AI Networking
$272k - $431.25k
...tapping into the unlimited potential of AI to define the next era of computing. An... ...R&D group requires a senior software engineer. In this exciting role, you will profile... ...used for distributed Deep Learning LLM training and inference. Your primary focus will be collectives...
Training
Full time
Remote work
Nvidia
Santa Clara, CA
3 days ago
Director, Engineering, Compute Infrastructure, Google Distributed Cloud
$307k - $427k
...Director Of Engineering For Compute Infrastructure In Google... ...managed hardware and AI-led software services,... ...relevant education or training. US: $307000 - $427000... ...for demanding AI inference and agentic workflows.... ...leaders (managers and principal/staff engineers).Experience...
Training
CompliancePoint
Sunnyvale, CA
3 days ago
Principal Machine Learning Engineer
Overview As a Principal Machine Learning Engineer, you will drive the development and... ...machine learning algorithms, training sophisticated models, and... ...analytics teams to build AI functionalities into... ...offline training and online inference at scaleOversee end-to-end...
Training
Local area
Remote work
Atlassian
Mountain View, CA
4 days ago
Principal Machine Learning Engineer
$296.3k - $374.8k
...CAMeet The TeamCisco's CX AI Incubation and Agents team... ...platforms – including model and inference layers, evaluation systems... ...AI.Your ImpactAs a Principal Machine Learning Engineer on Cisco’s CX AI Incubation... ...education, certifications, and/or training. The full salary range for...
Training
Full time
Temporary work
Local area
Flexible hours
3 days per week
Cisco
San Jose, CA
3 days ago
Principal Machine Learning Engineer
$126.2k - $264.1k
...to monitor the performance and alignment with design criteria of trained models and/or systems. Proactively monitors the performance... ...everything from industry innovations to life‑saving care. And with AI embedded across our products and services, we help customers...
Training
Temporary work
Flexible hours
Shift work
Oracle
Santa Clara, CA
3 days ago
Principal ML Engineer, E2E Autonomy
$135k - $378k
...opportunities, delivering autonomy products that customers love. As a senior ML Engineer, you will help grow and shape our E2E stack. This involves shaping the design of the E2E training and inference pipeline, both on‑and off-vehicle and on‑and off-prem. You will also help...
Training
Full time
Work at office
Immediate start
Visa sponsorship
Blue River Technology
Santa Clara, CA
1 day ago
(USA) Principal, Machine Learning Engineer
$169k - $338k
...Segment: Home OfficeRole summary: The Principal, Machine Learning Engineer will lead the design and development... ...innovation in Machine Learning and AI to improve customer engagement and... ...sourcing, feature engineering, model training, deployment, and monitoring.Drive innovation...
Training
Full time
Temporary work
Part time
Work experience placement
Walmart
Sunnyvale, CA
1 day ago
Principal Supply Chain Product Engineer
$102.3k - $209.5k
The Principal Supply Chain Product Engineer is a recognized technical leader responsible for ensuring that products... ...to life-saving care. And with AI embedded across our products and services... ...standards, methodologies, and training programs.Influence organizational culture...
Training
Temporary work
Work at office
Flexible hours
Oracle Corporation
Santa Clara, CA
4 days ago
Principal Engineer TL/M - Software Development (PaaS)
$249.02k - $292.96k
...Principal Engineer TL/M - Software Development (PaaS)Santa Clara, CAAviatrix® is pioneering the... .... For more information, visit aviatrix.ai.Aviatrix Platform-as-a-Service (PaaS) delivers... ..., leaves of absence, compensation and training.CPRA - California Applicant Privacy...
Training
Full time
Temporary work
Local area
Flexible hours
Day shift
Aviatrix
Santa Clara, CA
4 days ago
Principal GenAI Inference Optimization Engineer
...accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems.... ...Together, we advance your career. THE ROLEWe are seeking a Principal GenAI Inference Optimization Engineer to join our Models and Applications team. This role...
AMD
San Jose, CA
2 days ago
Principal Security Lead Engineer
...and scientific discovery to powering AI and the technologies people rely on every... ..., we’ll advance your career. PRINCIPAL SECURITY LEAD ENGINEER THE ROLE: We are looking for a... ...programming requirements, owned customer training and in-house training Experienced...
Training
Work experience placement
Advanced Micro Devices, Inc.
Santa Clara, CA
4 days ago
Senior Principal Engineer- Autonomous Driving (ADAS) Data Loop & Flywheel
$240k - $320k
...electrical and system integration engineers to define, build, and scale our vehicle... ....Job DescriptionAs the Senior Principal Engineer - ADAS & AV Data Loop & AI Flywheel, you will spearhead the... ...prototypes into scalable, production-grade training and auto-labeling pipelines,...
Training
Full time
Work experience placement
Local area
Flexible hours
Robert Bosch
Sunnyvale, CA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Engineer: AI Training & Inference on Neuron. Be the first to apply!