Principal AI Performance Architect
$142.8k - $274.8kMicrosoft Corporation
Overview Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy? Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live. We are seeking a Principal AI Performance Architect to help shape the next generation of Microsoft AI systems. In this role, you will analyze Frontier training and inference workloads, develop analytical models and tools to evaluate system performance, and validate key assumptions through targeted measurements on silicon. You will study interactions across accelerator architecture, memory, networking, and systems software; evaluate trade-offs in performance, scalability, utilization, and cost; and work with MSI and partner teams to guide hardware-software co-design decisions for cloud-scale AI systems.
Responsibilities
- Analyze Frontier training and inference workloads to identify key performance requirements and bottlenecks.
- Develop and improve analytical models, simulators, and data-analysis tools for AI system performance.
- Evaluate trade-offs in performance, scalability, utilization, capacity, and cost across accelerator, memory, network, and software configurations.
- Study hardware-software interactions in large-scale AI systems and translate workload insights into architecture requirements.
- Work with MSI and partner teams to evaluate hardware-software co-design options for training and inference.
- Develop and run targeted microbenchmarks on silicon to measure compute, memory, communication, kernel, and synchronization performance.
- Compare model predictions with silicon and end-to-end workload measurements, identify gaps, and improve model accuracy.
- Communicate findings and recommendations through clear data visualizations, technical reports, and architecture decision materials.
Qualifications
Required Qualifications- Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience
- Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 5+ years of technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 12+ years technical engineering experience OR equivalent experience
- Experience in AI systems performance, computer architecture, performance modeling, high-performance computing, distributed systems, or accelerator software.
- Strong understanding of computer architecture and the performance interactions among compute, memory, communication, and software.
- Experience with analytical performance modeling, simulation, profiling, workload characterization, or system performance analysis.
- Hands-on programming experience in Python and at least one systems or accelerator programming environment such as C++, CUDA, Triton, ROCm/HIP, or an equivalent platform.
- Experience analyzing AI training or inference workloads, including latency, throughput, capacity, utilization, and scaling behavior.
- Experience with transformer-based models, large language model training and inference, attention, KV-cache behavior, mixture-of-experts, or speculative decoding.
- Experience modeling or optimizing distributed execution strategies such as tensor, pipeline, expert, or data parallelism, or prefill/decode disaggregation.
- Knowledge of accelerator architecture, HBM and memory hierarchies, scale-up and scale-out networks, PCIe or other high-speed I/O, kernels, compilers, and runtimes.
- Experience correlating analytical or simulation models with silicon measurements and performing root-cause analysis of performance gaps.
- Experience with data analysis and visualization for performance studies and architecture decisions.
- ...not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up... ...combine deep expertise in full-stack engineering and advanced AI systems to deliver transformative outcomes for clients. You will...PrincipalPerformanceApprenticeshipImmediate startEasy workFlexible hours
$148.19k - $198.17k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...accepted until 01/31/2027.About the RoleOur architect team is organized into four domains that... ..., benefits, training, assessment of job performance, discipline, termination, and everything...PrincipalPerformanceFull timeRemote work$230k
...advantage and superior business performance through the use of data,... ...Transformation, Data & Digital Platforms, AI at Scale, Agile,... ...What You'll DoPrincipal AI Tech Architects at BCG Platinion are:... ...business challenges.We are seeking Principal AI Tech Architects to design,...PrincipalPerformanceWork at officeLocal area$200k - $275k
...Edge. ADI combines analog, digital, AI, and software technologies into solutions... ...Learn more at and on LinkedIn and X.Principal AI Accelerator Architect Lead Boston, MA; San Jose, CA Team:... ...qualifies for a discretionary performance-based bonus which is based on personal...PrincipalPerformancePermanent employmentFull timeWork at officeDay shift$200k - $360k
...Akamai's future cloud products. As a Principal Architect on the CTO's team of our global cloud... ...Running apps closer to users for instant performance. Security : Neutralizing threats... ...s biggest moments without a glitch. AI : Enabling our customers to build, secure...PrincipalPerformanceWork experience placementWork at office- ...We are seeking an experienced Principal Consultant specializing in... ...including exposure to Generative AI and Agentic AI. Key... ...business analysts, architects, developers, and banking... ...testing, debugging, performance optimization, and production...PrincipalPerformanceContract work
$151.6k - $252.6k
PBM Test Architect PrincipalEnterprise Test Strategy, Architecture &... ...DescriptionPBM Test Architect Principal will serve as the senior... ...integration, end-to-end, regression, performance, resilience, security, data-... .... Automation, Test Data & AI-Assisted QualityOwn the test...PrincipalPerformanceFull timeContract workLocal areaWork from home$120k - $180k
...together.Role description:Arcadis is seeking an Associate Principal, Architect with deep expertise in Federal Healthcare project delivery... ...technical staff while supporting resource planning and operational performance.Ensure compliance with Federal design standards, healthcare...PrincipalPerformanceFull timePart time- ...built to adapt. At Stantec, our Landscape Architects bring a systems-based, and resilience-... ....Your OpportunityStantec is seeking a Principal Landscape Architect/Design Director to... ...development, interviews, and tracking key performance indicators such as win rates and...PrincipalPerformanceWork at officeLocal area
$172.2k - $236.9k
Become a part of our caring communityThe Principal Chief Architect is a dual-mandate leadership role that... ...experience incorporating AI/ML capabilities into product strategy... ...observability, evaluation frameworks, and cost/performance optimization at enterprise scale.Understanding...PrincipalPerformanceFull timeTemporary workApprenticeshipImmediate start$190k
...competitive advantage and business superior performance through data, technology and digital.... ..., Data & Digital Platforms, AI at Scale, Cybersecurity and Digitizing the... ...scale. What You'll Do Lead AI Tech Architects - AI Platforms at BCG Platinion are:...PerformanceWork at officeLocal area$150k
...leading-edge tech platforms, at scale.What You'll DoSenior AI Tech Architects at BCG Platinion are:Collaborative. They are interdisciplinary... ...technical proofs of concept, and scaling software solutions.Performing technology assessments and implementing IT architectures....PerformanceWork at officeLocal area$200k - $250k
Job Title: Performance Modeling Architect - AI Memory SystemsJob Location: Santa Clara, CA, or Boston, MACompensation: $200K - $250K base DOE plus 25% bonus and meaningful equityRequirements: AI Memory Systems, Performance Modeling, Memory Expansion (NICs, SmartNICs, CXL...PerformanceNight shift- ...entering a transformative era where Data & AI are reshaping industries, work, and... ...defining solutions. You Are: As an Advanced AI Architect, you will be responsible for designing... ...scalability, security, governance and performance that meet our client’s business needs....PerformanceWork experience placementLive inWork at officeLocal area
$119k - $299.93k
...ManagerJob Description & SummaryThe OpportunityAs an AIT - AI/Blockchain Architect Senior Manager you will design and implement technology... ...teams through complex delivery challenges while balancing performance, reliability, security, and maintainability- Collaborating...PerformanceFull timeH1bShift work$183.6k - $297k
...our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving...PrincipalFull timeRemote work$99k - $252.45k
...ArchitectureManagement LevelManagerJob Description & SummaryThe OpportunityAs an AI Architect Manager, you will design and implement innovative technology... ..., leveraging team members' unique strengths, and managing performance to deliver on client expectations. With your growing...PerformanceFull timeH1b$116.64k - $145.8k
Lead Architect - Generative AIReports to: Manager - Application DevelopmentLocation: In Office... ...and growth opportunitiesGenerous performance‑based bonuses12% 401(k) matchComprehensive... ...excellence? As the Lead Architect - Generative AI, you will be at the forefront of...PerformanceWork at officeLocal area$183.6k - $297k
...Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the... ...efficiency.Mentor your colleagues in engineering reliable, performant, high-quality user experiences through direct mentorship,...PrincipalFull timeRemote workFlexible hours$270k - $300k
At WHOOP, we're on a mission to unlock and inspire performance for life. By providing members with a deep understanding of their bodies... ...healthier choices and peak performance.We are seeking a Principal AI Researcher to join our Foundation AI team. This team builds the...PrincipalPerformanceFull timeWork at officeRelocation- ...Accenture’s more than 1,500 certified AWS architects across the company. Join our team and be... ...and AWS at Accenture here:.You Are:An AI/ML Sr Architect delivering full-stack AI... ...scalability, security, governance, and performance on public, private, and sovereign clouds...PerformanceWork experience placementLive inWork at officeLocal area
$204.3k - $266.73k
...Principal Technical Program Manager We are seeking a Principal Technical... ..., high availability and performance. Build a consistent way... ...engineers, ML engineers and architects to settle trade-offs and keep... ...TPM, including 3+ years on ML, AI platform or large-scale...PrincipalPerformanceWork at officeLocal area$339k
...technical vision for how the whole onboard AI workload is scheduled, shared, isolated,... ....You will join Zoox's Software Performance organization, which owns end-to-end performance... ...we build next.In this role, you will: Architect onboard GPU execution. Define how perception...PrincipalPerformanceFull timeTemporary workRelocation package$119.7k - $222.3k
...development and use of artificial intelligence (AI) enabled strategies to transform clinical... ...or in AI strategy, to be considered for Principal Scientist II. 4+ years of experience to... ..., experience & capabilities required to perform the role at the level the role has been...PrincipalPerformanceFull time$268k - $384k
...2Your Impact at LILAWe're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the... ...risks by connecting material properties, processing and functional performance (across a range of materials domains) to harmful applications,...PrincipalPerformanceFull timeWork at officeLocal areaImmediate startFlexible hours$180.35k - $270.52k
...proven results, Lyric combines responsible AI with clinical, payment, regulatory, and... ..., and support accurate payments. The Principal Software Engineer is responsible for... ...development of complex, scalable, and high-performance software systems, collaborating with...PrincipalPerformanceFull timeRemote work$108k - $209k
...experienced, creative, and talented Principal / Senior Software Engineer.... ...feedback to evaluate feature performance and guide continued... ...architecture for rapidly evolving, AI-enabled back-end components.... ...Certifications, such as Solutions Architect Associate or Professional....PrincipalPerformance$214.1k - $217.6k
...help build and shape McKinsey’s Scientific AI offering.Who you'll work withDriving... ...the kind of person who thrives in a high performance/high reward culture - doing hard things,... ...start-up like environment, serving as a Principal Data Scientist in a technology development...PrincipalPerformanceApprenticeshipEasy work$220k - $290k
About the RoleCloudZero is hiring Staff and Principal Software Engineers across our... ...the spearhead of CloudZero's push into AI cost intelligence. You'll work on the AI... ...stakeholdersIdentify and drive improvements to performance, scalability, and reliability before they...PrincipalPerformanceImmediate start$168.6k - $224.8k
...vision for scalable validation platforms, including automation, performance, and resilience testing capabilitiesPartner cross-functionally... ...identifying system bottlenecks and leveraging data-driven and AI-assisted approaches to improve validation and code quality.Grow...PrincipalPerformanceWork at officeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Performance Architect. Be the first to apply!
- epic principal trainer Boston, MA
- principal consultant Boston, MA
- principal solution architect Boston, MA
- principal Boston, MA
- principal scientist Boston, MA
- principal applied scientist Boston, MA
- principal architect Boston, MA
- associate principal Boston, MA
- principal data scientist Boston, MA
- senior principal scientist Boston, MA




