Principal ASIC Architect - Memory Systems & AI Interconnects
$200k - $300kCybercoders
Job Description
Job Description
Principal ASIC Architect - Memory Systems & AI Interconnects
Job Title: Principal ASIC Architect - Memory Systems & AI Interconnects
Job Location: Santa Clara, CA or Boston, MA
Compensation: $200K - $300K plus bonus and equity
Requirements: ASIC Architecture, Memory Subsystems, CXL / NVLink / PCIe / UCIe/ UALink / RDMA, ARM CHI, AI Accelerators
Our company is working on solving the memory wall for AI. We develop memory-to-compute networking solutions for AI infrastructure, with a focus on high-bandwidth optical interconnects for XPU memory expansion.
Position Overview
We are seeking a Principal ASIC Architect to lead architecture and system-level design of memory subsystems and AI interconnects for next-generation AI accelerators and SoCs. The role combines deep expertise in memory systems architecture, interconnect protocols (CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, PCIe), and performance modeling to define high-bandwidth, low-latency solutions that scale across accelerator, host, and memory fabrics. You will partner with product teams, ASIC design, verification, firmware, and system integration to set architectural direction, drive technical tradeoffs, and ensure robust, high-performance solutions for ML hardware and AI workloads.
Key Responsibilities
- Define end-to-end memory and interconnect architectures for AI accelerators, including coherent and non-coherent fabrics, memory pooling, and tiered memory hierarchies.
- Lead specification and micro-architecture of interfaces and protocols (CXL, NVLink, UALink, RDMA, UCIe, PCIe, ARM CHI) and their integration into SoC designs and AI accelerators.
- Develop performance, latency, and bandwidth models and run system-level simulations to evaluate architectural trade-offs and inform design decisions.
- Collaborate with RTL, verification, firmware, and physical design teams to translate architecture into implementable hardware blocks and ensure design-for-performance.
- Drive cross-functional reviews with product management, systems teams, and external IP partners to align on interfaces, compliance, and interoperability.
- Architect solutions for memory subsystems including HBM, DDR, persistent memory, and CXL-attached devices, optimizing for AI/ML workloads and data movement patterns.
- Define verification and validation strategies for interconnect and memory subsystems, including test plans for coherence, error handling, flow control, and performance stress tests.
- Mentor and lead other architects and engineers, setting best practices, architectural patterns, and documentation for memory and interconnect subsystems.
- Keep abreast of industry trends, emerging protocols, and ecosystem developments; represent the company in standards and partner engagements as needed.
- Provide technical leadership during silicon bring-up, performance tuning, and system-level debugging to achieve target performance and reliability metrics.
Qualifications
- Bachelors degree in Electrical Engineering, Computer Engineering, Computer Science or related field; MS or PhD preferred.
- 10+ years of experience in ASIC/SoC architecture, with a significant focus on memory systems and interconnects for high-performance computing or AI.
- Deep working knowledge of CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, and PCIe protocols and how they are used to build coherent and high-performance systems.
- Experience with memory subsystems (HBM, DDR, persistent memory), memory controller architecture, cache coherency and memory consistency models.
- Hands-on experience with AI accelerators, ML hardware architectures, dataflow characteristics of ML workloads, and integration of accelerators into SoCs.
- Strong background in performance modeling, system-level simulation, and latency/bandwidth analysis.
- Familiarity with RTL design concepts, verification methodologies, and silicon bring-up processes; ability to review microarchitecture and RTL for performance implications.
- Excellent written and verbal communication skills; proven ability to collaborate across teams and influence technical decisions.
- Proven track record of technical leadership, mentoring engineers, and delivering complex ASIC/SoC projects on schedule.
- Experience with scripting and modeling tools (Python, C/C++, SystemC, or equivalent) and performance analysis tools is a plus.
Benefits
- Competitive salary commensurate with experience including base salary, performance-based bonus, and early-stage equity grant
- Comprehensive benefits including health, dental, vision, and life insurance
- Well-equipped, sunny offices in Santa Clara, CA and Boston, MA
- Relocation assistance and visa sponsorship
- Perks include a daily lunch stipend, 401k match, and more
- A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing
- Netpreme is seeking an ASIC Architect to define the architecture and microarchitecture for their silicon product with offices in Boston, MA. Responsibilities include performance modeling for GPU memory systems, architecting data planes, and owning SoC architecture specs...Suggested
$150k - $250k
...Senior / Principal Neuromorphic Systems Architect Cambridge, MA USA The Company Flagship Labs... ...This is not a conventional AI accelerator role. We are... ...(analog, mixed-signal, in-memory, or alternative substrates... ...designing hardware architectures (ASIC, FPGA, analog/mixed-signal...PrincipalFlexible hours- A cutting-edge AI startup is seeking a Senior R&D Engineer - System Architecture to design and optimize next-gen AI acceleration platforms. The role includes building prototypes and collaborating with cross-functional teams. Candidates should have a Master's or Ph.D. in...Suggested
- ...Principal Ai Platforms Architect Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver... ...groups to existing teams. Systems thinkers. They are well-versed in designing... ...automation, including the use of memory, agentic reflection, and task planning...Principal
$178.6k - $223.2k
...The Federal Reserve Bank of New York is seeking a Technical Leader for its payment systems team, responsible for architecting innovative solutions in distributed payments and AI. Candidates will engage with cutting-edge technologies and drive the development of high-performance...Principal$230k
...Boston Consulting Group (BCG) is seeking a Principal AI Platforms Architect in Boston, MA. This role involves designing advanced AI solutions, partnering... ...stakeholders, and managing architecture for intelligent systems. The ideal candidate should have over 10 years of...Principal- Draper Inc. is seeking a Principal Hardware in the Loop Simulation Engineer in Cambridge, Massachusetts. This role involves architecting and verifying simulations for aerospace projects... ...degree plus significant experience in Systems Engineering. The candidate will lead...Principal
$170k - $200k
Principal AI Engineering ArchitectSkip to main content# Careers at TMGPrincipal AI Engineering Architect page is loaded## Principal AI Engineering ArchitectApplyremote... ..., enterprise knowledge systems, and secure deployment... ..., context management, memory patterns, guardrails,...PrincipalFull timeTemporary workWork at officeRemote workHome officeFlexible hours- ...Band: 14 Remote Position: Yes Region: Americas Country: USA Summary This position is for a Senior Principal Engineer, AI/ML System Architect. As system architect,one will define the architecture of leading and competitive AI systems, lead new technologyresearch...PrincipalLocal areaRemote work
- 7AI is looking for a Senior Software Architect to join our R&D team in Boston, MA. In this role, you will define and... ...foundation, focusing on reliable and scalable systems at the intersection of engineering and AI. Candidates should have over 20 years of experience...
$204k - $348k
...Sr Principal/ Principal Software Engineer, AI Lab Execution System Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We are seeking a Senior... ...System of Record Team (SSR) builds the memory layer for Lila's operations. It answers two questions...PrincipalFull timeWork at officeLocal areaFlexible hours- Summary This position is for a Senior Principal Engineer, AI/ML System Architect. As system architect, one will define the architecture of leading and competitive AI systems, lead new technology research, study market trend, customer interface and lead Celestica’s design...PrincipalLocal areaRemote work
$115.4k - $192.3k
...unstructured information into richly interconnected knowledge graphs that capture... ...graph-powered agentic AI with advanced search... ...team, you'll contribute to the systems and infrastructure that fuel... ...The Role We are looking for a Principal Software Engineer with extensive...PrincipalLocal areaWorldwide$144k - $198k
...Twitter (X). Edge Compute Architect for Optical Systems The Analog Garage is... ...and compute architectures for ASIC- or FPGA-based near-sensor processing... ...streaming pipelines, memory and bandwidth budgets,... ...modern machine-learning and AI approaches in resource-constrained...Permanent employmentWork at officeShift workDay shift- A leading open-source software company is seeking a Principal Software Engineer to drive AI integration within their product portfolio. This role involves... ...design of scalable solutions, implementing Multi-Agent Systems, and collaborating with both internal teams and...Principal
- Blitzy is hiring a Principal Engineer based in Cambridge, Massachusetts. This role demands full ownership of critical production systems, focusing on delivering impactful features that enhance customer outcomes and engineering velocity. The successful candidate will operate...Principal
$197.3k - $313.7k
Salesforce is seeking a Principal Systems Engineer for the Agentforce for Supply Chain - Super Agent team in Boston, MA. As a senior technical... ...engineering experience, expertise in system design, and a strong AI-focus. You'll play a crucial part in improving system quality...Principal$300k
A dynamic Generative AI startup in Cambridge, MA is seeking a Principal Engineer to take on critical production systems and enhance engineering velocity. The ideal candidate will have extensive experience in Python, Kubernetes, and databasess. This is a hands-on role that...Principal- ...solutions. Building the world's leading AI-powered, cloud-native products that shape... ...responsibilities Overview: The Business Systems team manages the backbone of our company’... ...teams. We are looking for a hands‑on AI Architect to deliver technical designs and implementations...Remote job
- ...Kinaxis is seeking a Principal Architect to join their Solution Assurance team. This remote role involves addressing complex supply chain management... .... The ideal candidate will lead engagements, leverage AI and analytics, and guide solution design for measurable business...PrincipalRemote work
- Red-Hat is searching for a Senior Principal Software Engineer in Boston, Massachusetts. In this pivotal role, you will drive the development... ...OpenShift, focusing on scalability, lifecycle management, and AI integration. With over 12 years of software development experience...Principal
- ...verification of next-generation cache-coherent interconnect subsystems. You will own complex... ...quality. The ideal candidate has 7+ years of ASIC/SoC design verification experience,... ...and a comprehensive understanding of cache-coherent systems. #J-18808-Ljbffr SiFive, Inc.
- ...built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster... ...integrate data across the enterprise. What You’ll Do As the Principal AI Architect for Teradata AI Studio, you will define the technical architecture...PrincipalPermanent employmentFlexible hours
$155k - $278.3k
...manufactured. We are seeking a Senior Principal UX Designer who operates at the intersection of UX, systems thinking, and computational... ...who can shape the future of AI-powered product development workflows... ...creation environments. Architect node- and graph-based automation...PrincipalRemote jobFor contractors- Draper is seeking an ASIC Hardware Engineer in Cambridge, MA. The ideal candidate will design and simulate complex circuits for ASICs with responsibilities including system design and driving solutions to complex problems. A Bachelor's degree in Engineering is required,...Remote work
$139.4k - $230k
...Growing Team! As a member of AI and Emerging Technology... ...class solutions. As a Senior Architect, you will partner with Technology... ...technical depth in modern AI systems to design and deliver solutions... ...LLM integration, RAG pipelines, memory systems, and tool/function-...Work experience placementLocal area$124.5k - $239k
...We are seeking a forward-thinking and customer-centric Solution Architect specializing in Customer Experience. The ideal candidate will possess... ...cutting-edge technologies such as Artificial Intelligence (AI), chatbots, and next-generation digital channels. This role will...PrincipalFull timeTemporary workPart timeWork experience placementShift work- ...development, corporate, and commercial operations. About the Role: We are seeking a Principal/Senior Systems Engineer , to join our team. This role will serve as the Technical Lead for Generative AI and Collaboration Tools. The Principal/Senior Systems Engineer will serve as...PrincipalTemporary workWork at officeAfternoon shift
- ...A leading data streaming platform is seeking an AI Architect to deliver technical designs and implementations of internal AI tools. In this hybrid role, you'll act as a software architect and a lead engineer, responsible for turning vague business problems into reliable...Remote work
- ...Principal Systems Analyst Anywhere Type: Contract Category: Business Analysis Industry: Financial Services Workplace Type:... ...advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring...PrincipalHourly payContract workLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal ASIC Architect - Memory Systems & AI Interconnects. Be the first to apply!
- principal architect Boston, MA
- principal Boston, MA
- principal solutions consultant Boston, MA
- principal solution architect Boston, MA
- senior principal scientist Boston, MA
- associate principal Boston, MA
- principal consultant Boston, MA
- senior principal cloud computing engineer Boston, MA
- epic principal trainer Boston, MA
- principal applied scientist Boston, MA

