Principal ASIC Architect - Memory Systems & AI Interconnects
$200k - $300kCybercoders
Job Description
Job Description
Principal ASIC Architect - Memory Systems & AI Interconnects
Job Title: Principal ASIC Architect - Memory Systems & AI Interconnects
Job Location: Santa Clara, CA or Boston, MA
Compensation: $200K - $300K plus bonus and equity
Requirements: ASIC Architecture, Memory Subsystems, CXL / NVLink / PCIe / UCIe/ UALink / RDMA, ARM CHI, AI Accelerators
Our company is working on solving the memory wall for AI. We develop memory-to-compute networking solutions for AI infrastructure, with a focus on high-bandwidth optical interconnects for XPU memory expansion.
Position Overview
We are seeking a Principal ASIC Architect to lead architecture and system-level design of memory subsystems and AI interconnects for next-generation AI accelerators and SoCs. The role combines deep expertise in memory systems architecture, interconnect protocols (CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, PCIe), and performance modeling to define high-bandwidth, low-latency solutions that scale across accelerator, host, and memory fabrics. You will partner with product teams, ASIC design, verification, firmware, and system integration to set architectural direction, drive technical tradeoffs, and ensure robust, high-performance solutions for ML hardware and AI workloads.
Key Responsibilities
- Define end-to-end memory and interconnect architectures for AI accelerators, including coherent and non-coherent fabrics, memory pooling, and tiered memory hierarchies.
- Lead specification and micro-architecture of interfaces and protocols (CXL, NVLink, UALink, RDMA, UCIe, PCIe, ARM CHI) and their integration into SoC designs and AI accelerators.
- Develop performance, latency, and bandwidth models and run system-level simulations to evaluate architectural trade-offs and inform design decisions.
- Collaborate with RTL, verification, firmware, and physical design teams to translate architecture into implementable hardware blocks and ensure design-for-performance.
- Drive cross-functional reviews with product management, systems teams, and external IP partners to align on interfaces, compliance, and interoperability.
- Architect solutions for memory subsystems including HBM, DDR, persistent memory, and CXL-attached devices, optimizing for AI/ML workloads and data movement patterns.
- Define verification and validation strategies for interconnect and memory subsystems, including test plans for coherence, error handling, flow control, and performance stress tests.
- Mentor and lead other architects and engineers, setting best practices, architectural patterns, and documentation for memory and interconnect subsystems.
- Keep abreast of industry trends, emerging protocols, and ecosystem developments; represent the company in standards and partner engagements as needed.
- Provide technical leadership during silicon bring-up, performance tuning, and system-level debugging to achieve target performance and reliability metrics.
Qualifications
- Bachelors degree in Electrical Engineering, Computer Engineering, Computer Science or related field; MS or PhD preferred.
- 10+ years of experience in ASIC/SoC architecture, with a significant focus on memory systems and interconnects for high-performance computing or AI.
- Deep working knowledge of CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, and PCIe protocols and how they are used to build coherent and high-performance systems.
- Experience with memory subsystems (HBM, DDR, persistent memory), memory controller architecture, cache coherency and memory consistency models.
- Hands-on experience with AI accelerators, ML hardware architectures, dataflow characteristics of ML workloads, and integration of accelerators into SoCs.
- Strong background in performance modeling, system-level simulation, and latency/bandwidth analysis.
- Familiarity with RTL design concepts, verification methodologies, and silicon bring-up processes; ability to review microarchitecture and RTL for performance implications.
- Excellent written and verbal communication skills; proven ability to collaborate across teams and influence technical decisions.
- Proven track record of technical leadership, mentoring engineers, and delivering complex ASIC/SoC projects on schedule.
- Experience with scripting and modeling tools (Python, C/C++, SystemC, or equivalent) and performance analysis tools is a plus.
Benefits
- Competitive salary commensurate with experience including base salary, performance-based bonus, and early-stage equity grant
- Comprehensive benefits including health, dental, vision, and life insurance
- Well-equipped, sunny offices in Santa Clara, CA and Boston, MA
- Relocation assistance and visa sponsorship
- Perks include a daily lunch stipend, 401k match, and more
- A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing
- Netpreme is seeking an ASIC Architect to define the architecture and microarchitecture for their silicon product with offices in Boston, MA. Responsibilities include performance modeling for GPU memory systems, architecting data planes, and owning SoC architecture specs...Suggested
$150k - $250k
...Senior / Principal Neuromorphic Systems Architect Cambridge, MA USA The Company Flagship Labs... ...This is not a conventional AI accelerator role. We are... ...(analog, mixed-signal, in-memory, or alternative substrates... ...designing hardware architectures (ASIC, FPGA, analog/mixed-signal...PrincipalFlexible hours- A cutting-edge AI startup is seeking a Senior R&D Engineer - System Architecture to design and optimize next-gen AI acceleration platforms. The role includes building prototypes and collaborating with cross-functional teams. Candidates should have a Master's or Ph.D. in...Suggested
- ...Principal Ai Platforms Architect Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver... ...groups to existing teams. Systems thinkers. They are well-versed in designing... ...automation, including the use of memory, agentic reflection, and task planning...Principal
$178.6k - $223.2k
...The Federal Reserve Bank of New York is seeking a Technical Leader for its payment systems team, responsible for architecting innovative solutions in distributed payments and AI. Candidates will engage with cutting-edge technologies and drive the development of high-performance...Principal- ...Draper Inc. is seeking a Principal Hardware in the Loop Simulation Engineer in Cambridge, Massachusetts. This role involves architecting and verifying simulations for aerospace projects... ...degree plus significant experience in Systems Engineering. The candidate will lead...Principal
- ...Summary This position is for a Senior Principal Engineer, AI/ML System Architect. As system architect, one will define the architecture of leading and competitive AI systems, lead new technology research, study market trend, customer interface and lead Celestica’s design...PrincipalLocal areaRemote work
$170k - $200k
Principal AI Engineering ArchitectSkip to main content# Careers at TMGPrincipal AI Engineering Architect page is loaded## Principal AI Engineering ArchitectApplyremote... ..., enterprise knowledge systems, and secure deployment... ..., context management, memory patterns, guardrails,...PrincipalFull timeTemporary workWork at officeRemote workHome officeFlexible hours- ...Band: 14 Remote Position: Yes Region: Americas Country: USA Summary This position is for a Senior Principal Engineer, AI/ML System Architect. As system architect,one will define the architecture of leading and competitive AI systems, lead new technologyresearch...PrincipalLocal areaRemote work
$204k - $348k
...Sr Principal/ Principal Software Engineer, AI Lab Execution System Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We are seeking a Senior... ...System of Record Team (SSR) builds the memory layer for Lila's operations. It answers two questions...PrincipalFull timeWork at officeLocal areaFlexible hours- A leading open-source software company is seeking a Principal Software Engineer to drive AI integration within their product portfolio. This role involves... ...design of scalable solutions, implementing Multi-Agent Systems, and collaborating with both internal teams and...Principal
- ...Blitzy is hiring a Principal Engineer based in Cambridge, Massachusetts. This role demands full ownership of critical production systems, focusing on delivering impactful features that enhance customer outcomes and engineering velocity. The successful candidate will operate...Principal
- ...solutions. Building the world's leading AI-powered, cloud-native products that shape... ...responsibilities Overview: The Business Systems team manages the backbone of our company’... ...teams. We are looking for a hands‑on AI Architect to deliver technical designs and implementations...Remote work
$144k - $198k
...Twitter (X). Edge Compute Architect for Optical Systems The Analog Garage is... ...and compute architectures for ASIC- or FPGA-based near-sensor processing... ...streaming pipelines, memory and bandwidth budgets,... ...modern machine-learning and AI approaches in resource-constrained...Permanent employmentWork at officeShift workDay shift$197.3k - $313.7k
Salesforce is seeking a Principal Systems Engineer for the Agentforce for Supply Chain - Super Agent team in Boston, MA. As a senior technical... ...engineering experience, expertise in system design, and a strong AI-focus. You'll play a crucial part in improving system quality...Principal$300k
A dynamic Generative AI startup in Cambridge, MA is seeking a Principal Engineer to take on critical production systems and enhance engineering velocity. The ideal candidate will have extensive experience in Python, Kubernetes, and databasess. This is a hands-on role that...Principal- Red-Hat is searching for a Senior Principal Software Engineer in Boston, Massachusetts. In this pivotal role, you will drive the development... ...OpenShift, focusing on scalability, lifecycle management, and AI integration. With over 12 years of software development experience...Principal
- ...verification of next-generation cache-coherent interconnect subsystems. You will own complex... ...quality. The ideal candidate has 7+ years of ASIC/SoC design verification experience,... ...and a comprehensive understanding of cache-coherent systems. #J-18808-Ljbffr SiFive, Inc.
- ...Draper is seeking an ASIC Hardware Engineer in Cambridge, MA. The ideal candidate will design and simulate complex circuits for ASICs with responsibilities including system design and driving solutions to complex problems. A Bachelor's degree in Engineering is required...Remote work
- ...built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster... ...integrate data across the enterprise. What You’ll Do As the Principal AI Architect for Teradata AI Studio, you will define the technical architecture...PrincipalPermanent employmentFlexible hours
$139.4k - $230k
...Growing Team! As a member of AI and Emerging Technology... ...class solutions. As a Senior Architect, you will partner with Technology... ...technical depth in modern AI systems to design and deliver solutions... ...LLM integration, RAG pipelines, memory systems, and tool/function-...Work experience placementLocal area$82.3k - $220k
...seeking a motivated individual to join the analog mixed signal (AMS) ASIC team at Draper. The physical silicon design group is responsible... ...architecture and requirement specifications Contribute to system-level design Optimize hardware designs for performance, power, and...Full timeLocal areaRemote work$124.5k - $239k
...We are seeking a forward-thinking and customer-centric Solution Architect specializing in Customer Experience. The ideal candidate will possess... ...cutting-edge technologies such as Artificial Intelligence (AI), chatbots, and next-generation digital channels. This role will...PrincipalFull timeTemporary workPart timeWork experience placementShift work- ...development, corporate, and commercial operations. About the Role: We are seeking a Principal/Senior Systems Engineer , to join our team. This role will serve as the Technical Lead for Generative AI and Collaboration Tools. The Principal/Senior Systems Engineer will serve as...PrincipalTemporary workWork at officeAfternoon shift
$100k - $130k
...C-4 Analytics is seeking an AI Automation Specialist to develop AI solutions across Sales, Marketing, and Operations. The role requires a strong engineering mindset, experience in cross-functional system building, and the ability to translate business needs into effective...Remote work$163.8k - $257.4k
...ZoomInfo is seeking a Principal Software Engineer specializing in Applied AI to develop high-performance systems that enhance their B2B marketing platform. You'll work on projects involving large-scale data processing and cutting-edge AI techniques while collaborating...Principal- ...Principal Systems Analyst Anywhere Type: Contract Category: Business Analysis Industry: Financial Services Workplace Type:... ...advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring...PrincipalHourly payContract workLocal areaRemote work
$99.6k - $223.4k
...Job Description We are looking for smart systems software engineers with BS/MS/PhD in Computer Science to join the Exadata Team @ Oracle... ...group also keeps looking into leading edge technology like AI vector Database. As a member of the software engineering division...PrincipalTemporary workFlexible hours- ...team! Seeking a motivatedand dedicated hands-on SoC architect to help develop an ASIC for next-generationartificial intelligence... ...helping define the architecture for a ground-breaking AI accelerator. From memory system design to data-flow optimization, you will be part...
$169.4k - $279.6k
...Growing Team! As a member of AI and Emerging Technology... ...class solutions. As a Lead Architect, you will collaborate with senior... ...visionary thinking to architect AI systems that drive business value... ...selection and routing, RAG pipelines, memory systems, and tool/function-...Temporary workWork experience placementLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal ASIC Architect - Memory Systems & AI Interconnects. Be the first to apply!
- principal architect Boston, MA
- principal Boston, MA
- principal solutions consultant Boston, MA
- principal solution architect Boston, MA
- senior principal scientist Boston, MA
- associate principal Boston, MA
- principal consultant Boston, MA
- senior principal cloud computing engineer Boston, MA
- epic principal trainer Boston, MA
- principal applied scientist Boston, MA

