Principal ASIC Architect - Memory Systems & AI Interconnects
$200k - $300kCyberCoders
Job Description
Job Description
Principal ASIC Architect - Memory Systems & AI Interconnects
Job Title: Principal ASIC Architect - Memory Systems & AI Interconnects
Job Location: Santa Clara, CA or Boston, MA
Compensation: $200K - $300K plus bonus and equity
Requirements: ASIC Architecture, Memory Subsystems, CXL / NVLink / PCIe / UCIe/ UALink / RDMA, ARM CHI, AI Accelerators
Our company is working on solving the memory wall for AI. We develop memory-to-compute networking solutions for AI infrastructure, with a focus on high-bandwidth optical interconnects for XPU memory expansion.
Position Overview
We are seeking a Principal ASIC Architect to lead architecture and system-level design of memory subsystems and AI interconnects for next-generation AI accelerators and SoCs. The role combines deep expertise in memory systems architecture, interconnect protocols (CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, PCIe), and performance modeling to define high-bandwidth, low-latency solutions that scale across accelerator, host, and memory fabrics. You will partner with product teams, ASIC design, verification, firmware, and system integration to set architectural direction, drive technical tradeoffs, and ensure robust, high-performance solutions for ML hardware and AI workloads.
Key Responsibilities
- Define end-to-end memory and interconnect architectures for AI accelerators, including coherent and non-coherent fabrics, memory pooling, and tiered memory hierarchies.
- Lead specification and micro-architecture of interfaces and protocols (CXL, NVLink, UALink, RDMA, UCIe, PCIe, ARM CHI) and their integration into SoC designs and AI accelerators.
- Develop performance, latency, and bandwidth models and run system-level simulations to evaluate architectural trade-offs and inform design decisions.
- Collaborate with RTL, verification, firmware, and physical design teams to translate architecture into implementable hardware blocks and ensure design-for-performance.
- Drive cross-functional reviews with product management, systems teams, and external IP partners to align on interfaces, compliance, and interoperability.
- Architect solutions for memory subsystems including HBM, DDR, persistent memory, and CXL-attached devices, optimizing for AI/ML workloads and data movement patterns.
- Define verification and validation strategies for interconnect and memory subsystems, including test plans for coherence, error handling, flow control, and performance stress tests.
- Mentor and lead other architects and engineers, setting best practices, architectural patterns, and documentation for memory and interconnect subsystems.
- Keep abreast of industry trends, emerging protocols, and ecosystem developments; represent the company in standards and partner engagements as needed.
- Provide technical leadership during silicon bring-up, performance tuning, and system-level debugging to achieve target performance and reliability metrics.
Qualifications
- Bachelors degree in Electrical Engineering, Computer Engineering, Computer Science or related field; MS or PhD preferred.
- 10+ years of experience in ASIC/SoC architecture, with a significant focus on memory systems and interconnects for high-performance computing or AI.
- Deep working knowledge of CXL, NVLink, UALink, RDMA, ARM CHI, UCIe, and PCIe protocols and how they are used to build coherent and high-performance systems.
- Experience with memory subsystems (HBM, DDR, persistent memory), memory controller architecture, cache coherency and memory consistency models.
- Hands-on experience with AI accelerators, ML hardware architectures, dataflow characteristics of ML workloads, and integration of accelerators into SoCs.
- Strong background in performance modeling, system-level simulation, and latency/bandwidth analysis.
- Familiarity with RTL design concepts, verification methodologies, and silicon bring-up processes; ability to review microarchitecture and RTL for performance implications.
- Excellent written and verbal communication skills; proven ability to collaborate across teams and influence technical decisions.
- Proven track record of technical leadership, mentoring engineers, and delivering complex ASIC/SoC projects on schedule.
- Experience with scripting and modeling tools (Python, C/C++, SystemC, or equivalent) and performance analysis tools is a plus.
Benefits
- Competitive salary commensurate with experience including base salary, performance-based bonus, and early-stage equity grant
- Comprehensive benefits including health, dental, vision, and life insurance
- Well-equipped, sunny offices in Santa Clara, CA and Boston, MA
- Relocation assistance and visa sponsorship
- Perks include a daily lunch stipend, 401k match, and more
- A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing
- A cutting-edge AI startup is seeking a Senior R&D Engineer - System Architecture to design and optimize next-gen AI acceleration platforms. The role includes building prototypes and collaborating with cross-functional teams. Candidates should have a Master's or Ph.D. in...Suggested
$150k - $250k
...Senior / Principal Neuromorphic Systems Architect Cambridge, MA USA Flagship Labs 119... ...This is not a conventional AI accelerator role. We are seeking... ...(analog, mixed-signal, in-memory, or alternative substrates... ...hardware architectures (ASIC, FPGA, analog/mixed-signal...PrincipalFlexible hours- ...Principal Ai Platforms Architect Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver... ...groups to existing teams. Systems thinkers. They are well-versed in designing... ...automation, including the use of memory, agentic reflection, and task planning...Principal
- ...Band: 14 Remote Position: Yes Region: Americas Country: USA Summary This position is for a Senior Principal Engineer, AI/ML System Architect. As system architect,one will define the architecture of leading and competitive AI systems, lead new technologyresearch...PrincipalLocal areaRemote work
$204k - $348k
...Sr Principal/ Principal Software Engineer, AI Lab Execution System Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We are seeking a Senior... ...System of Record Team (SSR) builds the memory layer for Lila's operations. It answers two questions...PrincipalFull timeWork at officeLocal areaFlexible hours- A leading open-source software company is seeking a Principal Software Engineer to drive AI integration within their product portfolio. This role involves... ...design of scalable solutions, implementing Multi-Agent Systems, and collaborating with both internal teams and...Principal
$144k - $198k
...Twitter (X). Edge Compute Architect for Optical Systems The Analog Garage is... ...and compute architectures for ASIC- or FPGA-based near-sensor processing... ...streaming pipelines, memory and bandwidth budgets,... ...modern machine-learning and AI approaches in resource-constrained...Permanent employmentWork at officeShift workDay shift$197.3k - $313.7k
Salesforce is seeking a Principal Systems Engineer for the Agentforce for Supply Chain - Super Agent team in Boston, MA. As a senior technical... ...engineering experience, expertise in system design, and a strong AI-focus. You'll play a crucial part in improving system quality...Principal- ...solutions. Building the world's leading AI-powered, cloud-native products that shape... ...responsibilities Overview: The Business Systems team manages the backbone of our company’... ...teams. We are looking for a hands‑on AI Architect to deliver technical designs and implementations...Remote job
- ...scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI. What You’ll Do As the Principal AI Architect for Teradata AI Studio, you will define the technical architecture of Teradata's end-to-end AI development...PrincipalPermanent employmentFlexible hours
$124.5k - $239k
...We are seeking a forward-thinking and customer-centric Solution Architect specializing in Customer Experience. The ideal candidate will possess... ...cutting-edge technologies such as Artificial Intelligence (AI), chatbots, and next-generation digital channels. This role will...PrincipalFull timeTemporary workPart timeWork experience placementShift work$100k - $130k
...C-4 Analytics is seeking an AI Automation Specialist to develop AI solutions across Sales, Marketing, and Operations. The role requires a strong engineering mindset, experience in cross-functional system building, and the ability to translate business needs into effective...Remote work$99.6k - $223.4k
...Job Description We are looking for smart systems software engineers with BS/MS/PhD in Computer Science to join the Exadata Team @ Oracle... ...group also keeps looking into leading edge technology like AI vector Database. As a member of the software engineering division...PrincipalTemporary workFlexible hours$169.4k - $279.6k
...Growing Team! As a member of AI and Emerging Technology... ...class solutions. As a Lead Architect, you will collaborate with senior... ...visionary thinking to architect AI systems that drive business value... ...selection and routing, RAG pipelines, memory systems, and tool/function-...Temporary workWork experience placementLocal area- ...team! Seeking a motivatedand dedicated hands-on SoC architect to help develop an ASIC for next-generationartificial intelligence... ...helping define the architecture for a ground-breaking AI accelerator. From memory system design to data-flow optimization, you will be part...
- ...targets, including GPUs, FPGAs, ASICs, and edge SoCs. We support... ...transpilation tools enabled by AI and modern verification techniques... ...and deployment to embedded systems. In this role you will lead... ...repositories and CI/CD processes. Architect and implement complex...PrincipalRemote workRelocation packageFlexible hours
- ...Little About Us EDB provides a data and AI platform that enables organizations to... ...solutions enable customers to modernize legacy systems and break data silos while leveraging... ...s). To achieve this mission, you will architect and build data platform solutions that...PrincipalLocal areaRemote work
$250k
...for a technically exceptional SoC product solutions architect. Requires expertise across digital systems, industrial motion control, ethernet protocols,... ...guide future roadmaps. Title: Group Lead - Senior Principal Principal Architect Location: Work locations...PrincipalH1bRelocation package$160k - $175k
...Principal DevOps Architect Harvard Business Publishing (HBP) – the leading destination for innovative... ..., and repeatability across teams and systems. Champion Infrastructure as Code (IaC... .... ~ Experience leveraging AI coding assistants to develop and review...PrincipalSummer work1 day per week- ...Principal Security Engineer Liberate builds AI agents to automate manual tasks for the $2.7T insurance industry. We... ...to embed compliance controls into systems, CI pipelines, and defaults. Lead... ...new agent capabilities, tools, memory, tenant isolation, and data flows....PrincipalWork at officeShift work
- ...Reserve Bank of Boston The Federal Reserve System serves as the central bank of the United... ...Succeed Core Technical Leadership Architect high-throughput distributed payment... ...tracing, metrics, and real-time alerting AI-Native Payment Innovation Translate payment...PrincipalFull timeContract workTemporary workPart timeWork at officeLocal areaShift work
$140k - $180k
...Sr. Architect, AI Governance & Risk hatch I.T. is partnering with Babel Street to find a Sr. Architect, AI Governance & Risk. Please see... ...AI-enabled products—spanning LLM-powered workflows, agentic systems, and multimodal capabilities—are built and deployed with measurable...$168.15k - $277.35k
Red Hat, Inc. is seeking a Senior Principal Software Engineer in Boston to define technical strategy and enhance... ...will have extensive experience in backend systems and distributed systems, with a strong focus on AI-driven practices. Responsibilities include driving...Principal$178.88k - $320.65k
## Senior Principal Machine Learning Engineer, ML Platform and Systems ArchitectureApplylocations: Boston, MA, USA: AMER - United States - New York - Offsite/Home: AMER - United States - New Jersey - Offsite/Home: AMER - United States - Massachusetts - Boston - Drydock...PrincipalRemote work$150k - $250k
...Senior AI Architect Charlestown, Massachusetts Hybrid Full Time $150k - $250k A rapidly growing robotics and warehouse automation... ...AI Architect to lead the development of next-generation AI systems deployed on real-world robotic platforms. This role focuses on...Full time$178.88k - $320.65k
Autodesk, Inc. is seeking a Senior Principal Machine Learning Engineer to drive the technical strategy for large-scale ML platforms and systems. This role involves defining architecture, leading multi-team initiatives, and influencing standards across teams. The ideal...Remote job$134.9k - $237.3k
...and employees. Through Genesys Cloud, the AI-powered Experience Orchestration platform... ...the job is tagged to) The Genesys AI Architect is a senior presales AI specialist who... ...Responsibilities: Design end-to-end AI systems for customer experience use cases....Remote workWork from homeWorldwideFlexible hours$82.3k - $220k
...Senior Digital Engineering Solution Architect Draper is an independent, nonprofit research and development company headquartered in... ...seeking a Senior Digital Engineering Solution Architect to apply systems-thinking and advanced methodologies to developing solutions to...PrincipalFull timeLocal area$95k - $245k
...of ideas necessary for true innovation. For more information about Draper, visit Job Description Summary: As Principal Signal Processing System Engineer you will work directly with customers and program managers to create innovative, multidisciplinary technical...PrincipalFull timeLocal area$152k - $272.25k
...solve problems that matter. Autodesk is looking for a Principal ML Engineer, ML Platform and Systems Architecture to lead the design and evolution of... ...Autodesk products THE IDEAL CANDIDATE Is a strong architect and hands-on engineer Drives clarity and momentum...PrincipalRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal ASIC Architect - Memory Systems & AI Interconnects. Be the first to apply!
- principal applied scientist Boston, MA
- senior principal cloud computing engineer Boston, MA
- associate principal Boston, MA
- senior principal scientist Boston, MA
- principal consultant Boston, MA
- epic principal trainer Boston, MA
- principal data scientist Boston, MA
- principal cloud computing engineer Boston, MA
- principal architect Boston, MA
- principal scientist Boston, MA

