Principal AI Memory Systems Architect
$250k - $300kCyberCoders
Job Title: Principal AI Memory Systems Architect
Location: San Jose, CA or Irvine, CA
Compensation: $250K - $300K base plus equity
Requirements: AI Systems Architecture, Memory Hierarchy, CXL, HBM, AI Inference, Computer Architecture, Memory Disaggregation, Processing-in-Memory (PIM), GPU / Accelerator Architecture, ASIC/SoC Architecture
We are a leading provider of high-performance modular memory subsystems and next-generation storage-class memory solutions. We specialize in cutting-edge technologies that enable innovation in AI, cloud computing, and enterprise infrastructure. Our product portfolio includes DDR4/DDR5 DIMMs, NAND-based SSDs, and advanced interconnect technologies such as CXL and PCIe .
RoleThis is a senior architecture role for someone who understands how AI workloads translate into memory, bandwidth, latency, compute, interconnect, power, and system-level requirements. The role partners closely with the Chief AI Systems Architect, AI Product Strategist, AI Software Architect, and R&D teams to develop next-generation AI hardware and memory architectures.
We are particularly interested in investigating opportunities involving:- AI memory hierarchy evolution for larger models and context windows
- HBM, DDR, CXL, storage, and memory-tiering strategies
- Near-memory and processing-in-memory architectures
- Reducing data movement, power consumption, and system cost
- Expanding effective memory capacity and utilization
- New hardware architectures that outperform current AI systems
Key Responsibilities
- Architect AI systems, memory subsystems, and accelerator platforms
- Translate AI workload requirements into memory, compute, bandwidth, and latency specifications
- Design solutions leveraging HBM, DDR, CXL, memory pooling, disaggregation, caching, and persistent memory
- Analyze architectural tradeoffs across performance, power, capacity, area, and cost
- Characterize AI workloads including LLM inference, RAG, agentic AI, long-context inference, and KV-cache management
- Evaluate emerging technologies such as CXL memory expansion, memory compression, and near-memory computing
- Partner with software teams to optimize runtime, memory management, scheduling, and workload orchestration
- Build architectural models, simulations, benchmarks, and proof-of-concept prototypes
- Define product architectures, technical roadmaps, and system specifications
- Conduct technical due diligence on startups, technologies, IP, and M&A opportunities
Required Qualifications
- BS/MS in Electrical Engineering, Computer Engineering, Computer Science, or related field (PhD preferred)
- 10+ years in computer architecture, memory systems, semiconductor design, AI hardware, or related fields
- Deep expertise in memory hierarchy and computer architecture
- Experience with HBM, DDR, CXL, PCIe, UCIe, high-speed interconnects, and/or AI accelerators
- Strong understanding of AI/ML workloads and architectural tradeoffs
- Demonstrated experience developing complex semiconductor or computing systems
- Proven ability to translate system requirements into hardware architectures and specifications
Preferred Experience
- LLM inference and transformer architectures
- KV-cache systems and AI inference runtimes (e.g., vLLM)
- CUDA/GPU architectures
- CXL 2.x/3.x, memory pooling, and memory disaggregation
- Processing-in-memory and near-memory computing
- AI networking and storage-class memory
- ASIC/SoC architecture, RTL, and microarchitecture
- Hardware/software co-design and architectural modeling
- Edge AI systems
Benefits
- Vacation/PTO
- Medical
- Dental
- Vision
- Equity
- 401k w/ match
- ...Summary Celestica is seeking a Principal Hardware Systems Architect for Compute Platforms to provide senior... ...architecture and development of next-generation AI, accelerated computing, and high-... ...CPUs, GPUs and AI accelerators, memory, storage, PCIe/CXL, scale-up...PrincipalLocal area
- ...Description Axiado is an AI-enhanced security processor company... ...management of every digital system. The company was founded in 20... ...Summary As a Lead System Architect at Axiado, you will define the... ...chip interconnects (AXI/AHB), memory hierarchies, and standard I/O...Principal
$220k - $275k
...Job Description Job Description Principal System Architect - AI, SOCs At the forefront of the latest semiconductor technology & security we'... ...semiconductor environment. ~ Deep SoC knowledge: interconnects, memory hierarchies, and standard interfaces (PCIe, Ethernet,...PrincipalOngoing contractLocal areaWork visa$152k - $241.5k
...candidates with a track record of architecture development to join our memory system architecture team! This team drives memory system architecture... ...6, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to...SuggestedFull time$202k - $343k
...Technology is a world leader in innovating memory and storage solutions that accelerate... ...advance faster than ever.SummaryThe Principal System Architect is a senior technical individual... ...reliability domains. Have experience using AI.End-to-end technical ownership: Lead...PrincipalFull timeLocal areaImmediate start- ...CMOS nodes, enabling differentiated SoC architectures for AI/ML accelerators, hyperscale datacenter interconnects,... ...448G and beyond. Job Description We are seeking a Principal / Lead DSP & Systems Architect to own the architectural direction of ultra high-speed SerDes...PrincipalFull time
$221k - $301k
Principal Memory Design Engineer/Senior Technical ManagerCategoryChip DesignLocationSan Jose, CAExperienceMore... ...experienced memory design engineer to architect and define memory circuits. This role... ...(HPC) ASIC solutions for Data Center AI and Networking, as well as designing...PrincipalTemporary work$169.47k - $242.36k
...devices, non-silicon technology, have kept systems in sync, but they struggle in harsher,... ...applications, including high-growth ones in AI datacenters, automated driving,... ...visit: .Job SummaryThe Networking System Architect serves as the resident networking systems...Principal$100k
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use... ...of all seniorities.We are seeking a highly experienced Principal Power Systems Architect to define and deliver next-generation power systems for high...PrincipalPermanent employment- ...differentiated SoC architectures for AI/ML accelerators, hyperscale... ...Job Description We are seeking a Principal / Lead DSP & Systems Architect to own the architectural direction of... ...on micro-architecture, latency, and memory trade-offs. Silicon Bring-up &...Principal
$200k - $300k
Job Title: Principal ASIC Architect - Memory Systems & AI InterconnectsJob Location: Santa Clara, CA or Boston, MACompensation: $200K - $300K plus bonus and equityRequirements: ASIC Architecture, Memory Subsystems, CXL / NVLink / PCIe / UCIe/ UALink / RDMA, ARM CHI, AI...Principal$250k - $300k
...Job Description Job Description Principal AI Inference Systems Software Architect Job Title: Principal AI Inference Systems Software Architect Location... ..., KV Cache Management, Distributed Inference, Memory Systems Architecture, CXL, Hardware/Software Co-Design...PrincipalOngoing contractLocal area$155.8k - $224.2k
...digitizing, energy-intensive world. From revolutionizing power for AI-driven data centers to ensuring resilience for hospitals,... ...challenges of the 21st century. We are looking for a Principal IT Systems Architect to join our team in one of today’s most exciting technologies...PrincipalFull timeWork at officeWorldwide$180.64k - $261.58k
...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into... .... Learn more at and on LinkedIn and X.Principal Systems ArchitectData Center PlatformsThe OpportunityThe... ...is searching for a Principal Systems Architect to help define the next generation of...PrincipalPermanent employmentFull timeWork at officeDay shift$233.9k - $330.4k
...package design and heterogeneous system integration. Our substrates... ...Your Impact We are seeking a Principal Hardware Engineer to serve as... ...across customer architects, software teams, and Cisco cloud... ...protect organizations in the AI era - and beyond. We’ve been...PrincipalFull timeTemporary workWork at officeLocal areaFlexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture... ...RoleAs a Network Systems Architect, you will define the... ...and placement, data and memory movement, synchronization... ...experience, including principal-level technical ownership...Principal
$138.84k - $208k
...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling... ...to deliver high-performance response for thousands of daily system usersOwn and continuously improve the user-facing planning tools...PrincipalPermanent employmentFull timeInternshipWork from home- ...scientific discovery to powering AI and the technologies people... ...advance your career.THE ROLE: The Memory PHY team is seeking a seasoned... ...PHY Design Engineer to help architect and develop industry-leading... ...firmware, physical design, and system architecture teams. You will...Principal
$300k - $330k
...The Principal AI Solutions Architect at DataDirect Networks (DDN) combines technical mastery with outcome driven strategic selling/consulting delivering... ...), neural networks, RAG, Inference, and recommendation systems, to drive innovation and client success. Technical...PrincipalFull timeWork at office$141k - $319k
...Technology is a world leader in innovating memory and storage solutions that accelerate the... ...and advance faster than ever.As a Principal Business Development Manager for the Cloud... ...increasing growth opportunities across Cloud and AI, the structural definition, development,...PrincipalFull timeLocal areaImmediate startWorldwide$184k - $287.5k
...NVIDIA GPUs excel. We are seeking a GPU System Architect who will architect and design multi-GPU... ...next-generation datacenter platforms for AI and HPC. The architect in this role will... ...tightly couple GPU compute, high-bandwidth memory, in-package interconnects and GPU-to-GPU...Full timeWorldwide$152k - $241.5k
...We are now looking for a Senior GPU system and process scheduling architect! NVIDIA is seeking outstanding system... ...out from the crowd: Knowledge of memory isolation and security, firmware,... ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA...Full timeWork experience placement$205k - $308k
...Senior Solutions Architect, Alliances Everpure is building the Enterprise Data Cloud data unified, governed and understood as one intelligent system, and the foundation enterprises build AI on. No vendor delivers that alone. Our key Alliance Partners own software and...PrincipalFlexible hours$164k - $231k
...Principal Systems Engineering Architect MaxLinear is seeking a Principal Systems Engineering Architect to join our Analog Mixed Signal (AMS) group... ...subsystems, USB based connectivity, PCIe based interfaces, memory and networking interfaces, and serial and control...PrincipalWork experience placementLive in$90 per hour
...including highly reliable autonomy, over-the-air servicing and AI-backed applications. Ethernovia's co-founders are... ...from concept to silicon to the future of mobility. Principal Robotics Systems Architect Summary: Work closely with robotics customers and Ethernovia...PrincipalFlexible hours$323k
...are seeking an outstanding and visionary Lead Architect to drive the definition and exploration of next-generation system architectures and technologies that craft the... ...innovative solutions—from 3D integration and advance memory systems to emerging system-level paradigms....PrincipalWork at officeLocal areaRemote work- ...Title: Principal / Lead Wireless Communications System Architect Location: US, Europe Job Type: Full-Time / Consultant Industry: Wireless Communications... ...networks, LiDAR, radar, automotive networking, AI acceleration, imaging, and related high-growth markets...PrincipalFull time
$239.5k - $281.4k
...million-qubit, fault-tolerant quantum systems. Quantum computers harness the... ...the most advanced supercomputers or AI systems will never reach. Their impact... ...Come join us. Job Summary: Principal Power Systems Architect, Quantum Infrastructure will serve as...PrincipalFull timeRemote workShift work$163.2k - $264k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...is seeking an accomplished Principal AI-ML / Data Scientist to... ...engineering, turning massive system telemetry into autonomous, self... ...practices for prompt design, agent memory management, tool usage, and...PrincipalFull timeWork at office- ...infrastructure behind the AI-driven data economy.As... ..., every model, every system generates data that must... ...Senior Systems Architect is a senior technical leader... ...standards covering compute, memory, accelerators, firmware... ...Partner with the Principal Storage Architect to ensure...Temporary workWork at officeLocal areaImmediate startRemote workWorldwideFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Memory Systems Architect. Be the first to apply!
- technical architect San Jose, CA
- pega system architect San Jose, CA
- system architect San Jose, CA
- embedded systems architect San Jose, CA
- principal San Jose, CA
- principal architect San Jose, CA
- senior principal scientist San Jose, CA
- senior principal cloud computing engineer San Jose, CA
- principal cloud computing engineer San Jose, CA
- salesforce technical architect




