Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Memory Systems Architect

$250k - $300k

CyberCoders

Principal AI Memory Systems Architect

Job Title: Principal AI Memory Systems Architect
Location: San Jose, CA or Irvine, CA
Compensation: $250K - $300K base plus equity
Requirements: AI Systems Architecture, Memory Hierarchy, CXL, HBM, AI Inference, Computer Architecture, Memory Disaggregation, Processing-in-Memory (PIM), GPU / Accelerator Architecture, ASIC/SoC Architecture

Company Brief

We are a leading provider of high-performance modular memory subsystems and next-generation storage-class memory solutions. We specialize in cutting-edge technologies that enable innovation in AI, cloud computing, and enterprise infrastructure. Our product portfolio includes DDR4/DDR5 DIMMs, NAND-based SSDs, and advanced interconnect technologies such as CXL and PCIe .

Role

This is a senior architecture role for someone who understands how AI workloads translate into memory, bandwidth, latency, compute, interconnect, power, and system-level requirements. The role partners closely with the Chief AI Systems Architect, AI Product Strategist, AI Software Architect, and R&D teams to develop next-generation AI hardware and memory architectures.

We are particularly interested in investigating opportunities involving:
  • AI memory hierarchy evolution for larger models and context windows
  • HBM, DDR, CXL, storage, and memory-tiering strategies
  • Near-memory and processing-in-memory architectures
  • Reducing data movement, power consumption, and system cost
  • Expanding effective memory capacity and utilization
  • New hardware architectures that outperform current AI systems

Key Responsibilities

  • Architect AI systems, memory subsystems, and accelerator platforms
  • Translate AI workload requirements into memory, compute, bandwidth, and latency specifications
  • Design solutions leveraging HBM, DDR, CXL, memory pooling, disaggregation, caching, and persistent memory
  • Analyze architectural tradeoffs across performance, power, capacity, area, and cost
  • Characterize AI workloads including LLM inference, RAG, agentic AI, long-context inference, and KV-cache management
  • Evaluate emerging technologies such as CXL memory expansion, memory compression, and near-memory computing
  • Partner with software teams to optimize runtime, memory management, scheduling, and workload orchestration
  • Build architectural models, simulations, benchmarks, and proof-of-concept prototypes
  • Define product architectures, technical roadmaps, and system specifications
  • Conduct technical due diligence on startups, technologies, IP, and M&A opportunities

Required Qualifications

  • BS/MS in Electrical Engineering, Computer Engineering, Computer Science, or related field (PhD preferred)
  • 10+ years in computer architecture, memory systems, semiconductor design, AI hardware, or related fields
  • Deep expertise in memory hierarchy and computer architecture
  • Experience with HBM, DDR, CXL, PCIe, UCIe, high-speed interconnects, and/or AI accelerators
  • Strong understanding of AI/ML workloads and architectural tradeoffs
  • Demonstrated experience developing complex semiconductor or computing systems
  • Proven ability to translate system requirements into hardware architectures and specifications

Preferred Experience

  • LLM inference and transformer architectures
  • KV-cache systems and AI inference runtimes (e.g., vLLM)
  • CUDA/GPU architectures
  • CXL 2.x/3.x, memory pooling, and memory disaggregation
  • Processing-in-memory and near-memory computing
  • AI networking and storage-class memory
  • ASIC/SoC architecture, RTL, and microarchitecture
  • Hardware/software co-design and architectural modeling
  • Edge AI systems

#Enghp

Benefits

  • Vacation/PTO
  • Medical
  • Dental
  • Vision
  • Equity
  • 401k w/ match



     
- For this position, you must be currently authorized to work in the United States without the need for sponsorship for a non-immigrant visa. CyberCoders will consider for Employment in the City of Los Angeles qualified Applicants with Criminal Histories in a manner consistent with the requirements of the Los Angeles Fair Chance Initiative for Hiring (Ban the Box) Ordinance.This job was first posted by CyberCoders on 10/16/2026 and applications will be accepted on an ongoing basis until the position is filled or closed. Everforth CyberCoders is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Our hiring process includes AI screening for keywords and minimum qualifications, and a virtual recruiter as part of the application process. A human recruiter reviews all results. Everforth CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. Everforth CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at ****** to make arrangements.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal AI Memory Systems Architect in San Jose, CA vacancy
  •  ...Summary Celestica is seeking a Principal Hardware Systems Architect for Compute Platforms to provide senior...  ...architecture and development of next-generation AI, accelerated computing, and high-...  ...CPUs, GPUs and AI accelerators, memory, storage, PCIe/CXL, scale-up... 
    Principal
    Local area

    Celestica International LP

    San Jose, CA
    1 day ago
  •  ...Description Axiado is an AI-enhanced security processor company...  ...management of every digital system. The company was founded in 20...  ...Summary  As a Lead System Architect at Axiado, you will define the...  ...chip interconnects (AXI/AHB), memory hierarchies, and standard I/O... 
    Principal

    Axiado

    San Jose, CA
    26 days ago
  • $220k - $275k

     ...Job Description Job Description Principal System Architect - AI, SOCs At the forefront of the latest semiconductor technology & security we'...  ...semiconductor environment.  ~ Deep SoC knowledge: interconnects, memory hierarchies, and standard interfaces (PCIe, Ethernet,... 
    Principal
    Ongoing contract
    Local area
    Work visa

    CyberCoders

    San Jose, CA
    a month ago
  • $152k - $241.5k

     ...candidates with a track record of architecture development to join our memory system architecture team! This team drives memory system architecture...  ...6, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    12 hours ago
  • $202k - $343k

     ...Technology is a world leader in innovating memory and storage solutions that accelerate...  ...advance faster than ever.SummaryThe Principal System Architect is a senior technical individual...  ...reliability domains. Have experience using AI.End-to-end technical ownership: Lead... 
    Principal
    Full time
    Local area
    Immediate start

    Micron

    San Jose, CA
    3 days ago
  •  ...CMOS nodes, enabling differentiated SoC architectures for AI/ML accelerators, hyperscale datacenter interconnects,...  ...448G and beyond. Job Description We are seeking a Principal / Lead DSP & Systems Architect to own the architectural direction of ultra high-speed SerDes... 
    Principal
    Full time

    omnidesigntech

    Milpitas, CA
    4 days ago
  • $221k - $301k

    Principal Memory Design Engineer/Senior Technical ManagerCategoryChip DesignLocationSan Jose, CAExperienceMore...  ...experienced memory design engineer to architect and define memory circuits. This role...  ...(HPC) ASIC solutions for Data Center AI and Networking, as well as designing... 
    Principal
    Temporary work

    MediaTek

    San Jose, CA
    4 days ago
  • $169.47k - $242.36k

     ...devices, non-silicon technology, have kept systems in sync, but they struggle in harsher,...  ...applications, including high-growth ones in AI datacenters, automated driving,...  ...visit: .Job SummaryThe Networking System Architect serves as the resident networking systems... 
    Principal

    SiTime

    Santa Clara, CA
    4 days ago
  • $100k

    Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use...  ...of all seniorities.We are seeking a highly experienced Principal Power Systems Architect to define and deliver next-generation power systems for high... 
    Principal
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    3 days ago
  •  ...differentiated SoC architectures for AI/ML accelerators, hyperscale...  ...Job Description We are seeking a Principal / Lead DSP & Systems Architect to own the architectural direction of...  ...on micro-architecture, latency, and memory trade-offs. Silicon Bring-up &... 
    Principal

    Omni Design Technologies

    Milpitas, CA
    19 days ago
  • $200k - $300k

    Job Title: Principal ASIC Architect - Memory Systems & AI InterconnectsJob Location: Santa Clara, CA or Boston, MACompensation: $200K - $300K plus bonus and equityRequirements: ASIC Architecture, Memory Subsystems, CXL / NVLink / PCIe / UCIe/ UALink / RDMA, ARM CHI, AI... 
    Principal

    CyberCoders

    Santa Clara, CA
    4 days ago
  • $250k - $300k

     ...Job Description Job Description Principal AI Inference Systems Software Architect Job Title: Principal AI Inference Systems Software Architect Location...  ..., KV Cache Management, Distributed Inference, Memory Systems Architecture, CXL, Hardware/Software Co-Design... 
    Principal
    Ongoing contract
    Local area

    CyberCoders

    San Jose, CA
    29 days ago
  • $155.8k - $224.2k

     ...digitizing, energy-intensive world. From revolutionizing power for AI-driven data centers to ensuring resilience for hospitals,...  ...challenges of the 21st century. We are looking for a Principal IT Systems Architect to join our team in one of today’s most exciting technologies... 
    Principal
    Full time
    Work at office
    Worldwide

    Bloom Energy

    San Jose, CA
    12 hours ago
  • $180.64k - $261.58k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into...  .... Learn more at and on LinkedIn and X.Principal Systems ArchitectData Center PlatformsThe OpportunityThe...  ...is searching for a Principal Systems Architect to help define the next generation of... 
    Principal
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    1 day ago
  • $233.9k - $330.4k

     ...package design and heterogeneous system integration. Our substrates...  ...Your Impact We are seeking a Principal Hardware Engineer to serve as...  ...across customer architects, software teams, and Cisco cloud...  ...protect organizations in the AI era - and beyond. We’ve been... 
    Principal
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    12 hours ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture...  ...RoleAs a Network Systems Architect, you will define the...  ...and placement, data and memory movement, synchronization...  ...experience, including principal-level technical ownership... 
    Principal

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $138.84k - $208k

     ...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling...  ...to deliver high-performance response for thousands of daily system usersOwn and continuously improve the user-facing planning tools... 
    Principal
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    12 hours ago
  •  ...scientific discovery to powering AI and the technologies people...  ...advance your career.THE ROLE: The Memory PHY team is seeking a seasoned...  ...PHY Design Engineer to help architect and develop industry-leading...  ...firmware, physical design, and system architecture teams. You will... 
    Principal

    AMD

    Santa Clara, CA
    2 days ago
  • $300k - $330k

     ...The Principal AI Solutions Architect at DataDirect Networks (DDN) combines technical mastery with outcome driven strategic selling/consulting delivering...  ...), neural networks, RAG, Inference, and recommendation systems, to drive innovation and client success. Technical... 
    Principal
    Full time
    Work at office

    DataDirect Networks Inc

    Santa Clara, CA
    3 days ago
  • $141k - $319k

     ...Technology is a world leader in innovating memory and storage solutions that accelerate the...  ...and advance faster than ever.As a Principal Business Development Manager for the Cloud...  ...increasing growth opportunities across Cloud and AI, the structural definition, development,... 
    Principal
    Full time
    Local area
    Immediate start
    Worldwide

    Micron

    San Jose, CA
    2 days ago
  • $184k - $287.5k

     ...NVIDIA GPUs excel. We are seeking a GPU System Architect who will architect and design multi-GPU...  ...next-generation datacenter platforms for AI and HPC. The architect in this role will...  ...tightly couple GPU compute, high-bandwidth memory, in-package interconnects and GPU-to-GPU... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    9 days ago
  • $152k - $241.5k

     ...We are now looking for a Senior GPU system and process scheduling architect! NVIDIA is seeking outstanding system...  ...out from the crowd: Knowledge of memory isolation and security, firmware,...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA... 
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    12 days ago
  • $205k - $308k

     ...Senior Solutions Architect, Alliances Everpure is building the Enterprise Data Cloud data unified, governed and understood as one intelligent system, and the foundation enterprises build AI on. No vendor delivers that alone. Our key Alliance Partners own software and... 
    Principal
    Flexible hours

    Pure Storage

    Santa Clara, CA
    2 days ago
  • $164k - $231k

     ...Principal Systems Engineering Architect MaxLinear is seeking a Principal Systems Engineering Architect to join our Analog Mixed Signal (AMS) group...  ...subsystems, USB based connectivity, PCIe based interfaces, memory and networking interfaces, and serial and control... 
    Principal
    Work experience placement
    Live in

    MaxLinear (US)

    San Jose, CA
    1 day ago
  • $90 per hour

     ...including highly reliable autonomy, over-the-air servicing and AI-backed applications.   Ethernovia's co-founders are...  ...from concept to silicon to the future of mobility. Principal Robotics Systems Architect Summary: Work closely with robotics customers and Ethernovia... 
    Principal
    Flexible hours

    Ethernovia, Inc.

    San Jose, CA
    1 day ago
  • $323k

     ...are seeking an outstanding and visionary Lead Architect to drive the definition and exploration of next-generation system architectures and technologies that craft the...  ...innovative solutions—from 3D integration and advance memory systems to emerging system-level paradigms.... 
    Principal
    Work at office
    Local area
    Remote work

    ARM

    San Jose, CA
    12 hours ago
  •  ...Title: Principal / Lead Wireless Communications System Architect Location: US, Europe Job Type: Full-Time / Consultant Industry: Wireless Communications...  ...networks, LiDAR, radar, automotive networking, AI acceleration, imaging, and related high-growth markets... 
    Principal
    Full time

    omnidesigntech

    Milpitas, CA
    4 days ago
  • $239.5k - $281.4k

     ...million-qubit, fault-tolerant quantum systems.  Quantum computers harness the...  ...the most advanced supercomputers or AI systems will never reach. Their impact...  ...Come join us.   Job Summary: Principal Power Systems Architect, Quantum Infrastructure will serve as... 
    Principal
    Full time
    Remote work
    Shift work

    PsiQuantum

    Milpitas, CA
    1 day ago
  • $163.2k - $264k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything...  ...is seeking an accomplished Principal AI-ML / Data Scientist to...  ...engineering, turning massive system telemetry into autonomous, self...  ...practices for prompt design, agent memory management, tool usage, and... 
    Principal
    Full time
    Work at office

    PaloAlto Networks

    Santa Clara, CA
    4 days ago
  •  ...infrastructure behind the AI-driven data economy.As...  ..., every model, every system generates data that must...  ...Senior Systems Architect is a senior technical leader...  ...standards covering compute, memory, accelerators, firmware...  ...Partner with the Principal Storage Architect to ensure... 
    Temporary work
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Western Digital

    San Jose, CA
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Memory Systems Architect. Be the first to apply!