Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Chief Architect, AI Infrastructure & Memory Systems

$300k - $350k

CyberCoders

Job Description

Job Description

Chief Architect, AI Infrastructure & Memory Systems

Job Title: Chief Architect, AI Infrastructure & Memory Systems
Location: San Jose, CA or Irvine, CA
Compensation: $300K - $350K base plus equity
Requirements: Chief Architect / Sr. Fellow, AI Infrastructure, Memory Systems, AI Inference, PCIe/UCIe/CXL, GPU / AI Accelerator Architecture, DDR/HBM/RDIMM, AI Data Center Systems Architecture

Company Brief  

We are a technology company developing advanced memory and computing solutions for data center, server, and AI infrastructure markets. Our customers and partners include leading server OEMs, hyperscalers, cloud service providers, and technology companies.

As AI workloads rapidly reshape data center architecture, we are expanding beyond traditional memory products to develop next-generation solutions at the intersection of AI, memory, compute, interconnect, storage, data movement, and power efficiency.

We are looking for an exceptional Chief AI Systems Architect / Senior Fellow to help define the future by leading exploration and architecture of next-generation memory-centric computing platforms for AI inference, including HBM, DDR, CXL, memory pooling, KV-cache infrastructure, near-memory computing, AI accelerators, and heterogeneous compute.

Role  

This is a highly technical role for an individual who combines deep understanding of AI workloads with strong computer architecture and systems expertise. The successful candidate will identify emerging bottlenecks in AI infrastructure, develop new product concepts, evaluate emerging technologies, and lead the architecture of solutions that address real customer problems.

We are particularly interested in opportunities involving:
  • AI Data Center infrastructure
  • Memory hierarchy and data movement
  • HBM, DDR, CXL, PCIe and advanced interconnects
  • AI context memory and KV-cache infrastructure
  • Memory pooling and disaggregation
  • Near-memory and processing-in-memory architectures
  • AI accelerator and heterogeneous-computing architectures
  • Memory compression and intelligent data placement
  • AI infrastructure power and thermal efficiency
  • Edge AI and inference
  • Advanced chiplet and silicon technologies

    The role is for someone who can challenge conventional architectures and turn emerging technology trends into compelling products.

Key Responsibilities

Technology and Product Vision

  • Identify major technical and architectural bottlenecks emerging in AI data centers and inference systems.
  • Develop a deep understanding of how LLMs, generative AI, agentic AI, and other AI workloads are evolving.
  • Anticipate how workload changes will affect memory capacity, bandwidth, latency, power, networking, storage, and system architecture.
  • Generate and evaluate new product concepts that address these emerging problems.
  • Assess build-versus-buy-versus-partner opportunities for emerging technologies.

AI Systems Architecture

  • Architect next-generation AI computing and memory systems spanning compute, memory, interconnect, storage, and software.
  • Explore alternative memory hierarchies involving HBM, HBF, DDR, CXL memory, persistent memory, NVMe, and emerging memory technologies.
  • Analyze the architectural implications of KV cache, long-context inference, model weights, activations, embeddings, and other AI data structures.
  • Evaluate opportunities for memory pooling, disaggregation, intelligent caching, compression, prefetching, and data placement.
  • Investigate near-memory computing, processing-in-memory, chiplets, heterogeneous computing, and other approaches for reducing data movement and energy consumption.
  • Develop system-level architectures and performance models to quantify bandwidth, latency, capacity, throughput, power, and cost.

Product Definition and R&D Leadership

  • Translate architectural concepts into technically and commercially viable product requirements.
  • Work closely with semiconductor, hardware, firmware, software, and systems engineering teams to develop prototypes and proof-of-concept platforms.
  • Define performance targets, benchmarks, interfaces, workloads, and validation methodologies.
  • Lead technical feasibility studies and architecture trade-off analysis.
  • Guide R&D teams through architecture definition, prototyping, and product development.
  • Work with customers and partners to validate problems, requirements, and potential solutions.

Industry and Technology Intelligence

  • Track developments from hyperscalers, AI accelerator companies, semiconductor vendors, startups, universities, and standards organizations.
  • Monitor developments in AI models, inference frameworks, accelerators, memory technologies, CXL, UCIe, chiplets, and related technologies.
  • Identify technologies, startups, patents, research programs, and companies that could provide strategic value.
  • Evaluate potential acquisition, licensing, or technology partnership opportunities.

Customer and Executive Engagement

  • Engage directly with senior technical personnel at hyperscalers, OEMs, cloud service providers, semiconductor companies, and strategic partners.
  • Understand customers' current and emerging infrastructure problems and translate those requirements into product opportunities.
  • Present technology strategies, architecture proposals, and product concepts to executive management and engineering leadership.
  • Represent the company at major industry conferences and technical forums.

Qualifications

  • Bachelor's or Master's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related technical field. PhD preferred.
  • 10+ years of experience in computer architecture, semiconductor systems, AI infrastructure, memory systems, or a closely related field.
  • Deep understanding of modern AI/ML workloads, particularly LLM inference and large-scale AI systems.
  • Strong understanding of computer architecture and memory hierarchies.
  • Experience with one or more of HBM, DDR, CXL, PCIe, UCIe, chiplets, accelerator architectures, or high-speed interconnects.
  • Demonstrated experience developing or architecting complex hardware or software systems.
  • Ability to reason quantitatively about bandwidth, latency, capacity, power, performance, and cost.
  • Ability to move from an abstract industry problem to a concrete system architecture and product concept.
  • Excellent communication skills and ability to communicate complex technical concepts to both engineers and business executives.

Highly Desired Experience with several of the following:

  • LLM inference architecture
  • KV-cache management
  • GPU/AI accelerator architecture
  • CXL 2.0/3.0 memory pooling and disaggregation
  • Processing-in-memory and near-memory computing
  • Memory compression or intelligent memory management
  • Distributed inference
  • Edge AI and low-power inference
  • Performance modeling and workload characterization
  • ASIC/SoC architecture

    #Enghp

Benefits

  • Vacation/PTO
  • Medical
  • Dental
  • Vision
  • Equity
  • 401k w/ match

- For this position, you must be currently authorized to work in the United States without the need for sponsorship for a non-immigrant visa. CyberCoders will consider for Employment in the City of Los Angeles qualified Applicants with Criminal Histories in a manner consistent with the requirements of the Los Angeles Fair Chance Initiative for Hiring (Ban the Box) Ordinance.This job was first posted by CyberCoders on 10/08/2026 and applications will be accepted on an ongoing basis until the position is filled or closed. Everforth CyberCoders is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Our hiring process includes AI screening for keywords and minimum qualifications, and a virtual recruiter as part of the application process. A human recruiter reviews all results. Everforth CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. Everforth CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at ****** to make arrangements.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Chief Architect, AI Infrastructure & Memory Systems in San Jose, CA vacancy
  • $200k - $300k

    Job Title: Principal ASIC Architect - Memory Systems & AI InterconnectsJob Location: Santa Clara, CA or Boston, MACompensation: $200K - $300K...  ...develop memory-to-compute networking solutions for AI infrastructure, with a focus on high-bandwidth optical interconnects for... 
    Suggested

    CyberCoders

    Santa Clara, CA
    15 hours ago
  • $200k - $250k

    Job Title: Performance Modeling Architect - AI Memory SystemsJob Location: Santa Clara, CA, or Boston, MACompensation: $200K - $250K base DOE plus 25% bonus and meaningful equityRequirements: AI Memory Systems, Performance Modeling, Memory Expansion (NICs, SmartNICs, CXL... 
    Suggested
    Night shift

    CyberCoders

    Santa Clara, CA
    4 days ago
  • $350k

    Job Title: VP of SoC Architecture (AI & Memory Systems)Job Location: Santa Clara, CA, or Boston...  ....Growing the underlying team of SoC architects, system architects, and performance modeling...  ...memory capacity bottlenecks for AI infrastructures.QualificationsBachelor's (Master's or... 
    Suggested

    CyberCoders

    Santa Clara, CA
    3 days ago
  • $177k - $387k

     ...Micron’s DRAM strategy by collaborating with industry architects and researchers to optimize AI workloads. The ideal candidate will possess a Bachelor'...  ...least 12 years of engineering experience, focusing on memory architectures. The company offers a competitive salary... 
    Suggested

    Micron Technology, Inc.

    San Jose, CA
    1 day ago
  • $100k

     ...industry on cutting-edge AI technology,...  ...High-Speed Communication Architect to define the next generation...  ...-scale AI accelerator systems. This role owns the...  ...GPUs, CPUs, switches, memory systems, and network interfaces...  ...toward production AI infrastructure.Compensation for all... 
    Suggested
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago
  •  ...DescriptionWD is building the infrastructure behind the AI-driven data economy.As AI...  ..., every model, every system generates data that must be...  ...individual contributor in memory design. Owns end-to-end product...  ...IC development; 5+ as architect or chief engineer2+ memory products... 
    Temporary work
    Immediate start
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Western Digital

    San Jose, CA
    1 day ago
  • $184k - $287.5k

     ...modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time...  ...at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $240k - $333k

     ...collaboration with internal AI/ML research teams, software/systems teams, and customers,...  ...across process nodes, memory subsystems (e.g., HBM/DRAM...  ...lead product or chip architect across multiple generations...  ...Google’s technical infrastructure and Cloud AI customers.In... 
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • NVIDIA is seeking a Senior SoC Product Architect, Memory Ecosystem, to drive external memory strategy across DRAM and non-volatile memories...  ...latency, power, and cost targets for future NVIDIA SoCs and systems. The role requires deep memory expertise, strong collaboration... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  •  ...Vice President, AI Infrastructure Product Strategy About the Company Leading provider of high-performance modular memory subsystems and next-generation storage-class memory solutions...  ..., data centers, computing systems, product management, or product strategy... 

    Confidential

    San Jose, CA
    4 days ago
  • $272k - $431.25k

     ...orbital roadmap to speed up AI adoption. We are looking for a strong technical architect to own end-to-end system software architecture for...  ...behaviors — ECC handling, memory scrubbing, latch-up mitigation...  ...experience in building AI infrastructure and systems in space. Proven... 
    Full time
    Work experience placement
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...within NVIDIA’s Networking Systems & Software Architecture group is solving some of AI’s hardest infrastructure problems. The team builds systems...  .... This Principal Architect role leads the research agenda...  ...understanding of computer architecture, memory hierarchies, DMA engines,... 
    Full time
    Remote work

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

     ...world-class computer architect to contribute to the development...  ...performance computing systems, with a focus on...  ...and analyzing memory systems architecture to...  ...outside partners on system infrastructure. What we want to see:1...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $132.4k - $251.6k

     ...team:We are seeking an experienced AI Architect to define and guide the architecture...  ..., applications, APIs, platforms, infrastructure, and enterprise systems.Partner with business and technology...  ...orchestration, tool use, state and memory, human-in-the-loop workflows, evaluation... 
    Permanent employment
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Raytheon

    San Jose, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is hiring an AI Hardware Architect to analyze and architect the next...  ...for the rapidly growing AI infrastructure market. If you have knowledge...  ...groundbreaking GPU and CPU systems. Understand them across a...  ...power management, security, memory management and other SOC level... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $75 per hour

     ...17/ SF_OP_208146-18 Role: AI Architect Location: Charlotte NC (3...  ...on architecting multi-agent systems, supervisory AI workflows with...  ...planning, reasoning, memory, orchestration, and tool-calling...  ...Lead implementation of CI/CD, Infrastructure as Code, observability,... 
    Work at office

    PeopleNTech LLC

    Santa Clara, CA
    2 days ago
  • $320k

     ...defines the platforms that power AI, graphics, and accelerated...  .... As a Senior SoC Product Architect, Memory Ecosystem, you will drive...  ...requirements, translating SoC and system needs into clear, data‑...  ...accelerated computing. Today, our AI infrastructure powers global intelligence,... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $160.4k - $208.4k

     ...a career opportunity for a Chief Architect experience to join our team...  ...States.Perficient is a global AI-first consultancy. Our team...  ...background, but will have expert infrastructure architecture, client...  ...thought leadership, mentorship, systems analysis, architecture, design... 
    Full time
    Work at office
    Local area
    2 days per week
    3 days per week

    Perficient

    San Jose, CA
    4 days ago
  • $185.5k - $344.5k

     ...make an impact on the world of technology.Design Engineering Architect – Systems and InterfacesSan JoseJob Description:The SSG Central Applications...  ...enable applications such as machine learning, edge AI, radar, audio, speech, and vision. Leading semiconductor companies... 
    Full time
    Work experience placement

    Cadence Design Systems

    San Jose, CA
    2 days ago
  •  ...Job Summary In this AI/ML HBF ASIC Architecture position,...  ...Storage Solutions based advanced system architectures for Sandisk's...  ...generation products. As an ASIC Architect you will drive new...  ...with optimized high bandwidth memory hierarchy for multi-trillion parameter... 

    Compunnel

    Milpitas, CA
    1 day ago
  • $143k - $398k

     ...Technology is a world leader in innovating memory and storage solutions that accelerate the...  ...the future of packaging of complex memory systems! Our Package pathfinding and Architecture...  ...generation memory systems from datacenter to edge-AI. You will leverage understanding of end to... 
    Full time
    Local area
    Immediate start

    Micron

    San Jose, CA
    4 days ago
  • $184k - $287.5k

    We are now looking for a Senior GPU Memory Architect.NVIDIA is seeking a motivated architect to work with a team in solving complex...  ...’s world-changing solutions for autonomous vehicles, AI, gaming, mobile systems.What you will be doing:Developing architecture and micro... 
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

    We are looking for a Principal Architect for SoC and System performance modelling.The NVIDIA Architecture...  ...tests, test plans, and testing infrastructure for new architectures/features and code...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA... 
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago
  • $232k - $368k

    NVIDIA builds the silicon behind AI, accelerated computing, and...  .... We identify, own, and drive system-level co-design ideas. We start...  ...Management and Performance Architect who operates at the ambiguous...  ...flow optimizations, HSIO, and memory power management.A power management... 
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    2 days ago
  • $210k - $255k

     ...Supermicro is hiring a Principal AI Safety Engineer in Technology...  ...run agentic AI on Supermicro infrastructure in named enterprises and in...  ...layer into the design before systems are quoted or shipped....  ...work with Supermicro solution architects, factory engineering, cloud and... 
    Worldwide

    Super Micro Computer

    San Jose, CA
    1 day ago
  •  ...scientific discovery to powering AI and the technologies people...  ...are seeking an experienced SoC Architect to define next-generation SoCs...  ...spanning compute, memory, bandwidth, interconnect, data...  ...alternatives and helping translate system-level requirements into executable... 
    Local area
    Night shift

    AMD

    San Jose, CA
    15 hours ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing....  ...processing with NVIDIA? As a Senior Architect in Data Processing Systems for Analytics and Data Intelligence (...  ...-offs: compute, IO provisioning, memory subsystem development, network topology... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $201.3k - $352.3k

     ...meaningful work. Today, ServiceNow is the AI control tower for business...  ...tool selection, context management, memory, critique, reflection, adaptation,...  ...production.• Partner across Agentic Systems, Search, Relevance, ML Infrastructure, Product, and Security to connect agent... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    3 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of...  ...: We are seeking a Robotics AI Architect to define and scale next-generation...  ...and orchestration models Memory and dataflow efficiency Inter... 
    Full time

    AMD

    San Jose, CA
    13 days ago
  • $140k - $310k

     ...develop the advanced memory solutions powering everything...  ...technology to massive AI data centers. With...  ...we build the critical infrastructure of the digital...  ...Onsite Job Title: HBM Architect - Memory Design Office...  ...HBM product assembly system analysis. Experience... 
    Full time
    Work at office
    Local area
    Flexible hours

    SK hynix America

    San Jose, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Chief Architect, AI Infrastructure & Memory Systems. Be the first to apply!