Senior Director, AI Interface Architecture

About the role

We are seeking a Senior Director, AI Interface Architecture to solve the system-level interconnection challenges that connect XPUs (NPU/GPU/custom silicon) into working AI infrastructure. This role owns how compute elements are wired, networked, and orchestrated together at node, rack, and cluster scale so that large-scale LLM training and inference run efficiently across the platform.

Base salary range

Range is $230,000 - $315,000 a year. The base salary offer will depend on factors such as education, experience, training, skills, qualifications, and location. This position is also eligible for a discretionary bonus, equity and a full range of medical and other benefits.

Why Credo

• Purpose: We invest in what matters. From meaningful-future shaping projects to competitive compensation, we empower you to grow your career while making a lasting impact.
• People: Connection starts within. We collaborate, celebrate wins, and create an environment where everyone can do their best work.
• Possibilities: Our belief shapes what’s next. Our technology powers the most reliable and energy-efficient connections around the world – and our team powers new products and markets that come next.

Basic Qualifications

• 15+ years in systems/interconnect architecture or AI/HPC infrastructure, including 5+ years in a technical leadership role.
• Solid understanding of NPU, GPU, and CPU architectures
• Strong grasp of DP, TP, PP, EP, and hybrid parallelism strategies and how they drive interconnect and communication patterns.
• Familiarity with leading open LLM architectures (e.g., Kimi, Llama, DeepSeek, Mixtral, Qwen) and their impact on system-level communication.
• Experience solving rack-, node-, and cluster-scale interconnection and workload-partitioning problems.
• Understanding of LLM deployment methods across training and inference from a networking/system-integration perspective.
• Strong cross-functional leadership and communication skills.
• Bachelor's degree in Computer Engineering, EE, CS, or related field required; Master's or PhD preferred.

Preferred Qualifications

• Experience at a silicon vendor or hyperscaler solving system/network integration for accelerator hardware at scale.
• Contributions to open-source AI infrastructure projects (Megatron-LM, DeepSpeed, vLLM, SGLang).
• Experience with next-gen interconnect standards (UALink, UEC).

Responsibilities

• Own the interconnection architecture linking XPUs across node, rack, and cluster boundaries - not the internal design of the NPUs/GPUs/CPUs themselves.
• Solve communication and topology bottlenecks that arise from all kinds of parallelism strategies during distributed LLM training and inference.
• Define how the AI software stack (PyTorch, Megatron, DeepSpeed, vLLM, SGLang) interfaces with the underlying interconnect and fabric, ensuring workloads map cleanly onto the network topology.
• Work with silicon, networking, and software teams to specify interconnect fabric requirements and resolve integration issues between compute nodes.
• Track leading open LLM architectures to anticipate how model structure will stress interconnect and system topology.
• Lead and mentor a team of architects focused on system interconnection; represent this strategy to leadership and partners.

About Credo

Credo’s mission is to transform connectivity at scale through fast, reliable, and energy-efficient system solutions. Our high-speed copper and optical interconnect products deliver industry-leading power and performance at up to 1.6T to meet the ever-expanding data infrastructure demands of AI.

Our product portfolio includes ZeroFlap (ZF) Active Electrical Cables (AECs) and ZF optical transceivers, OmniConnect memory solutions, and a suite of retimers and DSPs for optical and copper Ethernet and PCIe, all leveraging the PILOT diagnostic and analytics software platform. Credo innovations enable our customers to connect the systems that connect the world.

Credo is committed to creating an inclusive environment for all employees and welcome applicants from diverse backgrounds without regard to race, color, religion, gender, sex, gender identity, sexual orientation, pregnancy, marital status, national origin, ethnicity, genetic information, age, disability, veteran status, or any other legally protected basis. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email View email address on click.appcast.io.