Founder Vice President, AI Inference Software

Founder Vice President, AI Inference Software

About the Company

Confidential AI systems company

Industry
Information Technology and Services

Type
Privately Held, VC-backed

About the Role

The Company is seeking a senior software leader to take on a founder-level role in shaping the future of high-performance AI inference. The successful candidate will have the opportunity to influence architecture, team design, and product direction, with a focus on the transition from software acceleration to programmable hardware and future silicon. Key responsibilities include leading the architecture and delivery of a high-performance AI inference software stack, building and mentoring an elite engineering team, and partnering with founders to define the product roadmap and infrastructure strategy. The role also involves improving the efficiency of modern accelerator-based deployments, working with strategic customers, and establishing engineering standards in a fast-moving startup environment. Applicants for this role at the company should have a deep background in building or optimizing production-scale AI inference or distributed systems software, particularly in accelerator-rich environments. Strong technical skills in areas such as GPU programming, kernel optimization, and runtime design are essential. The ideal candidate will have a proven track record of delivering technically challenging platforms and experience in leading senior engineers. Familiarity with modern model serving patterns and performance measurement for large-scale AI workloads is also required. The role is suited to individuals who are comfortable in early-stage companies and can thrive in an environment of high ambiguity, where they will play a key role in defining the technical and operational playbook.

Travel Percent
Less than 10%

Functions

• Engineering