Vice President

Vice President of AI Inference, Software

About the Company

Confidential venture-backed AI systems company building high-performance inference software and future hardware.

Industry
Computer Software

Type
Privately Held, VC-backed

About the Role

The Company is seeking a Vice President of AI Inference, Software to take on a pivotal role in the development of high-performance inference systems. The successful candidate will be responsible for leading the architecture and delivery of a robust AI inference software stack, with a focus on runtime, scheduling, serving, and system optimization. This is a unique opportunity to have a founder-level influence on technical strategy, team design, and product direction, particularly in the transition from software acceleration to programmable hardware and future silicon. The role demands a leader with deep technical judgment, a strong leadership presence, and the ability to build and mentor an elite engineering team while remaining hands-on with code and technical design. Applicants for this role at the company should have a proven track record in building or optimizing production-scale AI inference or distributed systems software, particularly in accelerator-rich environments. A strong systems background in areas such as GPU programming, kernel optimization, and runtime design is essential. The ideal candidate will have experience in shipping technically challenging platforms with a focus on performance, reliability, and scalability, and be adept at leading senior engineers and attracting top talent. Familiarity with modern model serving patterns and performance measurement for large-scale AI workloads is also required. The role is suited to individuals who are comfortable in an early-stage company environment and can thrive in a setting where ambiguity is high and leaders are expected to help define the operational playbook.

Functions

• Engineering