Founder Vice President, AI Inference Software
Confidential
Founder Vice President, AI Inference Software About the Company Confidential AI systems company Industry Information Technology and Services Type Privately Held, VC-backed About the Role The Company is seeking a senior software leader to take on a founder-level role in shaping the future of high-performance AI inference. The successful candidate will have the opportunity to influence architecture, team design, and product direction, with a focus on the transition from software acceleration to programmable hardware and future silicon. Key responsibilities include leading the architecture and delivery of a high-performance AI inference software stack, building and mentoring an elite engineering team, and partnering with founders to define the product roadmap and infrastructure strategy. The role also involves improving the efficiency of modern accelerator-based deployments, working with strategic customers, and establishing engineering standards in a fast-moving startup environment. Applicants for this role at the company should have a deep background in building or optimizing production-scale AI inference or distributed systems software, particularly in accelerator-rich environments. Strong technical skills in areas such as GPU programming, kernel optimization, and runtime design are essential. The ideal candidate will have a proven track record of delivering technically challenging platforms and experience in leading senior engineers. Familiarity with modern model serving patterns and performance measurement for large-scale AI workloads is also required. The role is suited to individuals who are comfortable in early-stage companies and can thrive in an environment of high ambiguity, where they will play a key role in defining the technical and operational playbook. Travel Percent Less than 10% Functions Engineering
$250k
...Edge AI is a production requirement across automotive, robotics... .... The Opportunity Build the software and tooling layer that makes... ...models are doing in the field. Inference latency, memory pressure,... ...at scale. We're Looking for Founders You've shipped inference at the...Software- The Opportunity FutureSight is seeking a Co-Founder & CEO to lead BidOps, an AI-native proposal-orchestration platform for architecture, engineering... ...is a leading venture studio that co-creates world-class software companies with values-driven entrepreneurs from inception...Software
$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good... ...Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large...SoftwareLocal area$229.9k - $262.4k
...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)Overview:At Capital One, we are creating responsible and reliable AI systems... ...Capital One.Design, develop, test, deploy, and support AI software components including foundation model training, large...SoftwareFull timePart timeLocal area$200k - $270k
Advisory Lead - Data/AI Due Diligence (Ref: 187830) Advisory... ...from Forsyth Barnes Vice President - Data & Technology & Co-Founder of The Table | Finalist... ...industries including healthcare, software, and financial services.... ...at Forsyth Barnes by 2x Inferred from the description for...SoftwareContract workRemote work- ...transaction volumes in the trillions. As a Vice President, Applied AI/ML Lead (Sr Level IC role) within... ...batch, near‑real‑time, and real‑time inference patterns. Develop state‑of‑the‑art... ...for real‑world deployment Strong software engineering skills in Python, with deep...Software
$185k - $264.5k
...founding role within the Technology, Data, AI and Ventures Organization. The team's... ...Intelligence - Platform Engineering is the founder and general manager of this platform engineering... ...spanning Data & Analytics Engineering, Software/AI Engineering, and ML Operations. You...SoftwareLocal area3 days per week$290k
Anthropic is seeking a Technical Program Manager for Cloud Inference in New York. You will drive coordination across multiple teams and manage the launch of AI models on cloud platforms such as Amazon Bedrock and Google Vertex AI. This role requires expertise in technical...- ...Vice President of Sales, AI/LLM About the Company An AI company focused on reducing LLM inference costs for enterprise customers. Industry Computer Software Type Privately Held About the Role The Company is seeking a Vice President of Sales with...Software
- ...About Beacon Software Beacon is acquiring and operating a portfolio of vertical SaaS companies... ..., CPMG, and the family offices of the founders of Stripe, DoorDash, and Ramp. About the... ...or developer tooling projects. How We Use AI in Our Hiring Process: To ensure transparency...Software
$170k - $200k
...The Role iCapital is seeking a Vice President Artificial Intelligence... ...delivery of production-grade AI systems that drive measurable... ...well-engineered, maintainable software, including adherence to software... ...-based systems (fine-tuning, inference optimization, prompt engineering...SoftwareFull timeWork at officeRemote work$224k
...Mongo is seeking a Head of AI Platform, GM to lead the development... ...for R&D, infrastructure/inference costs, and headcount planning.... ...Track Record: Experience as a founder, early-stage employee, or "0-to... ...experience building and launching a software product from scratch....SoftwareLocal areaRemote workWorldwideFlexible hoursDay shift$200k - $250k
At Wizard AI, we’re building the top-performing AI Shopping Agent that delivers the best... ...and scaling - for a custom-built inference platform powering a live conversational shopping... ...build observability and alerting. Apply software engineering best practices including...SoftwareRemote workFlexible hours- ...Get AI-powered advice on this job and more exclusive features.... ...seeking an experienced full stack Software Engineer to join the platform... ...dates back to 1890 when our founder, Thomas Foster, pioneered distance... ...at Penn Foster Group by 2x Inferred from the description for this...SoftwareFull timeInternshipRemote workFlexible hours
- Machine Learning Engineer - Inference / Serving Join to apply for the Machine Learning Engineer - Inference / Serving role at Yobi AI Overview Yobi is a rapidly growing Behavioral AI... ...and Information Technology. Software Development industry. #J-18808-Ljbffr...SoftwareFull timeRemote work
- Analytics Developer, Assistant Vice President (AVP) Data & Applications | New York, NY | Assistant... ...and builds analytics tools, AI-enabled solutions, and data infrastructure... ...expertise with technical capabilities in software development, data engineering, and analytics...Software
$150k
The Opportunity FutureSight is seeking a Co-Founder & CEO to lead Clairo, an AI-native clinical documentation compliance venture currently in build... ...The ROI case is compelling: at current price points, the software can quickly pay for itself by reducing manual auditing labour...Software$1,000 - $2,030 per month
The Opportunity FutureSight is seeking a Co-Founder & CEO to lead a new AI-native reverse logistics orchestration venture currently in build at our... ...is a leading venture studio that co-creates world-class software companies with values-driven entrepreneurs from inception...Software$200k - $260k
...building the future of generative AI infrastructure. Our platform... ...with the fastest and most scalable inference in the industry. We've been independently... ...field exposure, or technical founder. Demonstrated ability to build production software with customers, not just advise...Software$120k - $130k
...Get AI-powered advice on this job and more exclusive features. This range is provided... ...maintains, and improves business processes and software applications to meet user needs. They... ...of interviewing at Insight Global by 2x Inferred from the description for this job Medical...SoftwarePermanent employmentFull timeRemote work$175k - $220k
Fireworks AI is seeking a Software Engineer for their Cloud Infrastructure team in San Mateo, CA. This role involves architecting backend systems for scalable AI workloads and requires 5+ years of experience in cloud environments like AWS or GCP, with strong skills in...Software- ...Senior Applied AI Engineer Paramount Skydance Corp. is seeking a Senior Applied AI... ...solutions that transform how we deliver software quality across the enterprise. This role... ...Vertex AI Online Endpoints for real-time inference. Integrate Vertex AI with GCP services...Software
- ...Hi I’m Aidan, founder of Maple. At Maple, we’re building AI agents that work for local businesses: restaurants, salons... ...where they are, not where software wants them to be. We have many customers... ..., and highly optimized production inference. Lead evaluations, error analysis,...SoftwareWork at officeLocal area
- The Opportunity FutureSight is seeking a Co-Founder & CEO to lead HawkAI, an enterprise AI venture for US logistics brokerages, carriers, and warehouse operators... ...significantly faster call resolution AI supply chain software is growing at approximately 23% CAGR globally from 20...Software
- ...Vice President of Engineering, AI Strategy & Full Stack About the Company Expanding technology company in the grocery industry Industry Grocery Type... ...in Ruby or Ruby on Rails, at least 8 years of software engineering experience, and a proven track record of managing...Software
$200k - $300k
...leading conversation intelligence software for offline commerce. By... ..., and profitability. The Role AI Engineers at Rilla are redefining... ...data acquisition to real-time inference and user-facing chat... ...about your craft, think like a founder, and want to be on the frontier...SoftwareRelocation package- ...Vice President, Cloud Data Engineering About the Company Top-tier organization in the consumer services industry Industry Consumer... ...successful candidate will be responsible for driving excellence in software, data, and AI, and will play a pivotal role in inspiring and empowering...Software
$109k - $142k
...focused on developing scalable conversational AI platform and related infrastructure.... ...‑of‑the‑art LLMs and open frameworks for inference, and orchestration. Build continuous learning... ...that will help you excel 10+ years of software or AI engineering experience, with...SoftwareFlexible hours$405k
...create reliable, interpretable, and steerable AI systems. We want AI to be safe and... ...AI systems. About The Role Anthropic's Inference organization serves Claude to millions of... ...agnostic across all of them Have significant software engineering experience, with a strong...SoftwareVisa sponsorship$165.3k - $235k
...don't just adapt to change, we lead it. AI and digital innovation are transforming... ...Inviting applications for the role of Vice President Senior Solution Architect! We are seeking... ...Masters - Information Systems, Masters - Software Engineering Certifications AWS Certified...SoftwareRemote workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Founder Vice President, AI Inference Software. Be the first to apply!
- vice president operations manager New York, NY
- vp of accounting New York, NY
- vice president technical operations New York, NY
- vice president legal New York, NY
- senior vice president of operations New York, NY
- vice president project management New York, NY
- vp customer service New York, NY
- vp support New York, NY
- vice president of accounting New York, NY
- vice president program management New York, NY

