Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founder Vice President, AI Inference Software

Confidential

Founder Vice President, AI Inference Software About the Company Confidential AI systems company Industry Information Technology and Services Type Privately Held, VC-backed About the Role The Company is seeking a senior software leader to take on a founder-level role in shaping the future of high-performance AI inference. The successful candidate will have the opportunity to influence architecture, team design, and product direction, with a focus on the transition from software acceleration to programmable hardware and future silicon. Key responsibilities include leading the architecture and delivery of a high-performance AI inference software stack, building and mentoring an elite engineering team, and partnering with founders to define the product roadmap and infrastructure strategy. The role also involves improving the efficiency of modern accelerator-based deployments, working with strategic customers, and establishing engineering standards in a fast-moving startup environment. Applicants for this role at the company should have a deep background in building or optimizing production-scale AI inference or distributed systems software, particularly in accelerator-rich environments. Strong technical skills in areas such as GPU programming, kernel optimization, and runtime design are essential. The ideal candidate will have a proven track record of delivering technically challenging platforms and experience in leading senior engineers. Familiarity with modern model serving patterns and performance measurement for large-scale AI workloads is also required. The role is suited to individuals who are comfortable in early-stage companies and can thrive in an environment of high ambiguity, where they will play a key role in defining the technical and operational playbook. Travel Percent Less than 10% Functions Engineering

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Founder Vice President, AI Inference Software in New York, NY vacancy
  • $250k

     ...Edge AI is a production requirement across automotive, robotics...  .... The Opportunity Build the software and tooling layer that makes...  ...models are doing in the field. Inference latency, memory pressure,...  ...at scale. We're Looking for Founders You've shipped inference at the... 
    Software

    Forum Ventures

    New York, NY
    1 day ago
  • The Opportunity FutureSight is seeking a Co-Founder & CEO to lead BidOps, an AI-native proposal-orchestration platform for architecture, engineering...  ...is a leading venture studio that co-creates world-class software companies with values-driven entrepreneurs from inception... 
    Software

    FutureSight Inc.

    New York, NY
    4 days ago
  • $197.3k - $225.1k

     ...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good...  ...Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large... 
    Software
    Local area

    Capital One National Association

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform)Overview:At Capital One, we are creating responsible and reliable AI systems...  ...Capital One.Design, develop, test, deploy, and support AI software components including foundation model training, large... 
    Software
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    14 hours ago
  • $200k - $270k

    Advisory Lead - Data/AI Due Diligence (Ref: 187830) Advisory...  ...from Forsyth Barnes Vice President - Data & Technology & Co-Founder of The Table | Finalist...  ...industries including healthcare, software, and financial services....  ...at Forsyth Barnes by 2x Inferred from the description for... 
    Software
    Contract work
    Remote work

    Forsyth Barnes

    New York, NY
    14 hours ago
  •  ...transaction volumes in the trillions. As a Vice President, Applied AI/ML Lead (Sr Level IC role) within...  ...batch, near‑real‑time, and real‑time inference patterns. Develop state‑of‑the‑art...  ...for real‑world deployment Strong software engineering skills in Python, with deep... 
    Software

    JPMorgan Chase & Co.

    New York, NY
    1 day ago
  • $185k - $264.5k

     ...founding role within the Technology, Data, AI and Ventures Organization. The team's...  ...Intelligence - Platform Engineering is the founder and general manager of this platform engineering...  ...spanning Data & Analytics Engineering, Software/AI Engineering, and ML Operations. You... 
    Software
    Local area
    3 days per week

    New York Life

    New York, NY
    2 days ago
  • $290k

    Anthropic is seeking a Technical Program Manager for Cloud Inference in New York. You will drive coordination across multiple teams and manage the launch of AI models on cloud platforms such as Amazon Bedrock and Google Vertex AI. This role requires expertise in technical... 

    Anthropic

    New York, NY
    1 day ago
  •  ...Vice President of Sales, AI/LLM About the Company An AI company focused on reducing LLM inference costs for enterprise customers. Industry Computer Software Type Privately Held About the Role The Company is seeking a Vice President of Sales with... 
    Software

    Confidential

    New York, NY
    4 days ago
  •  ...About Beacon Software Beacon is acquiring and operating a portfolio of vertical SaaS companies...  ..., CPMG, and the family offices of the founders of Stripe, DoorDash, and Ramp. About the...  ...or developer tooling projects. How We Use AI in Our Hiring Process: To ensure transparency... 
    Software

    BEACON SOFTWARE COMPANY

    New York, NY
    2 days ago
  • $170k - $200k

     ...The Role iCapital is seeking a Vice President Artificial Intelligence...  ...delivery of production-grade AI systems that drive measurable...  ...well-engineered, maintainable software, including adherence to software...  ...-based systems (fine-tuning, inference optimization, prompt engineering... 
    Software
    Full time
    Work at office
    Remote work

    iCapital

    New York, NY
    4 days ago
  • $224k

     ...Mongo is seeking a Head of AI Platform, GM to lead the development...  ...for R&D, infrastructure/inference costs, and headcount planning....  ...Track Record: Experience as a founder, early-stage employee, or "0-to...  ...experience building and launching a software product from scratch.... 
    Software
    Local area
    Remote work
    Worldwide
    Flexible hours
    Day shift

    MongoDB

    New York, NY
    2 days ago
  • $200k - $250k

    At Wizard AI, we’re building the top-performing AI Shopping Agent that delivers the best...  ...and scaling - for a custom-built inference platform powering a live conversational shopping...  ...build observability and alerting. Apply software engineering best practices including... 
    Software
    Remote work
    Flexible hours

    Wizard

    New York, NY
    14 hours ago
  •  ...Get AI-powered advice on this job and more exclusive features....  ...seeking an experienced full stack Software Engineer to join the platform...  ...dates back to 1890 when our founder, Thomas Foster, pioneered distance...  ...at Penn Foster Group by 2x Inferred from the description for this... 
    Software
    Full time
    Internship
    Remote work
    Flexible hours

    Penn Foster Group

    New York, NY
    14 hours ago
  • Machine Learning Engineer - Inference / Serving Join to apply for the Machine Learning Engineer - Inference / Serving role at Yobi AI Overview Yobi is a rapidly growing Behavioral AI...  ...and Information Technology. Software Development industry. #J-18808-Ljbffr... 
    Software
    Full time
    Remote work

    Yobi AI

    New York, NY
    3 days ago
  • Analytics Developer, Assistant Vice President (AVP) Data & Applications | New York, NY | Assistant...  ...and builds analytics tools, AI-enabled solutions, and data infrastructure...  ...expertise with technical capabilities in software development, data engineering, and analytics... 
    Software

    TSG Risk Management

    New York, NY
    14 hours ago
  • $150k

    The Opportunity FutureSight is seeking a Co-Founder & CEO to lead Clairo, an AI-native clinical documentation compliance venture currently in build...  ...The ROI case is compelling: at current price points, the software can quickly pay for itself by reducing manual auditing labour... 
    Software

    FutureSight Inc.

    New York, NY
    4 days ago
  • $1,000 - $2,030 per month

    The Opportunity FutureSight is seeking a Co-Founder & CEO to lead a new AI-native reverse logistics orchestration venture currently in build at our...  ...is a leading venture studio that co-creates world-class software companies with values-driven entrepreneurs from inception... 
    Software

    FutureSight Inc.

    New York, NY
    3 days ago
  • $200k - $260k

     ...building the future of generative AI infrastructure. Our platform...  ...with the fastest and most scalable inference in the industry. We've been independently...  ...field exposure, or technical founder. Demonstrated ability to build production software with customers, not just advise... 
    Software

    AI Chopping Block, Inc.

    New York, NY
    14 hours ago
  • $120k - $130k

     ...Get AI-powered advice on this job and more exclusive features. This range is provided...  ...maintains, and improves business processes and software applications to meet user needs. They...  ...of interviewing at Insight Global by 2x Inferred from the description for this job Medical... 
    Software
    Permanent employment
    Full time
    Remote work

    Insight Global

    New York, NY
    14 hours ago
  • $175k - $220k

    Fireworks AI is seeking a Software Engineer for their Cloud Infrastructure team in San Mateo, CA. This role involves architecting backend systems for scalable AI workloads and requires 5+ years of experience in cloud environments like AWS or GCP, with strong skills in... 
    Software

    Fireworks AI

    New York, NY
    1 day ago
  •  ...Senior Applied AI Engineer Paramount Skydance Corp. is seeking a Senior Applied AI...  ...solutions that transform how we deliver software quality across the enterprise. This role...  ...Vertex AI Online Endpoints for real-time inference. Integrate Vertex AI with GCP services... 
    Software

    Paramount Global Services

    New York, NY
    4 days ago
  •  ...Hi I’m Aidan, founder of Maple. At Maple, we’re building AI agents that work for local businesses: restaurants, salons...  ...where they are, not where software wants them to be. We have many customers...  ..., and highly optimized production inference. Lead evaluations, error analysis,... 
    Software
    Work at office
    Local area

    Maple Services

    New York, NY
    2 days ago
  • The Opportunity FutureSight is seeking a Co-Founder & CEO to lead HawkAI, an enterprise AI venture for US logistics brokerages, carriers, and warehouse operators...  ...significantly faster call resolution AI supply chain software is growing at approximately 23% CAGR globally from 20... 
    Software

    FutureSight Inc.

    New York, NY
    4 days ago
  •  ...Vice President of Engineering, AI Strategy & Full Stack About the Company Expanding technology company in the grocery industry Industry Grocery Type...  ...in Ruby or Ruby on Rails, at least 8 years of software engineering experience, and a proven track record of managing... 
    Software

    Confidential

    New York, NY
    14 hours ago
  • $200k - $300k

     ...leading conversation intelligence software for offline commerce. By...  ..., and profitability. The Role AI Engineers at Rilla are redefining...  ...data acquisition to real-time inference and user-facing chat...  ...about your craft, think like a founder, and want to be on the frontier... 
    Software
    Relocation package

    Rilla

    New York, NY
    2 days ago
  •  ...Vice President, Cloud Data Engineering About the Company Top-tier organization in the consumer services industry Industry Consumer...  ...successful candidate will be responsible for driving excellence in software, data, and AI, and will play a pivotal role in inspiring and empowering... 
    Software

    Confidential

    New York, NY
    1 day ago
  • $109k - $142k

     ...focused on developing scalable conversational AI platform and related infrastructure....  ...‑of‑the‑art LLMs and open frameworks for inference, and orchestration. Build continuous learning...  ...that will help you excel 10+ years of software or AI engineering experience, with... 
    Software
    Flexible hours

    MSCI

    New York, NY
    5 days ago
  • $405k

     ...create reliable, interpretable, and steerable AI systems. We want AI to be safe and...  ...AI systems. About The Role Anthropic's Inference organization serves Claude to millions of...  ...agnostic across all of them Have significant software engineering experience, with a strong... 
    Software
    Visa sponsorship

    Menlo Ventures

    New York, NY
    2 days ago
  • $165.3k - $235k

     ...don't just adapt to change, we lead it. AI and digital innovation are transforming...  ...Inviting applications for the role of Vice President Senior Solution Architect! We are seeking...  ...Masters - Information Systems, Masters - Software Engineering Certifications AWS Certified... 
    Software
    Remote work
    Flexible hours
    Shift work

    Genpact

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founder Vice President, AI Inference Software. Be the first to apply!