Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Founder Vice President, AI Inference Software

Confidential

Founder Vice President, AI Inference Software About the Company Confidential AI systems company Industry Information Technology and Services Type Privately Held, VC-backed About the Role The Company is seeking a senior software leader to take on a founder-level role in shaping the future of high-performance AI inference. The successful candidate will have the opportunity to influence architecture, team design, and product direction, with a focus on the transition from software acceleration to programmable hardware and future silicon. Key responsibilities include leading the architecture and delivery of a high-performance AI inference software stack, building and mentoring an elite engineering team, and partnering with founders to define the product roadmap and infrastructure strategy. The role also involves improving the efficiency of modern accelerator-based deployments, working with strategic customers, and establishing engineering standards in a fast-moving startup environment. Applicants for this role at the company should have a deep background in building or optimizing production-scale AI inference or distributed systems software, particularly in accelerator-rich environments. Strong technical skills in areas such as GPU programming, kernel optimization, and runtime design are essential. The ideal candidate will have a proven track record of delivering technically challenging platforms and experience in leading senior engineers. Familiarity with modern model serving patterns and performance measurement for large-scale AI workloads is also required. The role is suited to individuals who are comfortable in early-stage companies and can thrive in an environment of high ambiguity, where they will play a key role in defining the technical and operational playbook. Travel Percent Less than 10% Functions Engineering

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Founder Vice President, AI Inference Software in New York, NY vacancy
  • $250k

    Edge AI is a production requirement across automotive, robotics...  .... The Opportunity Build the software and tooling layer that makes...  ...are doing in the field. Inference latency, memory pressure, thermal...  ...at scale. We're Looking for Founders You've shipped inference at the... 
    Software

    Forum Ventures

    New York, NY
    2 days ago
  • The Opportunity FutureSight is seeking a Co-Founder & CEO to lead BidOps, an AI-native proposal-orchestration platform for architecture, engineering...  ...is a leading venture studio that co-creates world-class software companies with values-driven entrepreneurs from inception... 
    Software

    FutureSight

    New York, NY
    2 days ago
  •  ...Vice President, Applied AI/ML Lead As part of the Commercial & Investment Bank, JPMorgan Chase Payments...  ...batch, near-real-time, and real-time inference patterns. Develop state-of-the-art...  ...real-world deployment Strong software engineering skills in Python, with... 
    Software

    Chase

    New York, NY
    1 day ago
  • $197.3k - $225.1k

    Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good...  ...One. Design, develop, test, deploy, and support AI software components including foundation model training, large language... 
    Software
    Full time
    Part time
    Local area
    Immediate start

    Capital One

    New York, NY
    1 day ago
  •  ...Tech Lead, Data & Inference Engineer New York, New York, United States Or refer someone...  ...agency with a specialized vertical in Applied AI, Machine Learning, and Data Science. We...  .... We collaborate directly with Founders, CTOs, and Heads of AI in those themes who... 
    Suggested
    Full time

    Catalyst Labs, LLC

    New York, NY
    1 day ago
  • $180k - $250k

     ...Engineering Artemis is building the future of AI-driven defense - helping companies detect...  ...’s most prominent Operators. Our founders, Shachar (ex-Palo Alto Networks, AWS, Demisto...  ...Our exceptionally strong team includes software engineers, AI researchers, security... 
    Software
    Full time

    Theory Ventures

    New York, NY
    3 days ago
  • Head of Inference Full Time, Remote, NYC Preferred (US Based) About...  ...operating experience to give founders the strategic clarity and hands...  .... About Stealth Edge AI Co Co‑founded by Montauk Capital...  ...infrastructure designs Define the software access layer architecture and... 
    Software
    Full time
    Remote work
    Shift work

    Montauk Capital

    New York, NY
    2 days ago
  •  ...frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic...  ...), especially how they influence latency and throughput of inference. ~ Strong understanding or working experience with distributed... 
    Software
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Cohere

    New York, NY
    15 hours ago
  • $160k - $240k

     ...Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref # 10050779 Description & Requirements Our team: Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference... 
    Software
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $300k

     ...create reliable, interpretable, and steerable AI systems. We want AI to be safe and...  ...beneficial AI systems. About The Role Our Inference team builds and maintains the critical systems...  ...customers. Qualifications Significant software engineering experience, particularly with... 
    Software
    Worldwide

    Menlo Ventures

    New York, NY
    3 days ago
  • $290k

    Anthropic is seeking a Technical Program Manager for Cloud Inference in New York. You will drive coordination across multiple teams and manage the launch of AI models on cloud platforms such as Amazon Bedrock and Google Vertex AI. This role requires expertise in technical... 

    Anthropic

    New York, NY
    4 days ago
  • $300k

     ...Staff + Sr. Software Engineer, Inference San Francisco, CA | New York City, NY | Seattle, WA About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society... 
    Software
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    anthropic

    New York, NY
    2 days ago
  • $83k - $170k

     ...Vice President, Full-Stack Engineer At BNY, our culture allows us to run our company better...  ...Every day, our teams harness cutting-edge AI and breakthrough technologies to...  ...Typically, 5–9 years of hands-on experience in software development required with WebLogic Portal... 
    Software
    Temporary work
    Work experience placement
    Remote work
    Worldwide
    Flexible hours

    BNY

    Brooklyn, NY
    2 days ago
  •  ...Machine Learning Engineer - Inference / Serving Join to apply for the Machine Learning...  ...Engineer - Inference / Serving role at Yobi AI Overview Yobi is a rapidly growing...  ...Engineering and Information Technology. Software Development industry. #J-18808-Ljbffr
    Software
    Full time
    Remote work

    Yobi AI

    New York, NY
    15 hours ago
  • $200k - $250k

     ...At Wizard AI, we’re building the top-performing AI Shopping Agent that delivers the...  ...optimization and scaling – for a custom-built inference platform powering a live conversational...  ...build observability and alerting. Apply software engineering best practices including testing... 
    Software
    Remote work
    Flexible hours

    Wizard

    New York, NY
    3 days ago
  • $50 - $55 per hour

     ...chances of interviewing at Collette by 2x Inferred from the description for this job Medical...  ...Developer jobs in United States . Jr. Software/Application (ServiceNow) Developer- Secret...  ...insights directly into each article, started with the help of AI. #J-18808-Ljbffr... 
    Software
    Full time
    Local area
    Remote work

    Collette

    New York, NY
    3 days ago
  • $148.45k

     ...enterprise-level loyalty programs, subscription gifting models, and AI-driven marketing automation strategies. Lead initiatives to...  ...to the company's patent portfolio. Establish best practices for software security, regulatory compliance (GDPR, CCPA, PCI-DSS), and AI ethics... 
    Software
    Internship
    Work at office

    Gesture

    New York, NY
    15 hours ago
  •  ...Data Scientist Vice President Bring your expertise to JPMorgan Chase. As part of Risk Management...  ...(POCs) and deployable models using AI/ML techniques, algorithms and other statistical...  ...~ Hands-on professional experience in software development especially with analytical &... 
    Software

    Chase

    Jersey City, NJ
    2 days ago
  • $70 per hour

     ...Founding CEO for a B2B WealthTech advisor AI copilot. The new venture is...  ...venture studio that co-creates world-class software companies with values‑driven entrepreneurs...  ...from inception to exit. We are a team of founders, operators and designers with experience... 
    Software

    FutureSight

    New York, NY
    2 days ago
  • $150k - $210k

     ...Firm to manage technology risk through modern, cloud-aligned and AI-informed security practices. CDRR executes first line of defence...  ...ecosystem integrations). Experience with SCCM/Intune for software deployment and endpoint management, and security logging/analytics... 
    Software
    Temporary work

    Morgan Stanley

    New York, NY
    4 days ago
  • $1,000 - $2,030 per month

    The Opportunity FutureSight is seeking a Co-Founder & CEO to lead a new AI-native reverse logistics orchestration venture currently in build at our...  ...is a leading venture studio that co‑creates world‑class software companies with values‑driven entrepreneurs from inception... 
    Software

    FutureSight

    New York, NY
    2 days ago
  • $203k - $399k

     ...Mongo is seeking a Head of AI Platform, GM to lead the development...  ...for R&D, infrastructure/inference costs, and headcount planning....  ...Track Record: Experience as a founder, early-stage employee, or "0-to...  ...experience building and launching a software product from scratch.... 
    Software
    Local area
    Remote work
    Worldwide
    Flexible hours
    Day shift

    MongoDB

    New York, NY
    15 hours ago
  •  ...Get AI-powered advice on this job and more exclusive features....  ...seeking an experienced full stack Software Engineer to join the platform...  ...dates back to 1890 when our founder, Thomas Foster, pioneered distance...  ...at Penn Foster Group by 2x Inferred from the description for this... 
    Software
    Full time
    Internship
    Remote work
    Flexible hours

    Penn Foster Group

    New York, NY
    3 days ago
  • $102k - $250k

     ...Senior Vice President, Full-Stack Engineer At BNY, our culture allows us to run our company...  ...Every day, our teams harness cutting-edge AI and breakthrough technologies to...  ...and build flexible, scalable trade-flow software capable of handling diverse client-side... 
    Software
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours
    Shift work

    BNY Mellon

    New York, NY
    4 days ago
  •  ...Analytics Engineer, Assistant Vice President (AVP)Data & Applications | New York, NY | Assistant...  ...and builds analytics tools, AI-enabled solutions, and data infrastructure...  ...expertise with technical capabilities in software development, data engineering, and analytics... 
    Software

    TSG Risk Management

    New York, NY
    2 days ago
  •  ...Senior Applied AI Engineer Paramount Skydance Corp. is seeking a Senior Applied AI...  ...solutions that transform how we deliver software quality across the enterprise. This role...  ...Vertex AI Online Endpoints for real-time inference. Integrate Vertex AI with GCP services... 
    Software

    Paramount Global Services

    New York, NY
    2 days ago
  •  ...Front-End Developer - Senior Vice President We provide Recruitment and Staffing services to...  ...testable, efficient code. Integrate software components into a fully functional software...  .... ~ Familiarity with one or more AI vibe-coding and coding-assist tools (e.g... 
    Software
    Work experience placement

    VTekis Consulting LLC

    New York, NY
    4 days ago
  •  ...dependable problem-solving skills. Crafting software solutions through an understanding of...  ...interviewing at TSV Consulting LLC by 2x Inferred from the description for this job Medical...  ...insights directly into each article, started with the help of AI. #J-18808-Ljbffr... 
    Software
    Full time
    Remote work

    TSV Consulting LLC

    New York, NY
    3 days ago
  •  ...Programming well-designed, testable, efficient code. Integrate software components into a fully functional software system. Consults...  ...and attention to detail. ~ Familiarity with one or more AI vibe-coding and coding-assist tools (e.g., GitHub Copilot, Cursor... 
    Software
    Work experience placement

    VTekis Consulting LLP

    New York, NY
    2 days ago
  • $200k - $250k

     ...Advisory Lead – Data/AI Due Diligence (Ref: 187830) Advisory Lead – Data...  ...the job poster from Forsyth Barnes Vice President - Data & Technology & Co-Founder of The Table | Finalist at the Women...  ...across industries including healthcare, software, and financial services. This is a... 
    Software
    Contract work
    Remote work

    Forsyth Barnes

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Founder Vice President, AI Inference Software. Be the first to apply!