Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Director - AI Infrastructure Platforms (On-Prem)

TwinThread LLC

Drive the product strategy and delivery of enterprise-grade AI infrastructure platforms that power model training, inference, and experimentation at JPMorganChase. As Product Director for AI Infrastructure Platforms, you will set the vision, strategy, and direction for the platform's inferencing product area. The platform is an integrated suite of specialized AI infrastructure for model training, inference, and experimentation—consisting of compute, storage, network, and management services—with offerings that span public cloud, on-premises, Neo Cloud, and edge. You will define and deliver the go-to-market strategy, drive platform adoption across lines of business, and advance product capabilities toward an enterprise-scale AI Factory. Success in this role requires navigating rapid AI hardware evolution, complex multi-vendor ecosystems, and the regulatory demands of a highly regulated global financial institution—delivering infrastructure for high-value AI use cases. Job Responsibilities Own the product area vision, strategy, roadmap, execution, and business growth targets—with a strategic mandate to mature the platform toward an enterprise-scale AI Factory. Maximize returns on hardware capital investments spanning compute, accelerator, storage, networking, and orchestration layers—with direct accountability for driving platform adoption and utilization to realize the full value of the firm's AI infrastructure commitments. Serve as the key decision-maker for product prioritization and strategic direction across the AI Infrastructure product area—balancing competing demands, investment tradeoffs, and delivery sequencing across multiple products. Cultivate and manage senior stakeholder relationships to ensure alignment on vision, strategy, roadmap, and scope across the AI Infrastructure product area. Analyze market trends and interpret competitive signals to inform investment decisions, drive capital allocation, and direct vendor strategy across hyperscale providers (e.g. AWS, Azure, GCP), Neo Clouds (e.g. CoreWeave, Lambda Labs, Fluidstack, Runpod), edge platforms (e.g. Nvidia Jetson, HPE Edgeline, Dell Edge Gateway), and serverless GPU providers (e.g. Baseten, Together AI, Fireworks, Nebius). Identify and prioritize target market segments, qualify demand signals, and align product capabilities to address unmet customer needs across lines of business. Establish product metrics that quantify business value realization—spanning investment performance, cohort adoption, and platform utilization. Lead and develop a team of Product Managers and Senior Product Associates, providing strategic guidance and ensuring effective execution across the product area. Lead cross-functional teams and harness AI to drive efficiency and scalability in product management functions—enabling rapid prototyping, improving responsiveness to market demands, and amplifying productivity across a complex, matrixed environment. Required Qualifications, Capabilities, and Skills 8+ years in technical product management or equivalent expertise delivering technology products at production scale. Extensive experience in high-performance compute, GPU-accelerated, data center, or AI infrastructure. Deep knowledge of the AI infrastructure stack across compute, accelerators, high-speed interconnects, networking, storage, and orchestration layers—with experience across technologies such as Nvidia GPUs (B200, H100, A100), InfiniBand, Spectrum-X, Arista, DataDirect Networks (DDN), VAST Data, and Kubernetes. Understanding of how the AI infrastructure stack is integrated within AI Factory reference architectures and how architectural decisions impact performance, cost, and scalability at enterprise scale. Drive alignment across engineering, security, compliance, and lines of business to deliver capabilities at business speed without compromising security or regulatory compliance. Build and clearly communicate AI infrastructure investment cases, including TCO analysis, depreciation planning, and ROI modeling across on-prem, cloud, and hybrid deployments. Build consensus and secure commitment to action across senior leadership on high-stakes technology and investment decisions. Position AI infrastructure as a strategic enterprise asset, with a credible investment thesis and product roadmap progressing toward AI Factory–scale operations. Qualify demand signals, prioritize investments across competing lines of business and multiple products, and balance GPU capacity, compliance requirements, and latency constraints. Anticipate rapid shifts in AI hardware (accelerator evolution, emerging architectures, changing workload patterns) and translate them into actionable product strategy. Own multi-year capital plans and vendor ecosystems; bring AI Factory stack depth (hardware selection, distributed training/inference, workload portability), and ensure regulatory constraints and security/compliance controls are designed across on-prem, cloud, and hybrid. Preferred Skills Advanced degree in Computer Science, Engineering, or related field; MBA or equivalent preferred. Background in technical product management within the AI infrastructure ecosystem—including infrastructure vendors, cloud providers, and system integrators—or within highly regulated industries such as financial services or healthcare. Benefits We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit the FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans #J-18808-Ljbffr

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Product Director - AI Infrastructure Platforms (On-Prem) in Palo Alto, CA vacancy
  •  ...TwinThread is looking for a Product Director for AI Infrastructure Platforms to drive vision and delivery of enterprise-grade AI solutions. In this pivotal role, you will set the strategy for AI inferencing platforms and guide a team to ensure successful product execution... 
    Platform

    TwinThread LLC

    Palo Alto, CA
    4 hours ago
  •  ...Senior Account Director – Hyperscalers (AI Infrastructure) Mountain View, California, United States About the Job We are supporting a fast-growing AI infrastructure and GPU cloud platform in the search for a Senior Account Director focused on hyperscaler and frontier... 
    Platform
    Work at office

    Glint Tech Solutions LLC

    Mountain View, CA
    18 days ago
  • $130.9k - $251.9k

     ...Overview Microsoft AI is building the next generation of AI...  ...new ways. The AI Commerce Product Marketing team defines how AI...  ...Product Marketing team is seeking a Director of Product Marketing, AI...  ...tech, commerce, AI, or digital platforms. ~ Proven experience... 
    Platform
    Ongoing contract
    Work at office
    Local area
    Shift work

    Microsoft Corporation

    Mountain View, CA
    1 day ago
  •  ...Head Of Product Saga is building a new category: AI-native characters that form synthetic relationships with people across digital platforms. Agents on our B2B2C platform appear as AI-native characters across social platforms, where they create content, respond to fans... 
    Platform

    SAGA

    Los Altos, CA
    1 day ago
  • $109.2k - $205.9k

     ...Business Unit What the Role Entails Product Strategy & Roadmap: Own the full lifecycle management of AI infrastructure platforms (including large-scale clusters, distributed systems, lifecycle management toolchains, and model service gateways); develop 3-5... 
    Platform
    Relocation package

    Tencent

    Palo Alto, CA
    15 hours ago
  • $364k

     ...collection and curation infrastructure, including the data...  ...the Senior Engineering Director for the software engineering team called AI Data Infrastructure, you...  ...leading AI models and products. Google Cloud...  ...collection and curation platforms that power the development... 
    Platform

    Google Inc.

    Mountain View, CA
    5 days ago
  •  ...ThoughtSpot is seeking a Director of Product Marketing in Mountain View, California to lead the positioning and messaging of its AI-driven analytics platform. This role is pivotal in ensuring that the product narrative resonates with enterprise buyers and integrates efficiently... 
    Platform

    ThoughtSpot

    Mountain View, CA
    5 days ago
  • $163k - $237k

     ...practical experience. 5 years of experience in product management or related technical role. 2...  .... 1 year of experience in leveraging AI/ML technologies. Preferred...  ...solutions for our Google developers. The Platforms and Devices team encompasses Google's various... 
    Platform
    Full time

    Google

    Mountain View, CA
    1 day ago
  • $223.5k - $319.66k

     ...including high-growth ones in AI datacenters, automated...  ...customers to differentiate their products with higher performance,...  ...We are seeking a Director, Infrastructure Hardware to lead the strategy...  ...development, and delivery of system platforms supporting characterization... 
    Platform
    Contract work

    SiTime Corporation

    Santa Clara, CA
    17 days ago
  • $142.6k - $261.5k

     ...focusing on user interface development across mobile, web, and tablet platforms. Engage in coding, programming, and specification creation to...  ...improvements and strategic roadmap contributions. Advise on AI‑enabled ITOM use cases, including AIOps, event correlation,... 
    Platform
    Flexible hours

    EY

    Palo Alto, CA
    2 days ago
  • $122.7k - $317.2k

     ...consulting firm is seeking a Strategy Expert to lead transformative engagements in the Software and Platforms industry. The ideal candidate will have deep expertise in AI and demonstrate the ability to develop actionable strategies that clients can implement at scale.... 
    Platform

    Accenture

    Mountain View, CA
    5 days ago
  • $142.6k - $261.5k

     ...while focusing on developing user interfaces (UI) across various platforms including mobile, web, and tablets. You will engage in coding,...  ...improve our customers’ ITOM and CMDB process or evaluating how AI can streamline delivery. Wherever you find yourself, you’ll be making... 
    Platform
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Palo Alto, CA
    1 day ago
  •  ...AI Operating System For Healthcare At Commure, we're building the AI Operating System...  ...delivered, documented, and financed. Our platform spans the full care journey: Ambient AI...  ...full ownership from early thinking to production. If you're energized by hard problems, high... 
    Platform
    Work at office
    Immediate start
    Shift work

    Commure

    Mountain View, CA
    1 day ago
  •  ...AI Operating System For Healthcare At Commure, we're building...  ..., and financed. Our platform spans the full care journey:...  ...ownership from early thinking to production. If you're energized by hard...  ...for outcomes - building the infrastructure, tools, and processes that let... 
    Platform
    Full time
    Work at office
    Immediate start

    Commure

    Mountain View, CA
    2 days ago
  • $2,000 per month

     ...Elastic, the Search AI Company, enables everyone to find the...  ...people. The Elastic Search AI Platform, used by more than 50% of the...  ...eager to welcome an outstanding Product Manager to join the Elastic...  ...team, with a focus on Infrastructure Observability. With your knowledge... 
    Platform
    Local area
    Remote work
    Flexible hours

    Elastic

    Mountain View, CA
    15 hours ago
  • $175k - $280k

     ...Glean Technologies, Inc. is looking for a strategic Product Manager to lead their Growth product area. You will develop strategies to enhance...  ...strong expertise in product-led growth and familiarity with AI technologies. The position offers a competitive salary ranging... 
    Platform

    Glean Technologies, Inc.

    Mountain View, CA
    15 hours ago
  •  ...Poseidon Poseidon is building the data infrastructure the next generation of AI will depend on. Foundation models...  ...Ability to understand technical products and translate customer needs into clear...  ...companies, or developer platforms Enterprise sales roles selling technical... 
    Platform
    Work at office

    Story Protocol

    Palo Alto, CA
    4 days ago
  •  ...building neuron™ , a unified AI-native platform for data center...  ...environments, thereby giving infrastructure owners and operators the visibility...  ...integrations while writing production code alongside the...  ...~ Design hybrid cloud + on-prem deployment strategies; evaluate... 
    Platform

    Teserac, Inc.

    Sunnyvale, CA
    2 days ago
  •  ...Jerry is seeking a Product Manager to join our Growth team in Palo Alto, California. This role empowers you to drive product initiatives and enhance the user experience for millions of customers. You will work closely with Engineering, Design, and Marketing teams to improve... 
    Platform

    Jerry

    Palo Alto, CA
    23 hours ago
  • $220.92k - $311.89k

     ...are seeking an experienced Director of Analog Design & Infrastructure Design Automation to lead...  ...to ensure high productivity, reproducibility, and audit...  ...signal design flows using platforms such as Virtuoso and Custom...  ...technology leadership for the AI era, enabling our... 
    Platform
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    3 days ago
  •  ...Director Of Ai Software And Service Quality Assurance Samsung Bixby Labs is working towards...  ...devices. Our industry-leading hardware platforms like the Galaxy phones, and home...  ...technology investments are in place for future product launches. Minimum Qualifications:... 
    Platform

    Omega Solutions Inc

    Mountain View, CA
    1 day ago
  • $207k - $300k

     ...Engineering Manager, Health and Home Infrastructure corporate_fare Google place...  ...project goals, contribute to product strategy and help develop...  ...coherent internal developer platforms, easy-to-use APIs, trusted...  ...rapidly expanding their usage of AI. The Google Home team... 
    Platform
    Full time

    Google Inc.

    Mountain View, CA
    5 days ago
  • $132.3k - $198.45k

     ...scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses...  ..., Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale,...  ...safety engineers. Ensure safety work products are complete, consistent, and compliant with... 
    Platform

    Icehouseventures

    Mountain View, CA
    4 days ago
  • $208k - $327.75k

     ...seeking a world-class Senior Product Manager to architect...  ...future of Enterprise AI. While the NVIDIA DGX...  ...Factories.Productize the On-Prem Lifecycle: Define the "...  ...to self-healing infrastructure. Thoughtfully define the...  ...equivalent experience.The "Platform-First" Approach: A... 
    Platform
    Night shift

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $191k - $253k

     ...of systems is powered by Lattice OS, an AI-powered operating system that turns thousands...  ...oversight and tactical management of production systems to support high-volume products across...  ...key stakeholders, guiding the scaling of platforms from pre-production (LRIP) through to... 
    Platform
    Full time
    Work experience placement
    Relocation package

    Slope

    Mountain View, CA
    3 days ago
  • $205k - $310k

     ...Backend Platform Tech Lead Palo Alto, CA • Engineering • Hybrid •...  ...and Meta, to accelerate new product development and improve production...  .... Our technology leverages AI to process data generated on...  ...cloud platform on public cloud infrastructure and deploying it commercially... 
    Platform
    Full time

    Clutch Canada

    Palo Alto, CA
    4 days ago
  •  ...Tech Lead, AI Compute Infrastructure Los Angeles, Palo Alto, San Francisco, Toronto, Singapore About HeyGen At HeyGen...  ...building the robust, efficient, and scalable platform that enables our research and production teams to rapidly iterate on HeyGen's generative... 
    Platform
    Full time

    HeyGen

    Palo Alto, CA
    4 days ago
  • Moveworks is seeking a Tech Lead for its Agentic AI Product in Mountain View, California. In this role, you'll leverage cutting-edge Machine Learning technologies to drive automation and innovation within enterprise uses. You will lead a team, design product features,... 
    Platform

    Moveworks

    Mountain View, CA
    1 day ago
  • $142.6k - $261.5k

     ...while focusing on developing user interfaces (UI) across various platforms including mobile, web, and tablets. You will engage in coding,...  ...improve our customers’ ITOM and CMDB process or evaluating how AI can streamline delivery. Wherever you find yourself, you’ll be making... 
    Platform
    Full time
    Summer holiday
    Worldwide
    Flexible hours

    EY

    Palo Alto, CA
    8 hours ago
  • $238.7k - $365.7k

     ...ambition in Software & Services Product Management is to build a world...  ...web, mobile, and embedded platforms—both in and outside the vehicle. This role reports to the Director, Experience Prototyping – Vehicle...  ..., cloud‑based services, AI/ML, the ability to navigate ambiguity... 
    Platform
    H1b
    Relocation
    Relocation package

    General Motors

    Mountain View, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Director - AI Infrastructure Platforms (On-Prem). Be the first to apply!