Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, AI Infrastructure

$211.6k - $286.2k

Arm, Inc.

Product Management, Datacenter AI / ML

The future isn’t just about technology - it’s about people and the limitless possibilities AI can unlock for us all. As AI transforms how we live, work, and connect, Arm is at its very foundation, powering the innovations that are shaping our world.

Arm’s Cloud AI team is building next-generation platforms to power the AI workloads of tomorrow, and we’re growing our product management organization to help guide this journey. This is an opportunity to help shape the product direction of a major strategic investment while also helping build a new team and culture.

As a member of the team, you’ll own competitive and performance insights that directly shape product and roadmap decisions for AI compute platforms. You’ll be responsible for leading deep competitive and performance analysis across platforms and critical customer workloads and translating those into actionable insights for our engineering and executive partners. We’re looking for deeply technical, independent product leaders who thrive in ambiguity and can move seamlessly between product definition, system-level problem solving, technical analysis, and partner & customer engagement.

Responsibilities:

  • Own competitive and performance analysis for AI compute platforms across hardware, software, and services
  • Identify key workload-driven performance gaps and translate them into product and engineering priorities
  • Inform product roadmap and tradeoffs through data-driven insights across system layers
  • Drive alignment across teams on where and how to improve system performance and competitiveness
Required Skills and Experience:
  • Strong understanding of datacenter AI workloads and hardware & software infrastructure
  • Experience analyzing and comparing performance of complex compute systems (hardware & software) and translating insights into product or engineering direction
  • Strong systems thinking - ability to reason across system layers and understand end-to-end system behavior
  • Proven ability to drive ambiguous, multi-functional problems to resolution, including making product tradeoffs
  • 6+ years of experience in product management, systems or solution engineering, or related product leadership role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering
“Nice To Have” Skills and Experience:
  • Experience working with ML accelerators
  • Hands-on experience building or running GenAI workloads at scale
  • Experience with competitive analysis across AI compute platforms and customer workloads
  • Masters or PhD degree in Electrical or Computer Engineering

In Return:

Help shape products that will define the future of AI compute and define what world-class product management looks like in AI infrastructure. You’ll grow as a leader and technical voice - and help ensure Arm delivers the products our customers need today and the platforms that will power tomorrow.

Accommodations at Arm

At Arm, we want our people to Do Great Things. If you need support or an accommodation to Be Your Brilliant Self during the recruitment process, please email View email address on click.appcast.io. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Hybrid Working at Arm

Arm’s hybrid approach to working is centered around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Salary Range:

$211,600-$286,200 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email View email address on click.appcast.io . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Product Manager, AI Infrastructure in San Jose, CA vacancy
  • $168k - $258.75k

     ...into the unlimited potential of AI to define the next era of...  ...Kubernetes distribution and managed engine service (NKE) that powers...  ...deployments. This is the infrastructure underneath everything — the control...  ...optimally. We need a product manager who can lead this layer... 
    Suggested

    NVIDIA

    Santa Clara, CA
    23 hours ago
  •  ...At AMD, our mission is to build great products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded...  ...career. THE ROLE The Senior Product Manager, AI Infrastructure and Solutions owns the system-level product... 
    Suggested
    Work at office

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    1 day ago
  • $168k - $258.75k

     ...NVIDIA's SOC Hardware Infrastructure team is seeking a Senior Product Manager to lead the strategy and evolution of our internal infrastructure and tools used...  ...effectively. In addition, we support aggressive adoption of AI in chip design to accelerate development of new... 
    Suggested

    NVIDIA

    Santa Clara, CA
    23 hours ago
  •  ...our mission is to build great products that accelerate next-...  ...generation computing experiences-from AI and data centers, to PCs,...  ...seeking a highly skilled Product Manager in our Technical Product...  ...and execution of our network infrastructure products. This role is crucial... 
    Suggested
    Remote work

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago
  •  ...automotive systems to cloud and data center infrastructure. As Arm continues to grow its presence...  ...role in enabling high-quality, production‑ready platforms for customers and partners...  ...judgment, including assessing trade‑offs, managing technical risk, and sustaining long‑... 
    Suggested

    Arm

    San Jose, CA
    12 hours ago
  • $180k - $200k

     ...building an operational intelligence platform for digital infrastructure. By adopting an AI/ML-based analytics approach, the platform provides...  ...opportunity for a bonus, and more. Job Overview Product Manager is responsible for working with Selector customers across... 
    Night shift

    Selector Software, Inc.

    Santa Clara, CA
    1 day ago
  • $227.8k - $338.8k

     ...Principal Product Manager We are seeking a Principal Product Manager to lead the definition and evolution of NetApp's AI Data Infrastructure (AIDI) portfolio. This role owns a broad, end-to-end AI infrastructure strategy, spanning ONTAP-based data services delivered... 
    Local area

    NetApp

    San Jose, CA
    2 days ago
  • $172.1k - $305.6k

     ...Senior Product Manager - Apple Cloud Infrastructure Work Locations (2) Submit Resume Imagine what you could do here. At Apple, great ideas have a way...  ...Apple's key services ranging from Music, TV+, Sports, and AI/ML offerings. Apple's Cloud infrastructure has core... 
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $250.44k - $375.67k

     ...Principal Product Manager, AI Infrastructure San Jose, California, United States Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer... 

    OKX

    San Jose, CA
    4 days ago
  • $240k - $379.5k

     ...Principal Partner Enablement Product Manager, Ai Infrastructure This Principal Partner Enablement Product Manager, AI Infrastructure owns adoption and alignment for our ODM partners delivering data center solutions to customers. The person in this seat represents our... 

    NVIDIA

    Santa Clara, CA
    23 hours ago
  • $166.5k - $291.4k

     ...global market leader, bringing innovative AI-enhanced technology to over 8,100...  ...world work better for everyone. The Cloud Infrastructure Systems Engineering team at ServiceNow is currently seeking a Staff Product Manager to help build the products and infrastructure... 
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    4 days ago
  • $141.8k - $258.6k

     ...Product Manager, AirPods Software Imagine what you could do here. At Apple, great ideas have a way of becoming outstanding products, services...  ...opportunities. Collaborate with software engineering, AI/ML, clinical and design teams to define roadmap and strategy.... 
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $208k - $327.75k

     ...by building the most advanced AI factory from ground up. You...  ...researchers, developers, and AI infrastructure providers around the world....  ...build the software component products, early access collaboration,...  ...significant work experience in product management or technical partner... 
    Work experience placement

    NVIDIA

    Santa Clara, CA
    23 hours ago
  • $160k - $210k

     ...Senior Product Manager - Software Efficient is developing the world's most energy-efficient general-purpose computer processor. Efficient...  ...programmable using standard high-level programming languages and AI/ML frameworks. This level of efficiency makes perpetual,... 

    Efficient Computer Service LLC

    San Jose, CA
    2 days ago
  • $160.98k - $311.04k

     ...Job Details: Job Description: The AI Compute Software Product Manager owns the product strategy, roadmap, and execution for performance-critical middleware layers enabling AI training and inference on modern accelerators and CPUs. This role sits at the intersection... 
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    6 days ago
  • $210.9k - $369.1k

     ...Director of Mask Computational Software Products Group are core to KLA's technology, while...  ...lithography modeling, and numerical and AI methods to come up with unique and advanced...  ...issues, help needed and plans with senior management Travel up to 25-50% to better sync... 
    Minimum wage
    Flexible hours

    KLA

    Milpitas, CA
    2 days ago
  • $200k - $230k

     ...Ready to own the brain behind the world's fastest-growing AI datacenters? Supermicro is hiring aPrincipal Product Manager - DCIM Solutions to lead the strategy, roadmap, and execution of our Data Center Infrastructure Management platform powering next-generation compute at... 
    Worldwide

    Supermicro

    San Jose, CA
    6 days ago
  • $145.97k - $243.28k

     ...You are a visionary and technically savvy product leader with a deep understanding of optical...  ...your ability to grasp emerging trends in AI, solid modeling, and photonics. You are...  ...prioritization, and feature acceptance testing. Manage alpha and beta programs by recruiting... 
    Worldwide
    Flexible hours

    Keysight Technologies

    Santa Clara, CA
    1 day ago
  • $166.5k - $291.4k

     ...Staff Inbound Product Manager- SAM (Software Asset Management) It all started in sunny San Diego, California in 2004 when a visionary engineer...  ...stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of... 
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    4 days ago
  •  ...silicon to systems, enabling customers to rapidly innovate AI-powered products. We deliver industry-leading silicon design, IP, simulation...  ...flows. What You'll Be Doing Lead technical product management for the Synopsys's implementation portfolio with a focus on... 

    Synopsys

    Sunnyvale, CA
    2 days ago
  • $211k - $356k

     ...Description We are looking for a Senior Leader of Product Quality & Reliability to lead quality and...  ...engines, co-packaged optics (CPO), and AI networking products. This is a high-...  ...and statistical process control, and managing critical customer and field quality escalations... 
    Temporary work

    MediaTek

    San Jose, CA
    12 hours ago
  • $157k - $210k

     ...Product Marketing Manager, AI Infrastructure Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence... 
    Contract work
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $126k - $180k

     ...seeking a Senior Technical Project Manager (TPM) to drive execution across next-generation network infrastructure and hardware platform...  ...schedules, issue resolution, production readiness, and deployment timelines...  ...supporting data center, AI infrastructure, networking, or... 
    Full time
    Contract work
    Temporary work
    Flexible hours

    Astreya

    Santa Clara, CA
    4 days ago
  • $198.3k - $342.8k

     ...Manager, Machine Learning Infrastructure - SIML Work Locations Submit Resume Do you think Computer Vision...  ...performance infrastructure that powers product-focused machine learning initiatives...  ...Domain experience in areas such as AI/ML, computer vision, NLP, or related... 
    Relocation

    Apple

    Cupertino, CA
    23 hours ago
  • $136k - $212.75k

     ...team of motivated and experienced program managers who drive the successful introduction of NVIDIA's next generation GPU based products? We work closely with internal leaders in Software...  ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 
    Shift work

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud. Bitdeer is committed to providing comprehensive...  ...transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers... 
    Work experience placement
    Local area
    Overseas
    Flexible hours
    Weekend work

    Bitdeer Technologies Group

    San Jose, CA
    2 days ago
  • $198.3k - $342.8k

     ...Software Engineering Manager – Apple OS Agentic Infrastructure At Apple, we strive to make great products that empower people and improve their lives. We believe Generative AI has the potential to unlock new experiences that were never possible before, and are looking... 
    Part time
    Immediate start
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $148k - $203.5k

     ...exciting technologies that literally connect our world - like AI and IoT. If you want to push the boundaries of materials science...  ...or wherever you may go. Learn more about our benefits ( . Product Manager, Digital Joint Operations Leadership Team, Applied... 
    Full time
    Relocation

    Applied Materials

    Santa Clara, CA
    23 hours ago
  • $141k - $229k

     ...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and...  ..., strategy, and roadmap for AI-powered products that support the end-to-end seller...  ...years experience. ~5+ years of product management experience, with a minimum of 2 years focused... 
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $141k - $229k

     ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the...  ...precision that drives great outcomes. Job Summary As an IT Product Manager for AI Solutions G&A, you will play a crucial role in... 
    Full time
    Contract work
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    5 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, AI Infrastructure. Be the first to apply!