Senior Product Manager, TPU Inference
$192k - $279kSenior Product Manager, TPU Inference Location: Sunnyvale, CA, USA; Kirkland, WA, USA Benefits Benefits for this role include: Health, dental, vision, life, disability insurance Retirement Benefits: 401(k) with company match Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks Baby Bonding Leave: 18 weeks Holidays: 13 paid days per year Minimum qualifications Bachelor's degree or equivalent practical experience. 8 years of experience in product management or related technical role. Experience in managing and launching technical systems, platforms, or infrastructure products. Preferred qualifications Experience enabling and growing developer ecosystems, open-source communities, or platform-level architectures. Deep technical understanding of AI/ML infrastructure, AI accelerators, and accelerator software stacks. Strong business foundation with the ability to synthesize market trends, engaging strategies, and technical inputs. About the job At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day. In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development. One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users. The mission of the TPU Inference team is to help Google Cloud customers, from AI labs to major enterprises, serve their AI/ML models efficiently and at scale. As part of one of Google Cloud’s fastest-growing businesses, we’re positioned at the frontier of AI development, designing and deploying the production systems of customers operating at a global scale. We are a small but mighty team – join us for a unique opportunity to shape the future of TPU! The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $192000 - $279000 (USD) + 20% bonus target + equity + benefits Learn more about benefits at Google. Responsibilities Drive partnership with open source developer projects communities, ensuring TPU is natively supported, optimized, and adopted upstream. Identify and remove barriers to entry for Cloud customers serving on TPU. Deliver the industry’s best price-performance for TPU, ensuring customers can achieve optimal performance and efficiency. Anticipate market shifts to ensure the TPU inference stack remains exceptional. Collaborate with Google Cloud platform teams (e.g., GKE, Vertex AI) to define well lit paths and reference solutions. Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy. Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire. If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form. Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. #J-18808-Ljbffr Google
$168k - $258.75k
Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life,... ...acceleration algorithms, usecases, and deployment techniques. As a Senior Product Manager for AI Platform Inference you will be responsible for...SeniorFull time$208k - $327.75k
...impact on the world.NVIDIA is looking for a highly technical Product Manager to own the products that help customers extract the best possible... ...AI models and applications running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation to a multi-...SeniorFull time- AMD in Santa Clara is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD’s open-source GPU software stack. This role involves managing the product roadmap for inference capabilities and engaging with the open-source community to enhance AMD'...SeniorRemote job
$168k - $258.75k
Senior Product Manager - AI Platform Inference (Finance) Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where ever bit of accuracy and performance matters for quality, safety, and cost...Senior- ...At AMD, our mission is to build great products that accelerate next-generation computing... ...career. THE ROLE:AMD is seeking a Senior Product Manager to drive strategy and execution for ROCm... ...a specific focus on large-scale model inference on AMD Instinct™ and Radeon™ hardware....SeniorRemote work
- Advanced Micro Devices is looking for a Senior Product Manager in Santa Clara, CA, to drive the strategy for ROCm, AMD's GPU software stack.... ...strong background in product management, GPU computing, and AI inference technologies. This role provides an opportunity to work in...Senior
- Google in Sunnyvale, CA is seeking a Senior Product Manager to guide the Cloud TPU platform from conception to launch, delivering a seamless experience for developers and customers. You will work closely with engineers, designers, and analysts to shape features and drive...Senior
$208k - $327.75k
...you can make a lasting impact on the world.NVIDIA is seeking a Product Manager to drive product planning, roadmap definition, and execution... ...and sensor simulation capabilities with model training, inference, testing, and evaluation needs.Drive roadmap requirements for...SeniorFull time$192k - $278k
...networking libraries for training and inference (e.g., NCCL, NIXL and other collective... ...applies to Google's standard compute, TPU and GPU systems, aligning with company... ...practical experience.8 years of experience in product management or a related technical role.3 years of...SeniorWorldwide$150k - $350k
...building, understanding, using, and risk-managing foundation models. Our mandate is to... ...of AI pioneers. The Role As the Senior Product Manager for our teams, you will work within... .... You can discuss context windows, inference latency, and specific benchmarks with researchers...SeniorFlexible hours- ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale... ...wherever developers and AI builders are paying attention. As Senior Product Marketing Manager, you'll own realtime product marketing for Cerebras...SeniorShift workNight shift
$148k - $235.75k
We are looking for a Senior Technical Product Marketing Manager. This role will be located in our rapidly growing data center business and pivotal in our inference marketing. You will be focused on working with engineering to understand the technical capabilities of our...SeniorFull time$168k - $258.75k
...directly into the cockpit. We are looking for a highly technical Product Manager to own the strategy, roadmap, and execution of next-... ...Find opportunities to integrate LLMs, multimodal AI, and edge inference into the vehicle cabin experience. Build products that leverage...SeniorFull time- Crusoe is seeking a Product Manager, Compute to define Crusoe Cloud’s core compute offerings, spanning GPU/CPU infrastructure and orchestration... ..., scheduling, and developer experience for AI training and inference workloads, aligning infrastructure investments with customer...Senior
- As a Senior Product Manager for Orchestration, you will own major product areas within Crusoe’s Managed Orchestration portfolio Your scope will... ...Infrastructure: You understand how training, fine‑tuning, inference, checkpointing, and GPU‑intensive workloads interact with...Senior
$190.9k - $334.1k
...Platform team owns the foundational inference layer that every AI... ...scale. This is not a zero-to-one product role, it's a scale role:... ...Qualifications10+ years of product management experience, recent hands-on... ...problems.Proven skill influencing senior stakeholders without formal...SeniorWork at officeImmediate startRemote workFlexible hours$192k - $278k
...markets, competition, and user requirements in depth.Launch new products and features, test their performance, and iterate quickly.Work... ...practical experience.8 years of experience in product management or related technical role.3 years of experience taking technical...Senior- ...EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing... ...software quality delivered to customer managed, on-premise systems: performance,... ...developer experience. THE ROLE:AMD is seeking a Senior Product Manager to own the strategy,...Senior
$168k - $258.75k
We are seeking a versatile and highly technical Product Manager who will help us chart a course toward continued excellence in our Accelerated Datacenter products. If you have an intuitive understanding of gaps in hardware, software, tools, and systems, and experience driving...SeniorFull time$208k - $327.75k
...consistent track record in technology and the skills for GPU product definition for Data Center. We are a small, dynamic, and motivated... ...years of total experience in technology with previous product management, AI related engineering, design or development experience...SeniorFull time$168k - $258.75k
...world. You will participate in a focused effort to develop and productize ground-breaking solutions that will redefine the world of... ...Science, or an equivalent field.8+ years experience in product management, preferably within the automotive industry or related fields.Familiarity...SeniorFull time$168k - $258.75k
...world’s most challenging problems with our unique approach to accelerated computing. We’re looking for a technical and passionate product manager to join the NVIDIA team building our GPU acceleration libraries. This role is responsible for leading some of our newest...SeniorFull timeRemote work- Job DescriptionAt General Motors, we empower Product Managers to solve challenging customer and business problems. We seek passionate and innovative... ..., stakeholders, and executives using data and logic.As the Senior Product Manager for AV Features, you will own the vision and...SeniorFull timeWork at officeLocal areaWork from home
- ...than yourself and help transform the future of healthcare, you’ll find your purpose here.Job DescriptionPrimary Function of Senior Product Manager, Telepresence:You will manage da Vinci Telepresence products across the entire product lifecycle. You will develop and...SeniorLocal areaWorldwideFlexible hours
- ...enables industry-leading training and inference speeds and allows users to run... ...applications with less hardware management. Cerebras’ customers include top... ...real-time iteration and higher productivity for AI applications. About The Role Senior Director of Technical Product...Senior
$148.7k - $240.53k
...-solving, stronger relationships, and the kind of precision that drives great outcomes.Job SummaryWe are seeking a dynamic Senior Product Manager to lead the scoring, ML baselining, incidents, and user synthetics core of ADEM — the measurement engine that turns raw telemetry...SeniorFull timeWork at office$117k - $234k
...time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficePosition Summary...What you'll do...Role summary: As a Senior Product Manager for Seller Onboarding Risk, you will own products that determine who can sell on Walmart Marketplace. You’ll build...SeniorFull timeTemporary workPart time$180k - $230k
...to develop, test and deploy autonomous capabilities for the U.S. Department of Defense.Kodiak is seeking a highly skilled Senior Product Manager to drive the development of our Level 4 autonomous trucking solutions across different customer applications. In this role...SeniorTemporary workWork at officeVisa sponsorship$149k - $192k
...focused on transforming the diagnosis and management of patients with serious neurological... ...Overview:We are seeking a highly motivated Product Manager to drive key products within... ...status and release updates for Ceribell’s senior leadership, ensuring alignment across the...SeniorLocal area- Google is seeking a TPU Design Engineer, Silicon in Mountain View, CA. This mid-level role focuses on driving progress in digital design... ...to cutting-edge silicon for on-device ML and data-center inference. Required: a Bachelor's in EE/CS or related field and 5 years in...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Product Manager, TPU Inference. Be the first to apply!
- product manager oncology Sunnyvale, CA
- remote associate product manager Sunnyvale, CA
- product manager banking Sunnyvale, CA
- product launch manager Sunnyvale, CA
- platform product manager Sunnyvale, CA
- senior director product management Sunnyvale, CA
- product manager ii Sunnyvale, CA
- senior manager product engineering Sunnyvale, CA
- product manager electronics Sunnyvale, CA
- online product manager Sunnyvale, CA

