Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Product Architect, K8s-Based AI Infrastructure

$184k - $287.5k
Full-time

NVIDIA

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos! What you’ll be doing:

  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
  • Iterate and refine designs based on feedback, testing results, and evolving requirements
  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
  • Provide comprehensive documentation for product designs, including technical specifications and user guides
  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users
What we need to see:
  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelors degree in computer science or related field (or equivalent experience).
  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
  • A passion for staying updated with the latest technological advancements in AI and related fields
Ways to stand out from the crowd:
  • Prior first-hand experience on having built large scale AI infrastructure
  • Advanced certifications or publications in AI, deep learning, or related fields
  • Experience leading high-impact projects or initiatives in cutting-edge tech domains
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and [benefits]( Applications for this job will be accepted at least until August 24, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Product Architect, K8s-Based AI Infrastructure in Santa Clara, CA vacancy
  • $184k - $287.5k

     ...Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology...  ...scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture...  ...and refine designs based on feedback, testing results, and evolving... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...Senior Director, Product Management – Hardware Engineering (AI Infrastructure)Lead the future of AI infrastructure at Oracle! Drive next-generation hardware innovation,...  ...experience with high-performance computing (HPC), GPU-based systems, and large-scale AI infrastructure... 
    Senior

    Hackajob

    Santa Clara, CA
    3 days ago
  • $152k - $230k

    We are looking for a Senior Product Marketing Manager for the AI Infrastructure Solutions product marketing team. You will be alert to the latest industry trends...  ...sales teams, providing positioning mentorship and data-based evidence to support NVIDIA’s best-in-class platform... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...Devices, Inc. is seeking a Sr. Manager, AI Storage Solutions to shape AMD’s Data Center AI infrastructure and own storage strategy. Based in Santa Clara, CA, with potential for other...  ...translating customer needs into product requirements while evangelizing storage... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...We are looking for a Senior Product Marketing Manager focused on AI infrastructure solutions — from GPUs to rack-scale systems to AI factories. Want to join a fun...  ...for technology, we want to hear from you. Your base salary will be determined based on your location,... 
    Senior
    Work experience placement
    Work at office
    Worldwide

    2100 NVIDIA USA

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

     ...unlimited potential of AI to define the next era...  ...AI Storage Platform Architect at NVIDIA, this position...  ...into validated, production-ready blueprints. Work...  ...storage-optimized AI infrastructure, including KV Cache tiering...  ...to hear from you!Your base salary will be determined... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...receive an alert: Senior Principal, HW Design Engineering (AI/ ML Architect ) Date: Aug 15, 202...  ...to improve engineering productivity, reduce manual effort,...  ...and engineering tools based on their ability to solve...  ...critical data center infrastructure for AI, cloud, and... 
    Senior
    Temporary work
    Local area
    Worldwide
    Shift work

    Celestica Inc.

    San Jose, CA
    12 hours ago
  •  ...ByteDance is seeking a Senior Production Systems Engineer to lead the introduction and productionization of high-density GPU infrastructure. You will manage rack-scale GPU systems, integrate...  ...response. You will collaborate with AI training and inference environments to... 
    Senior

    ByteDance

    San Jose, CA
    2 days ago
  • $200k

     ...delivers trusted AI to transform customer...  ..., and Evaluator products are deployed in mission...  ...Knowledge Product Architect to drive the...  ...five-layer stack: Infrastructure Data...  ...enterprise customers and senior leadership. Competitive...  ...package can vary based on the candidate’s... 
    Work at office

    eGain

    Sunnyvale, CA
    2 days ago
  • $177k - $237k

     ...The Essential Cloud for AI™. Built for pioneers...  ...CoreWeave combines superior infrastructure performance with deep...  ...at What You’ll Do As Senior Product Marketing Manager for...  ...from Solutions Architects and customer‑facing engineers...  .... Come join us! The base salary range for this... 
    Senior
    Permanent employment
    Full time
    Contract work
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    Weights & Biases

    Sunnyvale, CA
    3 days ago
  • $200k

     ...delivers trusted AI to transform customer...  ..., and Evaluator products are deployed in mission...  ...Knowledge Product Architect to drive the...  ...along with data is infrastructure on which you build...  ...enterprise customers and senior leadership....  ...package can vary based on the candidate’s... 
    Work at office

    eGain Communications

    Sunnyvale, CA
    1 day ago
  • $180k - $223k

     ...Senior Staff Engineer, Product Marketing (AI datacenter infrastructure) Full-time Employment Type: Regular (PERM) Remote Work Available: No This senior role...  ...expertise with product definition and marketing for MCU-based platform-management and control-plane solutions.... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Jobleads-US

    San Jose, CA
    5 days ago
  •  ...Web Services, Inc. seeks a Forward Deployed Engineer to embed with strategic enterprise customers, designing and deploying AI-powered production systems and owning outcomes end-to-end alongside customer engineers. You will write production-grade software, craft scalable... 
    Senior

    Amazon

    East Palo Alto, CA
    4 days ago
  •  ...technology company for AI and Bitcoin mining infrastructure. Bitdeer is...  ...highly specialized Senior Design Engineer with...  ...circuits; you will be the architect of our design...  ...maximize engineer productivity and silicon performance...  ...or applicants based on conditions such... 
    Senior
    Local area

    Bitdeer Group

    San Jose, CA
    3 days ago
  • $375k - $425k

     ...DescriptionJob DescriptionChief Architect, AI Infrastructure & Memory Systems (VP/CTO)...  ...: $375K - $425K base plus equity Requirements: Chief...  ...beyond traditional memory products to develop next-generation...  ...EngagementEngage directly with senior technical personnel at hyperscalers... 
    Ongoing contract
    Local area

    Everforth CyberCoders

    San Jose, CA
    2 days ago
  •  ...Integrity, and Inclusion. We weave AI into the fabric of everything...  ....Job SummaryAs a Principal Product Manager for our SASE solution...  ...our core Prisma Access cloud infrastructure. You will be responsible for...  ...posted level, the starting base salary (for non-sales roles)... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    2 days ago
  •  ...platform in a hybrid role based out of the San Jose office....  ...functional teams to deliver production-grade AI-enabled systems. Lead the...  ...and deployment of AI/ML infrastructures, collaborate with product and...  ...engineering strategies to senior leadership. #J-18808-Ljbffr
    Senior
    Work at office

    Cisco

    Milpitas, CA
    2 days ago
  • $184k - $287.5k

    We are now looking for a Senior AI Training Performance ArchitectNVIDIA is seeking a senior...  ...the key AI training workloads.Implement production-quality software across multiple layers...  ...make a lasting impact on the world.Your base salary will be determined based on your... 
    Senior
    Full time

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming...  ...We are seeking a Robotics AI Architect to define and scale next-...  ...recruitment agencies, or fee-based recruitment services. AMD and... 
    Senior

    AMD

    San Jose, CA
    12 hours ago
  •  ...Built to set the gold standard for integrated AI infrastructure Crux AI is a newly formed, U.S.-based integrated AI infrastructure company created to remove...  ...What you’ll do You own how Crux prices its products, how it understands its own unit economics and profitability... 
    Senior
    Contract work
    Work at office
    Remote work

    Crux, Inc.

    Palo Alto, CA
    12 hours ago
  • $224k - $356.5k

     ...unlimited potential of AI to define the next...  ...'re looking for a senior engineer to invent,...  ...and construct the infrastructure and AI direction...  ...trustworthy, every product ships faster! This...  ...and orchestration (K8s or equivalent)Strong...  ...evident in your workYour base salary will be... 
    Senior
    Full time
    Immediate start

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...Palo Alto Networks, Inc. is seeking a Sr Principal Product Manager for the Strata Cloud Manager Platform to shape the future...  ..., marketing, and customer teams to drive adoption and AI-powered improvements. Based in Santa Clara, CA, you will influence pricing, packaging... 
    Senior

    Palo Alto Networks

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

     ...Senior Manager, Software EngineeringNVIDIA has been...  ...boundless possibilities of AI to build the next era...  ...Build Engineering and Infrastructure team. You will build and...  ...building employee-facing products software development,...  ...pipelines for the same.Your base salary will be... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $168k - $258.75k

     ...computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning...  ...and intelligence.NVIDIA is looking for a Product Architect to help define & design SoC- and GPU-based products and drive hardware/software feature improvements... 
    Senior
    Full time

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $175k - $275k

     ...builds the world's largest AI chip, 56 times larger...  ...times faster than GPU-based hyperscale cloud...  ...ultra high-speed inference.Senior Staff AI Accelerator Performance...  ...for a performance architect to guide the evolution...  ...features and product generations.Analyze important... 
    Senior

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    1 day ago
  •  ...groundbreaking technology and exceptional people. We are seeking a Senior Silicon Product Architect to define the technical strategy for next-generation...  ...2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...Position We are seeking an experienced Senior Insights Architect for Analytics and AI Solutions to lead the design and...  ...of our advanced analytics, data product architecture and collaborate...  ...and skills. Compensation will be based primarily on the job level at which... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    12 hours ago
  •  ...NVIDIA in Santa Clara is seeking a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role sits on...  ...responsible for an open source plugin-based agent execution framework and... 
    Senior
    Flexible hours

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $217.6k - $290.5k

     ...across the globe. AI is creating new possibilities...  ..., AI & Agentic Architect within Global...  ..., and token and infrastructure costs.Evaluate...  ...distributed systems and production platforms.Proven...  ...use, retrieval-based architectures, conversational...  ...and influencing senior engineers and... 
    Senior
    Work at office
    Immediate start
    Remote work
    Visa sponsorship

    eBay

    San Jose, CA
    3 days ago
  •  ...Eridu AI, a Silicon Valley hardware startup, is seeking a Senior Manager of Product Marketing to shape how we position and message AI infrastructure solutions. You will partner with product, engineering, and sales to translate complex technology into clear, differentiated... 
    Senior

    Eridu AI

    Saratoga, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Product Architect, K8s-Based AI Infrastructure. Be the first to apply!