Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Infrastructure & Data Center Architect

$208k - $260k
Full-time

MetroSys

Position Overview

MetroSys is seeking an experienced Senior AI Infrastructure & Data Center Architect to design, deploy, and optimize enterprise infrastructure environments supporting GPU-accelerated computing, artificial intelligence platforms, and high-performance workloads.

This is an IT infrastructure-focused position , requiring deep expertise in enterprise data center technologies, compute architecture, high-performance networking, storage systems, virtualization, and NVIDIA accelerated computing infrastructure.

The ideal candidate will have extensive experience designing complex enterprise infrastructure solutions and integrating NVIDIA GPU platforms into existing or newly developed data center environments.

This individual will be responsible for infrastructure architecture, technical assessments, solution design, hardware selection, deployment planning, and operational readiness.

The role requires a strong understanding of how GPU compute, networking, storage, and infrastructure management technologies work together to support enterprise AI workloads.

This is not an AI application development, data science, or machine learning engineering position. The focus is on building and supporting the underlying IT infrastructure required to operate enterprise AI environments.

Key Responsibilities

Enterprise Infrastructure & Data Center Architecture

  • Design and architect enterprise data center infrastructure supporting GPU-accelerated computing and high-performance workloads.

  • Develop end-to-end infrastructure solutions integrating compute, storage, networking, virtualization, and management platforms.

  • Assess existing customer environments and identify infrastructure requirements for deploying NVIDIA AI computing solutions.

  • Create high-level and low-level infrastructure designs, technical diagrams, bills of materials (BOMs), and implementation plans.

  • Lead infrastructure discovery sessions, technical assessments, and architecture workshops with enterprise customers.

  • Evaluate hardware platforms, infrastructure dependencies, scalability requirements, and operational considerations.

  • Design highly available, resilient, and scalable infrastructure environments.

  • Provide technical guidance on data center modernization, infrastructure consolidation, and emerging accelerated computing technologies.

NVIDIA GPU & Accelerated Computing Infrastructure

  • Design infrastructure solutions utilizing NVIDIA DGX, HGX, MGX, and enterprise GPU computing platforms.

  • Architect GPU compute environments incorporating NVIDIA Hopper, Blackwell, and other accelerated computing technologies.

  • Evaluate GPU server platforms, compute density, hardware compatibility, and infrastructure sizing requirements.

  • Design and support GPU cluster infrastructure for enterprise AI and high-performance computing environments.

  • Provide architectural guidance on NVIDIA Base Command Manager, NVIDIA Mission Control, and related infrastructure management technologies.

  • Support infrastructure deployment, configuration, validation, and operational readiness for NVIDIA-based computing environments.

  • Evaluate GPU resource allocation, cluster performance, capacity requirements, and infrastructure utilization.

  • Work with hardware manufacturers and infrastructure vendors to develop integrated computing solutions.

High-Performance Networking

  • Design high-bandwidth, low-latency networking environments supporting GPU clusters and distributed computing.

  • Architect NVIDIA InfiniBand and high-speed Ethernet networking solutions.

  • Design network fabrics utilizing RoCE, RDMA, and other high-performance interconnect technologies.

  • Evaluate NVIDIA Spectrum Ethernet and Quantum InfiniBand switching technologies.

  • Develop network architectures supporting east-west traffic, high-throughput data movement, and distributed GPU workloads.

  • Integrate accelerated computing environments with existing enterprise networking infrastructure.

  • Evaluate network performance, redundancy, scalability, and resiliency requirements.

  • Troubleshoot complex network connectivity and performance issues affecting GPU infrastructure.

Enterprise Storage & Data Center Systems

  • Architect high-performance storage environments supporting GPU-intensive computing workloads.

  • Evaluate enterprise SAN, NAS, NVMe, NVMe-oF, and parallel file system technologies.

  • Design storage connectivity and data access architectures for large-scale compute clusters.

  • Integrate enterprise storage platforms with NVIDIA GPU computing environments.

  • Evaluate storage performance, throughput, latency, and scalability requirements.

  • Support infrastructure solutions involving Linux, virtualization platforms, and containerized infrastructure environments.

  • Assess data center requirements including rack architecture, power distribution, cooling, and hardware density.

  • Collaborate with facilities and infrastructure teams to ensure data center readiness for GPU-dense deployments.

Infrastructure Deployment, Operations & Management

  • Develop deployment strategies for enterprise AI infrastructure and GPU computing environments.

  • Provide technical leadership during infrastructure installation, configuration, integration, and validation.

  • Design infrastructure monitoring, performance management, and operational support processes.

  • Establish best practices for GPU cluster administration, infrastructure maintenance, and capacity management.

  • Support infrastructure automation and standardized deployment methodologies.

  • Evaluate infrastructure management tools supporting GPU systems, networking, and storage environments.

  • Identify infrastructure performance bottlenecks and recommend optimization strategies.

  • Develop operational documentation, configuration standards, and technical runbooks.

  • Support troubleshooting and escalation activities for complex infrastructure environments.

Infrastructure Security & Availability

  • Incorporate enterprise security standards into GPU computing and data center infrastructure designs.

  • Develop secure network segmentation and infrastructure access control strategies.

  • Evaluate infrastructure isolation requirements for shared computing environments.

  • Design resilient infrastructure architectures supporting availability, redundancy, and disaster recovery.

  • Collaborate with security teams to align infrastructure solutions with enterprise compliance requirements.

  • Support secure management and monitoring of GPU compute clusters and supporting infrastructure.

Technical Consulting & Architecture Leadership

  • Serve as a senior technical advisor for enterprise infrastructure and accelerated computing engagements.

  • Work directly with customer infrastructure teams, IT directors, and technology leadership.

  • Translate technical requirements into infrastructure designs and implementation strategies.

  • Develop architecture documentation, technical proposals, and infrastructure equipment specifications.

  • Collaborate with technical sales teams and engineering resources during solution development.

  • Evaluate infrastructure technologies from NVIDIA, Cisco, Dell, HPE, Lenovo, AMD, and other enterprise technology providers.

  • Provide technical leadership and mentoring to infrastructure engineers and architects.

  • Present infrastructure recommendations and solution designs to technical and executive stakeholders.

Required Qualifications

  • 10+ years of experience in enterprise IT infrastructure engineering, data center architecture, or solutions architecture.

  • Extensive experience designing and implementing complex enterprise infrastructure environments.

  • Strong technical understanding of NVIDIA GPU computing infrastructure and accelerated computing platforms.

  • Experience with enterprise server architecture, compute platforms, and large-scale infrastructure deployments.

  • Advanced knowledge of enterprise networking, including high-speed Ethernet, InfiniBand, RoCE, or RDMA technologies.

  • Strong understanding of enterprise storage technologies, including SAN, NAS, NVMe, and high-performance storage architectures.

  • Experience with Linux-based infrastructure environments and enterprise virtualization technologies.

  • Knowledge of GPU cluster architecture, infrastructure management, and compute resource allocation.

  • Experience developing infrastructure architecture documentation, high-level designs, low-level designs, and bills of materials.

  • Understanding of data center hardware requirements, including rack density, power, cooling, and physical infrastructure considerations.

  • Experience integrating compute, networking, and storage platforms into enterprise environments.

  • Strong troubleshooting, infrastructure assessment, and technical problem-solving skills.

  • Ability to lead customer-facing architecture discussions and provide technical recommendations.

NVIDIA Certifications

Candidates holding one or more of the following NVIDIA professional certifications are strongly preferred:

  • NVIDIA-Certified Professional: AI Infrastructure (NCP-AII) – Demonstrates expertise in NVIDIA AI infrastructure architecture, deployment, and enterprise computing environments.

  • NVIDIA-Certified Professional: AI Networking (NCP-AIN) – Demonstrates expertise in high-performance networking technologies supporting accelerated computing infrastructure.

  • NVIDIA-Certified Professional: AI Operations (NCP-AIO) – Demonstrates expertise in operating, administering, monitoring, and maintaining NVIDIA AI infrastructure environments.

Candidates with multiple NVIDIA certifications will receive additional consideration.

Equivalent hands-on experience designing and deploying NVIDIA accelerated computing infrastructure will also be considered.

Preferred Technical Experience

  • NVIDIA DGX, HGX, MGX, and accelerated computing platforms.

  • NVIDIA Hopper and Blackwell GPU architectures.

  • NVIDIA Spectrum Ethernet and Quantum InfiniBand networking.

  • NVIDIA Base Command Manager and Mission Control.

  • GPU cluster design, deployment, and administration.

  • InfiniBand, RoCE, RDMA, and high-performance Ethernet networking.

  • Enterprise storage solutions and parallel file systems.

  • Linux infrastructure administration and cluster management.

  • Kubernetes and Red Hat OpenShift infrastructure.

  • VMware or other enterprise virtualization technologies.

  • Enterprise data center infrastructure and hardware integration.

  • Infrastructure automation and configuration management.

  • High-performance computing (HPC) architecture.

  • NVIDIA AI Factory infrastructure design and deployment.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Infrastructure & Data Center Architect in Remote vacancy
  •  ...Ram QS is seeking a Principal level architect to confirm what the facility and other...  ...so an NVIDIA Vera Rubin NVL72 AI Factory can be deployed as designed....  ...Required Qualifications ~12+ years in data center design or AI infrastructure, with recent work at Principal or... 
    Suggested
    Contract work
    Remote work

    Ram QS LLC

    Dallas, TX
    4 days ago
  •  ...Description Job Description Senior Account Executive - AI / HPC Infrastructure Solutions Remote | Greater NYC...  ...| GPU / Accelerated Compute | Data Center We’re partnered with a fast...  ...partnering closely with solutions architects, OEM partners, and engineering... 
    Senior
    Remote work

    Levelociti

    New York, NY
    5 days ago
  •  ...Opportunity We are partnering with an innovative data center development and infrastructure company supporting the rapidly growing AI and high-performance computing (HPC)...  ...computing environments. We are seeking a Senior Data Center Engineer to oversee critical infrastructure... 
    Senior
    Full time
    For contractors
    For subcontractor
    Remote work

    JeffreyM Consulting

    Remote
    11 days ago
  • $120k - $207k

    We are seeking a highly motivated Senior HPC Support Engineer - Ethernet / AI Infrastructure to be engaging with one of our prestige customers onsite and remote, passionate about data center and networking technologies, to provide comprehensive solutions for sophisticated... 
    Senior
    Full time
    Work experience placement
    Remote work

    Nvidia

    Austin, TX
    3 days ago
  •  ...consultant to develop a comprehensive business plan and go-to-market strategy focused on racks, mounts, and supporting infrastructure for data centers and AI compute environments. The engagement will evaluate market opportunities driven by accelerated AI infrastructure... 
    Senior
    Contract work
    Work at office
    Remote work
    Home office

    Mount-It!

    West Virginia
    19 days ago
  • $184k - $287.5k

     ...the unlimited potential of AI to define the next era of...  ...world.NVIDIA is seeking a Senior Solutions Architect to drive technical engagement...  ...partners across the AI Infrastructure Build Readiness - Execution...  ...in AI infrastructure, data center deployment, or large-scale... 
    Senior
    Full time
    Remote work

    Nvidia

    Austin, TX
    4 days ago
  • $132k - $253k

     ...NVIDIA is looking for a Senior Field Applications Engineer to assist with AI Factory build...  ...failure reproduction, data collection, domain isolation...  ...of experience in data center deployment, rack integration...  ...support, partner services, infrastructure bring-up, or large-... 
    Senior
    Full time

    NVIDIA

    Remote
    3 days ago
  • $174k - $253k

     .... 5 years of experience with data structures/algorithms.1 year...  ...architecture built by the Technical Infrastructure team to keep it running. From...  ...and maintaining our data centers to building the next...  ...fastest experience possible.The AI and Infrastructure team is redefining... 
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $131k - $175k

     ...an industry leader in data-driven, client-to-cloud...  ...networking for large data center, campus and routing...  ...You’ll Work With As a Senior Rack Solution Engineer...  ...for the world’s largest AI and cloud deployments....  ...deployment of AI and cloud infrastructure—translating cluster architectures... 
    Senior
    Remote work
    Flexible hours

    Arista Networks

    Santa Clara, CA
    2 days ago
  • $243.29k - $295.25k

     ...everyone.As a member of the Infrastructure Foundation Hardware Engineering...  ...lead for our GPU and AI accelerator ecosystem. You will...  ...hardware possible.You Will:Architect & Prototype: Prototype next-...  ...depth understanding of modern data center technologies, including PCIe... 
    Senior
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    1 day ago
  • $174k - $252k

     ...system design, networking and data storage, security, artificial...  ...built by the Technical Infrastructure team to keep it running. From...  ...developing and maintaining our data centers to building the next...  ...fastest experience possible. The AI and Infrastructure team is redefining... 
    Senior
    Worldwide

    CompliancePoint

    Kirkland, WA
    3 days ago
  •  ...to Remote/Hybrid Candidates The Senior Principal Enterprise Data Architect - AI Data Transformation will serve as...  ...expertise in Artificial Intelligence infrastructure and Data Science enablement to...  ...Our Culture Our work is centered on our People and Culture as reflected... 
    Senior
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    GE Appliances, a Haier company

    Louisville, KY
    3 days ago
  •  ...is the Kubernetes-native AI infrastructure company, enabling organizations...  ...AI, machine learning, and data-intensive applications. By...  ..., or in sovereign data centers. As enterprises navigate...  ...the roleWe are seeking a Senior Solutions Architect with deep networking expertise... 
    Senior
    Work at office
    Local area
    Remote work

    Mirantis

    Boston, MA
    2 days ago
  • $150k - $170k

     ...RecruiterWe have an outstanding opportunity for an experienced Senior Data & AI Solutions Architect to join a highly successful, financially strong...  ...cutting-edge networking, cloud, cybersecurity, and infrastructure technologies while leading critical transformation initiatives... 
    Senior
    Permanent employment
    Full time
    Remote work
    Flexible hours

    Smith Arnold Partners

    New Haven, CT
    10 hours ago
  • $105k - $201k

     ...#VTeamLife.What you’ll be doing...As the Senior Pricing Manager for GPU as a...  ...authority for next-generation AI/HPC (High-Performance Computing) infrastructure and cloud acceleration solutions....  ...enterprise cloud computing economics, data center infrastructure or IaaS business... 
    Senior
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Work from home
    Shift work
    3 days per week

    Verizon

    York, PA
    10 hours ago
  •  ...normalized problem and the AI-native curiosity to...  ...Engineer AI & Infrastructure Planning role helps Cloudflare...  ...networking and data center engineering teams to encode...  ...functional capabilities. Architect deploy and maintain...  ...and Experience Senior-level software engineering... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    Cloudflare

    San Francisco, CA
    6 days ago
  • $225k

     ...exciting new opportunity?  Join a rapidly scaling AI cloud infrastructure provider building next-generation GPU...  ...in high-performance networking and AI-ready data center architecture. The company is looking for a Senior Network Engineer to design, deploy, and support... 
    Senior
    Permanent employment
    Remote work
    San Francisco, CA
    more than 2 months ago
  • $220k - $350k

     ...Modeling Engineer, AI Inference Deployments (Senior / Principal) based...  ...and plan their AI infrastructure needs. You will...  ...pipeline, expert, and data parallelism strategies...  ...(HPC), or data-center infrastructure....  ...experienced engineers and architects developing next-... 
    Senior
    Full time
    Remote work
    Home office

    Jobgether

    Remote
    6 days ago
  • $180.14k - $269.84k

     ...essential building blocks of the data infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures,...  ...a key part of Marvell's Data Center Group providing networking...  ...relationships.Partner with BU Architects, Marketing and Applications to... 
    Senior
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    4 days ago
  • $250k

     ...career? Join a rapidly scaling AI cloud infrastructure provider building next-...  ...The company is looking for a Senior Storage Engineer with...  ...platform engineering teams across data-intensive AI and machine learning...  ..., or large-scale data center environments Deep hands-on... 
    Senior
    Permanent employment
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...Senior AI Data Architect - Remote Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create... 
    Senior
    Contract work
    Local area
    Immediate start
    Remote work

    Bright Vision Technologies

    Remote
    1 day ago
  • $184k - $287.5k

     ...Remote Full time JR2028523 We’re hiring a Senior Solutions Architect to drive technical engagement with NVIDIA customers across AI Factory teams . In this role, you’ll...  ...pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming... 
    Senior
    Full time
    Remote work

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $116k - $154k

     ...396308Company: NTT DATA Americas, Inc.Location...  ...seeking a Senior AWS Database Migration Architect / Engineer to join...  ...AWS Architecture and Infrastructure  ~ Design secure,...  ...the world's leading AI and digital infrastructure...  ...connectivity, data centers and application... 
    Senior
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Charlotte, NC
    2 days ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research....  ...availability of AI systems.As a senior DGX Cloud AI Infrastructure software...  ...that power the future of AI and data science and be part of a dynamic,... 
    Senior
    Full time
    Remote work

    Nvidia

    Austin, TX
    2 days ago
  •  ...is the Kubernetes-native AI infrastructure company, enabling organizations...  ...AI, machine learning, and data-intensive applications. By...  ..., or in sovereign data centers. As enterprises navigate...  ...the role We are seeking a Senior Solutions Architect with deep networking expertise... 
    Senior
    Full time
    Work at office
    Remote work

    Mirantis

    Remote
    a month ago
  •  ...Engineer, Cloud and AI Networking This...  ...and act on their data and applications wherever...  ..., AI, and data center environments. HPE...  ...AI/ML Networking Infrastructure, Data Center, and...  ...primary technical architect early in complex sales...  ...with senior technical and C-Level... 
    Senior
    Remote work
    Work from home

    Hewlett Packard Enterprise

    New York, NY
    3 days ago
  • $184k - $287.5k

     ...forefront of the generative AI revolution, building...  ...We are looking for a Senior Software Engineer to...  ...-scale AI clusters, infrastructure, and end-to-end workloads...  ...LLM workloads using data, tensor, pipeline, and...  ...Proven track record of architecting, debugging, and... 
    Senior
    Full time
    Remote work

    Nvidia

    Austin, TX
    10 hours ago
  •  ...leading technology company for AI and Bitcoin mining infrastructure. Bitdeer is committed...  ..., transport logistics, data center design and construction,...  ...We are seeking a Senior AI Storage Infrastructure...  ...will be responsible for architecting high-performance storage... 
    Senior
    Remote job
    Full time
    Local area

    Bitdeer Technologies Group

    Remote
    21 days ago
  • Senior Principal Presales Systems Engineer, Cloud and AI NetworkingThis role has been designated...  ...and act on their data and applications...  ..., AI, and data center environments. HPE...  ...AI/ML Networking Infrastructure, Data Center, and...  ...technical architect early in complex... 
    Senior
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    Andover, MA
    1 day ago
  • $166k - $220k

    Senior AI Infrastructure Engineer Anduril Industries is a defense technology company with a mission to transform U.S....  ...powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the world enters an era of strategic... 
    Senior
    Full time
    Work experience placement
    Immediate start

    ClearanceJobs

    Costa Mesa, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Infrastructure & Data Center Architect. Be the first to apply!