Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Datacenter Architect - AI Infrastructure

$125k - $170k

ePlus

Sr Datacenter Architect - AI Infrastructure

Remote

Overview

We are looking for a Senior Data Center Architect with deep hands-on experience in designing, deploying, and managing enterprise data center environments. The ideal candidate will lead the delivery of high-performance, GPU-enabled, and AI-ready infrastructures across compute, storage, and networking layers.

Your Impact

The essential functions of this position include:

  • Design and deliver end-to-end data center solutions covering compute, storage, and networking
  • Deploy and manage GPU-based systems (NVIDIA DGX, HGX, or similar) for AI and HPC workloads
  • Implement and support virtualization platforms (VMware ESXi, vCenter, vSAN, NSX)
  • Build and manage containerized environments using Kubernetes or related platforms
  • Automate infrastructure provisioning and operations using Ansible, Terraform, or scripting (Bash/Python)
  • Conduct infrastructure assessments, capacity planning, and performance tuning
  • Work closely with networking, storage, and DevOps teams to ensure smooth integration and delivery
  • Create and maintain technical documentation for customer and internal team

Qualifications

  • 6+ years of experience in data center infrastructure design and delivery
  • Strong knowledge of servers, networking, storage, and virtualization technologies
  • Hands-on experience with VMware (ESXi, vCenter, NSX, vSAN)
  • Exposure to GPU-based compute environments (NVIDIA DGX/HGX or equivalent)
  • Proficiency in Kubernetes administration and containerized deployments
  • Solid understanding of networking (L2/L3, VLANs, routing) and storage (SAN/NAS/CSI)
  • Experience with infrastructure automation tools (Ansible, Terraform)
  • Strong troubleshooting, documentation, and communication skills

Position Specifics

The initial base salary range for this position is expected to be between $125,000 and $170,000 annually. The final base salary offered will be determined by multiple factors, including, but not limited to, job-related knowledge, depth of experience, skills, certifications, and geographic location. In addition to base salary, our compensation package may include other components such as commissions and discretionary bonuses.

ePlus offers a full range of medical, financial, and/or other benefits (including 401(k) eligibility, employee stock purchase program and various paid time off benefits, such as vacation, sick time, and personal leave), dependent on the position offered. Details of participation in these benefit plans will be provided if an offer of employment is extended.

If hired, employee will be in an "at-will position" and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

At ePlus, we believe technology is a people business. Our team is passionate, skilled, and driven to deliver solutions that make a real difference. Join us and be part of a culture that values collaboration, innovation, and extraordinary results.

  • Respectful communication and cooperation: We prioritize respectful communication, fostering an environment where everyone is treated with dignity and respect.
  • Teamwork and employee participation: Collaboration and teamwork thrive through diverse perspectives, both within our teams and in our interactions with our customers.
  • Work/life balance that supports our employees' varying needs: We value the well-being of our employees, recognizing that a healthy work-life balance is pivotal to our collective success.
  • Embracing communities: We embrace and support the communities that nurture us. Our employees' dedication to fostering positive change is a source of immense pride for us.
  • We are an equal opportunity employer that does not discriminate or allow discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, national origin, citizenship, disability, veteran status, or any other classification protected by federal, state, or local law.
  • ePlus is dedicated to fostering, cultivating, and preserving a culture that represents diversity, enables inclusion, and makes our employees feel comfortable bringing their full, unique selves to work.
  • While performing this role, you will engage in both seated and occasional standing or walking activities. We provide reasonable accommodations, in accordance with relevant laws, to support success in this position.
  • By embracing our values, you will contribute to our collective mission of making a positive impact within our organization and the broader community. We understand that this job description serves as a guide and is not an employment contract.

Notice to Recruiting Agencies: ePlus only accepts unsolicited resumes when presented directly by a candidate. Unsolicited resumes submitted to ePlus from any other source will be considered ePlus property and will not qualify for any placement or referral fees. ePlus will only pay such fees in connection with a valid written agreement between ePlus and the referring agency, and then only after providing advance written approval to the referring agency to submit resumes in connection with a particular opportunity.

Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Sr Datacenter Architect - AI Infrastructure in United States vacancy
  •  ...Job Summary T he AI Interconnect Architect designs and engineers high-speed networking and communication systems for AI inference infrastructure, including servers, racks, and chips. This role focuses on delivering bandwidth, power efficiency, scalability, and optimized... 
    Senior

    Compunnel

    Milpitas, CA
    1 day ago
  •  ...A leading AI infrastructure company seeks an Engineering Manager for Datacenter Storage Engineering to lead the team responsible for distributed storage infrastructure. The role requires deep technical expertise and managing a team to ensure performance and scalability... 
    Suggested
    Remote work

    RunPod, Inc.

    New York, NY
    2 days ago
  •  ...Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Location: Remote (US Preferred) Compensation: Equity-... 
    Senior
    Full time
    Work at office
    Remote work

    Nivalto

    San Francisco, CA
    2 days ago
  • $172.8k - $304.9k

     ...Job Title SoC Architect for Next Generation AI Products in Datacenter Job Description Qualcomm is looking for an experienced SoC architect to work...  ...plus Experience and knowledge in defining RAS infrastructure at the Server SoC level Experience and... 
    Suggested
    Work experience placement

    Qualcomm

    Austin, TX
    1 day ago
  •  ...Raleigh, or Chicago. The Senior AIF Electrical Architect – MV/LV leads the electrical architecture for Siemens’ AI Factory program, spanning high-, medium-, and...  ...integrate both physical and digital power infrastructure across AI Factory and data center environments... 
    Senior
    Permanent employment
    Remote work

    Siemens

    Atlanta, TX
    5 days ago
  •  ...Sr. GTM AI Architect Remote About Invoca: Invoca is the industry leader and innovator in AI and machine learning-powered Conversation...  ...& AI team is responsible for building and powering the infrastructure of our revenue engine. We own the GTM tech stack, data... 
    Senior
    Remote work
    Flexible hours

    Invoca

    United States
    2 days ago
  • $80.2k - $133.68k

    Sentara Healthcare Inc in Virginia Beach is seeking an Experienced Professional for a Domain Architect position. This role involves leading the development of IT infrastructure solutions that align with the organization's business strategies and outcomes. Candidates should... 
    Senior

    Sentara Healthcare Inc

    Virginia Beach, VA
    2 days ago
  •  ...Systems Engineer specializing in Cloud & AI Networking in California. This hybrid...  ...over 15 years of experience in network infrastructure architecture, including expertise in AI...  ...centers. You will act as a key technical architect, translating business needs into scalable... 
    Senior

    Hewlett Packard Enterprise Development LP

    Sunnyvale, CA
    15 hours ago
  • A leading AI infrastructure startup is seeking a highly experienced Packet Processor Architect in Saratoga, California. This role involves defining and architecting high-performance networking ASICs, collaborating closely with system microarchitects, and driving architectural... 
    Senior

    Eridu AI

    Saratoga, CA
    15 hours ago
  •  ...seeking an experienced Power Engineer to design and develop high-efficiency power delivery solutions for advanced networking and AI infrastructure. The ideal candidate will have over 10 years of industry experience, with expertise in DC-DC power conversion and power... 
    Senior

    Eridu Corporation

    Saratoga, CA
    4 days ago
  • $210k - $275k

     ...startup is seeking a highly experienced ASIC Architect to define and implement advanced networking products that enhance AI data centers. The ideal candidate should...  ...275,000 per year, making a significant impact on the future of AI infrastructure. #J-18808-Ljbffr Eridu
    Senior

    Eridu

    Saratoga, CA
    15 hours ago
  • $178.5k - $241.5k

     ...Sr. Security Architect Advance your career while impacting our national security as...  ...programs. Architecting new security infrastructure to support changes to datacenter, colocation and production...  ...center of everything we do. Growth: AI-powered career tool that... 
    Senior
    Temporary work
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    General Dynamics

    Washington DC
    1 day ago
  • $210k - $275k

    A cutting-edge AI infrastructure startup located in Silicon Valley is seeking a highly experienced Senior Staff Engineer. This role focuses on the architecture, development, and integration of open networking components. Candidates must have strong programming skills in... 
    Senior

    Eridu Corporation

    Saratoga, CA
    2 days ago
  •  ...it needs to keep our world moving forward. Job Description An AI Interconnect Architect defines and engineers high-speed networking and communication systems for AI Inference infrastructure which include servers, racks, and chips with a focus on bandwidth, power... 
    Senior
    Temporary work
    Remote work
    Flexible hours
    Shift work

    Sandisk

    Milpitas, CA
    4 days ago
  •  ...A premier AI infrastructure company in Seattle is seeking an Engineering Manager for Datacenter Storage Engineering. You will lead a team responsible for global storage platforms, ensuring performance and reliability for AI workloads. Ideal candidates should have over... 
    Remote work

    Runpod

    Seattle, WA
    4 days ago
  • $130k - $185k

     ...collaborative team at Thermo Fisher Scientific as a Sr Staff IT Architect, specializing in HR AI solutions. You'll help drive innovation in HR technology...  ..., data/analytics, automation, and network infrastructure Proven experience designing and implementing large... 
    Senior
    Temporary work
    Work at office

    Thermo Fisher Scientific

    Pittsburgh, PA
    4 days ago
  •  ...Teserac is building neuron™ , a unified AI-native platform for data center observability...  ...center environments, thereby giving infrastructure owners and operators the visibility to...  ...‑tenancy, scalability, and resilience. Architect real‑time data pipelines capable of ingesting... 
    Senior

    Teserac, Inc.

    Sunnyvale, CA
    1 day ago
  •  ...Lead Tech Architect – AI Infrastructure Location: United States (Remote) | Duration: Contract-to-hire | Rate: $75 - 85/hour on W2 Key Responsibilities Support deployment and maintenance of NVIDIA DGX, HGX, and GPU-accelerated systems. Administer VMware environments, including... 
    Contract work
    Remote work

    Trident Consulting

    Richmond, VA
    1 day ago
  • $144k - $209k

     ...Manufacturing Test Development Engineer in Atlanta. This role involves developing and optimizing Rack and L11 test platforms for AI and Infrastructure products. Applicants should have a Bachelor's degree in Electrical Engineering or Computer Science, along with at least 8... 

    Google Inc.

    Atlanta, GA
    3 days ago
  •  ...Senior Enterprise Sales Executive – AI Inference Infrastructure Tensordyne (formerly Recogni) is building the next generation of AI inference...  ...~ Strong technical fluency in AI workloads and modern datacenter architectures ~ Comfortable in early-stage environments... 
    Senior

    Tensordyne

    Sunnyvale, CA
    1 day ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...will spearhead the next generation of AI infrastructure by defining GPU architecture specifications...  ...expert and data parallel dimensions Architect memory-efficient training systems... 
    Remote work

    Advanced Micro Devices , Inc.

    United States
    1 day ago
  •  ...Senior Principal Ai/Hpc Architect Make an impact with NTT DATA. Join a company that is pushing the boundaries of what is possible....  ...and conflict resolution sills. Significant knowledge of infrastructure strategies including Infrastructure-as-a-Service, Platform-... 
    Senior
    Remote work

    NTT DATA

    United States
    2 days ago
  • $123.5k - $206.75k

     ...Overview The AI Observability Architect is a senior technical leader responsible for designing, deploying, and operating an enterprise-...  ...reducing time-to-observability from weeks to hours. Drive infrastructure-as-code (IaC) practices for observability platform... 
    Senior
    Shift work

    PepsiCo

    Plano, TX
    1 day ago
  •  ...AI Solutions Architect Key Responsibilities Design comprehensive AI solutions integrating the latest AI technology developments....  ...solution design with an understanding of GPU/NPU, Cognitive Infrastructure, and Copilot domains. Experience collaborating with global... 
    Work at office

    E-Solutions

    Jersey City, NJ
    2 days ago
  • $120k - $160k

     ...Principal / Senior Design Engineer – Enterprise Server Rack & AI Infrastructure Packaging Location: Sutton, Massachusetts (Remote...  ...innovation and next-generation packaging system development. Architect reusable packaging and reverse-logistics ecosystems. Own... 
    Senior
    Work at office
    Remote work

    Global Packaging Group LLC

    Sutton, MA
    4 days ago
  • A leading AI infrastructure startup is seeking a Compiler Tech Lead to drive technical and team leadership. You'll manage a team of engineers, guide architecture decisions, and influence core compiler systems. The ideal candidate has over 8 years of compiler development... 

    Amadeus Search

    San Francisco, CA
    1 day ago
  •  ...products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded...  ...your career. THE ROLE: We are seeking a Robotics AI Architect to define and scale next-generation Physical AI systems , with... 
    Senior

    Advanced Micro Devices , Inc.

    San Jose, CA
    2 days ago
  •  ...Senior Principal Cybersecurity Architect Come on board with an iconic financial institution and take your career to the next level. You...  ...expertise to bring together talent that will consistently create AI-enabled solutions, processes, and reusable proof-of-concept... 
    Senior

    Chase

    Wilmington, DE
    1 day ago
  • $227.5k - $280k

     ...Mainspring Energy is evolving beyond using AI for simple productivity gains. We are seeking a Principal AI Architect to lead our transition into an organization where...  ...AI stack Technical Leadership & Infrastructure Agentic Infrastructure: Design the end... 
    Local area
    Remote work
    Flexible hours

    Mainspring Energy

    United States
    2 days ago
  • $286.2k - $326.7k

     ...hiring a Senior Distinguished Engineer, AI Compute in Indianapolis, Indiana, to lead the development of scalable AI infrastructure. The ideal candidate has over 10 years of...  ...AI technologies. Responsibilities include architecting complex systems, developing distributed compute... 
    Senior
    Remote work

    Capital One

    Indianapolis, IN
    16 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Datacenter Architect - AI Infrastructure. Be the first to apply!