Sr Datacenter Architect - AI Infrastructure
$125k - $170kePlus
Sr Datacenter Architect - AI Infrastructure
Remote
Overview
We are looking for a Senior Data Center Architect with deep hands-on experience in designing, deploying, and managing enterprise data center environments. The ideal candidate will lead the delivery of high-performance, GPU-enabled, and AI-ready infrastructures across compute, storage, and networking layers.
Your Impact
The essential functions of this position include:
- Design and deliver end-to-end data center solutions covering compute, storage, and networking
- Deploy and manage GPU-based systems (NVIDIA DGX, HGX, or similar) for AI and HPC workloads
- Implement and support virtualization platforms (VMware ESXi, vCenter, vSAN, NSX)
- Build and manage containerized environments using Kubernetes or related platforms
- Automate infrastructure provisioning and operations using Ansible, Terraform, or scripting (Bash/Python)
- Conduct infrastructure assessments, capacity planning, and performance tuning
- Work closely with networking, storage, and DevOps teams to ensure smooth integration and delivery
- Create and maintain technical documentation for customer and internal team
Qualifications
- 6+ years of experience in data center infrastructure design and delivery
- Strong knowledge of servers, networking, storage, and virtualization technologies
- Hands-on experience with VMware (ESXi, vCenter, NSX, vSAN)
- Exposure to GPU-based compute environments (NVIDIA DGX/HGX or equivalent)
- Proficiency in Kubernetes administration and containerized deployments
- Solid understanding of networking (L2/L3, VLANs, routing) and storage (SAN/NAS/CSI)
- Experience with infrastructure automation tools (Ansible, Terraform)
- Strong troubleshooting, documentation, and communication skills
Position Specifics
The initial base salary range for this position is expected to be between $125,000 and $170,000 annually. The final base salary offered will be determined by multiple factors, including, but not limited to, job-related knowledge, depth of experience, skills, certifications, and geographic location. In addition to base salary, our compensation package may include other components such as commissions and discretionary bonuses.
ePlus offers a full range of medical, financial, and/or other benefits (including 401(k) eligibility, employee stock purchase program and various paid time off benefits, such as vacation, sick time, and personal leave), dependent on the position offered. Details of participation in these benefit plans will be provided if an offer of employment is extended.
If hired, employee will be in an "at-will position" and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.
At ePlus, we believe technology is a people business. Our team is passionate, skilled, and driven to deliver solutions that make a real difference. Join us and be part of a culture that values collaboration, innovation, and extraordinary results.
- Respectful communication and cooperation: We prioritize respectful communication, fostering an environment where everyone is treated with dignity and respect.
- Teamwork and employee participation: Collaboration and teamwork thrive through diverse perspectives, both within our teams and in our interactions with our customers.
- Work/life balance that supports our employees' varying needs: We value the well-being of our employees, recognizing that a healthy work-life balance is pivotal to our collective success.
- Embracing communities: We embrace and support the communities that nurture us. Our employees' dedication to fostering positive change is a source of immense pride for us.
- We are an equal opportunity employer that does not discriminate or allow discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, national origin, citizenship, disability, veteran status, or any other classification protected by federal, state, or local law.
- ePlus is dedicated to fostering, cultivating, and preserving a culture that represents diversity, enables inclusion, and makes our employees feel comfortable bringing their full, unique selves to work.
- While performing this role, you will engage in both seated and occasional standing or walking activities. We provide reasonable accommodations, in accordance with relevant laws, to support success in this position.
- By embracing our values, you will contribute to our collective mission of making a positive impact within our organization and the broader community. We understand that this job description serves as a guide and is not an employment contract.
Notice to Recruiting Agencies: ePlus only accepts unsolicited resumes when presented directly by a candidate. Unsolicited resumes submitted to ePlus from any other source will be considered ePlus property and will not qualify for any placement or referral fees. ePlus will only pay such fees in connection with a valid written agreement between ePlus and the referring agency, and then only after providing advance written approval to the referring agency to submit resumes in connection with a particular opportunity.
- ...Job Summary T he AI Interconnect Architect designs and engineers high-speed networking and communication systems for AI inference infrastructure, including servers, racks, and chips. This role focuses on delivering bandwidth, power efficiency, scalability, and optimized...Senior
- ...A leading AI infrastructure company seeks an Engineering Manager for Datacenter Storage Engineering to lead the team responsible for distributed storage infrastructure. The role requires deep technical expertise and managing a team to ensure performance and scalability...SuggestedRemote work
- ...Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Senior AI Architect – Multi-Agent Systems & Platform Infrastructure Location: Remote (US Preferred) Compensation: Equity-...SeniorFull timeWork at officeRemote work
$172.8k - $304.9k
...Job Title SoC Architect for Next Generation AI Products in Datacenter Job Description Qualcomm is looking for an experienced SoC architect to work... ...plus Experience and knowledge in defining RAS infrastructure at the Server SoC level Experience and...SuggestedWork experience placement- ...Raleigh, or Chicago. The Senior AIF Electrical Architect – MV/LV leads the electrical architecture for Siemens’ AI Factory program, spanning high-, medium-, and... ...integrate both physical and digital power infrastructure across AI Factory and data center environments...SeniorPermanent employmentRemote work
- ...Sr. GTM AI Architect Remote About Invoca: Invoca is the industry leader and innovator in AI and machine learning-powered Conversation... ...& AI team is responsible for building and powering the infrastructure of our revenue engine. We own the GTM tech stack, data...SeniorRemote workFlexible hours
$80.2k - $133.68k
Sentara Healthcare Inc in Virginia Beach is seeking an Experienced Professional for a Domain Architect position. This role involves leading the development of IT infrastructure solutions that align with the organization's business strategies and outcomes. Candidates should...Senior- ...Systems Engineer specializing in Cloud & AI Networking in California. This hybrid... ...over 15 years of experience in network infrastructure architecture, including expertise in AI... ...centers. You will act as a key technical architect, translating business needs into scalable...Senior
- A leading AI infrastructure startup is seeking a highly experienced Packet Processor Architect in Saratoga, California. This role involves defining and architecting high-performance networking ASICs, collaborating closely with system microarchitects, and driving architectural...Senior
- ...seeking an experienced Power Engineer to design and develop high-efficiency power delivery solutions for advanced networking and AI infrastructure. The ideal candidate will have over 10 years of industry experience, with expertise in DC-DC power conversion and power...Senior
$210k - $275k
...startup is seeking a highly experienced ASIC Architect to define and implement advanced networking products that enhance AI data centers. The ideal candidate should... ...275,000 per year, making a significant impact on the future of AI infrastructure. #J-18808-Ljbffr EriduSenior$178.5k - $241.5k
...Sr. Security Architect Advance your career while impacting our national security as... ...programs. Architecting new security infrastructure to support changes to datacenter, colocation and production... ...center of everything we do. Growth: AI-powered career tool that...SeniorTemporary workImmediate startRemote workWorldwideFlexible hours$210k - $275k
A cutting-edge AI infrastructure startup located in Silicon Valley is seeking a highly experienced Senior Staff Engineer. This role focuses on the architecture, development, and integration of open networking components. Candidates must have strong programming skills in...Senior- ...it needs to keep our world moving forward. Job Description An AI Interconnect Architect defines and engineers high-speed networking and communication systems for AI Inference infrastructure which include servers, racks, and chips with a focus on bandwidth, power...SeniorTemporary workRemote workFlexible hoursShift work
- ...A premier AI infrastructure company in Seattle is seeking an Engineering Manager for Datacenter Storage Engineering. You will lead a team responsible for global storage platforms, ensuring performance and reliability for AI workloads. Ideal candidates should have over...Remote work
$130k - $185k
...collaborative team at Thermo Fisher Scientific as a Sr Staff IT Architect, specializing in HR AI solutions. You'll help drive innovation in HR technology... ..., data/analytics, automation, and network infrastructure Proven experience designing and implementing large...SeniorTemporary workWork at office- ...Teserac is building neuron™ , a unified AI-native platform for data center observability... ...center environments, thereby giving infrastructure owners and operators the visibility to... ...‑tenancy, scalability, and resilience. Architect real‑time data pipelines capable of ingesting...Senior
- ...Lead Tech Architect – AI Infrastructure Location: United States (Remote) | Duration: Contract-to-hire | Rate: $75 - 85/hour on W2 Key Responsibilities Support deployment and maintenance of NVIDIA DGX, HGX, and GPU-accelerated systems. Administer VMware environments, including...Contract workRemote work
$144k - $209k
...Manufacturing Test Development Engineer in Atlanta. This role involves developing and optimizing Rack and L11 test platforms for AI and Infrastructure products. Applicants should have a Bachelor's degree in Electrical Engineering or Computer Science, along with at least 8...- ...Senior Enterprise Sales Executive – AI Inference Infrastructure Tensordyne (formerly Recogni) is building the next generation of AI inference... ...~ Strong technical fluency in AI workloads and modern datacenter architectures ~ Comfortable in early-stage environments...Senior
- ...next-generation computing experiences—from AI and data centers, to PCs, gaming and... ...will spearhead the next generation of AI infrastructure by defining GPU architecture specifications... ...expert and data parallel dimensions Architect memory-efficient training systems...Remote work
- ...Senior Principal Ai/Hpc Architect Make an impact with NTT DATA. Join a company that is pushing the boundaries of what is possible.... ...and conflict resolution sills. Significant knowledge of infrastructure strategies including Infrastructure-as-a-Service, Platform-...SeniorRemote work
$123.5k - $206.75k
...Overview The AI Observability Architect is a senior technical leader responsible for designing, deploying, and operating an enterprise-... ...reducing time-to-observability from weeks to hours. Drive infrastructure-as-code (IaC) practices for observability platform...SeniorShift work- ...AI Solutions Architect Key Responsibilities Design comprehensive AI solutions integrating the latest AI technology developments.... ...solution design with an understanding of GPU/NPU, Cognitive Infrastructure, and Copilot domains. Experience collaborating with global...Work at office
$120k - $160k
...Principal / Senior Design Engineer – Enterprise Server Rack & AI Infrastructure Packaging Location: Sutton, Massachusetts (Remote... ...innovation and next-generation packaging system development. Architect reusable packaging and reverse-logistics ecosystems. Own...SeniorWork at officeRemote work- A leading AI infrastructure startup is seeking a Compiler Tech Lead to drive technical and team leadership. You'll manage a team of engineers, guide architecture decisions, and influence core compiler systems. The ideal candidate has over 8 years of compiler development...
- ...products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded... ...your career. THE ROLE: We are seeking a Robotics AI Architect to define and scale next-generation Physical AI systems , with...Senior
- ...Senior Principal Cybersecurity Architect Come on board with an iconic financial institution and take your career to the next level. You... ...expertise to bring together talent that will consistently create AI-enabled solutions, processes, and reusable proof-of-concept...Senior
$227.5k - $280k
...Mainspring Energy is evolving beyond using AI for simple productivity gains. We are seeking a Principal AI Architect to lead our transition into an organization where... ...AI stack Technical Leadership & Infrastructure Agentic Infrastructure: Design the end...Local areaRemote workFlexible hours$286.2k - $326.7k
...hiring a Senior Distinguished Engineer, AI Compute in Indianapolis, Indiana, to lead the development of scalable AI infrastructure. The ideal candidate has over 10 years of... ...AI technologies. Responsibilities include architecting complex systems, developing distributed compute...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Datacenter Architect - AI Infrastructure. Be the first to apply!
- senior development executive United States
- senior technical manager United States
- senior medical writer United States
- senior procurement specialist United States
- senior software development engineer in test United States
- senior communications specialist United States
- senior manager data science United States
- senior platform engineer United States
- senior procurement United States
- senior director product management United States


