Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer - Hosting

$200k
Full-time

Are you ready to advance your career in AI and high-performance computing while working with next-generation GPU infrastructure?

Join a technology team that provides scalable GPU computing solutions and global infrastructure for AI and compute-intensive workloads. The team focuses on simplifying access to high-performance systems, allowing engineers to deploy, manage, and optimize resources efficiently across multiple environments. Team members work on real-world projects, collaborating closely with experienced professionals in a fast-paced, innovative environment. This role offers hands-on experience with modern compute platforms, exposure to cloud and bare metal systems, and opportunities to contribute to solutions that support advanced AI workloads worldwide.

Apply now to grow your expertise and play a key role in shaping the future of GPU infrastructure and AI computing!

Responsibilities:

  • Get AI Platform customers production-ready on the platform — standing up Kubernetes clusters, configuring GPU drivers, validating networking, and troubleshooting the issues that surface when real workloads hit real hardware.
  • Own the bare metal platform layer (NCCL, InfiniBand, NVLink, storage) with orchestration layers (Kubernetes, SLURM) and MLOps tooling that customers actually use.
  • Configure, benchmark, and debug NVIDIA driver stacks — firmware versions, CUDA compatibility, NCCL tuning, MIG configurations. 
  • Run quality benchmarks and diagnostics to validate performance for inference and training workloads across chip types.
  • Identify gaps before customers do, pressure-testing the infrastructure, APIs, and workflows to find what's missing or broken.
  • Turn customer learnings into product. working with Product and Engineering to build reusable templates, default configurations, and automated workflows that eliminate manual onboarding.
  • Advise customers on chip selection and tokenomics, helping AI platform customers understand price/performance trade-offs across GPU types, cost-per-token economics, and which hardware fits their inference or training workloads.

Skills/Must have:

  • Bare metal Linux depth, you've administered GPU servers at the metal: driver stacks, kernel tuning, firmware, storage configuration. 
  • NVIDIA GPU stack expertise, drivers, CUDA, NCCL, NVLink, nvidia-smi profiling. 
  • You understand how stack compatibility affects performance.
  • Kubernetes and orchestration, production experience with K8s, SLURM, or similar. You know how to stand up clusters, not just deploy to them.
  • AI Networking fundamentals, TCP/IP, VLANs, bonding, and high-speed interconnects (InfiniBand, RoCE) for distributed workloads.
  • Customer-facing communication, you can work directly with engineers at AI platform companies, understand their constraints, and translate that into clear requirements for your team.
  • Bias toward scalable solutions, you'd rather build a feature that helps 10 customers than a custom deployment that helps

Benefits: 

  • Comprehensive health, dental, and vision insurance, 401 (k) with employer matching
  • 10/15 % bonus
  • Equity options

Salary: 

  • $200,000 base per year
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer - Hosting in Albany, NY vacancy
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered...  ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    2 days ago
  •  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...  ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    17 hours ago
  • We are:A forward-thinking services company at the forefront of AI-native innovation. We partner with enterprise clients to create next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers embed deeply with customers, moving projects... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    14 hours ago
  •  ...capabilities across data, edge, integrated infrastructure and applications, deep ecosystem skills,...  ...the elite technical and product engine of the Accenture Google Business Group (...  ...shift in technology: the move to Agentic AI and Product-Led Operating Models. As a Google... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Albany, NY
    2 days ago
  • $96k - $181k

     ...TechnologyExperience: 4+ yearsAbout the RoleKeyBank is seeking a Lead AI Engineer to design, build, and modernize AI-powered conversational...  ....Familiarity with CI/CD pipelines, containerization, and Infrastructure as Code.Experience working in Agile delivery models at... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    KeyBank

    Albany, NY
    3 days ago
  •  ...engagement. A Cybersecurity Forward Deployed Engineer is a production engineer who works...  ...security and engineering teams—to make AI systems secure, governed, and resilient...  ...pipelines, RAG architectures, and MLOps infrastructure—owning the full security design from assessment... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    17 hours ago
  • $106.9k - $147k

     ...caring community The Senior Software Engineer codes software applications based on business...  ...of variable factors. The Senior AI Software Engineer standardizes the quality...  ...REST, GraphQL APIs and Websockets. Infrastructure and MLOps: Contribute to AI infrastructure... 
    Full time
    Temporary work
    Apprenticeship

    Humana

    Albany, NY
    1 day ago
  •  ...thinking services company at the forefront of AI-native innovation. We partner with...  ...next-generation, agent-powered workflows engineered to scale in real-world settings. Our...  ...augment workflows and scale across modern infrastructure. You’ll help shape the playbook for how... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    14 hours ago
  •  ...passionate and forward-thinking experts. We’re one of the largest engineering and system integration firms in the United States providing...  ...(SCADA) Systems, thin clients, networked I/O, and externally hosted systems.Expertise with the design, implementation, maintenance... 
    Local area
    Flexible hours

    E Tech Group

    Albany, NY
    17 hours ago
  •  ...Senior Life Sciences Knowledge Engineer Company: Norstella Location: Remote, United States Date Posted: Jul 24, 2026 Employment...  ...intersection of deep scientific domain expertise and applied AI development. This role will be embedded within a group of life science... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Norstella

    Albany, NY
    4 days ago
  •  ...digital core and unleashing the power of AI to create value at speed across the enterprise...  ....com.WHO WE ARE:We are Supply Chain & Engineering: We embed innovation, intelligence, and...  ...upgrades or migrations across different hosting options (On-Prem or Cloud - Private Cloud... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    1 day ago
  • $73.8k - $218.8k

     ...Are: Accenture's Oracle Business Group AI Center of Excellence is one of the most...  ...conversation. You might come from engineering, consulting, product, or pre-sales - what...  ...at scale Build and extend MCP server infrastructure - our federated Model Context Protocol network... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    17 hours ago
  • $73.5k - $212.28k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust...  ...Engineering team you will lead the development of innovative AI solutions that drive remarkable client outcomes. As a Manager... 
    H1b

    PwC

    Albany, NY
    3 days ago
  •  ...At PwC, our people in data and analytics engineering focus on leveraging advanced...  ...Opportunity: As part of the People Tech & AI team you will lead the design, build, and...  ...resilient platforms that integrate cloud infrastructure, conversational AI, data, and enterprise... 
    Work experience placement

    PwC (US)

    Albany, NY
    17 hours ago
  •  ...Teradata delivers real business value with AI. What You'll Do At Teradata, we're...  ...environments. As a member of our AI engineering team, you’ll play a critical role in designing...  ...environments. Build foundational infrastructure and tools to support multi-agent... 
    Permanent employment
    Flexible hours

    Teradata

    Albany, NY
    1 day ago
  •  ...reinvent with digital, cloud, data, and AI capabilities, drawing on its large global...  ...create 360 value.By combining hands-on engineering with deep industry context, we help organizations...  ...to design, build, and operate the data infrastructure and services that power our AI-driven... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    3 days ago
  • $178.42k - $230.5k

     ...successful candidate is in the Seattle, Washington area. About Us The AI Cloud and Developer Infrastructure organization is responsible for delivering and maintaining the tools and services engineers here at GM use every day to do their best work and drive our cars... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours
    3 days per week

    General Motors

    Albany, NY
    1 day ago
  •  ...capabilities across data, edge, integrated infrastructure and applications, deep ecosystem skills,...  ...—including Gemini Enterprise, Data & AI, CES, Security, and Gen AI—that empower...  ...Build a clear career pathway toward senior engineering, architecture, or leadership roles... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Albany, NY
    17 hours ago
  • $296.3k - $423.9k

     ...Trajectory Generation team within the Embodied AI organization. This role combines deep...  ...You will lead a high-performing team of engineers building ML-driven trajectory generation...  .... Experiencewith large-scaletraining infrastructure and distributed ML pipelines.... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Albany, NY
    4 days ago
  •  ...scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI. What You’ll Do We are seeking a Staff Software Engineer to lead the design, development, and evolution of networking software for our massively parallel... 
    Permanent employment
    Flexible hours

    Teradata

    Albany, NY
    17 hours ago
  • Role: Machine Learning/AI Engineers (This role is open to US Citizens, Green Card holders, GC-EAD only. We do not sponsor visas.) Summary: Adidev is looking for an adept Machine Learning Engineer to take the helm in deploying advanced machine learning models, with a special... 
    Remote work
    Visa sponsorship
    Relocation package

    Adidev Technologies Inc

    Albany, NY
    3 days ago
  •  ...Job Title: Senior Network & Infrastructure Systems Engineer Role Overview We are seeking an ownership-driven Senior Network & Infrastructure...  ...experience maintaining enterprise telephony infrastructure (VoIP, hosted, or legacy PBX frameworks). oClear experience with... 
    Temporary work

    AllSTEM Connections

    Albany, NY
    2 days ago
  •  ...Senior Lead Network Engineer II Employment Type: Full Time Department: Information Technology CGS is seeking an experienced...  ...project that includes both wired and wireless network infrastructure and related hardware & software. The project's objectives are... 
    Full time
    Local area
    Monday to Friday
    Flexible hours

    Contact Government Services LLC

    Albany, NY
    3 days ago
  • $40 - $45 per hour

     ...Cloud Software Engineer Req number: R8448 Employment type: Full time Worksite flexibility: Remote Who we are...  ...Strong scripting and automation experience ~ Understanding of infrastructure concepts including operating systems, virtualization, and networking... 
    Hourly pay
    Full time
    Contract work
    Apprenticeship
    Work at office
    Local area
    Remote work
    Worldwide

    CAI

    Albany, NY
    4 days ago
  •  ...requirements. Selecting appropriate GCP services (e.g., Compute Engine, Kubernetes Engine, Cloud Storage, BigQuery, Cloud SQL, Cloud...  ...of cloud solutions on GCP. Developing and managing Infrastructure as Code (IaC) using tools like Terraform or Cloud Deployment Manager... 

    Donato Technologies Inc

    Albany, NY
    3 days ago
  • $153k - $297k

     .... If you're as passionate about your future as we are, join our team.KPMG is currently seeking an Associate Director, AI Security Frontier Engineering to join our Enterprise Security Services organization.Responsibilities:Serve as the primary technical subject matter expert... 
    H1b
    Local area

    KPMG

    Albany, NY
    4 days ago
  •  ...experience implementing, automating, and administering GCP cloud infrastructure, including Infrastructure as Code using Terraform; automation...  ...and administration of GCP services including Compute Engine, Cloud Storage, VPC/XPN, Cloud SQL, Redis, Secret Manager, CDN... 
    Hourly pay
    Contract work

    Genesys

    Albany, NY
    3 days ago
  • $92.5k - $209.5k

     ...Job Description The Oracle Cloud Infrastructure team is building and operating a broad set...  ...multi-tenant cloud environment. OCI gives engineers the opportunity to work on systems that...  ...observability and self-service debugging, and using AI-driven automation to accelerate triage,... 
    Temporary work
    Fixed term contract
    Flexible hours

    Oracle

    Albany, NY
    4 days ago
  • $253.9k - $298.7k

     ...Coinbase. As a Senior Staff Software Engineer on the Data Platform team within Platform...  ...technical strategy for Coinbase's data infrastructure, spanning ingestion, transformation, warehousing...  ...systems, data engineering, and AI-readiness, reporting to the Senior Director... 
    Local area

    Coinbase

    Albany, NY
    17 hours ago
  •  ...platforms. - Evaluate cloud systems for alignment with enterprise architecture and governance standards, partnering with Cloud Engineers and Architects to support system suitability assessments and modernization efforts. - Support operational analysis across cloud... 
    Minimum wage
    Contract work
    Temporary work
    Work experience placement

    MAXIMUS

    Albany, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer - Hosting. Be the first to apply!