Cloud GenAI Platform Engineer

Cloud GenAI Platform Engineer

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Cloud GenAI Platform Engineer to join our team in Charlotte, North Carolina (US-NC), United States (US).

Role Summary

We are seeking a hands-on Cloud GenAI Platform Engineer to support an enterprise GenAI platform enabling predictive and generative AI inferencing across both GCP and Azure. This role is focused on platform/infrastructure provisioning (IaaS/PaaS): creating cloud projects/subscriptions, enabling required services, establishing secure access/entitlements, deploying containerized components, and automating everything through Terraform. This is not an application development or RAG/agent pipeline build role.

Key Responsibilities (Day-to-Day)

• Cloud Provisioning for GenAI Consumers: Build secure, repeatable cloud environments for internal teams consuming GenAI services (e.g., provisioning GCP projects / Azure resources, enabling notebooks, endpoint access, guardrails, telemetry integrations).
• Infrastructure as Code (Terraform): Author, enhance, and maintain Terraform modules/scripts to automate: Cloud project/resource creation IAM/entitlements setup and access control Network/security baseline configuration Enablement of required GenAI platform services
• Containers & Kubernetes Operations: Package, deploy, and troubleshoot containerized services; debug runtime issues, image builds, configuration, and cluster-level behavior.
• Platform Troubleshooting & Support: Rapidly diagnose issues across cloud console/portals, infrastructure configs, IAM, containers, and platform integrations; drive issues to resolution with clear root-cause documentation.
• Cross-Team Provisioning Coordination: Partner with internal platform/security/operations teams to complete environment provisioning and ensure standards are met.

Required Skills / Qualifications

Strong hands-on experience with both:

• 5+ years GCP (projects, IAM, service enablement, console navigation)
• 5+ years Azure (subscriptions/resource groups, IAM/RBAC, portal navigation)

Proven hands-on experience with:

• 3+ years Terraform (writing/debugging IaC, modularization, state management basics)
• 3+ years Containers (Docker/container build & runtime debugging)
• 3+ years Kubernetes (deployments, services, configmaps/secrets, troubleshooting)

Strong troubleshooting skills across:

• Cloud access/permissions (IAM/RBAC)
• Container failures, image issues, runtime misconfigurations
• Basic networking and API connectivity patterns

Preferred / Nice-to-Have

Familiarity with GenAI platform governance/guardrails concepts (e.g., policy enforcement, request/response inspection). Exposure to rate limiting / API gateway behaviors and diagnosing throttling patterns. Experience in regulated enterprise environments (security-first provisioning).

Experience Level

Typically 6–10+ years in cloud/platform engineering roles (flexible based on depth of hands-on skills).