Cloud Engineer II -AI

Cloud Engineer II- AI

Location: This is a hybrid opportunity in Delhi NCR, Hyderabad, Bangalore, Pune.

Insight at a Glance

• 14,000+ engaged teammates globally with operations in 25 countries across the globe.
• Received 35+ industry and partner awards in the past year
• $9.2 billion in revenue
• #20 on Fortune’s World's Best Workplaces™ list
• #14 on Forbes World's Best Employers in IT – 2023
• #23 on Forbes Best Employers for Women in IT- 2023
• $1.4M+ total charitable contributions in 2023 by Insight globally

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organizations through complex digital decisions.

Role Overview

As a Cloud AI Engineer II , you will be responsible for leading the architecture, design, and delivery of enterprise-scale AI/ML and Generative AI cloud platforms. You will drive technical strategy, establish engineering standards, mentor teams, and deliver secure, scalable, reliable, and cost-optimized AI infrastructure across multi-cloud environments including AWS, Azure, and GCP.

This role requires a strong combination of cloud architecture, AI/ML platform engineering, Kubernetes, MLOps, GenAI solution design, infrastructure automation, security governance, and hands-on experience deploying production-grade AI workloads.

Key Roles and Responsibilities

• Architect enterprise-scale AI/ML infrastructure across AWS, Azure, and Google Cloud Platform, ensuring high availability, scalability, performance, and cost efficiency.
• Lead the design and implementation of cloud infrastructure standards, governance frameworks, security controls, and technical best practices for AI/ML platforms.
• Design scalable Kubernetes-based platforms and self-service environments that enable ML, data science, and application teams to build, deploy, and manage AI workloads independently.
• Architect Generative AI, Retrieval-Augmented Generation, vector database, and LLM deployment solutions using frameworks and tools such as LangChain, CrewAI, LlamaIndex, OpenAI-compatible APIs, and enterprise AI services.
• Very good understanding of Microsoft Foundry 
• Build and manage production-grade MLOps and LLMOps pipelines for model training, deployment, monitoring, versioning, evaluation, and continuous improvement.
• Design cloud-native solutions for AI workloads using containerization, orchestration, serverless computing, GPU/accelerator-based compute, managed ML services, and distributed processing frameworks.

Required Skills and Technical Expertise

• Strong hands-on experience with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform.
• Hands-on experience with GenAI frameworks and orchestration tools such as LangChain, CrewAI, LlamaIndex, Semantic Kernel, or similar frameworks.
• Experience designing RAG pipelines, embedding workflows, document ingestion pipelines, prompt orchestration, vector search, and enterprise knowledge retrieval solutions.
• Strong understanding of LLM deployment patterns, model serving, inference optimization, prompt engineering, evaluation frameworks, guardrails, and responsible AI controls.
• Strong scripting and programming skills in Python , Bash, PowerShell, or similar languages, with the ability to build automation and integration solutions.
• Ability to work with APIs, data models, and external toolchains across complex systems.

What you can expect

We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:

• Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
• Medical Insurance
• Health Benefits
• Professional Development: Learning Platform and Certificate Reimbursement
• Shift Allowance

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.

When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.