Senior AI/LLM Engineer

Salary: $114,400 - 128,960 per year Requirements:

• We need a Bachelors or Masters degree in Computer Science, Artificial Intelligence, Software Engineering, or a closely related discipline.
• We are looking for 6+ years of software engineering or machine learning engineering experience.
• We require at least 3+ years of hands-on experience building Artificial Intelligence and Generative AI solutions.
• We need 3 to 5 years of strong practical experience developing production applications with Python.
• We are seeking 1 to 3 years of experience building solutions with OpenAI, Anthropic Claude, Gemini, Llama, or comparable LLM platforms.
• We require 3+ years of experience implementing Retrieval-Augmented Generation (RAG) architectures.
• We need 1 to 3 years of experience integrating vector databases and semantic search solutions.
• We are looking for 1 to 3 years of strong experience with LangChain and AI orchestration frameworks.
• We expect experience designing multi-agent AI architectures.
• We need strong knowledge of prompt engineering, model evaluation, AI governance, and Responsible AI principles.
• We require experience building REST APIs, microservices, and event-driven architectures.
• We need experience working with Azure or AWS cloud platforms.
• We expect a solid understanding of scalable enterprise application architecture.
• We value excellent analytical, problem-solving, and communication skills.
• Preferred: experience with LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar agent frameworks.
• Preferred: experience with vector databases such as Pinecone, Weaviate, ChromaDB, Qdrant, Milvus, or Azure AI Search.
• Preferred: experience with Docker and Kubernetes.
• Preferred: familiarity with CI/CD pipelines and MLOps practices.
• Preferred: experience with AI observability and monitoring platforms.
• Preferred: exposure to enterprise security, compliance, and Responsible AI frameworks.
• Preferred: experience working in Agile/Scrum environments.
• Nice to have: experience building enterprise copilots or AI assistants.
• Nice to have: experience integrating AI into enterprise SaaS platforms.
• Nice to have: knowledge of AI governance, security, and compliance standards.
• Nice to have: experience optimizing LLM inference performance and AI operating costs.

• We will design, develop, and deploy enterprise-scale Generative AI applications using modern LLM technologies.
• We will build production-ready backend services with Python and strong software engineering practices.
• We will create scalable AI architectures using OpenAI, Anthropic Claude, Gemini, Llama, or similar foundation models.
• We will design and implement Retrieval-Augmented Generation (RAG) pipelines with vector databases and semantic search.
• We will develop intelligent multi-agent AI systems that coordinate complex business workflows.
• We will architect AI solutions that are scalable, secure, maintainable, and aligned with enterprise standards.
• We will integrate AI capabilities into existing enterprise applications, APIs, and business processes.
• We will develop and consume REST APIs, microservices, and event-driven services for AI applications.
• We will implement AI orchestration frameworks such as LangChain and related agent platforms.
• We will write and refine prompts to improve accuracy, reasoning, and business outcomes.
• We will assess LLM performance and apply improvements to response quality.
• We will establish AI governance, model evaluation, and responsible AI best practices.
• We will monitor AI application performance and continuously optimize latency, cost, and quality.
• We will build cloud-native AI solutions using Azure or AWS AI services.
• We will implement Azure AI Search and vector search capabilities.
• We will design secure enterprise AI applications that follow cloud security and governance standards.
• We will collaborate with DevOps teams to deploy AI solutions through CI/CD pipelines.
• We will partner with business stakeholders to identify AI use cases and turn them into scalable technical solutions.
• We will present architecture decisions, solution approaches, and AI strategies to technical and non-technical audiences.
• We will mentor junior engineers and help strengthen AI engineering best practices across the organization.

• AI
• AWS
• Architect
• Azure
• Backend
• CI/CD
• Cloud
• DevOps
• Docker
• Support
• Kubernetes
• LLM
• Machine Learning
• MLOps
• Python
• RAG
• REST
• Security
• microservices
• JavaScript
• Langfuse

More:

We are NTT DATA, a global business and technology services innovator with a strong focus on data, artificial intelligence, consulting, and digital infrastructure. We support clients worldwide in innovating, optimizing, and transforming for long-term success, and we work with a diverse ecosystem across more than 50 countries. This is a remote Senior AI/LLM Engineer role supporting EST hours, based for Pittsburgh, Pennsylvania, United States, with a starting pay range of $55 to $62 per hour. The position includes company benefits such as medical, dental, and vision coverage, flexible spending or health savings accounts, AD&D insurance, employee assistance, 401(k) participation, and additional voluntary or legally required benefits.

last updated 33 week of 2026