AI Application Engineer / Architect
Top Prospect Group
We are seeking an experienced AI Application Engineer / Architect to lead the design, development, and optimization of our next-generation agentic AI platform. This individual will play a key role in architecting intelligent, scalable AI solutions that leverage LangGraph to orchestrate sophisticated multi-agent workflows and state machines while maximizing the capabilities of Azure AI Search and the broader Microsoft Azure AI ecosystem.
The ideal candidate possesses deep expertise in AI application architecture, large language models (LLMs), retrieval-augmented generation (RAG), agent orchestration frameworks, and cloud-native development. You will work closely with engineering, product, and business stakeholders to build innovative AI-powered solutions that drive automation, decision-making, and operational efficiency.
Key Responsibilities
- Architect, design, and implement scalable AI applications leveraging multi-agent frameworks and agentic workflows.
- Develop and optimize complex stateful agent orchestration solutions using LangGraph and related LangChain technologies.
- Design and implement advanced Retrieval-Augmented Generation (RAG) solutions utilizing Azure AI Search for high-quality knowledge retrieval and contextual reasoning.
- Build intelligent AI systems capable of autonomous decision-making, task planning, memory management, and multi-step execution.
- Integrate large language models from Azure OpenAI and other AI platforms into enterprise-grade applications.
- Partner with business stakeholders to gather requirements, define AI use cases, and translate business needs into technical solutions.
- Drive architecture decisions, governance standards, and best practices for AI application development.
- Optimize AI application performance, scalability, observability, and security.
- Collaborate with software engineers, data engineers, and DevOps teams to deliver production-ready AI solutions.
- Evaluate emerging AI technologies, frameworks, and methodologies to continuously improve platform capabilities.
- Establish monitoring, testing, and evaluation frameworks for AI applications to ensure quality, reliability, and responsible AI practices.
Required Qualifications
- Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related field.
- 5+ years of software engineering experience with at least 2+ years focused on AI/ML application development.
- Hands-on experience designing and deploying enterprise AI applications.
- Strong expertise with LangChain , LangGraph , and agent-based AI architectures.
- Experience implementing RAG solutions using Azure AI Search , vector databases, and semantic search technologies.
- Proficiency with Python and modern software development practices.
- Strong understanding of large language models (LLMs), prompt engineering, embeddings, vector search, memory systems, and tool integration.
- Experience developing cloud-native applications within Microsoft Azure .
- Knowledge of API design, microservices architecture, containerization, and CI/CD pipelines.
- Excellent problem-solving, communication, and stakeholder management skills.
Preferred Qualifications
- Experience with Azure OpenAI Service , Cognitive Services, and other Azure AI offerings.
- Familiarity with vector databases such as Pinecone, Weaviate, Chroma, or Azure-native vector storage solutions.
- Experience implementing multi-agent systems, autonomous agents, and workflow orchestration platforms.
- Knowledge of MLOps, AI observability, and model evaluation frameworks.
- Experience with enterprise security, compliance, and responsible AI governance.
- Advanced degree in Computer Science, Artificial Intelligence, Machine Learning, or related disciplines.
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Application Engineer / Architect. Be the first to apply!
- senior ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai ml engineer New York, NY
- ai developer New York, NY
- ai prompt engineer New York, NY
- ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer remote New York, NY
- network applications engineer New York, NY
- field applications engineer New York, NY
