GenAI Architect
Capgemini
Job Description
Job Title: Generative AI (GenAI) Architect
Location: NYC, NY (Hybrid)
Experience: 10+ Years in Software Engineering, Data & AI with 3+ Years in Generative AI, LLMs, and Enterprise AI Solutions
Job Summary
We are seeking an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and AI-powered automation. The ideal candidate will drive AI strategy, define architecture standards, and collaborate with business stakeholders, engineering teams, and leadership to deliver scalable, secure, and responsible AI solutions.
Key Responsibilities
AI Architecture & Strategy
- Define and implement enterprise GenAI architecture and roadmap.
- Design scalable AI solutions using OpenAI, Azure OpenAI, Anthropic Claude, Gemini, and open-source LLMs.
- Evaluate emerging AI technologies and recommend adoption strategies.
- Establish AI governance, security, compliance, and responsible AI frameworks.
Solution Design & Development
- Architect and implement:
- RAG (Retrieval-Augmented Generation) solutions
- AI Agents and Multi-Agent Systems
- Conversational AI and Chatbots
- Knowledge Management Solutions
- Document Intelligence Platforms
- Design vector database architectures using Pinecone, Weaviate, ChromaDB, Qdrant, or Azure AI Search.
- Develop prompt engineering and prompt management strategies.
- Define scalable LLM orchestration patterns using LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, or LangGraph.
Cloud & Infrastructure
- Architect cloud-native AI solutions on:
- Microsoft Azure
- AWS
- Google Cloud Platform
- Design MLOps/LLMOps pipelines for deployment, monitoring, and optimization.
- Establish model observability, monitoring, and performance tracking frameworks.
- Optimize AI workloads for scalability, reliability, and cost efficiency.
Security & Compliance
- Develop secure AI architectures aligned with enterprise security standards.
- Implement data privacy controls, PII protection, model governance, and audit mechanisms.
- Ensure compliance with regulatory frameworks such as GDPR, HIPAA, SOC2, and Responsible AI principles.
Stakeholder Management
- Partner with business leaders to identify GenAI opportunities.
- Translate business requirements into scalable technical solutions.
- Lead architecture reviews, design sessions, and technical governance meetings.
- Mentor AI engineers, architects, and development teams.
Required Qualifications
Education
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field.
Experience
- 10+ years of software engineering, solution architecture, or data engineering experience.
- 3+ years in AI/ML architecture and GenAI solution design.
- Hands-on experience building enterprise-grade GenAI solutions.
Technical Skills
Generative AI & LLMs
- OpenAI GPT-4/4o
- Azure OpenAI Service
- Anthropic Claude
- Google Gemini
- Llama, Mistral, Falcon
AI Frameworks
- LangChain
- LlamaIndex
- Semantic Kernel
- LangGraph
- CrewAI
- AutoGen
RAG & Search Technologies
- Azure AI Search
- Elasticsearch
- Pinecone
- ChromaDB
- Weaviate
- Qdrant
Programming
- Python
- Java
- C#
- REST APIs
- Microservices Architecture
Cloud Platforms
- Microsoft Azure (Preferred)
- AWS
- GCP
DevOps & MLOps
- Docker
- Kubernetes
- Terraform
- GitHub Actions
- Azure DevOps
- MLflow
Preferred Qualifications
- Microsoft Azure AI Engineer Associate (AI-102)
- Azure Solutions Architect Expert (AZ-305)
- AWS Machine Learning Specialty
- Google Professional Machine Learning Engineer
- TOGAF Certification
- Experience with Agentic AI and Autonomous Workflow Systems
Desired Skills
- Enterprise Architecture
- AI Governance
- Responsible AI
- Design Thinking
- Stakeholder Management
- Team Leadership
- Strategic Planning
- Solution Consulting
Key Deliverables
- Enterprise GenAI Architecture Blueprint
- AI Governance Framework
- RAG and Agentic AI Solutions
- LLM Platform Strategy
- AI Security & Compliance Standards
- Production-Ready AI Applications
- ...of the Fortune 100 companies. For a brief 1 minute video about us, you can check Designation: Enterprise Application Architect (GenAI) Location: New York, NY (Onsite) Job Type: Fulltime Description: ~15+ years overall experience and at least 1...SuggestedFull time
- ...Job Description Job Title- Gen AI Architect Location - NYC, NY Job Type-Full Time Technical Skills Deep expertise in AI/ML engineering and GenAI platforms. LLM Evaluation & Observability – Exposure to tools such as LangSmith, LLM as a Judge, RAGAS...SuggestedFull time
$70k - $90k
...Project Architect OpportunityIf you are a passionate Project Architect looking to join a growing firm, there is an incredible opportunity that awaits. This reputable Architecture and Design Firm is looking for a Project Architect to mentor, coach, develop and promote for...SuggestedWork at officeFlexible hours- ...Job Description Project Architect | New York Studio: -york At IA, we bring architecture, design, and strategy together to create environments that move people and organizations forward. Our teams help clients respond to changing business needs by designing places...SuggestedWork at office
$70k - $90k
...Project Architect Opportunity If you are a passionate Project Architect looking to join a growing firm, there is an incredible opportunity that awaits. This reputable Architecture and Design Firm is looking for a Project Architect to mentor, coach, develop and promote...SuggestedWork at officeFlexible hours$75k - $125k
...Job Description Intermediate Architect New York, NY | $75,000–$125,000 base + Bonus + Benefits Benefits: ~ Health Insurance: Company-paid medical, dental and vision coverage ~ Bonus: Discretionary year-end bonus, traditionally paid ~401(k): 50%...For contractorsWork at officeWork from home1 day per week- ...This is an excellent opportunity for a designer who enjoys being involved in all aspects of a project, working closely with senior architects and contributing to thoughtful, highly detailed architecture. The Role Contribute to the design and development of...
$120k - $150k
...in part due to our industry leading success in mergers and acquisitions Job Description We are seeking an experienced IAM Architect to design, build, and evolve our enterprise Identity and Access Management (IAM) program. This role oversees and drives the IAM architectural...- ...Job Description Architect – Workplace Design & Project Delivery (Client Side) Our client is seeking an experienced Architect for an in-house role overseeing workplace projects from early planning through construction and occupancy. This position will collaborate...For contractorsWork at office
$75k - $100k
...Job Description Rhythm Careers are partnering with a long-standing client in their search for an Intermediate Architect. This design studio has a commitment to work / life balance and wellbeing, making this a rare opportunity to work for a top-quality design studio...Local area$90k - $110k
...Job Description One of New York's most ambitious and holistic design studios is seeking an Architect to join their small, Manhattan-based studio. This firm work in high-end residential, small scale cultural, boutique workplace, product design and landscape architecture...- ...Job Description Architect Location: New York City We are working with a highly regarded architecture and design practice seeking a talented Architect to join its growing team in New York. This is an excellent opportunity for a design-focused professional...
$100k - $120k
...Job Description Join an Acclaimed Global Architecture Firm: Valerio Architects is an acclaimed mid-size ±85 people multi-disciplinary Architecture and Interior Design firm, with offices in Los Angeles, New York, Milan (IT), Monterrey (MX), and Buenos Aires (AR)...Full timeFor contractorsWork at officeMonday to Friday- ...Job Description A well-established, growing design-build firm in the Syracuse area is looking for an experienced Project Architect to join their design team. The organization has a strong reputation across Central New York for architecture and construction work...For contractors
- ...Job Description Title: Project Architect (Revit Focused) Location: Greater Chicago Employment Type: Full-Time, In-Office Our client is a mid-sized professional architectural practice based in Greater Chicago providing comprehensive architectural services...Full timeInternshipWork at office
- ...Job Description We are seeking a Project Architect to participate in the design, documentation, and construction administration for a variety of projects for municipal and corporate clients including; Healthcare, K-12/Higher Education, Public Safety and Justice for...Work at officeLocal areaFlexible hours
- ...sustainability and the belief that thoughtful design should be accessible to people across incomes and backgrounds is seeking a Project Architect to join its New York City team. Through affordable housing, schools, and spaces that bring people together, the firm’s work...Full timeWork at officeRemote work
$120k - $155k
...Job Description Senior Architect New York, NY | $120,000–$155,000 base + Bonus + Benefits Benefits: ~ Health Insurance: 100% company-paid medical, dental and vision coverage ~ Bonus: Discretionary year-end bonus, traditionally paid ~401(k): 50%...For contractorsWork from home1 day per week$60 - $80 per hour
...Description Help Shape Architectural Services at Trotter and Associates Trotter and Associates, Inc. is seeking an experienced Architect to join our multidisciplinary team and help expand architectural services within our municipal engineering practice. This...Hourly payTemporary workWork at officeWork from home- ...Job Description A large federal modernization program is looking for a Senior Test Automation Architect who is, first and foremost, a strong hands on Java engineer. You will write Java code every day, own the BDD automation framework built in Java, and lead the testers...
- Job Description We are excited to be partnering with a highly regarded New York-based design studio specialising in luxury residential and hospitality interiors. Known for its sophisticated, timeless aesthetic and exceptional attention to detail, the studio has built an...
- ...Job Description Enterprise Data Architect Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes... ...through BI platforms such as Power BI and Tableau, as well as GenAI and natural-language querying solutions. • Define...Full time
- ...for building enclosure, roofing, waterproofing, and facilities-related assignments. Coordinating with clients, contractors, architects, engineers, and internal project teams throughout all phases of project delivery. Minimum Qualifications: Minimum of 1...Contract workTemporary workFor contractorsWork at officeNight shift
- ...with a leading global legal technology company to identify an experienced attorney to join its growing Enterprise team as a Legal Architect. This is a unique opportunity for a lawyer looking to transition away from traditional legal practice and into the rapidly evolving...
- ...Job Description ITTConnect is seeking a Platform Architect expert in Fiserv for a direct-hire full time position with a client in Miami. Job location: Miami or NY preferred. Remote in US Central or Eastern Time Zones will be considered. Key Responsibilities...Full timeRemote work
- ...projects across new construction, rehabilitation and commissioning Develop and maintain senior relationships with major owners, architects, developers and industry partners Drive business development, strategic pursuits and the expansion of key client accounts...
$65 - $80 per hour
Job Description Job Title: Senior Power Platform & Process Automation Consultant Contract Type: W2 Job Type/Length: 1 year Contract to Hire Days a Week Onsite/Hybrid/Remote: Primarily remote, Heavy preference to DC - in office at client site as needed. ...Contract workWork at officeRemote work- ...talent excited to join that effort. To learn more about our exciting organization, please visit us at We are seeking a Principal Architect to join our team and support our government client on a large, multi-year IT services program. The Principal Architect is...Work experience placementWork at officeLocal areaRemote workFlexible hours
- ...looking to grow their Transportation Practice in their New York office. With several U.S. projects in the works, they are looking for Architects of all experience and leadership levels to join their team and help grow the scope of work to international markets. Key...Work at office
- Job Description Required Qualifications ~10+ years of experience in application architecture, enterprise architecture, solution architecture, or closely related technical roles. ~ Extensive experience designing enterprise applications and cloud-native solutions...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GenAI Architect. Be the first to apply!


