AI Engineer/Architect

AI Engineer/Architect

Position Description
We CGI is seeking a highly skilled and experienced Senior AI Engineer/Architect to join our Health Care client in one of our selected client locations. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest leaders in the Health Care industry.

This Senior AI Engineer will be instrumental to design, develop, and lead enterprise grade Generative AI solutions. This role requires deep hands-on expertise in Python, Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and agent-based architectures.

The role will work closely with the AI Center of Excellence (AI CoE) to ensure alignment with enterprise AI standards, governance, and best practices while driving adoption across delivery teams.

This position can be performed from any Client site Bloomfield, CT, Raleigh, NC or Lafayette, LA in a Hybrid working Model.

Your future duties and responsibilities
The AI Engineer/Architect will own the architecture and technical direction for enterprise agentic AI solutions, balancing hands-on engineering with design governance. The role will establish reusable patterns for multi agent orchestration, MCP enabled tool ecosystems, secure backend services, integration, observability, and production reliability.

Key Responsibilities
AI Architecture & Multi Agent Orchestration
. Architect and implement robust multi agent orchestration using Python and LangGraph, including intelligent routing, dynamic handoffs, shared state management, long term memory, tool calling, error recovery, and follow up conversation flows.
. Define target and reference architectures for agentic AI, retrieval augmented generation (RAG), model access, memory, evaluation, and human in the loop controls.
. Establish reusable architecture patterns, engineering standards, guardrails, and design review practices for enterprise AI solutions.
MCP & Agent Ecosystem
. Design, develop, and maintain MCP servers using FastAPI and Python to expose tools, resources, prompts, and custom capabilities as part of the agent ecosystem.
. Define standards for tool contracts, discovery, versioning, permissions, schema validation, error handling, and safe execution.
. Build and maintain custom tools and integrations that connect AI agents with internal APIs, enterprise data sources, and legacy systems.
AI Powered Products & Domain Solutions
. Design complex AI powered chatbots and insights engines for critical healthcare and pharmacy benefit management workflows, including claims, pharmacy search, drug coverage, and prior authorization.
. Translate business and product requirements into scalable technical designs and guide solutions from proof of concept through production implementation.
. Select appropriate model, RAG, memory, orchestration, and tool use patterns based on quality, latency, cost, security, and compliance requirements.
Backend Services, Integration & Security
. Own the architecture and development of high-performance FastAPI services, including streaming responses, asynchronous processing, custom middleware, rate limiting, caching, and authentication and authorization strategies.
. Design resilient integration patterns for APIs and legacy platforms, including retries, idempotency, timeouts, circuit breakers, fallbacks, and auditability.
. Ensure solutions follow security, privacy, responsible AI, secrets management, input/output validation, and regulated data handling best practices.
Observability, Reliability & Optimization
. Implement comprehensive observability using LangSmith, distributed tracing, monitoring, logging, evaluation, error handling, and performance tuning for AI agent workloads.
. Define service level objectives and quality measures for latency, answer quality, tool accuracy, task completion rate, reliability, and cost.
. Identify and prioritize technical improvements in agent performance, latency, tool accuracy, scalability, and overall system architecture.
Technical Leadership & Collaboration
. Collaborate cross functionally with frontend, DevOps, product, security, data, and enterprise architecture teams to deliver end to end AI capabilities with high reliability.
. Lead architecture reviews, mentor developers, communicate design trade offs, and establish implementation guidance for distributed delivery teams.
. Evaluate emerging AI technologies pragmatically and recommend adoption based on measurable business value and enterprise readiness.

Required qualifications to be successful in this role
. 12+ years of professional software engineering and solution architecture experience, including hands on delivery of enterprise applications and platforms.
. 5+ years of AI/ML experience with recent hands-on delivery of production Generative AI and agentic AI solutions.
. Expert level Python skills and strong experience designing scalable, secure, production grade backend services using FastAPI.
. Hands on experience with LangGraph or a comparable framework for multi agent orchestration, including routing, handoffs, shared state, memory, tool use, recovery, and conversational continuity.
. Experience designing and implementing MCP servers and governing tools, resources, prompts, schemas, permissions, and lifecycle management within an agent ecosystem.
. Deep understanding of LLMs, prompt engineering, RAG, embeddings, vector search, memory patterns, function/tool calling, model evaluation, and guardrails.
. Proven experience designing AI powered chatbots, insights engines, or workflow automation solutions that integrate with enterprise APIs, data sources, and legacy systems.
. Strong knowledge of API and distributed system patterns, including streaming, asynchronous processing, middleware, rate limiting, authentication, authorization, resilience, and observability.
. Experience implementing LangSmith or equivalent AI observability, tracing, evaluation, debugging, and performance monitoring capabilities.
. Strong understanding of cloud native architecture, containers, CI/CD, security, privacy, responsible AI, and operational support for regulated enterprise workloads.
. Demonstrated ability to lead architecture decisions, mentor engineering teams, facilitate design reviews, and communicate complex tradeoffs to technical and business stakeholders.
Expectations
. Own solution architecture end to end, from discovery and design through implementation, production readiness, and adoption.
. Balance innovation with reliability, security, cost, maintainability, and measurable business outcomes.
. Drive architectural simplification, reuse, and consistent engineering practices across AI implementations.
. Operate as a hands-on technical leader who can validate critical designs and implementation patterns through working code and prototypes.
. Build trusted partnerships across product, engineering, DevOps, security, data, and enterprise architecture teams.

Bachelor's degree in computer science, Engineering, or a related field, or equivalent professional experience.

Other Information:
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $80,600.00 $218,200.00.

CGI's benefits are offered to eligible professionals on their first day of employment to include:
. Competitive compensation
. Comprehensive insurance options
. Matching contributions through the 401(k) plan and the share purchase plan
. Paid time off for vacation, holidays, and sick time
. Paid parental leave
. Learning opportunities and tuition assistance
. Wellness and Wellbeing programs

#LI-MP2

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business.

CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at View email address on us.fitly.work . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned.

We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members.

All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.

CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI’s legal duty to furnish information.