BCG Platinion | Senior IT Architect - AI Platforms

Senior IT Architects - AI Platforms at BCG Platinion

Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Durham | Houston | Miami | Minneapolis | Nashville | New York | Philadelphia | Pittsburgh | Summit | Washington

Boston Consulting Group (BCG) is a global consulting firm that partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Our success depends on a spirit of deep collaboration and a global community of diverse individuals determined to make the world and each other better every day.

BCG's Tech and Digital Advantage (TDA) practice focuses on helping clients deliver competitive advantage and superior business performance through the use of data, technology and digital. Platinion is the fastest growing practice at BCG and at the heart of the strategic impact we have with our clients. Our consultants and experts globally work across all industries and provide deep experience and expertise across a number of topics including Digital Transformation, Data & Digital Platforms, AI at Scale, Agile, Cybersecurity and Digitizing the Tech Function.

At BCG, we bring together the right people to conquer complexity, drive material change, and initiate positive, long-term impact. Explore our BCG Culture and Values for more information.

About BCG Platinion

BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.

What You'll Do

Senior IT Architects - AI Platforms at BCG Platinion are:

• Collaborative. They are strong team players who work closely with engineers, data scientists, and architects to deliver AI platform components effectively.
• Systems-Oriented. They contribute to the design and implementation of AI platform and agentic system components that solve real business problems.
• Hands-on Technologists. They apply solid AI and software engineering skills to build, test, and improve AI platform capabilities.
• Comfortable with ambiguity. They can operate effectively when requirements are evolving, adapting their technical approach as solutions take shape.
• Delivery focused. They help teams adopt new AI capabilities by supporting implementation, integration, and operational readiness.
• Agile contributors. They work within agile teams, iterating on designs and implementations as requirements and feedback evolve.
• Curious and Innovative. They explore and apply modern AI platform and agentic patterns to improve solution quality and scalability.
• Developing architects. They grow their architectural skills by combining hands-on implementation with exposure to broader system design decisions.
• Reliable team members. They support senior architects and technical leads by executing assigned workstreams and contributing to high-quality AI platform solutions.

You're Good At:

We are seeking a Senior AI Platform Architect to help design and implement intelligent, agentic AI platforms. This role is ideal for someone who enjoys hands-on development while growing their architectural skills. You will work closely with Lead and Principal Architects, contributing to AI platform implementations that integrate large language models (LLMs), data pipelines, and enterprise systems.

AI Architecture & Solution Design

• Contribute to the design of AI and LLM-based system architectures with guidance from senior architects.
• Implement agentic AI components that support intelligent workflow automation and task execution.
• Build and extend RAG-based solutions for context retrieval, prompt workflows, and system integration.
• Follow established architectural standards and contribute feedback to improve design patterns and practices.
• Support implementation of batch and real-time inference pipelines with attention to performance and reliability.

Prototyping & Validation

• Develop prototypes and technical proofs-of-concept to validate AI platform components and workflows.
• Implement solutions using modern AI frameworks and libraries under architectural guidance.
• Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.

Implementation Management and Support

• Support implementation and deployment of AI platform components into development and production environments.
• Assist with monitoring, troubleshooting, and improving system performance and reliability.
• Follow defined standards for versioning, testing, and monitoring of AI services and models.

Communication and Collaboration

• Communicate technical concepts clearly within the project team and with immediate stakeholders.
• Support preparation of technical documentation and presentations.
• Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
• Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
• Seek and incorporate feedback from senior team members to improve technical output.

Team Management

• Support junior team members through knowledge sharing and day-to-day collaboration.
• Contribute positively to team culture and ways of working.
• Seek feedback on work quality and incorporate guidance from senior architects.
• Demonstrate professionalism and alignment with BCG's culture and values.

Innovation and Growth

• Current on emerging concepts in agentic AI, RAG, and AI platform tooling.
• Experiment with new tools and techniques under guidance to expand technical skill sets.
• Build depth in AI platform engineering through hands-on delivery experience.
• Actively pursue learning opportunities to grow toward broader architectural responsibilities.
• Contribute technical input to proposals or internal initiatives when needed.

What You'll Bring

• Bachelor's degree in information technology, computer science, engineering, or a related field (Master's degree is a plus).
• 4+ years of experience in software engineering, data engineering, or AI development.
• Solid foundation in software development and distributed systems concepts.
• Hands-on experience building or integrating AI/ML or LLM-based components.
• Proficiency in one or more programming language such as Python or JavaScript is nice to have.
• Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
• Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
• Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
• Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
• Exposure to deploying AI workloads on cloud platforms.
• Experience integrating AI components with APIs and data sources.
• Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
• Strong problem-solving skills and attention to code quality.
• Ability to explain technical concepts clearly within a project team.
• Willingness to learn and grow in fast-paced, ambiguous environments.
• Agile mindset with a focus on iterative delivery and continuous improvement.
• Willingness to travel to work with clients and BCG teams as needed.
• Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Additional info

What We Offer:

At BCG, we care about our people, and offer best in class benefits to support you personally and professionally including:

• An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
• A unique experience to work