Managing Director, AI Platform Architect

Overview

Baker Tilly is a leading advisory tax and assurance firm providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the worlds leading financial centers New York London San Francisco Los Angeles Chicago and Boston. Baker Tilly Advisory Group LP and Baker Tilly US LLP (Baker Tilly) provide professional services through an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable laws regulations and professional standards. Baker Tilly US LLP is a licensed independent CPA firm that provides attest services to its clients. Baker Tilly Advisory Group LP and its subsidiary entities provide tax and business advisory services to their clients. Baker Tilly Advisory Group LP and its subsidiary entities are not licensed CPA firms.

Baker Tilly Advisory Group LP and Baker Tilly US LLP trading as Baker Tilly are independent members of Baker Tilly International a worldwide network of independent accounting and business advisory firms in 141 territories with 43000 professionals and a combined worldwide revenue of $5.2 billion. join the conversation onLinkedInFacebookandInstagram.

Please discuss the work location status with your Baker Tilly talent acquisition professional to understand the requirements for an opportunity you are exploring.

Baker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race color religion sex national origin disability or protected veteran status gender identity sexual orientation or any other legally protected basis in accordance with applicable federal state or local law.

Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group LP employee e-mail accounts are considered property of Baker Tilly Advisory Group LP and are not subject to payment of agency order to be an authorized recruitment agency (search firm) for Baker Tilly Advisory Group LP there must be a formal written agreement in place and the agency must be invited by Baker Tillys Talent Attraction team to submit candidates for review via our applicant tracking system.

Job Description:

The Managing Director AI Platform Architect is the founding architect of Baker Tillys AI Product Group (APG) the senior-most individual contributor in the organization and the single design authority for the product agentic and data architecture of everything APG builds. The architect designs the agent platform the firms AI products run on (agent harness orchestration tool and MCP integration retrieval memory and context management and the evaluation infrastructure that decides what ships) co-designs the intelligence substrate (ontology knowledge graph judgment layer) with the substrate lead chairs APGs technical design authority and serves as the CAITOs senior technical counsel.

This is a hands-on build-first role: the architect prototypes the patterns product teams then harden sets the technical bar for the founding engineers and leads the deliberate absorption of architecture from the firms expert engineering partners so Baker Tilly owns its platform rather than renting it.

Responsibilities

• Architecture design and standards.
  • Own the target-state architecture for the AI product portfolio and the architecture decision records that make significant decisions transparent durable and teachable.
  • Design the agent platform: harness and orchestration patterns tool and MCP integration retrieval architecture spanning vector and graph memory and context management and the shared services every product consumes.
  • Co-design the intelligence substrate (ontology knowledge graph judgment layer) with the substrate lead.
  • Set and steward a model-agnostic model strategy selection routing fallback fine-tuning versus context strategies and cost-per-outcome economics and keep the platform portable and vendor-neutral.
• Hands-on technical leadership.
  • Design by building: prototype the patterns product teams then harden.
  • Review and shape each products architecture with the engineering teams hands-on in the code.
  • Chair APGs technical design authority.
  • Lead architecture absorption from the firms expert engineering partners on a shadow-pair-lead-own ramp converting partner-built patterns into firm-owned standards decision records and runbooks with defined gates at which each architecture layer becomes firm-owned.
• Evaluation standards and production readiness.
  • Establish evaluation-first engineering as an architectural standard: no capability is production-ready until its evaluation suite says so.
  • Define the non-functional architecture (scalability deployment security observability) with enterprise technology partners so products transition cleanly into enterprise operation.
  • Co-own the production handoff standard and exercise it on the first products through the gate.
  • Operate the architectural seam with Enterprise Architecture full design authority inside APG products built to enterprise standards data contracts and production gates.
• Technical counsel and talent.
  • Advise the CAITO on build buy and integrate decisions across the portfolio including vendor AI architecture boundaries where the firm must own the data and knowledge layer.
  • Help hire and mentor the founding engineers; raise the bar on design quality code quality and written technical decision-making.
  • Represent APG architecture in the firms architecture forums and with the CAITO to executive leadership.
• Engage and participate in special projects or complete other duties as assigned.

Qualifications

• Bachelors degree in computer science engineering or a related field or equivalent practical experience; advanced degree a plus.
• No certifications or licenses required.
• 15 years in software and platform architecture or engineering including senior engineering leadership (director level or above) or principal/consulting-architect scope across multiple teams.
• Recent hands-on depth in LLM-based and agentic systems carried to production including agentic infrastructure itself: control planes agent runtimes gateways SDKs and the developer experience around them. Founder or zero-to-one platform experience is highly valued.
• Has personally designed and shipped an AI platform agent framework or ML platform at meaningful scale and can walk through the decisions trade-offs and failures.
• Experience operating as a principal or consulting architect across multiple teams setting direction through standards prototypes and persuasion rather than authority alone.
• Experience partnering with enterprise architecture security and governance functions in a large organization without losing product velocity.
• Deep fluency in the modern agentic stack: orchestration frameworks tool/function calling and MCP retrieval (vector and graph) context and memory management and evaluation methodology.
• Strong data architecture background: lakehouse platforms semantic and graph modeling data contracts and pipeline architecture for structured and unstructured data.
• Knowledge representation: ontologies knowledge graphs GraphRAG judgment/decision modeling.
• LLM platform engineering: gateways routing evaluation harnesses observability token economics; model strategy across frontier and open models.
• Enterprise integration: APIs event-driven patterns data contracts identity and entitlements.
• Writes production-quality code and prototypes; recent hands-on work in Python and/or TypeScript.
• Demonstrates personal AI leverage: designs and prototypes with agentic tools as a force multiplier the working standard for this team.
• Builder-first temperament with strong architectural judgment; pragmatic about which decisions must be made once and well versus delegated; raises the technical bar of everyone in range; writes things down; makes complex systems explainable to executives and practitioners; treats the firms platform substrate and runbooks as owned assets.

The pay rate range for the position is $350000-$550000. Actual compensation is influenced by a variety of relevant factors including but not limited to applicants skills prior experience qualifications degrees professional certifications work arrangements and geographic location. Baker Tilly offers a comprehensive compensation and benefits package to eligible employees.

All qualified internal candidates will be considered for this position irrespective of their current geographic location.

Required Experience:

Director