AI Gateway Engineering Associate Director
DTCC- The Depository Trust & Clearing Corporation
Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve. The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential, building infrastructure capabilities to meet client needs and implementing data standards and governance.Pay and Benefits:Competitive compensation, including base pay and annual incentiveComprehensive health and life insurance and well-being benefits, based on locationPension / Retirement benefitsPaid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).The Impact you will have in this role:Being a member of CISO Team, this role is critical to enabling the organization’s AI strategy by providing a secure, resilient, and governed platform for AI innovation. The Senior AI Gateway Engineer will play a foundational role in establishing the control plane through which enterprise AI interactions are managed, secured, monitored, and governed, while ensuring the resilience expected of a systemically important financial services organization. The Senior AI Gateway Engineer will lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform with a primary focus on Kong AI Gateway.This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs), AI Agents, Retrieval Augmented Generation (RAG) services, Model Context Protocol (MCP) services, and Agent-to-Agent (A2A) communications across the enterprise.The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, identity and access management (IAM), resiliency engineering, and enterprise governance to deliver a highly available AI platform that meets the demands of a regulated financial services environment.Your Primary Responsibilities:AI Gateway Architecture & EngineeringDesign, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI.Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and internal and external AI services.Implement intelligent model routing, failover, traffic shaping, and provider abstraction.Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.Define scalable control plane and data plane deployment architectures across hybrid and multi-cloud environments.Identity & Access Management for AIArchitect and implement enterprise-grade identity controls for AI platforms.Integrate Kong AI Gateway with enterprise identity providers and IAM platforms.Implement OAuth 2.0, OpenID Connect (OIDC), JWT, mutual TLS (mTLS), RBAC, ABAC, non-human identities, workload identities, and agent identities.Establish fine-grained authorization controls at the model, agent, tool, prompt, and data source levels.Design identity propagation patterns across AI workflows and MCP services.Partner with security and compliance teams to establish AI governance and Zero Trust controls.AI Security, Governance & Risk ManagementImplement AI security guardrails and policy enforcement mechanisms.Design controls for prompt injection protection, data loss prevention (DLP), PII detection and redaction, content safety enforcement, prompt and response filtering, and model access governance.Establish policy-as-code practices to manage AI controls at scale.Define logging, monitoring, and audit controls supporting regulatory and compliance requirements.Collaborate with Risk, Compliance, Legal, Data Protection, and AI Governance teams.Resiliency, Reliability & Operational ExcellenceDesign highly available and resilient AI platform architectures.Establish enterprise resiliency requirements including multi-region deployment strategies, provider failover, cross-cloud recovery patterns, active-active architectures, disaster recovery, and business continuity controls.Implement rate limiting, circuit breakers, load balancing, traffic throttling, semantic caching, and capacity management.Define and manage Service Level Objectives (SLOs), Service Level Indicators (SLIs), error budgets, Recovery Time Objectives (RTOs), and Recovery Point Objectives (RPOs).Conduct architecture reviews, resilience testing, and failure scenario exercises.Cloud & Data Platform IntegrationDesign AI access patterns across Microsoft Azure, Amazon Web Services (AWS), and Snowflake.Integrate AI Gateway services with Azure OpenAI, AWS Bedrock, Snowflake Cortex, vector databases, data protection platforms, and enterprise observability tooling.Ensure secure connectivity and standardized governance across multi-cloud environments.Observability & Platform OperationsBuild enterprise observability capabilities for AI workloads.Implement monitoring, metrics, tracing, and audit logging.Analyze token consumption, latency, model utilization, cost optimization opportunities, and security events.Create operational dashboards for engineering, security, risk, and executive stakeholders.Support incident response and platform troubleshooting efforts.**NOTE: The Primary Responsibilities of this role are not limited to the details above. **Qualifications:Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, and/or related discipline.Master's degree preferred.Min 8 years of relevant experienceTalents Needed for Success:8+ years of experience designing and operating enterprise API, application, or cloud platforms.5+ years of experience in cloud architecture and security.3+ years working with AI/ML platform technologies or enterprise AI deployments.Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions.Experience within regulated industries such as financial services, banking, insurance, or capital markets strongly preferred.Technical SkillsAI Gateway & Platform TechnologiesKong AI Gateway; Kong Enterprise; API gateway technologies; service mesh concepts; MCP and Agent-to-Agent architectures; LLM platforms and AI orchestration frameworks.Cloud PlatformsMicrosoft Azure; Azure OpenAI; AWS; AWS Bedrock; hybrid and multi-cloud architectures.Data & Analytics PlatformsSnowflake; Snowflake Cortex; vector databases; RAG architectures; data governance platforms.IAM & SecurityOAuth 2.0; OIDC; JWT; SAML; mTLS; privileged access management; secrets management; Zero Trust architecture; identity federation; machine and agent identity.Programming & AutomationPython; Terraform; Kubernetes; GitHub Actions; CI/CD; Infrastructure as Code; Policy as Code.Preferred QualificationsKong Certified Professional certification.AWS Solutions Architect certification.Microsoft Azure Solutions Architect certification.CISSP, CCSP, or equivalent security certification.Experience implementing AI security controls and governance frameworks.Familiarity with NIST AI RMF, NIST 800-53, NYDFS 500, PCI DSS, SOC 2, and other financial services regulatory requirements.Experience with DSPM, DLP, and enterprise data protection controls.Key Success MetricsSuccessful deployment and adoption of enterprise AI Gateway services.Reduction of direct AI provider integrations through centralized governance.Achievement of enterprise resiliency and availability targets.Compliance with security, privacy, and regulatory requirements.Improved AI observability, auditability, and cost management.Successful implementation of AI identity and authorization controls.Reduction in AI-related security risks and policy violations.The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. With over 50 years of experience, DTCC is the premier post-trade market infrastructure for the global financial services industry. From 20 locations around the world, DTCC, through its subsidiaries, automates, centralizes, and standardizes the processing of financial transactions, mitigating risk, increasing transparency, enhancing performance and driving efficiency for thousands of broker/dealers, custodian banks and asset managers. Industry owned and governed, the firm innovates purposefully, simplifying the complexities of clearing, settlement, asset servicing, transaction processing, trade reporting and data services across asset classes, bringing enhanced resilience and soundness to existing financial markets while advancing the digital asset ecosystem. In 2024, DTCC’s subsidiaries processed securities transactions valued at U.S. $3.7 quadrillion and its depository subsidiary provided custody and asset servicing for securities issues from over 150 countries and territories valued at U.S. $99 trillion. DTCC’s Global Trade Repository service, through locally registered, licensed, or approved trade repositories, processes more than 25 billion messages annually. To learn more, please visit us at or connect with us on LinkedIn, X, YouTube, Facebook and Instagram. DTCC proudly supports Flexible Work Arrangements favoring openness and gives people freedom to do their jobs well, by encouraging diverse opinions and emphasizing teamwork. When you join our team, you’ll have an opportunity to make meaningful contributions at a company that is recognized as a thought leader in both the financial services and technology industries. A DTCC career is more than a good way to earn a living. It’s the chance to make a difference at a company that’s truly one of a kind.Learn more about Clearance and Settlement by clicking here.Full timePosting Date: 2026-09-04
$156.4k - $301k
.... Join EY and help to build a better working world.The OpportunityAs an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments. This...SuggestedSummer holidayLocal areaFlexible hours$130.9k - $268.7k
Position Summary Role Overview: As an Associate Director, Applied AI Engineering, you will set the engineering vision and technical direction for... ...solutions on modern technology stacks (e.g., API Gateways, Message Brokers, Queuing Services, Workflow Automation...SuggestedWork at officeLocal areaVisa sponsorship3 days per week- ...NJ, 07310 / Dallas, TX, 75019 / Tampa, FL, 33647CTH2 round interview - zoomDescription:We are seeking an experienced Senior AI Gateway Engineer to lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform with a primary...Suggested
$156.4k - $301k
...EY and help to build a better working world. The Opportunity As an Associate Director in EY’s Forward Deployed Engineering team, you will support the design, development, and deployment of AI-driven, data-centric solutions within strategic client environments....SuggestedSummer holidayLocal areaFlexible hours$170k - $300k
...United StatesSalary: $170,000.00 - $300,000.00Category: Technology, Applications Development, ExecutiveCompany: CitiApplied AI Engineering Director for Banking Technology (Hybrid)Role SummaryWe are looking for a highly motivated, hands-on Applied AI Engineering Senior...SuggestedFull time- ...member of the Technology Research & Innovation team, the Associate Director, DevSecOps Engineering Manager will serve as the spearhead for Web3 Platform... ...as Kubernetes, Kafka, Cloud Managed Databases, API gateways, and service meshesChampion engineering standard methodologies...Remote workFlexible hours
- ...career opportunity that will light a fire within you.Team Lead, AI Engineering So, what’s the role all about?NICE is assembling a core... ...the MCP integration layer, agent orchestration engine, Models Gateway, RAG pipelines, prompt management, LLM evaluation, and developer...Work at officeRemote workFlexible hours
$200k - $300k
AI Architect, Principal Frontline AI Engineer - HealthcareAbout Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative...$195k - $275k
...countries. DevGenAI has been an extraordinary AI development platform built internally... ...the POC/Dev stage). With more than 200 engineers contributing code and more than 4,000 PRs... ...AWS Bedrock, Google Vertex AI, internal AI gateways, or enterprise model access/control...Temporary workWork at officeWorldwide- Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We're committed...Remote workFlexible hours
- As an Executive Director of Architecture & Engineering at JPMorgan Chase within Asset and Wealth Management, you define and drive the technical vision, architecture... ...north star with a strong point of view on agentic AI-enabled engineering, platform modernization, and...
$113.1k - $232.3k
Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI... ...and the AI control plane (model/LLM gateway, guardrails) from the operability and... ...the applicable geographic differential associated with the location at which the...Work at officeLocal areaVisa sponsorshipFlexible hours3 days per week$142.32k - $213.48k
...countries operating at a scale few can match. From deploying advanced AI to helping shape global markets, we build systems that matter.... ...and innovative Vice President-level Machine Learning Systems Engineer with extensive ML Ops experience to join our team and lead the...Full time$170k - $200k
Our client is seeking an AI Software Engineer Manager to help lead the development of a greenfield AI platform that will serve as a centralized intelligence layer across a large ecosystem of digital products. This is a hands-on leadership role for an experienced engineering...2 days per week3 days per week- ...The Assistant Vice President, Red Team & AI Security supports the planning,... ...documentation.Coordinate with defensive, engineering, risk, and business stakeholders to ensure... ...Authority (FINRA) and the National Futures Association (NFA). The major responsibilities listed...Full timeWork at officeLocal areaRemote work1 day per week
$142.32k - $213.48k
...Development, ProfessionalCompany: CitiWe're searching for a highly skilled and experienced senior engineer and Python expert to lead the design and development of the various AI-related technologies as part of Services Tech AI team. The ideal candidate has an excellent...Full time- ...JPMorgan Chase & Co. in Jersey City seeks a Director of Software Engineering to lead a technical area within Commercial & Investment Bank, Sales & Controls... ...and solution delivery. We expect strong Python expertise, AI-enabled architecture experience, cloud leadership on AWS,...
- ...Chase is seeking a senior technology leader to drive multi-department AI-enabled engineering initiatives and SDLC/TLM automation. You will partner with executives to set governance, security, and delivery standards, while guiding large cross-functional teams toward firmwide...
- ...JPMorgan Chase & Co. in New Jersey seeks a Director of Software Engineering to lead a technical area and drive impact across departments. You will guide AI-enabled engineering, SDLC automation, and governance to ensure secure, scalable delivery of software solutions....
$175k - $215k
...a 200-year legacy and a shared passion for what’s next, this is the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-powered features that allow financial services users to generate data...Full timeLocal area- ...exciting and rewarding opportunity for you to take your software engineering career to the next level.As an Software Engineer III at... ...Enterprise Technology, you will help design and deliver agentic AI platforms and large language model-enabled services for enterprise...
- ...AlphaLife Sciences, a pioneer in the fusion of life sciences and AI computer science as an AI-enabled integrated clinical research... ...Agile Trial Management. AlphaLife Sciences is seeking an AI Engineer Leader to drive AI innovation for new projects in clinical workflows...Full timeVisa sponsorship
- ...JPMorgan Chase & Co. is seeking a Senior Director of Software Engineering in Jersey City. You will lead technology implementations across departments, focusing on AI-enabled engineering. With over 10 years of experience in software engineering, you will provide leadership...
- GovPilot is seeking a senior engineering leader to act as the operational counterweight to the VP of Engineering, with deep technical and... .... You will own staffing, capacity planning, and governance for AI-enabled development, guiding multiple product lines and partnering...
- ...innovation and transforms how the business operates. We build AI-first, agent-driven products that change how Arch underwrites,... ...are continuing to scale our impact and are seeking an AVP, AI Engineering to lead the design and application of advanced AI systems within...Full timeTemporary workRemote work
$117.6k - $160.73k
Job DescriptionAssociate Director, Cloud Computing & Systems EngineeringDivision... ...TechnologyPosition SummaryThe Associate Director, Computing & Systems Engineering is hands on role that provides senior... ..., and a working understanding of AI-enabled platforms. This role...Full timeFor contractors$142.32k - $213.48k
...United StatesSalary: $142,320.00 - $213,480.00Category: Technology, Applications Development, ProfessionalCompany: CitiThe Senior AI Engineer is a senior level hands-on position responsible for establishing and implementing new or revised application systems and programs...Full time$102.5k - $188.9k
...reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft,... ...not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte...Work at officeLocal areaVisa sponsorshipFlexible hours3 days per week- ...one of the world's leading financial institutions, you've come to the right place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a specialized technical area, driving impact across...
$149 per hour
...provide more details.Vice President - Technical AI Foundation Model EngineerRole SummaryThe VP, Technical AI Foundation Model Engineer is responsible for designing, building,... ...(FINRA) and the National Futures Association (NFA). The major responsibilities listed above...Full timeWork at officeLocal areaRemote work1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Gateway Engineering Associate Director. Be the first to apply!
- ai ml engineer Jersey City, NJ
- ai prompt engineer Jersey City, NJ
- senior ai engineer Jersey City, NJ
- machine learning ai engineer Jersey City, NJ
- ai developer Jersey City, NJ
- ai engineer Jersey City, NJ
- ai engineer remote Jersey City, NJ
- principal cloud engineer Jersey City, NJ
- director data engineering Jersey City, NJ
- principal developer Jersey City, NJ

