Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Azure AI Gateway AI Platform AIOps Engineer

Full-time

TalentOla

Azure AI Gateway AI Platform AIOps Engineer 3 Roles | Start: Immediate

What They'll Build

  • Stand up M&T's Azure AI Gateway (APIM, token quotas, cost attribution, multi-model routing)
  • Establish the AI Platform foundation - Azure OpenAI, AI Foundry, model registry, fine-tuning pipelines
  • Build AIOps: automated monitoring, drift alerting, self-healing pipelines for production AI workloads
  • Instrument observability - LLM call tracing, latency/cost dashboards via Azure Monitor & App Insights
  • Embed guardrails: content filtering, PII redaction, prompt injection controls aligned to M&T risk standards

Must-Have Skills

  • Azure OpenAI Azure AI Foundry APIM AKS - hands-on, not conceptual
  • AIOps tooling: MLflow, Prometheus/Grafana, Azure Monitor, drift detection
  • IaC (Terraform or Bicep) + CI/CD (Azure DevOps / GitHub Actions)
  • Python + LangChain or Semantic Kernel
  • 5+ yrs engineering; 2+ yrs Azure AI/ML in regulated or financial environments
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Azure AI Gateway AI Platform AIOps Engineer in New York, NY vacancy
  • $128k - $153.75k

     ...Information Job Title Senior Platform Engineer Job ID 105799 Work...  ...platform runs on Microsoft Azure and Azure Kubernetes Service...  ...ongoing review feedback.Use AI coding assistants to accelerate...  ...) interact with the Agent Gateway and what security constraints... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area

    Bain & Company

    New York, NY
    3 days ago
  • $113.9k - $189.9k

     ...Unit/Function:The One Policy Engine is a unified policy platform for multi-cloud...  ...and hands-on experience with Azure, AWS and DevSecOps. The ideal...  ...a key role in integrating AI-powered tools into development...  ...Experience with GraphQL and API gateway technologiesFamiliarity... 
    Suggested
    Full time
    Part time
    Internship

    London Stock Exchange Group

    New York, NY
    6 days ago
  • $152.29k - $250.2k

    As the Head of Platform Engineering - Control Plane, you will lead the development...  ..., developer platform, AI/ML platform, security platform...  ..., LLM platforms, model gateways, tool/action gateways, agent...  ...Background in MLOps, LLMOps, AIOps, model lifecycle management,... 
    Suggested
    Full time
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    3 days ago
  • $152.29k - $250.2k

    As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation...  ...of agentic AI workloads, model gateways, agent runtimes, tool/action gateways,...  ...communication.Background in MLOps, LLMOps, AIOps, model lifecycle management,... 
    Suggested
    Full time
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    3 days ago
  • $230k - $290k

     ...Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps...  ...migrate to the Microsoft Azure platform, and increasingly helps...  ...design, build, and run AI agent platforms on top of it...  ...connectivity: ExpressRoute, VPN gateways, and DNS strategies that... 
    Suggested
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    2 days ago
  •  ...Azure Cloud Architect (Banking-Multi-Region & Active-...  ...Expert, Azure Security Engineer Associate Experience...  ...modernization, payment gateways and SWIFT integrations,...  ...Knowledge of digital banking platforms and fintech integrations Exposure to AI/ML use cases in fraud detection... 

    Abode Techzone LLC

    New York, NY
    1 day ago
  •  ...deployment speed, system reliability, and engineering efficiency across the organization....  ...to engineer solutions that matter. From AI to cloud transformation, you'll collaborate...  ...deployment workflows Architect and maintain Azure cloud infrastructure, including AKS, networking... 

    EPAM Systems

    New York, NY
    a month ago
  • $141k

     ...Together, we are creating the only platform that combines modern 911 infrastructure with an AI intelligence layer—helping...  ...looking for an experienced platform engineer to join Prepared's platform...  ...platforms such as AWS, Google Cloud, or Azure.Working knowledge of... 
    Work experience placement
    Work at office

    Axon

    New York, NY
    2 days ago
  •  ...Vulnerability Management & Cloud Security Posture Platform Engineering to join our Cybersecurity Engineering...  ...with cloud environments, including AWS, Azure, and GCP, cloud connectors, IAM, APIs,...  ...day, our teams harness cutting-edge AI and breakthrough technologies to... 
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    4 days ago
  • $122k - $200k

     ...for defining and leading the engineering approach for complex features...  ...London, and India. Generative AI presents an exciting opportunity...  ...Strategies & Data Group (QSDG) & Platform teams to the design and...  ...the GenAI platform across AWS, Azure, and GCP, enabling secure and... 
    Full time
    Work at office
    Flexible hours
    Day shift

    Bank of America

    New York, NY
    6 days ago
  • $100.2k - $167k

     ...looking for a Senior Associate Software & Platform Engineer to join our FX Engineering group as an...  ...Work with public cloud platforms such as Azure, AWS, or GCP to support application...  ...reliability, and developer productivity.Use AI-assisted engineering tools where appropriate... 
    Full time
    Part time
    Internship

    London Stock Exchange Group

    New York, NY
    5 days ago
  • $250.6k - $362.6k

     ...citizen on U.S. soil.Meet the Team The Platform Engineering organization is responsible for building...  ...cloud-native infrastructure across AWS, Azure, GCP, or hybrid cloud environments. Experience...  ...and protect organizations in the AI era - and beyond. We’ve been innovating... 
    Permanent employment
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    New York, NY
    6 days ago
  • $175k - $215k

     ...Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and pipelines that power the...  ...Python applications using Azure AI Foundry and the Claude API (Anthropic...  ...secure access patterns, API gateway controls, rate limiting, and cost... 

    PJT Partners

    New York, NY
    2 days ago
  • $129.7k - $216.1k

     ...looking for a hands-on Lead Software and Platform Engineer to drive the design, development,...  ...Kubernetes in public cloud environments such as Azure, AWS, or GCP.Remain hands-on with the...  ...mission-critical systems.Critical Thinking & AI-Enabled EngineeringWe value engineers... 
    Full time
    Part time
    Internship

    London Stock Exchange Group

    New York, NY
    5 days ago
  • $180k - $220k

     ...which makes everything possible.The Staff Platform Infrastructure Engineer will be instrumental in building and scaling our next-generation data and AI infrastructure — driving technical...  ...scalable cloud infrastructure (AWS, GCP, Azure) using Infrastructure as Code (e.g.,... 
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Danaher Corporation

    New York, NY
    6 days ago
  •  ...preferred3+ years of experience as a Software Engineer; Previous enterprise platform experience preferredStrong programming skills in PythonExpertise with AI agents / agentic applications, React...  ...- multiple cloud platforms (AWS, Azure, GCP) a plusKnowledge of... 
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    2 days ago
  •  ...looking for:A Senior Manager, IT Systems / Platform Engineering to own the infrastructure, identity, and...  ...-cloud fluency across platforms (AWS, Azure, and/or GCP) — you've operated in a...  ...— written, verbal, and executive-ready; AI-first mindset and employee experience focus... 
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    Oura

    New York, NY
    4 days ago
  • Senior Full-Stack Engineer - AI Applications & PlatformsWe are partnering...  ...opportunity to shape modern, scalable platforms that directly support how...  ...users.Cloud platforms (AWS & Azure) - Use services such as App Services, Lambda, API Gateway, Azure Functions, and Key... 
    Permanent employment

    Huxley Associates

    New York, NY
    5 days ago
  •  ...hold ourselves to the same bar. Our AI-native workspace lets legal professionals...  ...bar. This is the place. As a Senior Platform Engineer at Legora, you'll join an enabling team...  ...IAM, secrets, capacity, and cost across Azure, AWS, and GCP Maintain and expand our... 

    Legora

    New York, NY
    4 days ago
  • $120.3k - $161.3k

     ...Job Posting Title: Software Engineer II - Ad Platform, Integrating Engineering Req ID: 101515...  ...workflow orchestration, decision rules, API gateway, service mesh, event driven & API...  ...desirable Experience in vibe coding and AI tools Previous work experience in... 
    Full time
    Work experience placement

    The Walt Disney Company

    New York, NY
    3 days ago
  •  ...They rely on multiple outdated platforms and error-prone manual work to...  ...-ownership Senior Platform Engineer to build and scale the infrastructure...  ...infrastructure patterns, AI-powered developer workflows, and...  ...such as AWS Lambda, Azure Functions, and Google Cloud Functions... 
    Flexible hours

    exacare ai

    New York, NY
    16 hours ago
  •  ...Databricks Platform Manager / Engineer (AWS) Experience 5-10 years of overall IT experience, including...  ...data engineering, analytics, and AI teams to work efficiently. This role...  ...Infrastructure as Code Azure DevOps, GitHub Actions, or Jenkins... 

    Diamondpick

    New York, NY
    2 days ago
  •  ...Backend Product Engineer This role spans backend product engineering...  ...running in production. The platform processes millions of clinical...  ...with GPU infrastructure serving AI extraction models. We need...  ...access to every deployment - AWS, Azure, customer-hosted environments.... 
    Day shift

    Triomics

    New York, NY
    16 hours ago
  • $91k - $118k

     ...Responsibilities As a Kubernetes/Linux Engineer and subject matter expert for...  ...tools, techniques, and cloud platforms Your skills and experience...  .../CD tools such as Terraform, Azure DevOps, GitHub, Ansible •...  ...our ****@*****.*** platform, AI Learning Center , LinkedIn... 
    Flexible hours

    MSCI

    New York, NY
    2 days ago
  •  ...Senior Platform Engineer Office Location: Lower Manhattan, NY (4 days per week in the office)...  ...intelligence. We specialize in creating advanced AI solutions that turn complex data into...  ...expertise with cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tools (... 
    Work at office
    Remote work
    Flexible hours

    Accrete.AI

    New York, NY
    1 day ago
  •  ...Platform Engineer We're looking for a Platform Engineer to own the foundational primitives and...  ...deploy and observability pipelines, our MCP gateway, and the integration substrate that...  ...engineering, preferably at a high-growth or AI-native company. Strong fundamentals... 
    Work at office
    Flexible hours
    Night shift

    Antimetal

    New York, NY
    16 hours ago
  •  ...Platform Engineer Location: NYC In-person 5 days/week Seniority: 5+ years of experience in platform...  ...the infrastructure that powers core AI technologies. You will work at the intersection...  ...and multi-cloud environments (AWS, GCP, Azure). Qualifications Experience and... 
    Full time

    Virco Talent

    New York, NY
    1 day ago
  • $120k - $161.6k

     ...technology applications and delivery, leveraging AI, automation, and contemporary ways of...  ...skilled and experienced Lead Software / Platform Engineer to drive the design, development, and...  ...as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).Strong... 
    Full time
    Temporary work
    Work at office
    Local area
    Worldwide
    Relocation package
    3 days per week

    Metropolitan Life Insurance Company

    New York, NY
    3 days ago
  • $132.42k - $217.55k

    Head of Digital Workplace Collaboration Platforms, Engineering & ArchitectureLocations: Bethlehem, PA...  ...Collaboration ExtensionsCollaboration-related AI and Productivity...  ...TeamsSharePoint OnlineOneDriveEntra ID (Azure AD)Microsoft GraphTeams VoiceTeams GovernanceEmail... 
    Full time
    H1b
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    5 days ago
  •  ...technology products.As a Lead Software Engineer (Vice President) at...  ...secure, stable, and scalable platform and software solutions for corporate...  ...(approximately 30%) and AI/agentic development (approximately...  ...(e.g., ELB/ALB, Route 53, API Gateway, Lambda, ECS, managed caching... 
    Work at office

    JP Morgan Chase

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Azure AI Gateway AI Platform AIOps Engineer. Be the first to apply!