Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Director, AI Platform Engineering

NYC Health + Hospitals

Purpose of Functional Assignment:

The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows operate safely, reliably, securely, and are in compliance with applicable laws and NYC Health + Hospitals rules and regulations. The Director leads platform engineering, cloud architecture, Continuous Integration and Continuous Delivery/Deployment (CI/CD) modernization, and reliability functions ensuring that AI tools enhance clinical excellence and protect patient safety.

Apply promptly! A high volume of applicants is expected for the role as detailed below, do not wait to send your CV.

Essential Duties and Responsibilities:

  1. Provides strategic leadership for cloud, platform, and infrastructure engineering, developing and leading multi-year roadmaps, standards, and strategies for the secure and scalable deployment of AI products.
  1. Oversees architecture and governance of CI/CD pipelines, infrastructure-as-code (Terraform), and Kubernetes/Azure Kubernetes Services (AKS) orchestration to support reliable AI deployment.
  1. Defines and oversee the infrastructure for the high-volume, low-latency data pipelines, feature stores, and data access layers required for training and real-time serving of AI models.
  1. Establishes enterprise-wide reliability, and monitoring frameworks to ensure stable, and safe operation of AI systems used by clinicians and care teams.
  1. Implements platform controls and audit trails to monitor and ensure Responsible AI practices, model explainability (XAI), and checks for model drift and bias on an ongoing basis.
  1. Partners with product management, product development, cybersecurity, Machine Learning Operations (MLOps) engineering, and interoperability teams to ensure AI platform readiness, safe integrations.
  1. Leads incident management and root-cause analysis, to minimize disruptions to clinical workflows and drive reliability improvements.
  1. Ensures the AI platform and infrastructure provide the necessary controls, logging, and audit capabilities to meet compliance requirements and support AI safety frameworks.
  1. Develops long-term platform resilience, disaster recovery, and cost optimization strategies to support System-wide AI expansion.
  1. Defines and standardizes the platform's toolchain and Application Programming Interface (API) for the Machine Learning (ML) lifecycle, including model experimentation tracking (e.g., MLflow, ClearML), model registry, and automated testing/validation frameworks.
  1. Manages a team of platform and infrastructure engineers.
  1. Performs other duties as assigned.

  1. Master's Degree from an accredited college or university in Computer Science, Information Systems or Technology, Cybersecurity, Hospital Administration, Health Care Planning, Business Administration, Mathematics, Engineering or Public Administration; and three (3) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity; or,
  1. Bachelor's Degree from an accredited college or university in disciplines, as listed in "1" above; and five (5) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity.

Minimum Qualifications:

  1. Master's degree from an accredited college or university in Computer science, Engineering, Information Systems, or related discipline; and,
  1. Five (5) years of experience in Machine Learning Operations (MLOps), Machine Learning (ML) engineering, Artificial Intelligence (AI) platform engineering, or operating production Machine Learning (ML) / Large Language Model (LLM) system; or ten (10) years of experience in Software and Data Engineering.

Certifications Preferred:

  1. Professional certifications in cloud architecture, ML/AI engineering, or DevOps from leading cloud platforms.

Preferred Knowledge Areas, Skills, Abilities, and other Qualifications:

  1. Figma, Sketch, Adobe XD, or similar design and prototyping tools.
  1. Expertise in Azure architecture, Kubernetes/ Azure Kubernetes Services (AKS), Terraform, Continuous Integration and Continuous Deployment (CI/CD), and automation frameworks.
  1. Experience supporting production AI/ML systems or mission-critical workloads.
  1. Knowledge of observability tools, monitoring frameworks, and reliability engineering practices.
  1. Understanding of security and compliance standards including Health Insurance Portability and Accountability Act of 1996 (HIPAA) and National Institute of Standards and Technology (NIST).
  1. Demonstrated leadership, cross-functional collaboration, and technical communication skills.
  1. Strong stakeholder engagement and change-management skill.
  1. Experience in healthcare, public sector, or other regulated environments.
  1. Experience deploying or supporting AI/ML, LLM, or agentic AI systems in production.
  1. Familiarity with Site Reliability Engineering (SRE) or platform engineering frameworks.
  1. Experience Using the Following Software and/or Platforms:

  • Python, Bash/Shell, HashiCorp Configuration Language (HCL Terraform), and YAML/ JavaScript Object Notation (JSON), with familiarity in Go preferred for Kubernetes-based platform tooling. xhyhwjd

  • Azure cloud services, Docker, Kubernetes/AKS, Terraform, CI/CD platforms (Azure DevOps, GitHub Actions, Jenkins), monitoring/observability tools (Grafana, Azure Monitor), secrets/IAM security tooling.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Director, AI Platform Engineering in New York, NY vacancy
  •  ...Sr Cloud AI Platform Engineer Contract Hybrid in NYC Must be local. This is not a Full Stack Developer role. We'd like candidates to have strong AWS infra experience (Terraform, VPC, EKS etc) with Python/Go experience As a Senior Engineer, you will help... 
    Suggested
    Contract work
    Local area

    PRI Technology

    New York, NY
    2 days ago
  • $110 - $130 per hour

     ...diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY! AIVA is the firm's governed AI execution platform, built to give engineers and... 
    Suggested

    Eleven Recruiting

    New York, NY
    6 hours ago
  •  ...Full TimeWorking Type HybridJob Reference 0000021462Salary Type AnnuallyIndustry Law PracticeSelling Points Lead innovative AI platform engineering projects at a forward-thinking organization. Collaborate on cutting-edge Azure AI/ML solutions and cloud infrastructure.... 
    Suggested

    Green Key Resources

    New York, NY
    5 days ago
  •  ...Purpose of Functional Assignment: The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows... 
    Suggested
    Full time

    NYC Health + Hospitals

    New York, NY
    4 days ago
  • $175k - $200k

     ...'re hiring our first dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant (OUTGPT, built on the Vercel...  ...) is live with early partner adoption. Both need a senior engineering owner, and both need to grow into the foundation of how OUTFRONT... 
    Suggested
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    7 days ago
  • $180k - $240k

    Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/Onsite)Employment Type: Full-TimeCompensation: $180-$240k base plus bonus We are seeking a highly experienced Head of AI Platform Engineering to lead the design, development, and operation of our... 

    Yoh

    New York, NY
    6 days ago
  •  ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits... 

    Farther Advisors

    New York, NY
    4 days ago
  •  ...PRI Technology in New York, NY seeks a Senior Software Engineer to build reliable, compliant AI platform services powering enterprise workflows. You will design Kubernetes-based PaaS, AI/LLM gateways, and self-service developer tooling, with emphasis on reliability,... 

    PRI Technology

    New York, NY
    1 day ago
  •  ...connects to more than 50 MRO and enterprise platforms that operators already run, including...  ...enriches their data with industry-leading AI predictions, and delivers actionable insight...  ...proprietary data.As an AI Platform Engineer, you will own the engineering that makes... 
    Contract work

    Kquika

    New York, NY
    2 days ago
  • $230k - $290k

     ..., Illinois / New York, New York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large enterprises assess, design...  ...helps those same enterprises design, build, and run AI agent platforms on top of it. This role sits in the AIC Platform... 
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    4 days ago
  • $155k - $215k

     ...mission is to develop a firmwide Artificial Intelligence (AI) Development Platform that aligns with the firm's Technology principles and drives...  ...of AI across our businesses.This role is for a platform engineering specialist who will help build a firmwide AI Development Platform... 
    Temporary work

    Morgan Stanley

    New York, NY
    7 days ago
  • $205k - $235k

     ...functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with...  ....Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data Scientists,... 
    Full time
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    3 days ago
  • $130.9k - $268.7k

    Position Summary Role Overview: As an Associate Director, Applied AI Engineering, you will set the engineering vision and technical direction for the firm’s enterprise solutions—mapping business capabilities to the enterprise technology landscape and defining how... 
    Work at office
    Local area
    Visa sponsorship
    3 days per week

    Deloitte

    New York, NY
    7 days ago
  •  ...Vice President of Software Engineering, Cloud, Platform & AI Engineering About the Company A leading global financial institution expanding cloud modernization, platform engineering, and AI enablement. Industry Financial Services Type Public Company... 

    Confidential

    New York, NY
    4 days ago
  •  ...Head of AI Platform Engineering, Execution Services About the Company Enterprise-focused organization building secure, scalable AI platform capabilities. Industry Internet Type Privately Held About the Role The Company is seeking a Head of AI Platform... 

    Confidential

    New York, NY
    5 days ago
  •  ...Head of AI Platform Engineering, Execution Plane About the Company Develops secure, scalable AI infrastructure for enterprise-wide adoption of AI capabilities. Industry Information Technology and Services Type Privately Held About the Role The Company... 

    Confidential

    New York, NY
    3 days ago
  • Owning the operational success of enterprise AI platforms, the full-time remote AI Platform Enablement Engineer III will manage the enablement, adoption, cost management, and governance of platforms like Anthropic and Microsoft Copilot, while addressing complex problems... 
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    6 days ago
  • Payward is building its enterprise AI platform to be safe, scalable, and self-service for the Kraken ecosystem. You will design the core...  ...organization. You will partner with compliance, traders, and backend engineers to enable safe, rapid AI tool adoption. The role emphasizes... 
    Remote job

    JobFluent

    New York, NY
    1 day ago
  • Relativity is seeking a Senior Software Engineer to design, develop, and operate distributed cloud services at petabyte scale...  .... You will own end-to-end solutions, apply cross-functional skills, and contribute to AI-powered legal data platforms. #J-18808-Ljbffr Relativity
    Remote job

    Relativity

    New York, NY
    6 days ago
  • Designing and building the technical layer of the AI platform, the full-time AI Platform Engineer will manage integration surfaces, internal tooling, and governed integration gateways while working remotely. Key responsibilities Design and build the technical layer of... 
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    3 days ago
  • Ellis is seeking an experienced infrastructure-focused engineer to build the AI-native harness that runs agents in parallel. You will craft local...  ...collaborate with the Lead Product Engineer, and shape the platform that underpins AI-driven product features. #J-18808-Ljbffr... 
    Local area

    Ellis

    New York, NY
    3 days ago
  • i2 Group, a Harris Computer company, seeks a Platform Software Engineer for a full-time, permanent role. This remote position requires monthly attendance...  ...Managers to define and build platform capabilities for AI-first workflows. The ideal candidate will have experience... 
    Permanent employment
    Full time
    Remote work

    Remote Worker LTD.

    New York, NY
    4 days ago
  •  ...Technologies Inc. in New York, NY is seeking a software engineer to join our founding team as we build a universal identity layer powered by AI. You will help shape our AI strategy and contribute to the core technology platform that verifies businesses globally. You'll... 
    Worldwide

    Niva Technologies, Inc.

    New York, NY
    4 days ago
  • Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You will collaborate with engineers, researchers, and PMs to build scalable AI-powered products for customers and associates.... 

    Capital One

    New York, NY
    3 days ago
  • Capital One is seeking a Senior Staff AI Engineer for the Agentic AI Platform with remote eligibility. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products and scalable AI infrastructure. You will design and optimize foundation... 
    Remote job

    Capital One

    New York, NY
    2 days ago
  • $122.5k - $423.78k

     ...ApplicableSpecialismIFS - Information Technology (IT)Management LevelDirectorJob Description & SummaryThe OpportunityAs a Director, Solution Architect, AI-Native Engineering, you will lead the charge in developing innovative technology solutions within our Internal Firm Services... 
    Full time
    Work experience placement
    H1b

    PwC

    New York, NY
    1 day ago
  • Capital One is seeking an AI Engineer 4 to advance our Gen AI Platform Services, including Agentic AI, Guardrails, Memory, and Evaluation. You will partner with cross-functional teams to design, deploy, and optimize AI components, from foundation models to multi-agent... 

    Capital One

    New York, NY
    5 days ago
  • To support the development of AI-driven systems, the contractor-based AI Platform Engineer Lead will design and implement frameworks for AI coding agents, focusing on enterprise engineering collaboration in a hybrid work environment based in Chicago or Philadelphia. Key... 
    For contractors

    Virtual Vocations Inc

    New York, NY
    3 days ago
  • $162k - $215k

     ...experience building and operating production AI systems, including LLM-based workflows....  ...of modern AI methods such as prompt engineering, retrieval-augmented generation, fine-tuning...  ...designing and delivering shared platforms or services at scale. We need deep technical... 
    Full time
    Apprenticeship
    Work at office
    Work from home
    Flexible hours

    BlackRock

    New York, NY
    27 days ago
  • Beazley Security, a Beazley Group subsidiary, seeks a Senior Data & AI Platform Engineer to unify data across Snowflake and relational sources for product and AI work. You will build pipelines from security products, ensure fast, trustworthy data for analytics, and establish... 
    Remote job
    Flexible hours

    Beazley Group

    New York, NY
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Director, AI Platform Engineering. Be the first to apply!