Director, AI Platform Engineering
NYC Health + Hospitals
Purpose of Functional Assignment:
The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows operate safely, reliably, securely, and are in compliance with applicable laws and NYC Health + Hospitals rules and regulations. The Director leads platform engineering, cloud architecture, Continuous Integration and Continuous Delivery/Deployment (CI/CD) modernization, and reliability functions ensuring that AI tools enhance clinical excellence and protect patient safety.
Apply promptly! A high volume of applicants is expected for the role as detailed below, do not wait to send your CV.
Essential Duties and Responsibilities:
- Provides strategic leadership for cloud, platform, and infrastructure engineering, developing and leading multi-year roadmaps, standards, and strategies for the secure and scalable deployment of AI products.
- Oversees architecture and governance of CI/CD pipelines, infrastructure-as-code (Terraform), and Kubernetes/Azure Kubernetes Services (AKS) orchestration to support reliable AI deployment.
- Defines and oversee the infrastructure for the high-volume, low-latency data pipelines, feature stores, and data access layers required for training and real-time serving of AI models.
- Establishes enterprise-wide reliability, and monitoring frameworks to ensure stable, and safe operation of AI systems used by clinicians and care teams.
- Implements platform controls and audit trails to monitor and ensure Responsible AI practices, model explainability (XAI), and checks for model drift and bias on an ongoing basis.
- Partners with product management, product development, cybersecurity, Machine Learning Operations (MLOps) engineering, and interoperability teams to ensure AI platform readiness, safe integrations.
- Leads incident management and root-cause analysis, to minimize disruptions to clinical workflows and drive reliability improvements.
- Ensures the AI platform and infrastructure provide the necessary controls, logging, and audit capabilities to meet compliance requirements and support AI safety frameworks.
- Develops long-term platform resilience, disaster recovery, and cost optimization strategies to support System-wide AI expansion.
- Defines and standardizes the platform's toolchain and Application Programming Interface (API) for the Machine Learning (ML) lifecycle, including model experimentation tracking (e.g., MLflow, ClearML), model registry, and automated testing/validation frameworks.
- Manages a team of platform and infrastructure engineers.
- Performs other duties as assigned.
- Master's Degree from an accredited college or university in Computer Science, Information Systems or Technology, Cybersecurity, Hospital Administration, Health Care Planning, Business Administration, Mathematics, Engineering or Public Administration; and three (3) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity; or,
- Bachelor's Degree from an accredited college or university in disciplines, as listed in "1" above; and five (5) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity.
Minimum Qualifications:
- Master's degree from an accredited college or university in Computer science, Engineering, Information Systems, or related discipline; and,
- Five (5) years of experience in Machine Learning Operations (MLOps), Machine Learning (ML) engineering, Artificial Intelligence (AI) platform engineering, or operating production Machine Learning (ML) / Large Language Model (LLM) system; or ten (10) years of experience in Software and Data Engineering.
Certifications Preferred:
- Professional certifications in cloud architecture, ML/AI engineering, or DevOps from leading cloud platforms.
Preferred Knowledge Areas, Skills, Abilities, and other Qualifications:
- Figma, Sketch, Adobe XD, or similar design and prototyping tools.
- Expertise in Azure architecture, Kubernetes/ Azure Kubernetes Services (AKS), Terraform, Continuous Integration and Continuous Deployment (CI/CD), and automation frameworks.
- Experience supporting production AI/ML systems or mission-critical workloads.
- Knowledge of observability tools, monitoring frameworks, and reliability engineering practices.
- Understanding of security and compliance standards including Health Insurance Portability and Accountability Act of 1996 (HIPAA) and National Institute of Standards and Technology (NIST).
- Demonstrated leadership, cross-functional collaboration, and technical communication skills.
- Strong stakeholder engagement and change-management skill.
- Experience in healthcare, public sector, or other regulated environments.
- Experience deploying or supporting AI/ML, LLM, or agentic AI systems in production.
- Familiarity with Site Reliability Engineering (SRE) or platform engineering frameworks.
- Experience Using the Following Software and/or Platforms:
- Python, Bash/Shell, HashiCorp Configuration Language (HCL Terraform), and YAML/ JavaScript Object Notation (JSON), with familiarity in Go preferred for Kubernetes-based platform tooling. xhyhwjd
- Azure cloud services, Docker, Kubernetes/AKS, Terraform, CI/CD platforms (Azure DevOps, GitHub Actions, Jenkins), monitoring/observability tools (Grafana, Azure Monitor), secrets/IAM security tooling.
- ...Sr Cloud AI Platform Engineer Contract Hybrid in NYC Must be local. This is not a Full Stack Developer role. We'd like candidates to have strong AWS infra experience (Terraform, VPC, EKS etc) with Python/Go experience As a Senior Engineer, you will help...SuggestedContract workLocal area
$110 - $130 per hour
...diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY! AIVA is the firm's governed AI execution platform, built to give engineers and...Suggested- ...Full TimeWorking Type HybridJob Reference 0000021462Salary Type AnnuallyIndustry Law PracticeSelling Points Lead innovative AI platform engineering projects at a forward-thinking organization. Collaborate on cutting-edge Azure AI/ML solutions and cloud infrastructure....Suggested
- ...Purpose of Functional Assignment: The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows...SuggestedFull time
$175k - $200k
...'re hiring our first dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant (OUTGPT, built on the Vercel... ...) is live with early partner adoption. Both need a senior engineering owner, and both need to grow into the foundation of how OUTFRONT...SuggestedFull timeInternship$180k - $240k
Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/Onsite)Employment Type: Full-TimeCompensation: $180-$240k base plus bonus We are seeking a highly experienced Head of AI Platform Engineering to lead the design, development, and operation of our...- ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits...
- ...PRI Technology in New York, NY seeks a Senior Software Engineer to build reliable, compliant AI platform services powering enterprise workflows. You will design Kubernetes-based PaaS, AI/LLM gateways, and self-service developer tooling, with emphasis on reliability,...
- ...connects to more than 50 MRO and enterprise platforms that operators already run, including... ...enriches their data with industry-leading AI predictions, and delivers actionable insight... ...proprietary data.As an AI Platform Engineer, you will own the engineering that makes...Contract work
$230k - $290k
..., Illinois / New York, New York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large enterprises assess, design... ...helps those same enterprises design, build, and run AI agent platforms on top of it. This role sits in the AIC Platform...Full timeWork at officeShift work$155k - $215k
...mission is to develop a firmwide Artificial Intelligence (AI) Development Platform that aligns with the firm's Technology principles and drives... ...of AI across our businesses.This role is for a platform engineering specialist who will help build a firmwide AI Development Platform...Temporary work$205k - $235k
...functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with... ....Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data Scientists,...Full timeFor contractorsWork experience placementSummer holidayFlexible hours$130.9k - $268.7k
Position Summary Role Overview: As an Associate Director, Applied AI Engineering, you will set the engineering vision and technical direction for the firm’s enterprise solutions—mapping business capabilities to the enterprise technology landscape and defining how...Work at officeLocal areaVisa sponsorship3 days per week- ...Vice President of Software Engineering, Cloud, Platform & AI Engineering About the Company A leading global financial institution expanding cloud modernization, platform engineering, and AI enablement. Industry Financial Services Type Public Company...
- ...Head of AI Platform Engineering, Execution Services About the Company Enterprise-focused organization building secure, scalable AI platform capabilities. Industry Internet Type Privately Held About the Role The Company is seeking a Head of AI Platform...
- ...Head of AI Platform Engineering, Execution Plane About the Company Develops secure, scalable AI infrastructure for enterprise-wide adoption of AI capabilities. Industry Information Technology and Services Type Privately Held About the Role The Company...
- Owning the operational success of enterprise AI platforms, the full-time remote AI Platform Enablement Engineer III will manage the enablement, adoption, cost management, and governance of platforms like Anthropic and Microsoft Copilot, while addressing complex problems...Full timeRemote work
- Payward is building its enterprise AI platform to be safe, scalable, and self-service for the Kraken ecosystem. You will design the core... ...organization. You will partner with compliance, traders, and backend engineers to enable safe, rapid AI tool adoption. The role emphasizes...Remote job
- Relativity is seeking a Senior Software Engineer to design, develop, and operate distributed cloud services at petabyte scale... .... You will own end-to-end solutions, apply cross-functional skills, and contribute to AI-powered legal data platforms. #J-18808-Ljbffr RelativityRemote job
- Designing and building the technical layer of the AI platform, the full-time AI Platform Engineer will manage integration surfaces, internal tooling, and governed integration gateways while working remotely. Key responsibilities Design and build the technical layer of...Full timeRemote work
- Ellis is seeking an experienced infrastructure-focused engineer to build the AI-native harness that runs agents in parallel. You will craft local... ...collaborate with the Lead Product Engineer, and shape the platform that underpins AI-driven product features. #J-18808-Ljbffr...Local area
- i2 Group, a Harris Computer company, seeks a Platform Software Engineer for a full-time, permanent role. This remote position requires monthly attendance... ...Managers to define and build platform capabilities for AI-first workflows. The ideal candidate will have experience...Permanent employmentFull timeRemote work
- ...Technologies Inc. in New York, NY is seeking a software engineer to join our founding team as we build a universal identity layer powered by AI. You will help shape our AI strategy and contribute to the core technology platform that verifies businesses globally. You'll...Worldwide
- Capital One is seeking a Lead AI Engineer for Gen AI Platform Services in New York, focusing on Agentic AI, guardrails, memory, and evaluation. You will collaborate with engineers, researchers, and PMs to build scalable AI-powered products for customers and associates....
- Capital One is seeking a Senior Staff AI Engineer for the Agentic AI Platform with remote eligibility. You will partner with engineers, researchers, PMs, and product managers to deliver AI-powered products and scalable AI infrastructure. You will design and optimize foundation...Remote job
$122.5k - $423.78k
...ApplicableSpecialismIFS - Information Technology (IT)Management LevelDirectorJob Description & SummaryThe OpportunityAs a Director, Solution Architect, AI-Native Engineering, you will lead the charge in developing innovative technology solutions within our Internal Firm Services...Full timeWork experience placementH1b- Capital One is seeking an AI Engineer 4 to advance our Gen AI Platform Services, including Agentic AI, Guardrails, Memory, and Evaluation. You will partner with cross-functional teams to design, deploy, and optimize AI components, from foundation models to multi-agent...
- To support the development of AI-driven systems, the contractor-based AI Platform Engineer Lead will design and implement frameworks for AI coding agents, focusing on enterprise engineering collaboration in a hybrid work environment based in Chicago or Philadelphia. Key...For contractors
$162k - $215k
...experience building and operating production AI systems, including LLM-based workflows.... ...of modern AI methods such as prompt engineering, retrieval-augmented generation, fine-tuning... ...designing and delivering shared platforms or services at scale. We need deep technical...Full timeApprenticeshipWork at officeWork from homeFlexible hours- Beazley Security, a Beazley Group subsidiary, seeks a Senior Data & AI Platform Engineer to unify data across Snowflake and relational sources for product and AI work. You will build pipelines from security products, ensure fast, trustworthy data for analytics, and establish...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, AI Platform Engineering. Be the first to apply!
- civil engineer project manager New York, NY
- director software engineering New York, NY
- principal cloud engineer New York, NY
- general engineer New York, NY
- chief design engineer New York, NY
- senior civil engineer project manager New York, NY
- senior director engineering New York, NY
- data center chief engineer New York, NY
- principal data engineer New York, NY
- director of product engineering New York, NY




