Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Engineer, Platform Engineering - AI

$133.9k - $154.5k

Ice Services

Job Purpose We are on a mission as a team. We are problem solvers and partners, always starting with our customers to solve their challenges and create opportunities. Our start‑up roots keep us nimble, flexible, and moving fast. We take ownership and make decisions. We all work for one company and work together to drive growth across the business. We engage in robust debates to find the best path, and then we move forward as one team. We take pride in what we do, acting with integrity and passion, so that our customers can perform better. We are experts and enthusiasts - combining ever‑expanding knowledge with leading technology to consistently deliver results, solutions and opportunities for our customers and stakeholders. Every day we work toward transforming global markets. Overview The AI Platform Engineering Lead drives the AI Platform Operations team, guiding platform strategy, governance, and stakeholder engagement. They align technical execution with business goals, ensuring cost‑effective, secure, and scalable AI/ML solutions. The lead defines the architecture, standards, and governance across AI/ML infrastructure, workflow automation, and agentic AI capabilities, including RAG pipelines, vector store infrastructure, agent memory frameworks, and MCP server strategy. They establish design patterns and best practices that span LLM, MCP, and agentic capabilities, ensuring the platform scales securely and operates with consistency across the enterprise. The lead collaborates across teams to set security standards, manage resources, maintain compliance, and align platform capabilities with enterprise architecture standards. Responsibilities Define platform strategy, roadmap, and capability evolution Establish governance frameworks, policies, and exception processes Manage team budget, CapEx planning, and vendor relationships Build and lead the AI Platform Operations team Define the architecture, standards, and governance for AI/ML infrastructure, including GPU cluster design, compute resource planning, security controls, and observability across the platform Drive the strategy, standards, and governance for AI- enabled workflow automation across LLM, MCP, and agentic capabilities, ensuring the platform scales securely and operates with consistency across the enterprise Define the architecture and design standards for vector store infrastructure supporting RAG pipelines, agent memory, and semantic search across the enterprise Establish design patterns and best practices for RAG workflow implementation, including ingestion strategies, chunking approaches, embedding model selection, and retrieval optimization Architect agent memory frameworks, defining standards for short-term context, long-term persistent memory, and episodic memory patterns across AI platform workloads Drive the architecture and governance of Agentic AI systems, including multi-agent orchestration design and tool-use pipeline standards Define the strategy and architecture for hosting and managing MCP servers across the platform, including deployment topology, security boundaries, and integration standards Establish governance frameworks and policies for MCP server lifecycle management, versioning, and access control Evaluate and select MCP server tooling and vendors; manage relationships and roadmap alignment Serve as executive liaison for platform matters Own major incident management and executive communication Drive continuous improvement and platform maturity initiatives Align platform capabilities with enterprise architecture standards Respond to and assist in production operations in a 24/7 environment Provide technical analysis, resolve problems, and propose solutions Provide support to, and coordinate with, developers, operations staff, release engineers, and end-users Educate and mentor team members and operations staff Knowledge and Experience 8+ years in IT infrastructure or platform engineering roles 3+ years in technical leadership or management positions 1+ years hands‑on experience with Kubernetes in production Direct experience with GPU infrastructure (NVIDIA preferred) 2+ years experience using CUDA 1+ years experience using MCPs 2+ years experience with vector databases and embedding infrastructure 2+ years experience with RAG pipeline design and deployment 2+ years experience with agent memory patterns (in-context, external stores, retrieval-augmented memory) 1+ years experience with agentic AI systems using orchestration frameworks 2+ years experience with semantic search, embedding models, and ANN search techniques 3+ years working with workflow/orchestration automation tools Experience managing teams of 5+ technical staff Demonstrated success in vendor management and contract negotiation Strong executive communication and presentation skills Understanding of AI/ML workloads and infrastructure requirements Experience with enterprise monitoring and observability tools Ability to work in a service-oriented team environment Project Management, organization, and time management Customer focused, and dedicated to the best possible user experience Communicate effectively with both technical and business resources Fluent speaking, reading, and writing in English Illinois Base Salary Range The expected base salary for this role, if located in Illinois, is between $133,900 - 154,500 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. New York Base Salary Range The expected base salary for this role, if located in New York, is between $149,400 - 180,000 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. California Base Salary Range The expected base salary for this role, if located in California, is between $149,400 - 180,000 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. Equal Opportunity Employer Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics. #J-18808-Ljbffr

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Lead Engineer, Platform Engineering - AI in New York, NY vacancy
  •  ...push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking's Customer Platform team, you are an integral part of an...  ...Drives team adoption of enterprise-authorized AI-assisted engineering practices within the... 
    Suggested

    J.P. Morgan

    New York, NY
    5 days ago
  •  ...greater purpose and impact. AI‑Powered Task Mining Our AI‑powered...  ...a 45‑person team of Senior+ engineers and Product leaders who...  ...teams, including a dedicated Platform team focused on infra & developer...  ...both cases, we're looking for a Lead/Staff‑level engineer who will... 
    Suggested
    Local area
    Remote work
    Flexible hours

    Mimica

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Capital One Machine Learning Engineer (MLE), you’ll be part of an Agile...  ...and emerging technology platforms. You’ll focus on machine learning...  ...in Responsible and Explainable AI. Use programming languages like...  ...least 2 years of experience leading teams developing ML solutions... 
    Suggested
    Full time
    Part time
    Internship
    Local area

    Capital One National Association

    New York, NY
    1 day ago
  • Tonsser is looking for a Lead Backend Engineer to own the architecture of their platform as they transition into a new phase. This role demands hands-on coding, setting...  ...Ruby or Python, and a passion for integrating AI into products. Compensation ranges from €80,000 to... 
    Suggested
    Remote job
    Flexible hours

    Tonsser

    New York, NY
    3 days ago
  • Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized... 
    Suggested
    Local area

    Energy Jobline ZR

    New York, NY
    1 day ago
  • $168k - $204k

     ...Part of What's Next We're looking for a Lead Engineer to help build and scale the next generation...  ...Targeting and Contextual Intelligence Platform—a system that enables privacy‑safe,...  ...and other monitoring tools. Use modern AI development tools (e.g., GitHub Copilot,... 
    Work experience placement
    Work at office

    Hearst Magazines

    New York, NY
    1 day ago
  • $155.7k - $208.7k

     ...Technology is a global organization of engineers, product developers, designers...  ...and building the products and platforms that will power our media,...  ...Job Summary: We are seeking a Lead Software Engineer to help...  ...Amazon Q or similar generative AI‑assistant for cloud... 
    Work experience placement
    Work at office

    Disney Entertainment and ESPN Product & Technology Careers

    New York, NY
    20 hours ago
  • $250.8k - $286.2k

     ...Overview Senior Lead Software Engineer, Full Stack (Enterprise Platform Technology) Do you love building and pioneering in the technology space? Do you enjoy...  ...technology solutions across the company. The AI Harness Engineering team is focused on enabling governed... 
    Full time
    Part time
    Internship
    Local area

    Capital One

    New York, NY
    a month ago
  • $101.9k - $175k

    What you'll do here: In your role as Technology Lead, Platforms & Ecommerce Engineering within our Digital organization, you are responsible for building...  ...continuous improvement. You will also help advance how AI is applied within engineering workflows to improve efficiency... 
    Work experience placement
    Live in
    Local area

    Cengage Group

    New York, NY
    20 hours ago
  • $175k - $200k

     ...of our people. Come join our industry-leading team! What We Offer OUTFRONT offers a...  ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant (OUTGPT...  ...partner adoption. Both need a senior engineering owner, and both need to grow into the foundation... 
    Internship

    OUTFRONT Media

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    24 days ago
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $197.3k - $225.1k

     ...Overview Lead Machine Learning Engineer (Enterprise Platforms Technology) As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team...  ...best practices in Responsible and Explainable AI.  Use programming languages like Python, Scala, or... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    5 hours ago
  • A leading global marketing and technology company is seeking a Director of Technology to architect scalable data solutions for AI-driven insights. This role involves leading data architecture...  ...Candidates should have 5+ years in data engineering, familiarity with AI/ML systems,... 

    Publicis Groupe

    New York, NY
    1 day ago
  •  ...DataAnnotation is seeking an experienced DevOps Engineer to join their coding team. This remote role offers flexibility and involves working closely with AI models to develop and evaluate coding tasks. The ideal candidate will possess strong English skills, knowledge... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $204.9k - $233.8k

     ...Senior Lead Software Engineer, Full Stack (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Are you excited by the prospect of using data to drive innovation? At Capital One, you'll join a team of makers, breakers, doers, and... 
    Full time
    Part time
    Internship
    Local area

    Capital One National Association

    New York, NY
    3 days ago
  •  ...in New York, is looking for a senior DevOps engineer to lead the development and optimization of advanced pipelines supporting AI/ML processes. Candidates should have over 1...  ...-functional teams to deliver secure AI platforms. Strong communication skills and experience... 

    Green Key Resources

    New York, NY
    1 day ago
  • Elastiq India is seeking talented software engineers to build and maintain our enterprise AI product, contributing to core technology within a dynamic startup. You will collaborate with cross-functional teams to develop AI solutions, own the software lifecycle from requirements... 
    Remote job

    Elastiq India

    New York, NY
    2 days ago
  • A cloud AI engineering startup is searching for a Senior Devops Engineer to work fully remotely. You will engage in significant Kubernetes projects, creating an authentication server and building cloud support for GCP, Azure, and Oracle Cloud. The ideal candidate has strong... 
    Remote job

    Saturn Cloud

    New York, NY
    1 day ago
  •  ...notch technology products. As a Senior Lead Software Engineer - ML at at JPMorgan Chase within the...  ...and maintaining robust machine learning platforms. You will design and deliver trusted,...  ...ML platforms (e.g., AWS SageMaker, GCP AI Platform, Azure ML) or on-prem ML infrastructure... 

    J.P. Morgan

    New York, NY
    16 days ago
  •  ...notch technology products. As a Senior Lead Software Engineer at JPMorganChase within the Consumer...  ...Drives adoption and governance of approved AI-assisted engineering practices across...  ...with enterprise logging and monitoring platforms, including Splunk, Elastic Search,... 
    For contractors
    Local area

    J.P. Morgan

    New York, NY
    7 days ago
  •  ...professionals for this role. Corporate Engineering – Fraud Hub Lead Engineer At BNY, our culture allows...  ...day, our teams harness cutting-edge AI and breakthrough technologies to...  ...Fraud detection, prevention, and response platforms, with responsibility for defining architecture... 
    Worldwide
    Flexible hours

    BNY

    New York, NY
    16 days ago
  • OPËNHOMME seeks a technical leader to drive the architecture design and enhance features on its platform. The role involves extensive collaboration, performance optimization, and data-driven insights. The ideal candidate will have 5+ years of experience and expertise in... 

    OPËNHOMME

    New York, NY
    1 day ago
  • Blueface Ltd is looking for a Lead C++ Software Engineer based in New York to help design and support our innovative video advertising platform. This hybrid role requires extensive experience in C/C++ programming and system design. The ideal candidate will lead a team of... 

    Blueface Ltd

    New York, NY
    2 days ago
  •  ...Doppel is built to outsmart one of the great threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other social...  ...re building the AI‑native social engineering defense platform. This means we’re designing scalable systems that monitor... 
    Work at office
    Flexible hours

    Doppel

    New York, NY
    8 hours ago
  • $15k

     ...that applies state‑of‑the‑art AI and machine learning techniques...  ...lunches, and more. Strategy Platform owns the infrastructure between...  ...across research and production Engineer smooth deployment processes...  ...disruption to active trading systems Lead complex projects spanning the... 
    Work at office
    Local area

    The Voleon Group

    New York, NY
    2 days ago
  • $220k - $300k

     ...incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical...  ...Harvey’s AI can do. Representative Projects Context Engineering & Agent Infrastructure – Build the platform-level... 

    Harvey

    New York, NY
    8 hours ago
  • $225k - $265k

     ...Unify Unify is building the first AI-powered system of action for...  ...into a top-performing growth engine by making go-to-market...  ...is focused on scaling our core platform to support our hyper growth. Morever...  ...accelerate customer value. Mentor & lead: Provide technical leadership... 

    Unify

    New York, NY
    2 days ago
  •  ...Anima is seeking an Intern/New Grad Software Engineer to join their dynamic team. You will contribute to building innovative healthcare...  ...offers the chance to directly impact healthcare through advanced AI and reinforcement learning, in a vibrant and fast-paced environment... 
    Internship

    Feedinkoo

    New York, NY
    4 days ago
  •  ...whale of a ride! Our Infrastructure Engineering team builds and operates the cloud-native platform that powers Docker’s suite of...  ...with product and security teams. AI-accelerated execution: we build agentic...  ...during your shifts. First Year Lead or co-lead a meaningful platform... 
    Remote work
    Home office
    Shift work

    Docker

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Engineer, Platform Engineering - AI. Be the first to apply!