Lead Engineer, Platform Engineering - AI
$133.9k - $154.5kIce Services
Job Purpose We are on a mission as a team. We are problem solvers and partners, always starting with our customers to solve their challenges and create opportunities. Our start‑up roots keep us nimble, flexible, and moving fast. We take ownership and make decisions. We all work for one company and work together to drive growth across the business. We engage in robust debates to find the best path, and then we move forward as one team. We take pride in what we do, acting with integrity and passion, so that our customers can perform better. We are experts and enthusiasts - combining ever‑expanding knowledge with leading technology to consistently deliver results, solutions and opportunities for our customers and stakeholders. Every day we work toward transforming global markets. Overview The AI Platform Engineering Lead drives the AI Platform Operations team, guiding platform strategy, governance, and stakeholder engagement. They align technical execution with business goals, ensuring cost‑effective, secure, and scalable AI/ML solutions. The lead defines the architecture, standards, and governance across AI/ML infrastructure, workflow automation, and agentic AI capabilities, including RAG pipelines, vector store infrastructure, agent memory frameworks, and MCP server strategy. They establish design patterns and best practices that span LLM, MCP, and agentic capabilities, ensuring the platform scales securely and operates with consistency across the enterprise. The lead collaborates across teams to set security standards, manage resources, maintain compliance, and align platform capabilities with enterprise architecture standards. Responsibilities Define platform strategy, roadmap, and capability evolution Establish governance frameworks, policies, and exception processes Manage team budget, CapEx planning, and vendor relationships Build and lead the AI Platform Operations team Define the architecture, standards, and governance for AI/ML infrastructure, including GPU cluster design, compute resource planning, security controls, and observability across the platform Drive the strategy, standards, and governance for AI- enabled workflow automation across LLM, MCP, and agentic capabilities, ensuring the platform scales securely and operates with consistency across the enterprise Define the architecture and design standards for vector store infrastructure supporting RAG pipelines, agent memory, and semantic search across the enterprise Establish design patterns and best practices for RAG workflow implementation, including ingestion strategies, chunking approaches, embedding model selection, and retrieval optimization Architect agent memory frameworks, defining standards for short-term context, long-term persistent memory, and episodic memory patterns across AI platform workloads Drive the architecture and governance of Agentic AI systems, including multi-agent orchestration design and tool-use pipeline standards Define the strategy and architecture for hosting and managing MCP servers across the platform, including deployment topology, security boundaries, and integration standards Establish governance frameworks and policies for MCP server lifecycle management, versioning, and access control Evaluate and select MCP server tooling and vendors; manage relationships and roadmap alignment Serve as executive liaison for platform matters Own major incident management and executive communication Drive continuous improvement and platform maturity initiatives Align platform capabilities with enterprise architecture standards Respond to and assist in production operations in a 24/7 environment Provide technical analysis, resolve problems, and propose solutions Provide support to, and coordinate with, developers, operations staff, release engineers, and end-users Educate and mentor team members and operations staff Knowledge and Experience 8+ years in IT infrastructure or platform engineering roles 3+ years in technical leadership or management positions 1+ years hands‑on experience with Kubernetes in production Direct experience with GPU infrastructure (NVIDIA preferred) 2+ years experience using CUDA 1+ years experience using MCPs 2+ years experience with vector databases and embedding infrastructure 2+ years experience with RAG pipeline design and deployment 2+ years experience with agent memory patterns (in-context, external stores, retrieval-augmented memory) 1+ years experience with agentic AI systems using orchestration frameworks 2+ years experience with semantic search, embedding models, and ANN search techniques 3+ years working with workflow/orchestration automation tools Experience managing teams of 5+ technical staff Demonstrated success in vendor management and contract negotiation Strong executive communication and presentation skills Understanding of AI/ML workloads and infrastructure requirements Experience with enterprise monitoring and observability tools Ability to work in a service-oriented team environment Project Management, organization, and time management Customer focused, and dedicated to the best possible user experience Communicate effectively with both technical and business resources Fluent speaking, reading, and writing in English Illinois Base Salary Range The expected base salary for this role, if located in Illinois, is between $133,900 - 154,500 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. New York Base Salary Range The expected base salary for this role, if located in New York, is between $149,400 - 180,000 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. California Base Salary Range The expected base salary for this role, if located in California, is between $149,400 - 180,000 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation. Regular full time ICE employees are eligible for a suite of competitive employee benefits, including healthcare coverage (medical, dental and vision), a 401(k) plan, life insurance, time off, and paid leave for qualifying circumstances. Equal Opportunity Employer Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics. #J-18808-Ljbffr
- ...push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking's Customer Platform team, you are an integral part of an... ...Drives team adoption of enterprise-authorized AI-assisted engineering practices within the...Suggested
- ...greater purpose and impact. AI‑Powered Task Mining Our AI‑powered... ...a 45‑person team of Senior+ engineers and Product leaders who... ...teams, including a dedicated Platform team focused on infra & developer... ...both cases, we're looking for a Lead/Staff‑level engineer who will...SuggestedLocal areaRemote workFlexible hours
$229.9k - $262.4k
...Capital One Machine Learning Engineer (MLE), you’ll be part of an Agile... ...and emerging technology platforms. You’ll focus on machine learning... ...in Responsible and Explainable AI. Use programming languages like... ...least 2 years of experience leading teams developing ML solutions...SuggestedFull timePart timeInternshipLocal area- Tonsser is looking for a Lead Backend Engineer to own the architecture of their platform as they transition into a new phase. This role demands hands-on coding, setting... ...Ruby or Python, and a passion for integrating AI into products. Compensation ranges from €80,000 to...SuggestedRemote jobFlexible hours
- Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...SuggestedLocal area
$168k - $204k
...Part of What's Next We're looking for a Lead Engineer to help build and scale the next generation... ...Targeting and Contextual Intelligence Platform—a system that enables privacy‑safe,... ...and other monitoring tools. Use modern AI development tools (e.g., GitHub Copilot,...Work experience placementWork at office$155.7k - $208.7k
...Technology is a global organization of engineers, product developers, designers... ...and building the products and platforms that will power our media,... ...Job Summary: We are seeking a Lead Software Engineer to help... ...Amazon Q or similar generative AI‑assistant for cloud...Work experience placementWork at office$250.8k - $286.2k
...Overview Senior Lead Software Engineer, Full Stack (Enterprise Platform Technology) Do you love building and pioneering in the technology space? Do you enjoy... ...technology solutions across the company. The AI Harness Engineering team is focused on enabling governed...Full timePart timeInternshipLocal area$101.9k - $175k
What you'll do here: In your role as Technology Lead, Platforms & Ecommerce Engineering within our Digital organization, you are responsible for building... ...continuous improvement. You will also help advance how AI is applied within engineering workflows to improve efficiency...Work experience placementLive inLocal area$175k - $200k
...of our people. Come join our industry-leading team! What We Offer OUTFRONT offers a... ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant (OUTGPT... ...partner adoption. Both need a senior engineering owner, and both need to grow into the foundation...Internship$229.9k - $262.4k
...Overview Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning...Full timePart timeLocal area$229.9k - $262.4k
...Overview Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to...Full timePart timeLocal area$197.3k - $225.1k
...Overview Lead Machine Learning Engineer (Enterprise Platforms Technology) As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team... ...best practices in Responsible and Explainable AI. Use programming languages like Python, Scala, or...Full timePart timeInternshipH1bLocal area- A leading global marketing and technology company is seeking a Director of Technology to architect scalable data solutions for AI-driven insights. This role involves leading data architecture... ...Candidates should have 5+ years in data engineering, familiarity with AI/ML systems,...
- ...DataAnnotation is seeking an experienced DevOps Engineer to join their coding team. This remote role offers flexibility and involves working closely with AI models to develop and evaluate coding tasks. The ideal candidate will possess strong English skills, knowledge...Hourly payRemote workFlexible hours
$204.9k - $233.8k
...Senior Lead Software Engineer, Full Stack (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Are you excited by the prospect of using data to drive innovation? At Capital One, you'll join a team of makers, breakers, doers, and...Full timePart timeInternshipLocal area- ...in New York, is looking for a senior DevOps engineer to lead the development and optimization of advanced pipelines supporting AI/ML processes. Candidates should have over 1... ...-functional teams to deliver secure AI platforms. Strong communication skills and experience...
- Elastiq India is seeking talented software engineers to build and maintain our enterprise AI product, contributing to core technology within a dynamic startup. You will collaborate with cross-functional teams to develop AI solutions, own the software lifecycle from requirements...Remote job
- A cloud AI engineering startup is searching for a Senior Devops Engineer to work fully remotely. You will engage in significant Kubernetes projects, creating an authentication server and building cloud support for GCP, Azure, and Oracle Cloud. The ideal candidate has strong...Remote job
- ...notch technology products. As a Senior Lead Software Engineer - ML at at JPMorgan Chase within the... ...and maintaining robust machine learning platforms. You will design and deliver trusted,... ...ML platforms (e.g., AWS SageMaker, GCP AI Platform, Azure ML) or on-prem ML infrastructure...
- ...notch technology products. As a Senior Lead Software Engineer at JPMorganChase within the Consumer... ...Drives adoption and governance of approved AI-assisted engineering practices across... ...with enterprise logging and monitoring platforms, including Splunk, Elastic Search,...For contractorsLocal area
- ...professionals for this role. Corporate Engineering – Fraud Hub Lead Engineer At BNY, our culture allows... ...day, our teams harness cutting-edge AI and breakthrough technologies to... ...Fraud detection, prevention, and response platforms, with responsibility for defining architecture...WorldwideFlexible hours
- OPËNHOMME seeks a technical leader to drive the architecture design and enhance features on its platform. The role involves extensive collaboration, performance optimization, and data-driven insights. The ideal candidate will have 5+ years of experience and expertise in...
- Blueface Ltd is looking for a Lead C++ Software Engineer based in New York to help design and support our innovative video advertising platform. This hybrid role requires extensive experience in C/C++ programming and system design. The ideal candidate will lead a team of...
- ...Doppel is built to outsmart one of the great threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other social... ...re building the AI‑native social engineering defense platform. This means we’re designing scalable systems that monitor...Work at officeFlexible hours
$15k
...that applies state‑of‑the‑art AI and machine learning techniques... ...lunches, and more. Strategy Platform owns the infrastructure between... ...across research and production Engineer smooth deployment processes... ...disruption to active trading systems Lead complex projects spanning the...Work at officeLocal area$220k - $300k
...incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical... ...Harvey’s AI can do. Representative Projects Context Engineering & Agent Infrastructure – Build the platform-level...$225k - $265k
...Unify Unify is building the first AI-powered system of action for... ...into a top-performing growth engine by making go-to-market... ...is focused on scaling our core platform to support our hyper growth. Morever... ...accelerate customer value. Mentor & lead: Provide technical leadership...- ...Anima is seeking an Intern/New Grad Software Engineer to join their dynamic team. You will contribute to building innovative healthcare... ...offers the chance to directly impact healthcare through advanced AI and reinforcement learning, in a vibrant and fast-paced environment...Internship
- ...whale of a ride! Our Infrastructure Engineering team builds and operates the cloud-native platform that powers Docker’s suite of... ...with product and security teams. AI-accelerated execution: we build agentic... ...during your shifts. First Year Lead or co-lead a meaningful platform...Remote workHome officeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Engineer, Platform Engineering - AI. Be the first to apply!
- lead algorithm engineer New York, NY
- lead product engineer New York, NY
- lead backend developer New York, NY
- lead structural engineer New York, NY
- lead maintenance engineer New York, NY
- lead project engineer New York, NY
- lead operating engineer New York, NY
- lead quality engineer New York, NY
- lead industrial engineer New York, NY
- lead solutions engineer New York, NY


