Lead Data Engineer (AI Platform)
$190k - $250kHarnham
Title: Lead Data Engineer (AI Platform) Location: NYC (Hybrid) Pay: $190k - $250k base + bonus About the Role A rapidly scaling global investment organization is building a nextgeneration data and AI backbone to support research, portfolio intelligence, reporting, and secure AIdriven workflows. This is a foundational engineering role where you will architect and implement the firm's core data and AI platform within a small, highimpact team. Responsibilities
- Design and maintain a modern lakehouse architecture (Bronze/Silver/Gold).
- Build scalable data ingestion and transformation pipelines.
- Develop structured and unstructured data systems optimized for AI retrieval and indexing.
- Implement secure access controls, governance models, and full data lineage.
- Partner directly with technical leadership and business stakeholders to translate workflows into production systems.
- Support AIenabled systems including retrievalbased and LLMintegrated applications.
- Ensure platform reliability, scalability, and adherence to regulatory best practices.
- Contribute to architectural strategy while remaining handson with implementation.
- 7-10+ years of experience in data engineering or platform engineering.
- Proven experience building data platforms from the ground up.
- Strong cloud experience (Azure preferred and Microsoft Foundry).
- Deep understanding of distributed data processing frameworks.
- Strong Python proficiency.
- Experience with productiongrade access control and governance systems.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (AI Platform) in New York, NY vacancy
$229.9k - $262.4k
...Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business... ...practices ~1+ years of experience leveraging AI-assisted coding tools (Claude Code, Github Copilot) to accelerate...SuggestedFull timePart timeInternshipLocal areaCapital One
New York, NY4 days ago- ...Kraken is looking for a leader for its Data Platform team to develop real-time streaming infrastructure crucial for decision-making in digital asset trading. The role demands expertise in data engineering, AI automation, and managing engineering teams in a high-volume...Suggested
Kraken
New York, NY3 days ago $197.3k - $225.1k
...Lead Data Engineer (Enterprise Platforms Technology) ( Java, Python, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy... ...Qualifications: ~1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate...SuggestedFull timePart timeInternshipH1bLocal areaCapital One
New York, NY2 days ago- ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions... ..., and performance optimization, with exposure to Cortex AI and advanced analytics use cases. Responsibilities & Qualifications...Suggested
TheStaffed
New York, NY2 days ago - ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY... ...to design and own scalable, production-grade data platforms supporting Agentic AI and LLM-based systems. The role focuses on building event...SuggestedContract work
Argyle Infotech
New York, NY2 days ago - ...enterprise initiative to modernize data platforms by migrating from legacy and... ..., enabling standardized data engineering, analytics, centralized... ...reconciliation utilities, and AI/ML use cases-while adhering to... ...Responsibilities Lead and execute migration of legacy...
Yochana
Jersey City, NJ3 days ago - ...Title: Lead Snowflake Data Engineer Location: NYC | Fully Onsite | Prioritizing local candidates... ...pipelines using Snowflake and Cortex AI, with full lifecycle ownership-from ingestion... ...ownership of production-grade data platforms ~ Deep expertise in: ~ Snowflake...Contract workLocal area
Suncap Technology
New York, NY2 days ago $160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of... ...backfill strategies, and late-arriving data handling — so the platform stays correct as clinical sites come online across time...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shiftDeliberate AI
New York, NY2 days ago- ...within the newly consolidated Data and Analytics (D&A)... ...infrastructure, data governance, data engineering, data modeling, data... ...intelligence, data science, and AI. The Lead Data Engineer is crucial to... ...volumes of data from various platforms for Analytics needs and writing...
MetLife
New York, NY1 day ago $100k - $200k
...in digital assets and data center infrastructure,... ...institutional digital assets platform spans trading,... ...infrastructure to power AI and high-performance computing... ...senior, hands-on data engineer with 8+ years of... ...— and you're ready to lead. You set the technical...Local areaFlexible hoursGalaxy USA
New York, NY23 hours ago$145.2k - $217.88k
...The Scientific Computing and Data team at the Icahn School of Medicine... ...scientific discovery. The AI-Ready.Mount Sinai (AIR.MS) platform contains patient data generated... ...translational science. The Lead Data Warehouse Engineer is a senior technical specialist...TraineeshipLocal areaMount Sinai Health System
New York, NY6 hours ago- ...a rapidly growing Behavioral AI company on a mission to ethically... ...democratize the benefits of data and AI . Since 2019, we have built... ...and decisioning for leading brands and agencies while protecting... ...and culture from the ground up. Engineers here own major surface areas ,...Remote workFlexible hours
$180k - $250k
...00.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize... ...expertise in Python, SQL, and cloud platforms (e.g., AWS, GCP, or Azure) Strong... ...each article, started with the help of AI. #J-18808-Ljbffr Evolve GroupFull time- A leading Behavioral AI company in New York is seeking a Lead Data Engineer to oversee data workflows and ensure the reliability of their products. This hands-on role involves working on schema modeling and orchestration techniques while collaborating with cross-functional...Remote job
- Bluefish, a leading AI-driven marketing technology platform, is seeking a Senior Data Acquisition Engineer in New York. This role involves developing scalable web data acquisition systems and ensuring system reliability. With at least 5 years' experience in backend systems...
$120k - $195k
Lead Data Engineering & Governance (Pharma) New York, NY | Full-Time Location: New York, NY — On-Site... ...& Governance Lead to join its Pharma AI practice and serve as the primary data... ...delivery of scalable data pipelines and data platform solutions built on AWS and Snowflake,...Hourly payFull timeWork at officeLocal areaDay shift- A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate will... ...and maintain scalable data pipelines and collaborate with AI/ML teams. The position requires strong skills in Databricks, Python...Remote job
$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements... ..., SQL, and Python. Collaborate with AI/ML teams to operationalize models... ...reliability, and cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data...Contract workLocal areaRemote workFlexible hours- A rapidly growing AI company in New York is looking for a Lead Data Engineer. In this hands-on role, you will manage how data powers our Behavioral AI products through efficient workflows and schema modeling. Candidates should be experienced in developing data pipelines...Remote job
$110k - $175.6k
...Employer & Broker pillar of Data and Analytics (D&A)... ..., data science, and AI. The Opportunity... ...the project (technical leads, build team, project managers... ...tools against various platforms such as Azure Synapse,... ...the data loaded by data engineering team. Work with IT,...Temporary workWork experience placementWork at officeLocal area3 days per weekMetLife
New York, NY4 days ago$120k - $158.4k
...MetLife Corporate Functions Data Office is part of the Data and... ...strategy! The Lead Big Data Engineer and Data Architect plays a critical... ...of data from various platforms for Analytics needs and write... ...Prior experience leveraging AI and ML capabilities to automate...Temporary workWork at officeLocal area3 days per weekMetLife
New York, NY2 days ago$145.2k - $217.88k
Mount Sinai Medical Center is seeking a Lead Data Warehouse Engineer to integrate multi-modal clinical data into the AIR.MS data warehouse. This senior role involves designing data pipelines, mentoring engineers, and ensuring compliance with privacy regulations. Candidates...- ...Job Description The Lead Data Analyst plays a critical role in designing... ...and related enterprise platforms. Lead data compilation, transformation... ...Power BI and Databricks AI/BI dashboards. Define and... ...Python, SQL, and Scala for data engineering, automation, and analytics....
Remote Jobs
New York, NY3 days ago $170k - $210k
...within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact... ...in our on-call rotation to ensure platform reliability and performance Contributed... ...Explored and evaluated new tools—including AI-assisted coding platforms like Claude...Remote workWork visaShift workMark43
New York, NY28 days ago- ...A European tech company is seeking a proactive Lead Data Engineer to join their fully remote team. The role involves contributing to a large-scale platform for performance management and revenue optimization. Candidates should have 5+ years in Data Engineering and experience...Remote work
DIGIS Corporation
New York, NY3 days ago $149.3k - $202.27k
S&P Global is hiring a data engineer in New York, NY, to design and implement data pipelines for analytics. The role requires a BS or MS in Computer Science, 8+ years of experience, and expertise in AWS cloud technologies including S3 and Redshift. Candidates should have...Flexible hours- ...A leading data solutions company in the United States is looking for a Technical Leader to drive complex data integration projects. This role requires over 5 years of experience in data engineering, excellent customer relationship management, and proficiency in modern...Remote work
Atlan Pte Ltd
New York, NY3 days ago - ...A leading data platform company in the United States is seeking an experienced data engineer to lead implementations and ensure customer success. You will work closely with Fortune 500 clients, transforming their data management and integration processes. Ideal candidates...
ATLAN LLC
New York, NY3 days ago - ...Tech Lead, Data & Inference Engineer New York, New York, United States Or refer someone About the Job... ...targetable audiences across platforms such as Meta, Google and YouTube, they... ...with a specialized vertical in Applied AI, Machine Learning, and Data Science....Full time
Catalyst Labs, LLC
New York, NY1 day ago - A cutting-edge healthcare technology firm in New York and Boston seeks a Data Engineer specialized in multimodal data infrastructure. You'll design and implement data architecture for diverse clinical datasets and build robust API integrations with wearable devices. The...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (AI Platform). Be the first to apply!
Related searches
- client platform engineer New York, NY
- senior platform engineer New York, NY
- data platform engineer New York, NY
- platform engineering manager New York, NY
- platform developer New York, NY
- platform engineer New York, NY
- clinical data New York, NY
- master data coordinator New York, NY
- clinical data coordinator remote New York, NY
- data intern New York, NY