Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer, Investment Data Platform

Castleton Tower Consulting, LLC

The Firm Castleton Tower is a boutique consulting firm founded by executives who have built and led quantitative research, data science, and technology teams at top-tier hedge funds and asset managers. We work exclusively with investment management firms, including asset allocators, asset managers, hedge funds, family offices, and RIAs, helping them modernize data infrastructure and build AI-ready foundations. Our engagements combine senior strategy with hands-on implementation. We assess technical and business strategy, design the architecture, and build the data and AI infrastructure needed to support better investment decisions. The Opportunity We are looking for a senior, hands-on data engineering lead to help a prominent asset allocator client build a modern investment data platform. The firm has outgrown a collection of disconnected applications and spreadsheets and is building a unified data foundation across its investment, operations, and reporting functions. This is a builder's role. The right person has deep technical expertise, writes and reviews production code, and holds a high bar for quality. They know what good data engineering looks like, and when work falls short of it they fix it and help the team raise its standards. You will lead technical work across a small, growing team and partner directly with the head of the function. What You Will Own Platform architecture: Design and build the warehouse and lakehouse, data models, orchestration, and semantic layers that the investment organization runs on. Hands-on delivery: Build production-grade Python, SQL, dbt, and orchestration work yourself, including batch and near-real-time pipelines. Engineering standards: Bring software engineering discipline to data: code review, testing, CI/CD, documentation, observability, and data quality controls. Technical leadership: Lead and mentor engineers through design reviews and pairing, set the technical direction for your area, and own outcomes end to end. Business partnership: Work with investment, operations, finance, and reporting stakeholders to turn their needs into durable data products. AI-enabled engineering: Use tools such as Claude Code, Codex, Cursor, and Copilot to move faster without compromising quality or controls. Core Responsibilities Architect and build core investment data domains such as security and entity reference data, positions and transactions, performance, risk, and private-markets fund data. Design data models that are correct, reconcilable, and point-in-time aware, with tests and controls that catch problems before users do. Own reliability, performance, and cost of the platform, including monitoring, alerting, and incident follow-through. Review others' work closely, send it back when it isn't right, and make the next version better. Evaluate tooling and vendors across Snowflake, dbt, Dagster/Airflow, and Azure, and make pragmatic build-versus-buy calls. Qualifications Required 8+ years of hands-on experience in data engineering, analytics engineering, or software engineering focused on data platforms. 3+ years leading technical work, as a tech lead, principal or staff engineer, or engineering manager who still builds. Expert SQL and Python, and deep data modeling and architecture judgment that goes beyond any single tool. Production experience with modern warehouse and lakehouse platforms (Snowflake, Databricks, or similar), dbt, and orchestration tools (Dagster, Airflow, or similar). Strong software engineering practice: version control, code review, automated testing, and CI/CD applied to data. Track record of shipping and operating systems you built, described in terms of what you delivered. Strongly Valued Experience with investment management systems and data: security master, IBOR/ABOR, OMS, risk, performance, fund accounting, or client reporting. Private markets data, including entity mapping across sources without universal identifiers. Azure data services (Azure Data Factory, Azure DevOps pipelines, Synapse) and Power BI. Experience in asset allocators, asset managers, hedge funds, private markets firms, or financial data providers. Personal Attributes Craftsman mindset: you care about the parts of the system nobody sees. High standards for yourself and the people around you, delivered constructively. Ownership: you see problems through to resolution without being asked. Clear communicator with both engineers and investment professionals. Location and Placement Location: Hybrid, Northeast U.S. This role is intended for full-time placement at a prominent asset allocator client. The successful candidate will work closely with the client's engineering leadership and investment, operations, and technology stakeholders, and spend regular time in the office. Compensation: Competitive total compensation commensurate with experience. #J-18808-Ljbffr Castleton Tower Consulting, LLC

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer, Investment Data Platform in New York, NY vacancy
  •  ...Role Overview The Lead Data Engineer will own the design, development, and maintenance of robust data architecture and pipelines leveraging...  ...), data transformation frameworks (dbt), cloud data platforms (Snowflake), SQL, and Python. Develop and optimize cloud-... 
    Platform
    Full time

    The Phoenix Group

    New York, NY
    4 days ago
  •  ...729598Reference Number: 25-00664Title: Lead Data EngineerLocation: NYC, NYPosted Date: 2...  ...Staffing Required Skills:Proficiency in data engineering programming languages (preferably...  ...Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or... 
    Platform

    HAN Staffing

    New York, NY
    1 day ago
  •  ...Data Engineers – Global Investment Firm | New York & London Build the data platform behind trading, research and risk at a top-tier investment firm. My direct client, a premier...  ...and work. New York: four openings. One Lead Data Engineer and three mid/senior individual... 
    Platform
    Full time
    Visa sponsorship

    $30 Global Investment Firm

    New York, NY
    4 days ago
  • $134.5k - $265.1k

     ...Summary Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build...  ...business needs into scalable data platform capabilities using Databricks and cloud...  ...organizations, as well as through our own investments, commitments, and actions across areas... 
    Platform
    Local area
    Visa sponsorship

    Deloitte

    New York, NY
    2 days ago
  • $137.7k - $229.5k

     ...Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help...  ...innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will...  ...organizations, as well as through our own investments, commitments, and actions... 
    Platform
    Local area

    Deloitte

    New York, NY
    2 days ago
  •  ...Title: Lead AWS Data Engineer Location: OWING MILLS, MD Duration: Full Time Salary: 120K Job Description: • 12+ years...  ...Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark • Very Good hands-on knowledge on SQL... 
    Platform
    Full time

    Diverse Lynx

    New York, NY
    4 days ago
  •  ...Job Title:Lead Data Engineer - Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa...  ...experience to design and own scalable, production-grade data platforms supporting Agentic AI and LLM-based systems . The role focuses... 
    Platform
    Contract work

    Argyll Infotech, Inc.

    New York, NY
    4 days ago
  • $120k - $180k

     ...within the newly consolidated Data and Analytics (D&A)...  ...infrastructure, data governance, data engineering, data modeling, data analysis...  ...intelligence, data science, and AI.The Lead Data Engineer is crucial to D...  ...volumes of data from various platforms for Analytics needs and... 
    Platform
    Full time
    Temporary work
    Work at office
    Local area
    Relocation package
    3 days per week

    Metropolitan Life Insurance Company

    New York, NY
    3 days ago
  • $172k - $232k

     ...dollars of media flows through platforms that don’t talk to each other...  ...: consented first-party data and AI that give the world’s...  ...powers reliable reporting and leading a small team of analysts. You...  ...experience in data analytics or data engineering, owning pipelines from raw... 
    Platform
    Temporary work

    Samba

    New York, NY
    2 days ago
  •  ...Agentic Commerce Orchestration Engine helping enterprise retailers,...  ...We are hiring a Lead Data Engineer to drive delivery across our analytics and data platform initiatives. This role is a hands...  ...not just accessible-they're invested in your growth, open to your... 
    Platform
    For contractors
    Work at office
    Remote work

    Logicbroker

    New York, NY
    3 days ago
  •  ...Lead Data Engineer Locations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location;...  ...opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide... 
    Platform
    Long term contract
    Work at office

    InterSources

    New York, NY
    4 days ago
  • $145.2k - $217.88k

     ...The Scientific Computing and Data team at the Icahn School of Medicine...  ...AI-Ready.Mount Sinai (AIR.MS) platform contains patient data...  ...translational science. The Lead Data Warehouse Enginee r is a...  ...maintenance Mentor junior engineers in data warehousing, data engineering... 
    Platform
    Full time

    Icahn School of Medicine at Mount Sinai

    New York, NY
    4 days ago
  •  ...The Scientific Computing and Data team at the Icahn School of Medicine at Mount...  ...resourcesfor translational science. Lead Data Warehouse Engineer is a senior technical specialist responsible...  ...other members of the AIR.MS data platform and Mount Sinai Data Warehouse teams... 
    Platform
    Traineeship
    Local area

    American Medical Informatics Association, Inc

    New York, NY
    1 day ago
  • $175k - $250k

     ...50000 per year Responsibilities Lead the development of cloud-based data platforms, pipelines, and data products leveraging...  ...research. Collaborate with investment, research, and technology teams...  ..., code reviews, mentorship, and engineering best practices. Drive projects... 
    Platform

    Selby Jennings

    New York, NY
    3 days ago
  •  ...A global financial institution is seeking a Lead Data Platform Engineer to drive adoption and enablement for a strategic enterprise cloud data platform. This position sits within a centralized data technology organization responsible for shared data-platform capabilities... 
    Platform
    Full time
    Immediate start

    Madison-Davis, LLC

    New York, NY
    4 days ago
  • $135k - $180k

     ...patients, Medidata offers industry-leading expertise, analytics-powered...  ...the largest clinical trial data sets in the industry. More...  ...Medidata's seamless, end-to-end platform to improve patient...  ...are seeking a Lead AI & Data Engineer to design, build, and deploy... 
    Platform
    Work at office
    Local area
    Remote work
    Flexible hours

    DASSAULT SYSTÈMES

    New York, NY
    1 day ago
  • $180k - $250k

     ...pay range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure...  ...: Deep expertise in Python, SQL, and cloud platforms (e.g., AWS, GCP, or Azure) Strong experience with ETL... 
    Platform
    Full time

    Evolve Group

    New York, NY
    1 day ago
  • $42.07 - $65.73 per hour

     ...leadership experience is mandatory. We are looking for a lead, not a senior Data engineer. Candidates without 5+ years of experience as lead will...  ..., scientists, and analysts to deliver self-service data platforms and support advanced analytics/ML use cases. Data Quality... 
    Platform

    Capgemini

    New York, NY
    19 hours ago
  •  ...Elevate and drive innovation, data engineering solutions, and serve as a decision maker for Firmwide HR...  ...Employee Experience data products. As a Senior Lead Software Engineering at JPMorgan Chase within the Employee Platforms, Workforce Experience Technology (WxT) Data... 
    Platform

    Testing Site - JPMC

    New York, NY
    19 hours ago
  •  ...future and make a meaningful difference.  As a Lead Data Engineer at JPMorganChase within the Commercial & Investment Bank Operational Resiliency team, you are an...  ...microservices, event-driven designs, cloud-based data platforms, and Lambda/Kappa patterns) to support scalable... 
    Platform

    JPMorgan Chase & Co.

    New York, NY
    17 days ago
  • $170k - $220k

     ...transformational scale beginning with the Coast Fleet and Fuel Card built on a cutting-edge spend management platform. About the Role Were looking for a Lead Data Engineer who can not just get their hands dirty building pipelines and also act as a thought leader for the... 
    Platform
    Full time
    Work at office
    Local area
    Flexible hours

    Coast

    New York, NY
    10 days ago
  • Description The Lead Data Engineer owns Awayday's ingestion and pipeline layer end to end, from each source system through to the landing...  ...reliability improves as the estate grows. Standards, Governance, and Platform Enforce the technical data contract each new source meets at... 
    Platform
    Contract work
    For contractors

    Luxury Coastal Vacations

    New York, NY
    3 days ago
  • Lead AWS Data Engineer Contract-to-hire 100% Remote Profile Summary: Lead Data and Analytics Engineer will be a senior member of data and analytics...  ...with expert level skills in ground-up AWS data & analytics platform development Strong background and experience in AWS Data... 
    Platform
    Contract work
    Remote work

    Software Technology Inc

    New York, NY
    3 days ago
  • Lead Data Engineer This is a remote role that may be hired in several markets across the United States. Priority given to those candidates...  ...seeking an experienced Lead Data Engineer to join our Data Platform Engineering Organization and lead the design, development, and... 
    Platform
    Remote work

    First Citizens Bank

    New York, NY
    3 days ago
  • Lead Data Engineer Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of...  ...Data Engineer with strong expertise in Snowflake-based data platforms, modern data architectures, and AWS, to lead the design and... 
    Platform
    Flexible hours

    Blend360

    New York, NY
    4 days ago
  • $111.8k

    Overview Lead Data Engineer | Build the Future of Data at GATX Remote (Chicago-area preferred...  ...space in the Willis Tower. Now we are investing in the next evolution of our data,...  ...of a modern AWS + Databricks Lakehouse platform; Partner across IT, analytics, and business... 
    Platform
    Temporary work
    Work at office
    Remote work

    GATX

    New York, NY
    3 days ago
  • Job Title: Lead Data Engineer Location: Dallas, TX Client: Prodapt/ AT&T Project Duration: 12 months Job Type: Contract Work Arrangement...  ...Python, ETL development, data warehousing, cloud-based data platforms, and technical leadership. The role involves collaborating... 
    Platform
    Contract work

    Abode Tech Zone

    New York, NY
    3 days ago
  • Lead Engineer Join Brooksource as a Lead Engineer, where you will combine hands-on application...  ...documentation Develop and support SaaS platforms, custom applications, APIs, integrations...  ...development, cloud computing, cybersecurity, data analytics, or enterprise IT, our... 
    Platform
    Contract work
    Local area
    Remote work
    Flexible hours

    Brooksource

    New York, NY
    3 days ago
  •  ...Guidance & Assistance, Inc. (SGA) is searching for a Senior Data Engineer - Investment Technology (Python) for a Direct Hire assignment with one...  ...the reliability and scalability of the overall data platform. Apply strong software engineering practices around testing... 
    Platform
    Remote work

    Software Guidance & Assistance

    New York, NY
    3 days ago
  • Lead Data Privacy Engineer We're building a world of health around every individual — shaping a more connected, convenient and compassionate health...  .../NoSQL databases, data lakes, and enterprise-scale data platforms. Demonstrated application of AI, automation, and advanced... 
    Platform
    Full time
    Work experience placement
    Local area

    Oak St. Health

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer, Investment Data Platform. Be the first to apply!