Capital Markets Data Warehouse Architect (Azure Databricks)

Datawarehouse Architect with Capital market Domain

New York, NY ( Need Onsite day 1, Hybrid 3 days from office)

Position type: W2 contract

Job Description

We are looking for a highly proficient Data Warehouse Architect to lead the design and implementation of our enterprise data solutions. The ideal candidate will possess strong expertise in Azure Databricks, Python, and have a deep understanding of the financial or capital markets domain to support our data-driven initiatives and strategic insights.

The Role

Responsibilities

• Design, develop, and optimize scalable data warehouse architectures leveraging Azure cloud services.
• Build and maintain robust data pipelines and workflows using Azure Databricks and Python.
• Collaborate with business teams to understand data requirements and translate them into effective technical solutions.
• Ensure high data quality, security, and compliance with industry standards and regulations.
• Lead efforts to migrate legacy data systems to modern cloud-based architectures.
• Develop data models, ETL/ELT processes, and performance tuning strategies.
• Provide technical leadership, mentorship, and guidance to data engineering teams.
• Monitor data pipelines for reliability and troubleshoot issues as they arise.
• Stay current with emerging technologies, tools, and best practices in big data, cloud computing, and financial data management.

Requirements

• Data Governance & Compliance:
• Define and operationalize the Data Governance framework covering data ownership, stewardship, classification, lineage, and quality SLAs in collaboration with the CDO and Compliance teams.
• Implement automated end-to-end data lineage capabilities to support audit trails and regulatory examinations.
• Establish and monitor data quality dimensions such as completeness, accuracy, consistency, and timeliness with automated profiling and alerting for critical financial datasets.
• Drive data cataloguing initiatives, business glossary management, and metadata enrichment to improve enterprise-wide data democratization.
• Ensure adherence to financial industry governance, security, privacy, and regulatory requirements.
• Stakeholder Engagement & Leadership:
• Act as a trusted technical advisor to senior stakeholders on enterprise data strategy and platform capabilities.
• Lead and mentor a team of data engineers through architectural guidance, code reviews, and technical coaching.
• Partner with Enterprise Architecture and Infrastructure teams to ensure alignment with bank-wide technology standards.
• Produce clear technical documentation, architecture diagrams, and executive-level presentations for technical and non-technical audiences.
• 12+ Years experience as a Data Warehouse Architect or in a similar senior data engineering role.
• Hands-on experience with Azure Databricks, Python, and related Azure Data Services.
• Strong proficiency in SQL and data modeling techniques.
• Experience developing data pipelines, ETL/ELT workflows, and working with big data technologies such as Spark.
• Deep domain knowledge of the financial or capital markets industry, including financial instruments, trading, risk management, and regulatory compliance.
• Familiarity with data governance, security, and regulatory requirements.
• Bachelor s degree in Computer Science, Information Technology, or a related field; Master s degree preferred.
• Excellent communication skills with the ability to collaborate effectively across cross-functional teams and executive stakeholders.

Preferred, But Not Required

• Azure certifications such as Azure Data Engineer, Azure Data Scientist, or Azure Solutions Architect.
• Experience with additional programming languages such as Scala, Java, or C#.
• Knowledge of financial data standards and protocols.
• Familiarity with BI tools and reporting platforms.

#J-18808-Ljbffr