Azure Data Engineer

Azure Data Engineer Charlotte, NC - Hybridis in the process of leading a Digital Transformation across our Americas Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced software Data engineers spread across Charlotte (N.C), Jersey City (N.J) and India, with 10+ years of relevant experience to support the design and development of a strategic data platform for Capital Markets and Nikko Securities Group.Role ObjectivesThese roles will be part of the Data Strategy team spanning across the business Capital Markets and Nikko securities teams, business Americas Division's broker-dealer and swap-dealer entities. These roles will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains. The consulting team will need to follow internal development standards to contribute to the overall agenda of the Data Strategy team. The implementation of this strategic platform on 's Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.Qualifications and Skills10+ years of experience in software development using Python, PySpark and its frameworks. Proven experience as a Data Engineer/Data Quality Engineer with experience in Azure cloud.Experience implementing solutions using:Azure cloud servicesAzure Data FactoryAzure Lake Gen 2Azure DatabasesAzure DatabricksData Quality Framework/Solution Collibra Data Quality or any Data Quality tools (IDQ/IBM/Ab-Initio)Collebra Data Governance and Data lineage knowledgePower BIWell versed with Azure DatabricksStrong SQL skills with RDMS or noSQL databasesFamiliarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processesGood understanding of ETL/ELT processesExperience in financial services industry, financial instruments, asset classes and market data are a plus.