Azure Data Engineer (1385)

Job Description

RESOURCE TYPE: W2 Only
LOCATION: Hybrid - Charlotte, NC
Experience Level: Senior (10+ Years)\n

Role Objectives

\n
• These roles will be part of the Data Strategy team spanning across the SMBC Capital Markets and Nikko securities teams, SMBC Americas Division’s broker-dealer and swap-dealer entities.
\n
• These roles will be involved in the active development of the data platform in close coordination with the SMBC team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.
\n
• The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.
\n
• The implementation of this strategic platform on SMBC’s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.
\n

Qualifications and Skills

\n
• 10+ years of experience in software development using Python, PySpark and its frameworks.
\n
• Proven experience as a Data Engineer/Data Quality Engineer with experience in Azure cloud.
\n
• Experience implementing solutions using -
  \n
  \n
  • Azure cloud services
  \n
  • Azure Data Factory
  \n
  • Azure Lake Gen 2
  \n
  • Azure Databases
  \n
  • Azure Databricks
  \n
  • Data Quality Framework/Solution
  \n
  • Collibra Data Quality or any Data Quality tools (IDQ/IBM/Ab-Initio)
  \n
  • Collibra Data Governance and Data lineage knowledge.
  \n
  • Power BI
  \n
\n
• Well versed with Azure Databricks
\n
• Strong SQL skills with RDMS or noSQL databases
\n
• Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes
\n
• Good understanding of ETL/ELT processes
\n
• Experience in financial services industry, financial
\n
• instruments, asset classes and market data are a plus.
\n