Azure Data Engineer

Azure Data Engineer

The organization is undergoing a Digital Transformation across its Americas Division as it continues to modernize its technology, strengthen its data-driven approach, grow, and plan for the future. As part of this expansion, we are seeking experienced Software Data Engineers across Charlotte, NC, Jersey City, NJ, and India, with 10 years of relevant experience, to support the design and development of a strategic data platform for Capital Markets and Securities operations.

Role Objectives

• Become part of the Data Strategy team supporting Capital Markets and Securities operations across the organization.
• Actively participate in the development of a strategic data platform in close coordination with internal data and technology teams.
• Contribute to the establishment of a reference data system for securities and pricing data, with plans to expand into additional data domains.
• Follow internal development standards and best practices while contributing to the overall objectives of the Data Strategy team.
• Design and implement solutions on the organization's Azure Cloud Platform using the required technologies and expertise outlined below.
• Collaborate with cross-functional teams to develop scalable, reliable, and high-quality data solutions.

Qualifications and Skills

• 10 years of experience in software development using Python, PySpark, and related frameworks.
• Proven experience as a Data Engineer or Data Quality Engineer with strong experience in Azure Cloud.
• Hands-on experience implementing solutions using:
  • Azure Cloud Services
  • Azure Data Factory
  • Azure Data Lake Gen2
  • Azure Databases
  • Azure Databricks
  • Data Quality Frameworks / Solutions
  • Collibra Data Quality or other Data Quality tools such as Informatica Data Quality (IDQ), IBM, or Ab Initio
  • Collibra Data Governance
  • Data Lineage
  • Power BI
• Strong hands-on experience with Azure Databricks.
• Strong SQL skills with RDBMS or NoSQL databases.
• Familiarity with the DevOps lifecycle, including Git, Jenkins, and related tools.
• Experience with CI/CD processes.
• Good understanding of ETL/ELT processes.
• Strong understanding of data engineering principles, data quality, and data management.
• Experience in the financial services industry is a plus.
• Knowledge of financial instruments, asset classes, and market data is a plus.

Preferred Industry Experience

Experience in the following areas will be considered an advantage:

• Financial Services
• Capital Markets
• Securities
• Financial Instruments
• Asset Classes
• Market Data
• Pricing Data
• Reference Data
• Data Governance
• Data Quality
• Data Lineage