Azure Data Engineer

div:has([data-free-thinking-preview-answer=true])+:is(.text-message,.relative:has(> .text-message))]:-mt-2 grow">

Job Summary
Azure Data Engineer responsible for designing, developing, and supporting enterprise-scale data engineering, migration, modernization, and integration initiatives on Microsoft Azure. The role requires strong expertise in Azure Databricks, Azure Data Factory, ADLS, Azure Synapse, Azure SQL Database, Azure Functions, Logic Apps, Spark, Python, SQL, and enterprise data architecture. The position will focus on building batch and real-time data pipelines, data modeling, data governance, data quality, and integration across complex data environments.


Key Responsibilities
• Design, develop, and optimize scalable ETL/ELT pipelines and data flows using Azure Data Factory for batch, real-time, and near-real-time data processing.
• Develop and implement data solutions using Azure Databricks, Delta Lake, ADLS, Azure Synapse, Azure SQL Database, Azure Functions, Logic Apps, Event Hubs, Web Apps, and API Management.
• Design and implement enterprise data architecture, data sourcing, ingestion, curation, transformation, and storage mechanisms.
• Develop Spark-based data processing solutions using Python, SQL, Scala, and Spark notebooks.
• Design and implement data models supporting enterprise reporting, analytics, data warehousing, and operational data requirements.
• Support data migration, system modernization, and integration initiatives across complex enterprise environments.
• Develop and maintain real-time and near-real-time data warehousing solutions and data processing architectures.
• Work with Microsoft SQL Server and Oracle databases to develop, optimize, and maintain data solutions.
• Analyze and reverse-engineer complex legacy implementations, including Oracle PL/SQL logic and database behavior.
• Apply data management principles across metadata management, master data management, data governance, and data quality initiatives.
• Support enterprise data integration and migration activities, including migration to Salesforce where applicable.
• Collaborate with technical and business stakeholders to understand data requirements and translate them into scalable data engineering solutions.
• Troubleshoot data pipelines, integrations, database issues, and production data processing challenges.


Required Qualifications
• 15+ years of overall professional experience with strong experience in enterprise data migration, system modernization, and integration initiatives.
• 8-10 years of experience in data modeling, data/information architecture, metadata management, master data management, data governance, and data quality.
• Strong hands-on experience with Microsoft Azure data services, including Azure Databricks, ADLS, Azure Data Factory, Azure Synapse, and Azure SQL Database.
• Strong experience with Azure Databricks and its components, including Delta Lake.
• Strong experience designing and developing ETL/ELT pipelines and data flows using Azure Data Factory.
• Hands-on experience with Azure Functions, Logic Apps, Event Hubs, Web Apps, and API Management.
• Strong programming experience with Python, SQL, Spark notebooks, and Scala.
• Strong development and design experience with relational database environments, including Microsoft SQL Server and Oracle.
• Strong understanding of data architecture, data management, data sourcing, ingestion, curation, transformation, and storage mechanisms.
• Experience with big data concepts and scalable data processing architectures.
• Experience designing real-time and near-real-time data warehousing solutions.
• Strong understanding of Oracle PL/SQL logic and database behavior, with the ability to analyze and reverse-engineer complex legacy implementations.
• Strong experience with enterprise data integration and data migration initiatives.
• Strong ETL/data integration experience with SSIS and/or Informatica as additional technologies.


Preferred Qualifications
• Experience supporting migration initiatives involving Salesforce.
• Experience working with complex enterprise data environments and modernization programs.