Senior Data Engineer

We are seeking a highly skilled and experienced Senior Level Data Engineer with extensive expertise in Azure Synapse and Azure Data Factory to join our team. The ideal candidate will have a deep understanding of Microsoft Azure and a proven track record of designing, implementing, and maintaining data pipelines and solutions using Azure Synapse and Azure Data Factory. Data Integration experience must include data lake and SQL database hands-on.

Responsibilities:


Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Synapse Analytics, and other Azure services to integrate and process data from various sources.


Collaborate with cross-functional teams to gather requirements and design scalable data solutions that meet business needs.


Optimize data storage, retrieval, and processing in Azure Synapse to ensure optimal performance, efficiency, and cost-effectiveness.


Develop, test, and deploy Azure Logic Apps and Azure Functions to automate data processing tasks and support data analysis and reporting.


Work closely with data scientists and analysts to enable advanced analytics and machine learning capabilities using Azure Synapse Analytics.


Ensure data security, data governance, and compliance with regulatory requirements.


Monitor, troubleshoot, and optimize the performance of Azure Data Factory pipelines and Azure Synapse workloads.


Stay up-to-date with the latest developments in Azure Synapse, Azure Data Factory, and other Azure services to ensure that our data solutions remain current and efficient.


Requirements:


Bachelor's or Master's degree in computer science, Information Systems, or a related field.


At least 10 years of experience in data engineering, with heavy focus on Azure Synapse and Azure Data Factory.


Strong proficiency in SQL, T-SQL, and at least one Object Oriented programming language like Python or C Sharp.


Extensive experience with Azure Synapse Analytics, including data warehousing, data integration, and advanced analytics.


In-depth knowledge of Azure Data Factory, including developing and optimizing data pipelines and ETL processes.


Experience working in an Agile development environment.


Strong analytical and problem-solving skills.


Excellent communication and collaboration skills.


Core Technologies:


Azure Synapse Analytics


Azure Data Factory


Azure Data Lake Storage


SQL Server and T-SQL


Python or C Sharp programming languages


Azure Functions and Azure Logic Apps


Azure DevOps


GitHub / GitHub Actions