Azure Data Engineer

Azure Data Engineer

We are seeking a highly skilled and experienced Azure Data Engineer who specializes in Azure Data Factory (ADF) to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in designing, developing, and implementing data integration solutions using Azure Data Factory to ensure efficient and reliable data pipelines.

Required Skills:

• Data Pipelines
• ETL
• Azure Data Factory
• DevOps principles

Job Duties:

• Assisting the Team Lead in developing technical blueprints for data management, cloud services, data assets, and reporting systems.
• Collaborating with stakeholders to gather requirements and understand data integration needs.
• Developing technical Proofs-of-Concepts as well as production ready data solutions.
• Developing and testing data lakes, data warehouses and other repositories which are part of a modern Data Warehouse solution in Azure.
• Designing, developing, and deploying end-to-end data integration solutions using Azure Data Factory.
• Implementing data transformation and data cleansing techniques to ensure data accuracy and consistency.
• Monitoring and troubleshooting data pipelines, identifying and resolving performance issues, data quality problems, and other pipeline-related challenges.
• Leveraging best practices for data integration, data orchestration, and scheduling within Azure Data Factory.
• Creating and maintaining technical design and operational documentation.

Job Requirements:

• *MUST HAVE* - Minimum of 7 years of experience designing and developing data pipelines and ETL solutions on-premise and in the cloud in a Microsoft environment.
• *MUST HAVE* - Minimum of 5 years of experience designing and implementing data solutions with Azure Data Factory.
• Experience delivering data solutions in an agile environment using either Scrum or Kanban.
• Bachelor's degree in Computer Science, Engineering, or a related field.
• In-depth knowledge of Azure Data Factory features, components, and integration capabilities.
• Familiarity with data storage technologies such as Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Data Warehouse.
• Proficiency in SQL and scripting languages for data transformation and manipulation is expected.
• Hands-on experience with data integration patterns, ETL/ELT processes, and data warehousing concepts.
• Familiarity with DevOps principles and techniques including CI/CD and Agile (Kanban/Scrum) Delivery of Data Solutions using Azure DevOps.
• Familiarity with project management including estimation and risk management.
• Working knowledge of the SDLC and IT Operations.
• Excellent written, verbal and presentation skills are expected along with experience presenting to senior technical and business management.

Desired Skills & Experience:

• Expertise with other Azure data services like Azure Databricks, Azure Synapse Analytics, or Azure Stream Analytics is a plus.