Azure Data Engineer

Azure Data Engineer

Azure Data Engineer will be responsible for implementing data ingestion and transformation pipelines. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering end-to-end production implementation. Performance Team and Damco Distribution, now part of the Maersk global organization under a combined Warehousing & Distribution division, offer third party logistics services to over 500 customers. Encompassing almost 15 million square feet of warehousing capacity throughout the country and a large transportation segment capturing a variety of services, we have key supply chain hubs in the Los Angeles and New Jersey/New York areas, and other facilities along the Western & Eastern coasts along with multiple locations in the Midwest. Delivering significant sales and profitability growth, we will drive the Inland Logistics and Services business for the combined US business units for Maersk.

Key Responsibilities

Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure tools Developing scalable and re-usable frameworks for ingesting of assorted data sets Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained Manage and lead junior data engineers and provide guidance, support and mentor other members of the team as well as do hands-on work Working with event based / streaming technologies to ingest and process data Working with other team members for implementing data pipelines and solutions in production using DevOps for deployment/automation Working with Azure CI/CD pipelines Delivering and presenting technical solutions to business users, technical teams and clients

Qualifications:

• Strong knowledge of Data Management principles
• Experience in building ETL / data warehouse transformation processes
• Direct experience of building data pipelines using one of the following Azure Data Factory, Azure Synapse, Azure Databricks
• Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Azure AI), Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
• Ability to work seamlessly within a team, react quickly to a fast paced, and rapidly changing environment
• Strong capacity for logical thinking with the ability to understand complex applications
• 5+ years hands on experience using databases
• Excellent written and verbal communication skills

Education and Preferred Experience:

• Bachelor's degree or combination of equivalent education and experience in related fields.
• 10+ years hands on experience providing solution design with BI systems and BI reports.
• Experience using geospatial frameworks on Apache Spark and associated design and development patterns
• Expert or professional level Azure certifications is a plus