Azure Data Engineer

Azure Data Engineer

Location: Chicago, IL Duration: 6-12 Months

U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor currently

Skills

• Over 8 years of IT experience
• 4+ years in Azure stack
• 4+ years of experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications
• 2+ years of experience in integrating with heterogeneous sources using linked services.
• 2+ years of experience enabling data governance capabilities and configuration in the data engineering lifecycle (data privacy, data security & compliance, and data quality)
• 2+ years integrating and nuances around maintaining GitHub and GitHub actions.
• 2+ years in ADF creating pipelines with several activities
• 2+ years of experience developing PySpark notebooks in an Azure data bricks cluster
• 1+ years of hardcore experience with Spark SQL
• 1+ years of relevant configuration experience in Unity catalog integration and use
• Strong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)
• Provide code review and facilitate code management for the engineering team to ensure best practices and performance standards
• 4 years in SDLC agile and using CI/ CD pipeline using GitHub actions.
• 1+ years in deployment and post-deployment activities in production.
• 1+ year helping with standing the infrastructure stack and linked services with various sources.