Azure Data Engineer

Azure Data EngineerLocation: Chicago, IL Duration: 6-12 MonthsU.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor currentlySkillsOver 8 years of IT experience4+ years in Azure stack4+ years of experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications2+ years of experience in integrating with heterogeneous sources using linked services.2+ years of experience enabling data governance capabilities and configuration in the data engineering lifecycle (data privacy, data security & compliance, and data quality)2+ years integrating and nuances around maintaining GitHub and GitHub actions.2+ years in ADF creating pipelines with several activities2+ years of experience developing PySpark notebooks in an Azure data bricks cluster1+ years of hardcore experience with Spark SQL1+ years of relevant configuration experience in Unity catalog integration and useStrong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)Provide code review and facilitate code management for the engineering team to ensure best practices and performance standards4 years in SDLC agile and using CI/ CD pipeline using GitHub actions.1+ years in deployment and post-deployment activities in production.1+ year helping with standing the infrastructure stack and linked services with various sources.