Senior Azure Data Engineer

Job Description

Job Description

Senior Azure Data Engineer | Remote

We are seeking a Senior Azure Data Engineer to help design, build, and operate a next-generation enterprise data platform on Microsoft Azure. This is a hands-on data engineering role focused on Azure Data Factory, Databricks/PySpark, modern Lakehouse architecture, enterprise data warehousing, and legacy-to-cloud modernization.

Location:

• Remote/Telecommute
• Occasional travel to Springfield, IL, approximately 2-3 times per year
• Must be willing to participate in a live verbal/video walkthrough of your technical experience and projects as part of the interview and verification process
• No third-party submissions.

What You’ll Do:

• Design reusable, parameter-driven pipelines using Azure Data Factory, Synapse Pipelines, Databricks and/or Microsoft Fabric Data Factory
• Build Bronze/Silver/Gold medallion architecture on ADLS Gen2 using Delta Lake and Parquet
• Develop and optimize PySpark notebooks and jobs
• Build and optimize scalable ELT workflows
• Design dimensional and Data Vault models
• Implement SCD Types 1/2/3, CDC, and late-arriving data patterns
• Implement CI/CD using Azure DevOps, YAML, ARM/Bicep and/or Terraform
• Support monitoring and troubleshooting using Azure Monitor, Log Analytics, and KQL
• Contribute to legacy-to-cloud modernization, including Informatica PowerCenter to Azure Data Factory
• Support migrations from Teradata, Oracle, and SQL Server to Synapse or Fabric
• Support production incident response for critical data pipelines

Required Qualifications:

• Deep hands-on Azure Data Factory experience
• Strong Databricks and PySpark experience
• Production experience with Azure Synapse, Azure Databricks, and/or Microsoft Fabric
• Strong ADLS Gen2 experience
• Advanced SQL skills, including CTEs, window functions, optimization, execution plans, and performance tuning
• Strong Python data engineering skills, including pandas, PySpark, REST API integration, and unit testing
• Experience with Azure Key Vault and Azure AD/Entra ID
• Experience with Azure networking, including VNet integration and private endpoints
• Azure DevOps/CI/CD experience
• Experience with modern Lakehouse architecture and Delta Lake
• T-SQL proficiency
• Familiarity with Spark SQL, KQL, PowerShell, and Bash

Preferred:

• 5+ years of data warehouse development experience
• 5+ years of data modeling experience using ERWIN or similar tools
• 2+ years of Azure Data Factory and Snowflake experience
• Medicaid domain knowledge is a plus

Benefits:

• Medical
• Dental
• Vision
• 401K