Senior Data Engineer

Job ID: 812170Job Title: Senior Data EngineerClient: State of NC - FASTLocation: 1915 Health Services Way, Raleigh, NC 27607Work Arrangements: HybridInterview Type: In Person OnlyOverview:NC DHHS requires the services of a Senior Data Analyst / Engineer that will help us design, manage, and optimize enterprise data pipelines, data warehouses, and analytics solutions within Microsoft Azure. This role transforms complex data into business insights and drives advanced analytics using Azure Synapse Analytics, Microsoft Fabric, and Azure AI services.The key responsibilities for this position will include the following:Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions to support data integration.Collaborate with business users to define analytical goals and build Power BI-ready datasets.Integrate AI and machine learning insights using Azure Machine Learning and Azure OpenAI Service.Enforce data governance, quality, and security via Microsoft Purview and Microsoft Entra ID.Build cross-functional reporting, dashboards, and predictive analytics modelsSkillExperience in enterprise data analytics, engineering, and designing complex ETL workflows.Expertise in Azure Synapse Analytics, Azure Data Factory, and cloud data warehousingAdvanced SQL and PL/SQL skills, including query optimization, performance tuning, and indexing strategiesHands-on experience with PySpark, Python, or ScalaExperience with data modeling, performance tuning, and cost optimization in AzureStrong knowledge of Microsoft Entra ID, role-based access control (RBAC), and cloud securityFamiliarity with Power BI semantic models and dataflowsKnowledge of Azure OpenAI or generative AI data integrationAbility to organize, prioritize, and follow complex and/or detailed technical proceduresExperience with Agile (Scrum, Kanban, or SAFe) development