Data Engineer

Genesis10 is currently seeking a Data Engineer for a hybrid position (3 days on-site per week) with a Government Agency located in Minneapolis, MN. This is a 5+ month contract opportunity. Compensation: Position Overview: This role will join a team managing a Data Analytics Platform (DAP) that spans the full data lifecycle on Azure. The platform utilizes a multi-zone Delta Lake medallion lakehouse on ADLS Gen2, processed with Azure Synapse Analytics, with a real-time tier on Azure Data Explorer for streaming telemetry. All new work is conducted within the client's metadata-driven orchestration framework, which drives configuration, scheduling, logging, and layer promotion through shared Synapse notebook toolboxes. Key Responsibilities: Source onboarding: Build ingestion for new data sources (REST APIs, SFTP drops, network file shares, vendor exports, sensor and telemetry feeds) through the metadata-driven orchestration framework, landing raw data and promoting it through the medallion zones with PySpark notebooks and Synapse pipelines Curated data products: Develop serverless SQL views and Delta Lake tables in the curated consumption layer that apply business rules and serve analytics, reporting, and downstream feeds, following the platform's schema-per-mart and access-control conventions Extraction jobs: Develop and maintain containerized Python jobs on Azure Container Apps for API extraction workloads, including managed identity authentication, structured logging to the orchestration database, and YAML-based CI/CD deployment Troubleshooting and defect resolution: Diagnose and resolve pipeline failures, data quality issues, and performance problems across the platform, tracing issues through orchestration metadata, Spark logs, and source systems to root cause Framework improvement: Extend and refactor shared toolbox notebooks and framework components when the backlog exposes gaps, with regression awareness Primary Requirements: 5+ years of data engineering experience with your own code running in production, including substantial hands-on work in Azure Production proficiency with Azure Synapse Analytics: Spark notebooks, pipeline development, triggers, and serverless SQL pools that you have built and operated in a live environment. Note that Databricks and Microsoft Fabric are not used in this environment; native Synapse experience matters PySpark and T-SQL at the depth that comes from regular production use: performance tuning, window functions, and incremental load patterns Desired Skills: Experience with Azure Data Explorer (KQL, ingestion mappings, continuous export) or other real-time analytics stores Experience working in a metadata-driven ingestion framework, where pipeline behavior is configured in database metadata rather than hard-coded per source Experience with Azure Container Apps or Docker-based job workloads, Logic Apps, and infrastructure-as-code (Bicep) Familiarity with Power BI as a consumer of the platform, including DirectQuery and Government Community Cloud constraints Microsoft certifications such as Azure Data Engineer Associate or Azure Solutions Architect Prior work in government, transportation, aviation, utilities, or other regulated environments handling non-public data Only candidates available and ready to work directly as Genesis10 employees will be considered for this position. If you have the described qualifications and are interested in this exciting opportunity, please apply! Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals. For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10: Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years Access to an experienced, caring recruiting team (more than 7 years of experience, on average) Behavioral Health Platform Medical, Dental, Vision Health Savings Account Voluntary Hospital Indemnity (Critical Illness & Accident) Voluntary Term Life Insurance 401K Sick Pay (for applicable states/municipalities) Commuter Benefits (Dallas, NYC, SF, and Illinois) For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all of our available career opportunities, please visit us at our website. Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. #DIG10-MN