Data Engineer

Data EngineerGenesis10 is currently seeking a Data Engineer for a hybrid position (3 days on-site per week) with a Government Agency located in Minneapolis, MN. This is a 5+ month contract opportunity. Compensation: $75.00 - $85.00 per hour, W2, based on qualifications.Position Overview: The client is seeking an experienced, self-directed data platform engineer for a contract engagement on its core data platform team. This is a generalist, delivery-focused engineering role built for independent work inside an established platform. The work is broad: onboarding new data sources, extending and hardening existing pipelines, resolving defects across the estate, building curated data products, and improving the shared framework itself where it falls short.About the Platform:The Data Analytics Platform (DAP) spans the full data lifecycle on Azure. Batch and file-based sources flow through a multi-zone Delta Lake medallion lakehouse on ADLS Gen2, processed with Azure Synapse Analytics. A real-time tier on Azure Data Explorer handles streaming and sensor telemetry. Azure SQL Database holds orchestration metadata and operational state, master data management provides enterprise golden records, containerized Python jobs on Azure Container Apps handle API extraction, and Logic Apps handle lightweight intake and notification workflows. Power BI delivers reporting tiered by data velocity: high-velocity real-time dashboards from Azure Data Explorer, near-real-time views from Azure SQL, and analytical reporting from curated serverless SQL marts in the lakehouse. Access is governed by a domain-based classification model, and all code deploys through Azure DevOps CI/CD.Key Responsibilities:Build ingestion for new data sources (REST APIs, SFTP drops, network file shares, vendor exports, sensor and telemetry feeds) through the metadata-driven orchestration frameworkDevelop serverless SQL views and Delta Lake tables in the curated consumption layer that apply business rules and serve analytics, reporting, and downstream feedsDevelop and maintain containerized Python jobs on Azure Container Apps for API extraction workloads, including managed identity authentication and structured loggingDiagnose and resolve pipeline failures, data quality issues, and performance problems across the platformExtend and refactor shared toolbox notebooks and framework components when the backlog exposes gapsRegister new sources and datasets in platform metadata and document solutions for team knowledge sharingPrimary Requirements:Every item below requires sustained, hands-on production work. That is code the candidate personally designed, built, deployed, and supported in a live environment over time, not coursework, certifications alone, proof-of-concept exposure, or brief contact with a technology on someone else's project.5+ years of data engineering experience with your own code running in production, including substantial hands-on work in AzureProduction proficiency with Azure Synapse Analytics: Spark notebooks, pipeline development, triggers, and serverless SQL pools that you have built and operated in a live environmentPySpark and T-SQL at the depth that comes from regular production use: performance tuning, window functions, and incremental load patterns against Delta Lake tables on ADLS Gen2Production-grade general-purpose Python beyond Spark: API clients, authentication handling, parsing varied file formats, and code you have packaged and deployed for containerized executionDay-to-day working use of Azure DevOps (Git, YAML pipelines, pull-request workflow) and of managed identity and Entra ID authentication patterns for Azure servicesA demonstrated record of self-directed delivery: named, specific examples of taking on unfamiliar systems or vaguely specified problems and driving them to a working, reviewed solution in productionClear written and verbal communication, including the ability to document technical work for a small teamDesired Skills:Experience with Azure Data Explorer (KQL, ingestion mappings, continuous export) or other real-time analytics storesExperience working in a metadata-driven ingestion framework, where pipeline behavior is configured in database metadata rather than hard-coded per sourceExperience with Azure Container Apps or Docker-based job workloads, Logic Apps, and infrastructure-as-code (Bicep)Familiarity with Power BI as a consumer of the platform, including DirectQuery and Government Community Cloud constraintsMicrosoft certifications such as Azure Data Engineer Associate or Azure Solutions ArchitectPrior work in government, transportation, aviation, utilities, or other regulated environments handling non-public dataOnly candidates available and ready to work directly as Genesis10 employees will be considered for this position.If you have the described qualifications and are interested in this exciting opportunity, please apply!Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ yearsThe opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for yearsAccess to an experienced, caring recruiting team (more than 7 years of experience, on average)Behavioral Health PlatformMedical, Dental, VisionHealth Savings AccountVoluntary Hospital Indemnity (Critical Illness & Accident)Voluntary Term Life Insurance401KSick Pay (for applicable states/municipalities)Commuter Benefits (Dallas, NYC, SF, and Illinois)For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all of our available career opportunities, please visit us at our website.Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.