Data Engineer

Job Details: Role: Data Engineer Location: Hanover, MD 21076 (Onsite with Hybrid - 2 Days Remote & 3- Days Onsite) Duration: Long Term Contract Interview Mode: In- Person Position Description: The Contractor shall assign a dedicated Data Engineer that will serve as the primary technical resource responsible for the successful execution of all data integration, migration, implementation, and post-deployment support activities throughout the eight-month project lifecycle. The Data Engineer will provide end-to-end technical services, including designing and configuring the Azure Synapse environment, implementing private endpoint connectivity, developing and updating linked services, migrating existing pipelines, converting Talend ETL jobs, validating source-to-target data accuracy, troubleshooting technical issues, and supporting system integration testing, user acceptance testing, production deployment, and operational stabilization. The role will also provide technical guidance, documentation, knowledge transfer, and ongoing collaboration with cloud infrastructure, cybersecurity, database administrators, application owners, and business stakeholders to ensure successful implementation while maintaining the stability, security, and integrity of enterprise data operations. By providing specialized expertise in Azure Synapse, Azure Data Factory, ETL/ELT processes, Azure networking, private endpoints, data integration, cloud data architecture, performance optimization, and operational support, the Data Engineer will reduce project risk, accelerate issue resolution, ensure adherence to enterprise security and governance standards, maintain implementation continuity, facilitate a smooth transition to production, and ensure all project milestones are completed on schedule while delivering a secure, resilient, high-performing, and production-ready analytics platform. Primary Duties and Responsibilities - The Contractor shall: Build data analytics solutions using Azure Synapse serverless SQL pools. Perform data engineering with Azure Synapse Apache Spark Pools. Monitor and troubleshoot data systems and pipelines to ensure high availability and performance. Work with Data Warehouses, Data Lakes, and Data Marts using Azure Synapse Analytics. Transfer and transform data with Azure Synapse Analytics pipelines. Monitor and optimize data storage and processing solutions for performance and efficiency. Design and implement data storage solutions using Azure services such as Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL Database Apply structured system development methodologies. Organize, prioritize, and follow complex or detailed technical procedures. Develop and maintain Data Lake and Data Warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and advance analytics. Position Requirements and Relevant Years of Experience: The Contractor shall ensure that proposed personnel possess the following qualifications and relevant years of experience: Experience with Agile Development Possess Data Warehouse Experience Knowledgeable in DevOps Practices Utilize Azure Data Factory, Synapse Analytics to perform data conversions, imports, and exports of data within and between internal and external software systems. Experience automating tasks with scripting tools and languages such as PowerShell. Familiarity with Azure Cloud Technologies such as Power Apps and Dataverse. Integrate data from multiple sources, ensuring data quality and integrity. Experience keeping data pipelines secure. At least eight (8) years of software development experience Experience with Azure Synapse, Azure Data Factory, Azure Databricks, and Azure Stream Analytics. Expert hands-on software development experience using C#, ASP.NET, Web Services/APIs. Experience with Microsoft DevOps, or GitHub code management environment. Experience or certification in Azure Cloud Services. Prior experience with Java/.NET and JavaScript Familiarity with Oracle and SQL databases Strong functional and technical background Excellent communications, collaboration, and customer focus skills. Preferred Personnel Experience: Previous experience with Maryland Department of Transportation (MDOT). Education: This position requires a bachelor's or master's degree from an accredited college or university with a major in computer science, statistics, mathematics, economics, or related field. Three (3) years of equivalent experience in a related field may be substituted for the bachelor's degree. Creative Global Consulting