Senior Data Engineer

Senior Data Engineer Fort Eustis / Hybrid (3 days per week onsite) CLEARANCE: Secret or TS ABOUT US: Soliel is an innovative, premium engineering company specializing in providing Enterprise Architecture, Network Design, Engineering, and Operations Support, Software Design and Development, Data Center Design, Deployment and Migration, and Systems Engineering services for both public and private sectors. Our Federal systems integration team manages the complexity inherent with technology change, from requirements planning to architecture, testing to deployment, and beyond. We also offer a complete range of industry-leading services, including architecture, systems development, information assurance, solution and platform integration, and program management, functional, and testing services. Over the years, Soliel's team of technical experts has consistently delivered outstanding innovative solutions and services that meet or exceed customer expectations and satisfaction. JOB DESCRIPTION: We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines, data integration solutions, and data systems supporting analytics, reporting, and operational applications. The role requires strong hands-on technical skills and the ability to lead complex data engineering efforts, troubleshoot data and performance issues, and collaborate with architects, developers, DBAs, analysts, and visualization developers. The Senior Data Engineer will help develop reliable, analytics-ready datasets and data products that support reporting, visualization, and data-driven decision-making. KEY RESPONSIBILITIES: Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or other data integration tools. Develop, optimize, and maintain relational and cloud-based databases (Azure SQL, Synapse, or similar) to support analytics and operational applications. Implement data validation, cleansing, and transformation logic to ensure data accuracy, consistency, and completeness. Monitor and tune database performance, including query optimization, indexing, and resource allocation. Ensure data lineage, metadata tracking, and database documentation for audit and compliance purposes. Collaborate with Data Architects and application developers to align database and pipeline design with business requirements. Work closely with Senior DBAs to ensure database security, availability, and backup/recovery strategies. Automate pipeline and database deployment using CI/CD practices and infrastructure-as-code. Troubleshoot and resolve pipeline failures, data inconsistencies, and database performance or integration issues.. REQUIRED SKILLS: CompTIA Security+ certification Bachelor’s or higher in Engineering, Science, or IT. 5+ years of experience in data engineering, database development, or ETL/ELT development required. Proficiency in SQL, Python, or Scala for data transformation. Experience with relational database design, indexing, partitioning, and query optimization. Knowledge of data quality, validation frameworks, and data governance principles. Understanding of DoD security and compliance requirements for data handling. PREFERRED SKILLS: Experience with Databricks, Spark, or big data processing. Familiarity with metadata management, data cataloging, or data lineage tools. Experience with performance tuning, backup/recovery, and high-availability database architectures. COMPENSATION: Salary: $110,000-120,000 (flexible based on experience) #J-18808-Ljbffr