Data Engineer

Clearance Required: Interim Secret or Higher Location: Remote / Hybrid (Client-Dependent) Work location is hybrid including majority remote with meetings in Tysons Corner and Crystal City. Employment Type: Full-Time We are seeking highly skilled Data Engineers (DA II / DA III) to support a critical federal data modernization initiative focused on enterprise financial management, general ledger analytics, and large-scale data integration efforts. This role is ideal for professionals with strong experience building and optimizing data pipelines, working with Databricks, and supporting cloud-based data platforms within federal environments. The selected candidates will play a key role in developing scalable data solutions, implementing automated data quality controls, and supporting advanced analytics initiatives leveraging AWS GovCloud and the Advana platform. Position Responsibilities Build, manage, optimize, and maintain enterprise data pipelines within the Advana platform. Design, develop, and implement scalable ETL/ELT processes to support large-scale data integration and analytics requirements. Develop data ingestion frameworks utilizing Databricks technologies including Delta Lake, Autoloader, and scheduled jobs. Perform data cleansing, transformation, aggregation, and enrichment activities across multiple financial data sources. Support Federal Financial Management (FM) and General Ledger (GL) data initiatives. Analyze and reconcile Universe of Transactions (UoT) data to ensure financial data accuracy and consistency. Implement and maintain Medallion Architecture frameworks (Bronze, Silver, Gold layers). Develop automated data validation, monitoring, and quality assurance processes. Collaborate with data analysts, product owners, engineers, and business stakeholders to deliver high-quality data solutions. Optimize performance of large-scale data pipelines and troubleshoot complex data processing issues. Support cloud-based data environments within AWS GovCloud. Contribute to CI/CD pipeline development and DevSecOps best practices. Maintain technical documentation and support data governance initiatives. Required Qualifications Experience Demonstrated experience building, managing, and optimizing data pipelines within the Advana platform. Hands-on experience with Databricks. Autoloader Job Scheduling Experience designing and implementing ETL/ELT processes. Experience with data wrangling techniques. Data Cleansing Data Transformation Data Aggregation Proven experience supporting large-scale Federal Financial Management (FM) and General Ledger (GL) data environments. Experience with Universe of Transactions (UoT) reconciliations. Experience working within AWS GovCloud environments. Experience utilizing cloud services such as Amazon S3. Familiarity with Medallion Architecture (Bronze, Silver, Gold). Experience implementing data quality frameworks and automated validation processes. Technical Skills Advanced Python development skills. Strong experience with PySpark. Expert-level SQL development and optimization. Experience with GitLab and version control best practices. Strong understanding of CI/CD principles and DevSecOps methodologies. Ability to troubleshoot, optimize, and scale complex enterprise data pipelines. Excellent communication and stakeholder engagement skills. Preferred Qualifications Experience with Unity Catalog for data governance. Knowledge of SAP data structures. Experience supporting Department of Defense (DoD) financial systems. Familiarity with enterprise data governance and metadata management frameworks. Clearance Requirement Active Interim Secret Clearance or higher is required. #J-18808-Ljbffr