IT Specialist (DATAMGT)

Job Title

Enterprise Data Engineer

Duties

The following are the duties of this position at the full working level. If this vacancy includes more than one grade and you are selected at a lower grade level, you will have the opportunity to learn to perform these duties and receive training to help you grow in this position.

1. Enterprise Data Pipeline Development: Designs, develops, and maintains scalable enterprise data pipelines, including Extract, Transform, Load (ETL)/Extract, Load, Transform (ELT) processes, and advanced data integration frameworks. Manages Databricks-based ingestion and transformation workflows.
2. Data Modeling and Standards: Defines and implements data models, schemas, semantic mappings, and metadata standards in alignment with agency-wide architectures. Ensures tiered data standards for consistency across platforms.
3. Data Governance and Quality: Ensures compliance with governance policies, data quality, and lineage across cloud and on-premises systems. Oversees Delta Lake structures, Unity Catalog integration, and lineage tracking for auditability.
4. Cloud Data Architecture Leadership: Leads the design and deployment of cloud-based data lake house and warehouse architectures, utilizing tools like Databricks for high-performance analytics.
5. Automated Data Ingestion: Develops and automates data ingestion from both structured and unstructured sources. Builds pipelines with anomaly detection capabilities to flag and resolve data quality issues.