DATA ENGINEER

Job Title

Job Description

Architects, develops, tests, and maintains scalable data pipelines to ingest structured and unstructured data from disparate DLA, DoD, and commercial sources using complex ETL/ELT processes.

Develops resilient batch and real-time data solutions using Python, Scala, or Java, and frameworks like Apache Spark and Airflow for strategic reporting and operational AI model serving.

Implements CI/CD practices for automated testing and deployment, troubleshooting pipeline executions to optimize performance, integrity, and cost-effectiveness for DLA systems.

Leads the design and administration of data warehouse and data lake structures, implementing dimensional and data vault models to support business intelligence and AI/ML use cases.

Administers and optimizes cloud data warehouses such as Snowflake, Redshift, or BigQuery, managing partitioning, indexing, and clustering strategies for high-performance analytics.

Enforces data governance, data quality, and enterprise data catalogs, collaborating with security teams to apply access controls, encryption, and data masking for CUI and Secret data.

Serves as principal technical advisor for the AI and Analytics CoE, translating data requirements from data scientists, ML engineers, and analysts into technical specifications for logistics systems.

Provides guidance on data architecture best practices, mentors junior technical staff, establishes coding standards, and conducts peer reviews for data engineering projects.

Communicates complex technical concepts regarding data architecture and pipeline design to non-technical stakeholders and senior leadership to guide strategic organizational decisions.

Researches, evaluates, and prototypes emerging data technologies and architectural patterns, conducting technical assessments and proofs-of-concept for cloud services and processing engines.

Leads technical planning and migration strategies to modernize legacy systems, transitioning data workloads to cloud-native platforms while maintaining expertise in industry trends.