Senior Data Engineer

Senior Data Engineer

We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines, data integration solutions, and data systems supporting analytics, reporting, and operational applications. The role requires strong hands-on technical skills and the ability to lead complex data engineering efforts, troubleshoot data and performance issues, and collaborate with architects, developers, DBAs, analysts, and visualization developers. The Senior Data Engineer will help develop reliable, analytics-ready datasets and data products that support reporting, visualization, and data-driven decision-making.

Key Responsibilities:

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or other data integration tools.
• Develop, optimize, and maintain relational and cloud-based databases (Azure SQL, Synapse, or similar) to support analytics and operational applications.
• Implement data validation, cleansing, and transformation logic to ensure data accuracy, consistency, and completeness.
• Monitor and tune database performance, including query optimization, indexing, and resource allocation.
• Ensure data lineage, metadata tracking, and database documentation for audit and compliance purposes.
• Collaborate with Data Architects and application developers to align database and pipeline design with business requirements.
• Work closely with Senior DBAs to ensure database security, availability, and backup/recovery strategies.
• Automate pipeline and database deployment using CI/CD practices and infrastructure-as-code.
• Troubleshoot and resolve pipeline failures, data inconsistencies, and database performance or integration issues.

Required Skills:

• CompTIA Security+ certification
• Bachelor's or higher in Engineering, Science, or IT.
• 5+ years of experience in data engineering, database development, or ETL/ELT development required.
• Proficiency in SQL, Python, or Scala for data transformation.
• Experience with relational database design, indexing, partitioning, and query optimization.
• Knowledge of data quality, validation frameworks, and data governance principles.
• Understanding of DoD security and compliance requirements for data handling.

Preferred Skills:

• Certification in Microsoft Azure Data Engineering or Azure Database Administrator.
• Experience with Databricks, Spark, or big data processing.
• Familiarity with metadata management, data cataloging, or data lineage tools.
• Experience with performance tuning, backup/recovery, and high-availability database architectures.

Compensation:

• Salary: $110,000-120,000 (flexible based on experience)
• Major medical, dental, and vision
• Paid holidays
• Paid Time Off (PTO)