Data Engineer

Job Title: Data Engineer Location: Sterling, VA Clearance: TS/SCI Poly This position is CONTINGENT upon contract award. The Data Engineer works with the sponsor, mission partners, platform and operations team to engineer, install, operate and sustain database repositories (data lake, lake house, specialized databases). The engineer supports the data lifecycle from acquisition and ingest through curation and disposition, ensuring data collections are processed from the moment of delivery at the landing zone. The DE collaborates with mission partners to support metrics, analytics, and dissemination. Daily tasks include, but are not limited to: Develop and maintain data and metadata policies and procedures for structural design and development to build, maintain and leverage unified data storage, data lake and lake house, ensuring integration with SYSTEM data standards. Engineer the design, development, deployment, implementation and support of major databases and metadata structures to include review and evaluation of database performance and optimization. Develop plans for, and tools to enhance, the transition of legacy data to the SYSTEM during install as well as transition of development and/or production environment to new technology. Recommend and plan server/cloud compute/storage resource recapitalization for sponsor consideration. Provide comprehensive assessments of the technical characteristics of proposed installations and alternatives considered to optimize database performance. Develop methods for ensuring data incompatibilities among systems are systematically eliminated. Diagnose, isolate and expediently resolve complex problems pertaining to data infrastructure. Baseline and forecast server performance data and refine server hardware and software configurations. Manage, monitor and administer database system performance/schedule activities; oversee daily performance; perform backups and restores; archive data; provide technical assistance and support. Monitor industry trends and directions in database technology and tools; develop and present substantive technical recommendations to the sponsor. Compose technical documents including design, deployment, system specifications and mission partner baselines, updates, user manuals, training materials, installation guides, proposals, and reports. Required Skills SQL: Proficiency in writing and executing SQL queries for data manipulation and analysis. Data Modeling: Understanding of data modeling principles and ability to design data structures that meet business requirements. ETL/ELT Processes: Experience with Extract, Transform, and Load (ETL) or Extract, Load, and Transform (ELT) processes and tools. Cloud Platforms: Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud Platform. Programming Languages: Proficiency in Python or Java for data manipulation and scripting. Data Warehousing: Understanding of data warehousing concepts and experience with data warehouse technologies. Data Governance and Security: Knowledge of data governance principles and best practices for data security and privacy. Desired Skills Big Data Technologies: Experience with technologies like Apache Hadoop, Spark, or Kafka. Data Visualization: Ability to create data visualizations using tools like Tableau or Power BI. Data Pipeline Orchestration: Experience with data pipeline orchestration tools like Airflow or Luigi. Data Quality Tools: Familiarity with data quality tools and techniques for identifying and resolving data quality issues. Data Wrangling: Experience with data wrangling techniques for cleaning, transforming, and preparing data for analysis. Desired Certs AWS Certified Data Analytics Specialty Microsoft Certified: Azure Data Engineer Associate Google Cloud Certified Professional Cloud Data Engineer IBM Data Engineering Professional Certificate IBM Data Warehouse Engineer Professional Certificate Meta Database Engineer Professional Certificate Nightwing is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class. #J-18808-Ljbffr