Senior Data Engineer

Design, develop, and optimize scalable data management solutions supporting advanced analytics and AI/ML workloads. Build and maintain Elasticsearch and graph-based data platforms that enable efficient storage, discovery, and analysis of complex hierarchical data. Design and optimize Elasticsearch indices to efficiently manage large-scale hierarchical classification structures, ensuring high-performance search, aggregation, and update operations. Design, implement, and maintain a graph data store supporting hierarchical graph structures optimized for large, dense batch updates and high-throughput analytics. Develop scalable ingestion pipelines that support scalable graph analytics. Design data schemas, indexing strategies, and partitioning approaches to maximize query performance, scalability, and storage efficiency. Collaborate with infrastructure and platform engineering teams to deploy, operate, and optimize Elasticsearch and graph database services in a Kubernetes environment using cloud-native technologies. Partner with Data Scientists and AI/ML engineers to ingest, curate, manage, analyze, and securely expunge datasets throughout the data lifecycle. Develop automated data loading, transformation, validation, and quality assurance pipelines supporting production analytics workflows. Optimize graph and search infrastructure for high availability, resilience, and performance under large-scale analytical workloads. Collaborate with software engineers and system architects to integrate graph and search services into microservice-based applications. Participate in SAFe Agile development activities, including sprint planning, design reviews, architecture discussions, and technical demonstrations. Foster a culture of innovation, collaboration, and professional development within the team. Ensure sound engineering practices, compliance with policies, and delivery of high-quality software. Coordinate with test teams to develop and monitor automated system integration tests. Engage with cross-functional teams to identify and develop high-value integrations with other systems/applications. Provide specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of COTS/GOTS in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelors degree in Computer Science, Data Engineering, or related field and 1215 years of relevant experience, or Masters with 1013 years of experience. Must possess an Active Top Secret/SCI clearance and ability to obtain and maintain a Polygraph. Elasticsearch/OpenSearch architecture, index design, mappings, analyzers, and query optimization. Graph databases such as JanusGraph, Neo4j, TigerGraph, Amazon Neptune, or Memgraph. Data modeling for hierarchical and highly connected datasets. Large-scale ETL/ELT pipeline development. Kubernetes deployment and operations for stateful data services. Distributed storage systems and high-volume data ingestion. Python or Java for data engineering and automation. Core Competencies Demonstrates expertise in designing and optimizing scalable data management solutions, particularly with Elasticsearch and graph databases, while ensuring high performance and efficiency in data processing and analytics. Proficient in developing automated data pipelines and collaborating with cross-functional teams to enhance data lifecycle management. Highest-signal resume keywords Elasticsearch/OpenSearch Architecture Graph Database Development Kubernetes Deployment Data Modeling for Hierarchical Datasets Large-Scale ETL/ELT Pipeline Development ATS Optimization Keywords Hard Skills Elasticsearch Index Design Graph Databases Data Ingestion Pipelines Python Java Soft Skills Collaboration Innovation Problem-Solving Certifications & Qualifications Active Top Secret/SCI Clearance Industry Keywords Data Engineering AI/ML Workloads SAFe Agile Development High-Volume Data Ingestion Distributed Storage Systems Tools & Technologies Kubernetes Cloud-Native Technologies Automated Testing Tools #J-18808-Ljbffr