Data Engineer

Data Engineer

Seeking a motivated, career and customer-oriented Data Engineer to join our partner's team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the customer's data pipelines and related applications, from collection to ingestion, and ensure the integrity and security of data systems. You will play a critical role in delivering relevant and actionable cyber data to the right customers in a format that is normalized and actionable by cyber analysts and data scientists.

Responsibilities

• Design, build, optimize, and maintain resilient data pipelines using Python, with a focus on data collection, ingestion, ETL, and analytics
• Develop and support complex data solutions, including data transformation, validation, and quality controls
• Integrate data from a variety of internal and external sources, including REST APIs, flat files, and structured/semi-structured formats
• Ensure data is available, accessible, reliable, and securely handled to meet stakeholder and operational needs
• Test, troubleshoot, and validate data movement, parsing, and transformation code across development and production environments
• Provide platform and production support, including debugging, root cause analysis, issue resolution, and ongoing maintenance
• Collaborate with cross-functional teams to deliver data products and help end users understand and effectively use analytics environments

Requirements

• TS/SCI FSP Clearance
• High School Diploma and 5+ years' experience with software development in Python
• Experience with data engineering
• Experience building and maintaining data pipelines, ETL processes, and ingestion workflows
• Experience with Git/GitHub or similar version control systems
• Experience with common data formats such as JSON, XML, CSV, and other structured or semi-structured data
• Experience working with Bash, Linux, and command-line tools in a development or production environment

About Us For more than 20 years, NewGen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics. Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance.