Senior Data Engineer - Secret Clearance

Brief Description Position Type: Direct Hire / Full-Time Location: Shiloh, IL / On-site at Scott Air Force Base Schedule: On-site, generally 9:00 AM–5:00 PM depending on project needs Clearance: Active Secret Clearance Preferred Years of Experience: 10+ Hiring Timeline: Immediate Compensation: $85,000–$130,000/year Company: The name of our partner organization will be disclosed during the interview process. This is not a direct role with LaunchCode; it is a position through LaunchCode, working with one of our partner companies. Position Overview Our partner is seeking a skilled and highly motivated Data Engineer to support an expanding portfolio of data and technology initiatives within the Defense sector. The Data Engineer will be responsible for designing, developing, and maintaining scalable cloud and data infrastructure that supports enterprise analytics, reporting, and operational decision-making. This role will focus heavily on building and optimizing end-to-end data pipelines, integrating large and complex datasets, improving data quality, and supporting business intelligence and analytics solutions. The ideal candidate brings strong experience with ETL processes, SQL, Python, Databricks, Spark, and modern data engineering practices. Experience working with Department of Defense data environments, business intelligence platforms, and large-scale federal datasets is highly preferred. Position Responsibilities Design, develop, and maintain end-to-end data pipelines using ETL processes and modern data engineering technologies. Build scalable and reliable data pipelines using technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. Create and optimize data pipelines from the ground up to support high-performance data processing and analytics. Perform data cleansing, transformation, integration, and quality assurance activities to maintain the accuracy and integrity of large datasets. Process and analyze large-scale datasets using big data technologies within federal and Department of Defense environments. Troubleshoot data-related issues and develop practical solutions to complex data challenges. Implement and support data governance policies, standards, and procedures to promote data integrity and regulatory compliance. Collaborate with technical and business stakeholders to understand data requirements and design effective data models and architectures. Partner with data scientists, analysts, and business teams to provide accurate and timely data for reporting, analytics, and decision-making. Develop and maintain business intelligence reports, applications, dashboards, and data visualizations. Maintain technical documentation for data pipelines, software applications, workflows, and related processes. Evaluate emerging data engineering technologies and recommend tools, platforms, and approaches that improve performance, scalability, and automation. Support continuous improvement of enterprise data environments, reporting processes, and analytics capabilities. Required Skills/Experience U.S. citizenship and an active Secret clearance. Clearance sponsorship may be available for qualified candidates. Strong SQL skills with the ability to write, troubleshoot, and modify complex queries and procedures across multiple datasets. Experience with Extract, Transform, Load (ETL) processes, including building and maintaining data ingestion and transformation workflows. Experience integrating, manipulating, and combining data from multiple structured and unstructured sources. Hands-on programming and data engineering experience with Python and related technologies. Experience with technologies such as Spark, Scala, JavaScript/JSON, and SQL. Experience developing and supporting business intelligence applications, reports, dashboards, and analytical solutions. Familiarity with business intelligence platforms such as Cognos Analytics, Qlik Sense, and Power BI. Experience working with large datasets and applying big data technologies to support scalable data processing and analysis. Strong analytical and problem-solving skills with the ability to troubleshoot complex data issues. Ability to work effectively with cross-functional technical and business teams. Strong written and verbal communication skills. Detail-oriented approach with a commitment to data quality and reliable technical delivery. Preferred Qualifications Experience with Databricks and modern cloud-based data engineering environments. Familiarity with Amazon Web Services, including AWS and Amazon S3. Experience working with Jupyter Notebooks. Understanding of data modeling, data visualization, database design principles, and data governance practices. Experience with Teradata, including Multiload, BTEQ, or related Teradata utilities and procedures. Experience supporting Department of Defense or other federal agency data environments. Familiarity with Department of Defense financial or accounting systems such as DEAMS, TFMS, NERP, or similar platforms. Knowledge of Department of Defense accounting processes, transportation policies, or related operational environments. Experience supporting cloud modernization, data transformation, or analytics initiatives within a federal environment. Benefits Health, vision, and dental plans for employees and their families. Competitive 401(k) plan with 100% company matching on employee contributions up to the first 6%. Generous paid time off based on length of service. Bonus opportunities based on individual performance and achievement of goals. Professional development support through training programs and certifications. Company-sponsored team-building activities, retreats, and professional conferences. #J-18808-Ljbffr LaunchCode