Sr. Data Engineer

Job Description Centurion is looking for an on site Sr Data Engineer with a Top Secret in Huntsville, AL. Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence. As a Data Engineer, you'll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients. Qualifications 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management Top Secret clearance Bachelor's degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree Nice to Have Skills 3+ years of experience architecting and designing large-scale enterprise data and analytics systems 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB Experience with AI or ML pipelines and processes TS/SCI clearance with a polygraph Master's degree Centurion Consulting Group, LLC