Data Engineer- SME

Company DescriptionFounded in 1989, SOSi is among the largest private, founder-owned technology and services integrators in the defense and government services industry. We deliver tailored solutions, tested leadership, and trusted results to enable national security missions worldwide.Job DescriptionOverviewSOSi is seeking an expert Data Engineer to join our analytics team working on an innovative MLOps workload leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama. This role will be responsible for delivering automation to key national security missions interacting with petabyte-scale data on supercomputing resources. In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical analysis. You will leverage scientific techniques to transform petabyte-scale data into insightful data products to enable data-driven decisions. You will partner with Data Scientists to refactor manual workflows to produce highly automated MLOPs based workloads. You will perform using Scrumban techniques and be embedded with end users.The team will work with technologies including:Open source, commercial, and government software packages such as PyTorch, TensorFlow, GitLab, Atlassian Suite, Linux, and Microsoft SuiteSQL and NOSQL databases such as PostgreSQL, Wevaiate, Neo4j, and MongoDBMicroservice architecture and containerization with Docker and KubernetesApache products such as Kafka, Airflow, and SparkLeverage GitOps patterns and CI/CD with tools like GitLab, Argo, and HarnessEssential Job DutiesBuild and maintain data pipelines, ETL processes, and storage systemsDesign end-to-end data architectures and infrastructureLead teams building complex data pipelines and ML systemsDevelop services and extend infrastructure to enable machine learning workflowsIntegrate software components into functional data systemsWrite clean, testable, maintainable code in Python and other languagesImplement CI/CD pipelines and DevSecOps best practicesCreate technical documentation for software systemsCollaborate across teams to share knowledge and leading practicesQualificationsTop Secret Security Clearance with SCI eligibilityAt least 7 years of experience as a Data Engineer/Scientist or advanced analytical roleExperience in data engineering and/or software developmentExpertise with Python, GIT, YAML, Docker, and SQLKnowledge of CI/CD and Agile methodologiesExperience developing back-end systems and servicesUnderstanding of software design and system integrationPreferred QualificationsSignificant Experience with Petabyte scale data setsSignificant Experience with large-scale, multi-INT analyticsBS or MS in Computer Science, Statistics, Mathematics, Physics or a quantitative fieldAdditional InformationWork EnvironmentWorking conditions are normal for an office environment.Fast paced, deadline-oriented environment.May require periods of non-traditional working hours including consecutive nights or weekends (if applicable).Working at SOSiAll interested individuals will receive consideration and will not be discriminated against for any reason. Clearance Requirement: Top Secret/SCI Compensation: USD 73046 - USD 151710 - yearly