Senior Data Engineer

Data Engineer RoleThis Data Engineer directly supports the U.S. Special Operations Command (SOCOM) based at MacDill Air Force Base, Florida. Data Engineers in this program support the command through a combination of data governance and data modernization efforts. Data Engineers will be embedded within the SOCOM HQ to provide subject matter expertise and technical capability for integrating complex data used by the command. Data Engineers in this program support SOCOM's initiative to be more capable and effective when leveraging their data resources.ResponsibilitiesA Data Engineer has a deep understanding of performance optimization and data pipelining. In addition to the baseline skills of a data analyst, data engineers can make raw data more useful for the enterprise. Senior Data Engineers can create and integrate application programming interfaces (APIs). Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design.This Data Engineer role requires a more in-depth knowledge in programming for integrating complex models and using advanced software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. A basic knowledge in machine learning is also required to build efficient and accurate data pipelines to meet the needs for downstream users such as data scientists to create the models and analytics that produce insight.The Data Engineer shall perform the following tasks:Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources.Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure. Create and maintain optimal data pipeline architecture.Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources. Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration.Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms.Administrate cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS).Coordinate with stakeholders, including product, data and design teams to assist with data-related technical issues and support their data infrastructure needsRequirementsMinimum of 1-year experience is required.Bachelor's degree in a STEM field with preference towards Computer Science and Software Engineering.Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No-SQL engines.Proficient in modeling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations.Proficiency in programming language(s).A Secret Clearance is required, Top Secret clearance with SCI eligibility is preferredAbility to work onsite 5 days per weekExperience working with large financial datasetsPreferred QualificationsFamiliarity with Palantir FoundryFamiliarity with DoWTop Secret Clearance with SCI EligibilitySenior Data Engineer $93,600 —$159,100 USDPay RangeThe posted pay range reflects the national salary range for this position and is provided to give candidates a general understanding of the compensation opportunity. The actual salary offered will be determined based on the requirements of the position and a variety of job-related factors, which may include geographic location, applicable Federal Government contract labor categories and wage rates, relevant experience, skills and competencies, education, certifications, and the scope and responsibilities of the role.Because this position may be performed in multiple locations and may be subject to different contract requirements, the salary ultimately offered may vary based on the applicable location and contract. The posted range is not a guarantee of a specific starting salary or an indication that an offer will be made at any particular point within the range.Total RewardsIn addition to competitive base pay, Clarity provides a Total Rewards package designed to attract and retain exceptional professionals committed to excellence. Our benefits reflect the value we place on skilled individuals who drive our impact in critical digital missions.At Clarity, a career means joining a high-performing team advancing vital work in the digital landscape. We encourage you to consider the total value of joining us—competitive compensation, comprehensive benefits, and resources that support your growth and impact.Our Total Rewards package includes performance-based bonuses, extensive medical, dental, and vision coverage, a 401(k) plan with company match, substantial paid time off and holidays, flexible work arrangements where possible, and a range of income protection benefits. We are committed to supporting your well-being, professional growth, and ability to contribute to essential digital missions.We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.