Data Engineer, Databricks

KeyLogic is seeking Databricks Engineers to join our growing team supporting the Department of Energy (DOE).The position requires U.S. CitizenshipPosition Requirements:U.S. Citizenship2+ years of engineering experience on Databricks and large-scale big data projects (Delta Lake, DLT, Apache Spark, unity Catalog).Bachelor's Degree4+ years of experience in Python, Java, or equivalent. Comfortable with evaluation tooling, logging, monitoring, and observabilityExperience with government contractingPosition Description:As a Data Engineer in this role, you will be responsible for designing, building, and maintaining robust data pipelines that support the organization’s analytical and operational needs. You will work closely with cross-functional teams to ensure data is collected, processed, and made available in a reliable and scalable manner. Leveraging your expertise, you will optimize data workflows and implement best practices for data integration, transformation, and storage. Your contributions will directly impact the efficiency and effectiveness of data-driven decision-making across the business.To excel in this position, you will utilize tools such as Databricks for advanced data processing and analytics, and Terraform for infrastructure automation and management. Familiarity with cloud-based environments, version control systems, and CI pipelines will further enhance your ability to deliver high-quality solutions. Experience with large-scale data architectures, real-time data streaming, and performance tuning will help you address complex challenges and drive continuous improvement. Your background in collaborating with diverse technical teams and managing end-to-end data solutions will be instrumental in achieving success in this dynamic environment.Position Responsibilities:Design, build, and maintain scalable data pipelines using DatabricksDevelop and implement infrastructure as code solutions with TerraformCollaborate with cross-functional teams to understand data requirements and deliver robust solutionsOptimize data workflows for performance, reliability, and scalabilityMonitor, troubleshoot, and resolve issues related to data processing and infrastructureEnsure data quality and integrity throughout the data lifecycleAutomate repetitive tasks to improve efficiency and reduce manual interventionSalary dependent upon experience: $90,000- $140,000