Senior Databricks Engineer - AWS Spark & Data Pipelines

Red Cedar Consultancy seeks a Databricks Specialist to support a federal project in Washington, DC. You will design and optimize high-performance Spark applications and enterprise data infrastructure in AWS Databricks, focusing on scalable ETL/ELT pipelines with PySpark, SQL, Delta Lake, and Medallion Architecture.

Responsibilities include administering Databricks workspaces, managing AWS services, and implementing DevSecOps practices; collaborate with cross-functional Agile teams in