Data Engineer -27793

Databricks Data Engineer

Our client is hiring a Data Engineer to build and improve production pipelines in Databricks. You'll work across the bronze, silver, and gold layers of the lakehouse and help take ownership of existing pipelines. This is a hands-on individual contributor role reporting to the Data Engineering & Platform Manager.

What You'll Do

Build batch and incremental pipelines that bring data from ERP, CRM, and other operational systems into the Databricks Lakehouse .

Use medallion architecture to land raw data in bronze, validate and standardize it in silver, and publish curated models in gold for reporting and analytics.

Review existing notebooks, pipelines, and data models built by implementation partners. Trace dependencies, fix gaps, and document how to operate and troubleshoot them.

Monitor job failures and data freshness. Troubleshoot root causes and add automated checks to validate data and reconcile it to source systems.

Apply Unity Catalog standards for access controls, ownership, and lineage. Use Git, code review, and CI/CD to deploy changes.

What You'll Bring

Approximately 3 years of data engineering experience, including at least 2 years building production pipelines in Databricks.

Hands-on experience implementing bronze, silver, and gold layers using Delta Lake.

Strong SQL, Python, and PySpark skills, with experience orchestrating pipelines in Databricks Workflows or Lakeflow Jobs.

Working knowledge of Unity Catalog and Azure data services such as Azure Data Lake Storage or Azure Data Factory.

Bachelor's degree in a related field or equivalent practical experience.

Preferred Experience

Integrating SAP ECC, Microsoft Dynamics GP, Salesforce, or similar enterprise systems. SAP ECC experience is especially valuable.

Experience with Lakeflow Declarative Pipelines, Power BI, or data engineering in regulated manufacturing.

Travel Up to 10%.