Lead Data Engineer

Openkyber

Job Role: Databricks Data Engineer / Data Platform Consultant

Location: Remote

Duration: Long Term Project

No C2C only W2 Mandatory Requirement: Databricks Partner Certification (Required Client will not consider resumes without this certification)
Job Summary

We are seeking an experienced Databricks Data Engineer / Data Platform Consultant with a valid Databricks Partner Certification to design, develop, and optimize enterprise-scale data platforms using Databricks Lakehouse technologies. The ideal candidate will have strong expertise in building scalable data pipelines, data engineering best practices, and modern cloud-based analytics solutions.
Key Responsibilities:

Design, develop, and maintain scalable ETL/ELT pipelines using Databricks.

Build and optimize Delta Lake and Lakehouse architectures.

Develop data ingestion frameworks for structured and unstructured data.

Implement data governance, security, and performance optimization strategies.

Work closely with data architects, analysts, and business stakeholders.

Optimize Spark workloads for scalability and cost efficiency.

Integrate Databricks with Azure/AWS cloud services.

Support CI/CD, DevOps, and Infrastructure-as-Code implementations.

Participate in architecture discussions and technical solution design.

Required Skills:

Databricks Partner Certification (Mandatory)

Databricks Lakehouse Platform

Apache Spark (PySpark/Scala)

Delta Lake

Python

SQL

Azure Databricks or AWS Databricks

Data Engineering & ETL Development

Performance Tuning

Data Modeling

Git, CI/CD

Cloud Storage (ADLS, S3)

Preferred Skills:

Unity Catalog

Delta Live Tables

MLflow

Azure Data Factory or AWS Glue

Airflow

Snowflake

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!