Urgent Requirement: Sr. Databricks Certified Data Engineer, Remote.

Greeting ,

This is Swarup from BN Associates . I'm reaching out regarding an exciting UEFI BIOS firmware validation engineer opportunity with a well-known client. This is based in Houston, TX role, and I believe your experience could be a great fit. Please let me know if you're interested, and I'll be happy to share the complete job details.

Role: Sr Databricks Certified Data Engineer
Location: Remote

Long-term Contract

Must Have:

Databricks Certified Data Engineer Professional Certification.

Strongly preferred:

Prior experience working in the Databricks Partner Program
Databricks Partner Champion Certificate.

Job Description:

10+ years of experience in data engineering, data platforms, & analytics.
Comfortable writing code in either Python or Scala.
Extensive Working knowledge of Databricks is required.
Experience with advanced Databricks concepts such as Genie Spaces, Agents, and Genie Code.
Experience handling or leading large-scale projects/customers.
Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
Deep experience with distributed computing with Apache Spark and knowledge of Apache Spark runtime internals
Familiarity with CI/CD for production deployments
Working knowledge of MLOps
Capable of design and deployment of highly performant end-to-end data architectures
Experience with technical project delivery managing scope and timelines
Documentation and white-boarding skills
Experience working with clients and managing conflicts
Experience in building scalable streaming and batch solutions using cloud-native components
Here is some feedback I got for one of the consultants that took the interview:
1) Not strong in Data engineering and advanced concepts.
2) No Experience with advanced Databricks concepts such as Genie Spaces, Agents, and Genie Code.
3) No experience handling or leading large-scale projects/customers.

Key Skills:
They want someone with. Spark fundamentals - Spark architecture, DataFrames, partitions, shuffles, joins, and performance behavior.Delta Lake - ACID tables, schema evolution, merges, optimization, and reliable lakehouse storage patterns.ETL / pipeline design - batch and incremental pipelines, medallion-style thinking, and production pipeline design.Lakeflow /SDP / Jobs / workflows - orchestration, declarative pipelines, and workload deployment on Databricks.Ingestion patterns - landing data from databases, files, streams, and connectors into bronze/silver/gold pipelines.Performance tuning - cluster sizing, file layout, pipeline optimization, and Spark tuning best practices.Data modeling and warehousing - dimensional modeling, warehouse migration patterns, and serving BI/reporting use cases. CI/CD and deployment - asset bundles, deployment workflows

Thanks & Regards,

Swarup,

Tel: View phone number on us.fitly.work

Email: View email address on us.fitly.work

BN Associates Inc.,

215 Depot Ct SE Ste 205, Leesburg VA 20175

"Certified SBA 8(a), EDWOSB, WOSB, WBE and MBE"

Certifications: ISO 9001 : 2015 Certified | ISO 27001 : 2022 Certified | ISO 20000 : 2018 Certified