Databricks Data Engineer (GCP)

job summary:
We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (GCP). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

 
location: Phoenix, Arizona
job type: Contract
salary: $53.75 - 63.75 per hour
work hours: 8am to 5pm
education: Bachelors

responsibilities:

• Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL.
• Integrate Databricks seamlessly with GCP services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer.
• Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models.
• Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage.
• Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.

qualifications:
4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark.

Strong experience with GCP cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer).

Proven capability in data modeling, complex SQL development, and pipeline performance optimization.

Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader.

Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.

PREFERRED QUALIFICATIONS

Proficiency in Scala for Spark processing.

Formal GCP or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, GCP Professional Data Engineer).

Experience with automated testing and DataOps frameworks.

skills:
Cloud Composer,Apache Airflow,BigQuery,Cloud Integration,cloud environments,cloud services,Cloud Storage,CI/CD,Lakehouse architecture,data governance,enterprise data governance,lineage tracking,real-time data pipelines,Pipeline Development,Streaming,DataOps,Data Bricks,Databricks,DevOps practices,distributed data,ETL,Google Cloud Platform (GCP),Google Cloud Platform,metadata,PySpark,real-time data,SQL,Scala,integrating,detail-oriented,self-driven,access controls,Access Control,automation,data modeling,data quality,Governance,Pub/Sub,security,deployment practices,workflows

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on randstadusa.com.


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.