Databricks Data Engineer

Job Type


Full-time

Description

We are seeking a Databricks Data Engineer with strong hands-on experience in Python and PySpark to support a fast-paced, high-impact delivery environment. This role requires someone who can quickly step in, take ownership, and deliver scalable data solutions with minimal ramp-up.

Key Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows using Databricks

• Build scalable data processing solutions leveraging PySpark and Python

• Work with large-scale datasets across cloud platforms (AWS and/or Azure)

• Implement and maintain Medallion Architecture (Bronze, Silver, Gold layers)

• Ensure data quality, performance optimization, and reliability of data pipelines

• Collaborate with cross-functional teams to support data-driven initiatives

Required Qualifications

• 3 to 5 years of experience in Databricks is required.

• Strong hands-on experience with Databricks, Python, PySpark, and SQL

• Proven experience building and optimizing ETL pipelines

• Experience working with large-scale data environments

• Solid understanding of cloud platforms (AWS and/or Azure)

• Familiarity with Medallion architecture (Delta Lake)

• Ability to work independently in fast-paced, deadline-driven environments

What We're Looking For

• Someone who can hit the ground running with minimal onboarding

• Strong sense of ownership and accountability

• Ability to deliver under tight timelines without compromising quality

• Proactive problem-solver with a delivery-first mindset Nice to Have

• Experience with Delta Lake

• Exposure to data governance and data quality frameworks

• Prior experience in federal or regulated environments

Preferred Additional Qualifications:

• Experience with Delta Lake

• Exposure to data governance and data quality frameworks

• Prior experience in federal or regulated environments

Requirements

Required Qualifications: :

Education:

• Bachelor's degree in information systems, computer science, or other related field. Will accept a suitable combination of education, training, or experience

Clearance:

• Clearance: Federal Health Agency within the U.S. Department of Health and Human Services Public Trust clearance

Onsite Requirement:

• Location: Hybrid - locals to DMV area

Professional Experience

• 3 to 5 years of experience in Databricks is required.
• Strong hands-on experience with Databricks, Python, PySpark, and SQL
• Proven experience building and optimizing ETL pipelines
• Experience working with large-scale data environments
• Solid understanding of cloud platforms (AWS and/or Azure)
• Familiarity with Medallion architecture (Delta Lake)
• Ability to work independently in fast-paced, deadline-driven environments

Salary Description


$130,000 - $140,000