Databricks Developer

About the role:
The Databricks Developer is located Northwest suburban office and reports to the Director of Enterprise Applications and Data Analytics in Information Technology. The Databricks Developer will build and modernize cloud-based data platforms using Databricks. This role requires strong expertise in data migration, ELT processes, data security, SQL, and Apache Spark, with experience across AWS, Azure, and GCP. The position supports data integration, analytics, and visualization initiatives, partnering with technical and business stakeholders to deliver scalable, value-driven solutions. The ideal candidate is highly analytical, detail-oriented, and an effective communicator who can lead initiatives, prioritize tasks, and contribute to high-performing teams.

• Design, develop, and maintain scalable data pipelines and ELT/ETL workflows using Databricks and Apache Spark (PySpark/Spark SQL)

• Build and optimize lakehouse architectures using Delta Lake and related data formats (e.g., Parquet, Iceberg)

• Develop production-grade data workflows using Databricks Workflows and/or Declarative Pipelines

• Implement data governance, security, and access controls using Unity Catalog and related frameworks

• Support data migration and modernization initiatives from legacy data warehouse systems to cloud-based architectures

• Apply medallion architecture principles (bronze, silver, gold layers) in solution design Implement CI/CD pipelines and infrastructure-as-code for Databricks environments (e.g., Terraform, Databricks Asset Bundles, GitHub Actions)

• Monitor, troubleshoot, and resolve production data pipeline issues to ensure reliability and performance

• Collaborate with stakeholders to gather requirements and translate them into scalable data solutions

• Participate in code reviews, testing, documentation, and deployment activities

• Contribute to continuous improvement of data engineering standards, tools, and best practices

• Provide technical support during solution implementation and stabilization phases

• Other duties and responsibilities as required.

What you will need:

• Bachelor's Degree in Engineering, Information Technology, Computer Science, or a related field from an accredited college or university.

• 4+ Years Focused on the Databricks platform Strong proficiency in Apache Spark (PySpark and/or Spark SQL)

• 5+ Years Data engineering experience

• Ability to prioritize tasks, delegate responsibilities, and develop high-performing teams in a customer-focused, collaborative environment.

• Excellent verbal and written communication skills, with the ability to collaborate effectively across multiple levels of responsibility and leadership.

• Experience designing and implementing solutions on AWS, Azure, or GCP, along with strong hands-on skills in SQL and Apache Spark.

• Experience facilitating technical workshops with both technical and business stakeholders to identify opportunities and deliver value-driven solutions is highly desirable.

• Hands-on expertise in data security, messaging patterns, ELT processes, data wrangling, and cloud computing.

• Highly analytical, detail-oriented, and self-motivated, with a strong sense of urgency. Quick learner who continuously builds technical expertise to support the deployment and integration of Databricks-based solutions for customer projects.

• Proven experience leading cloud modernization, data migration, and data warehousing initiatives using cloud-based platforms such as Databricks.

• Proficiency in data integration/EAI, database technologies, advanced analytics tools, programming languages, and visualization platforms.

A plus, but not required:

• Databricks certification preferred

• Expertise in Business Analytics design and development, along with familiarity with best-in-class systems and tools used for platform solutions.

• Solid, practical, hands-on understanding of a business area as well as an overall understanding of company systems and business processes.

• Strong skills in effective communications, change enablement, and business process redesign.

Key Details

• Job Location : Hybrid (Northwest Suburbs of Chicago – near O’Hare)

• Compensation : $135,000-$148,000 annually with eligibility to earn a bonus

• Benefits: Medical, dental, and vision insurance available

#LI-PW1