Mid-Senior Databricks Developer

Company Description

StarTekk’s adoption of Digital Transformation is to accelerate organizational growth, increase efficiencies and help Star Workforce achieve focused business goals. The Employee will help our organization to identify and bridge the gap that exists in the business by analyzing the data, scale and support digital transformation initiatives.

Job Description

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
• Build and optimize Delta Lake architectures and data models.
• Develop high‑quality, reusable code in Python for data processing and automation.
• Write and optimize complex SQL queries for large datasets.
• Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high‑quality solutions.
• Ensure data quality, reliability, and performance across all pipelines.
• Troubleshoot production issues and perform root‑cause analysis.
• Follow best practices for version control, CI/CD, and cloud security.

Required Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement).
• 8–10+ years of experience in data engineering or software development.
• Strong hands‑on experience with Databricks (including notebooks, jobs, clusters, Delta Lake).
• Advanced proficiency in Python for data engineering.
• Strong expertise in SQL, including performance tuning.
• Solid experience with Microsoft Azure cloud services.
• Experience working with large‑scale distributed data systems.
• Strong problem‑solving skills and ability to work independently.

Preferred Skills (Nice to Have)

• Experience with CI/CD tools (Azure DevOps, GitHub Actions).
• Knowledge of Spark performance optimization.
• Experience with data governance and security frameworks.
• Familiarity with Agile methodologies.

Qualifications

• Strong hands-on Databricks – Notebooks, Jobs, Clusters & Delta Lake
• Strong Python / PySpark
• Advanced SQL & performance tuning
• Strong Microsoft Azure experience
• Azure Data Factory (ADF) & Azure Data Lake (ADLS)
• Large-scale ETL/ELT & Data Engineering
• Spark / distributed data processing
• Data quality & production troubleshooting
• CI/CD, Git / Azure DevOps
• Cloud security & data governance knowledge

Additional Information

Preferred Qualifications

Experience working in structured environments with established standards, methodologies, and governance processes.

Location: Lansing, MI (Local Candidates Only)