Data Engineer (Spark, Scala)

Title: Data Engineer (Spark Scala)
Location: Eden Prairie MN
Job Type: Fulltime Permanent Role

Salary Range: $110000-$120000 a year

Job Description
Must Have Technical/Functional Skills
We are seeking a Data Engineer with strong hands-on experience in Azure Cloud Azure Databricks PySpark Azure Data Factory (ADF) Delta Lake and Unity Catalog. The ideal candidate will be responsible for designing developing and Eligible to workimizing scalable data pipelines and cloud-based data solutions with expertise in ETL/ELT processing data modeling performance tuning and data governance. The role requires proficiency in Python SQL GitHub and CI/CD practices along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills the ability to work Consultantly and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders

Expertise in:

• Azure Databricks PySpark Delta Lake
• Azure Data Factory (ADF) and ADLS Gen2
• Experience working on large-scale cloud-native data platforms (Azure preferred)
• Exposure to AI/LLM or agentic frameworks (Databricks AI/ML Codex Claude etc.)
• Strong experience building REST or GraphQL APIs
• Experience with Kubernetes (AKS preferred) for API deployment
• Understanding of API security contracts error handling and performance
• Strong understanding of data governance security and CI/CD practices
• Primary skill for the API Role with AI Builder

Disclaimer : Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination based solely on their qualifications ability competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error please disregard it and notify the sender. If you no longer wish to receive our communications you may at any time.
Security Notice : Our official website is We do not operate or authorize any other websites representing Diverse Lynx LLC.

Required Experience:

IC