Principal Data Engineer for Databricks

Principal Data Engineer for Databricks

Location: Warren, NJ. (2-3 days in-office)

Key Responsibilities

• Lead the architecture, design, and delivery of scalable enterprise data platforms using Azure Databricks, Delta Lake, and lakehouse patterns.
• Build and optimize reliable batch and real-time data pipelines for analytics, reporting, and AI workloads.
• Establish reusable engineering frameworks, coding standards, CI/CD practices, and performance and cost-optimization strategies.
• Implement data governance, security, lineage, and quality controls, including Unity Catalog capabilities.
• Provide technical leadership, mentor engineering teams, and collaborate with business, architecture, analytics, and data science stakeholders.

Key Skills

• Azure Databricks and Lakehouse: Databricks platform, Delta Lake, Unity Catalog, and enterprise lakehouse architecture.
• Data Engineering: Apache Spark, PySpark or Scala, advanced SQL, ETL/ELT design, and distributed processing.
• Azure Data Services: Azure Data Factory, ADLS Gen2, Synapse Analytics, Key Vault, Monitor, and Log Analytics.
• Architecture and Governance: Data modeling, security, data quality, lineage, scalability, and performance optimization.
• Engineering Leadership: Azure DevOps, CI/CD, Agile delivery, stakeholder management, mentoring, and technical roadmap development.

The pay range for this role is $140k - $170K per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.

Thanks & Regards

Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at View email address on us.fitly.work ."