Lead Data Engineer

Job Description

Job Description

Overview

Recognized by Clarivate, Forbes, the Human Rights Campaign, and Military Friendly® for innovation, workplace excellence, inclusion, and veteran support.

A global building automation and industrial technology company with 100+ years of history , 25,000+ patents , and 7,000+ engineers , operating across 70+ countries and 4 major business areas . Its technologies support industries including buildings, manufacturing, healthcare, data centers, and utilities worldwide.

Benefits

• 401(k) match: Employer matches 87.5% of the first 8% of eligible pay, up to 7% of base salary; generally fully vested after 3 years.
• Education support: Up to $5,250/year for eligible undergraduate programs and $7,500/year for graduate programs.
• Paid parental leave: 8 weeks (40 business days) for birth, adoption, or foster-care placement.
• Paid time off: 56 hours of paid sick time annually, plus vacation and 12 paid holidays.
• Health coverage: Medical, dental, and vision plans, including an HSA-eligible medical option and 100% in-network preventive care.
• HSA & FSA: Tax-advantaged accounts for eligible healthcare, dental, vision, and dependent-care expenses.
• Disability coverage: Short-Term Disability provides 100% of base pay for up to 8 weeks, then 70% through week 26; Long-Term Disability provides 60% of base pay after Short-Term Disability.
• Employee support: Company-paid with 8 sessions per issue per year, plus health and wellness resources.
• Employee support: Company-paid Employee Assistance Program with 8 sessions per issue per year, plus health and wellness resources.
• Insurance & discounts: Company-paid basic life insurance of 1× annual base pay, Accidental Death & Dismemberment coverage, Business Travel Accident Insurance, and employee discounts.

Benefits may vary by location, position, employee classification, and eligibility.

Qualifications

• 8+ years of data engineering experience with at least 2 years in a lead or senior role.
• Hands-on experience building and operating medallion lakehouse architectures.
• Deep expertise in Apache Spark / PySpark with production experience on Azure Databricks.
• Strong proficiency with streaming platforms - Apache Kafka and/or Azure Event Hub.
• Cloud data architecture skills (Azure preferred; AWS/GCP a plus).

Responsibilities

• Architect end-to-end data pipelines processing terabytes of IoT telemetry on Azure Databricks.
• Design and optimize real-time ingestion pipelines from Azure Event Hub and Apache Kafka.
• Build fault-tolerant, idempotent streaming architectures handling schema evolution.
• Lead architecture reviews, set engineering standards, and drive decisions on data modeling.
• Define technical direction for AI-ready data products including vector stores and embedding pipelines.