Data Engineer Senior

Team & Position Summary Acuity Brands is seeking a Senior Data Engineer to join its Atrius Analytics team. The role focuses on building a scalable, intelligent data platform that ingests and normalizes IoT telemetry across diverse verticals, supporting both batch and real‑time processing for cloud applications in building performance and spatial intelligence. Primary Responsibilities Design and implement scalable data engineering pipelines for ingesting, transforming, and storing IoT telemetry data using Apache Flink, Apache Spark, and Databricks. Build and maintain time‑series data solutions using PostgreSQL and TimescaleDB to support high‑resolution telemetry analytics. Integrate data governance frameworks for metadata management, lineage tracking, and compliance within a data lake ecosystem. Apply performance tuning techniques in Databricks (e.g., partitioning, caching, adaptive query execution) to optimize batch processing speed and resource utilization. Develop Infrastructure as Code (IaC) solutions using Terraform and Azure Bicep to provision and manage cloud resources across multi‑cloud environments. Optimize and monitor pipeline performance and resource utilization across distributed environments such as Kubernetes and Databricks clusters. Leverage telemetry and diverse data sources to design, test, and deploy AI/ML solutions, collaborating with data scientists and engineers to build deep‑learning capabilities for prediction, early alerting, and prescriptive recommendations. Define appropriate business metrics to measure the impact of AI/ML solutions within the platform. Write scalable, distributed, and highly efficient code in languages such as Python, Java, PySpark, Scala, and R. Qualifications BS in Computer Science, Statistics, Mathematics, or a related field. 5+ years of experience building end‑to‑end analytics solutions, including real‑time and batch data pipelines for IoT telemetry or time‑series data. Excellent problem‑solving, critical thinking, and communication skills. Demonstrated initiative to find solutions to complex problems at scale and operationalize them. Demonstrated ability to work in ambiguous situations and across organizational boundaries. Lead with respect, accountability, integrity, and a positive can‑do attitude. Experience in a data‑intensive environment and translating business needs into data requirements. 2+ years of experience building and operationalizing analytics pipelines and services with Docker and Kubernetes. 2+ years of demonstrated AI/ML pipeline development with code experience. 2+ years’ experience with TensorFlow, MLFlow, PyTorch, SparkML, or similar. 2+ years’ experience with one or more of the following: Apache Flink, Spark, structured Streaming, Akka, Kafka. 2+ years’ experience building scalable batch data pipelines on cloud platforms such as Databricks. Benefits Compensation range: $120,800.00 to $217,400.00, based on experience and geographic location. Acuity offers extensive benefits including health, dental, and vision coverage; 401(k); commissions and incentive compensation for eligible roles. Equal Opportunity Employer We value diversity and are an equal opportunity employer. All qualified applicants will be considered for employment without regard to race, color, age, gender, sexual orientation, gender identity, ethnicity, national origin, disability, pregnancy, religion, covered veteran status, genetic information, or any other characteristic protected by law. Accommodation for Applicants with Disabilities Acute Inc. is committed to providing reasonable accommodations in its application process for qualified individuals with disabilities and disabled veterans. Applicants can request accommodations by contacting the company. #J-18808-Ljbffr