Data Engineer

Architect, build, and maintain scalable, distributed data pipelines using Apache Spark and Microsoft Fabric to process large structured and unstructured datasets Integrate data from diverse internal and external systems, ensuring reliability, lineage, and consistency across the enterprise You are expected lead optimization of ETL/ELT workloads for large-scale analytics to improve cost efficiency, throughput, and reliability Define and implement standards for data quality, metadata management, cataloging, lineage, and governance compliance You will collaborate with data scientists, analysts, architects, and IT teams to define requirements, deliver insights, and integrate analytical models Develop and maintain comprehensive documentation for pipeline architectures, workflows, schemas, and operational processes You will be going to evaluate emerging technologies and introduce modern data engineering practices such as Lakehouse patterns, delta formats, automation, and real-time processing Lead resolution of complex data pipeline failures, ensuring platform stability, enterprise-grade reliability, and enforce data security, privacy, and access governance policies Linde Gas & Equipment Inc. Sr. Data Engineer Tonawanda, NY, United States | req31963 What you will enjoy doing* Architect, build, and maintain scalable, distributed data pipelines using Apache Spark and Microsoft Fabric to process large structured and unstructured datasets Integrate data from diverse internal and external systems, ensuring reliability, lineage, and consistency across the enterprise You are expected lead optimization of ETL/ELT workloads for large-scale analytics to improve cost efficiency, throughput, and reliability Define and implement standards for data quality, metadata management, cataloging, lineage, and governance compliance You will collaborate with data scientists, analysts, architects, and IT teams to define requirements, deliver insights, and integrate analytical models Develop and maintain comprehensive documentation for pipeline architectures, workflows, schemas, and operational processes You will be going to evaluate emerging technologies and introduce modern data engineering practices such as Lakehouse patterns, delta formats, automation, and real-time processing Lead resolution of complex data pipeline failures, ensuring platform stability, enterprise-grade reliability, and enforce data security, privacy, and access governance policies What Makes You Great You hold a bachelor’s or master’s degree in computer science, Engineering, Information Systems, or related field. 7+ years of professional experience in data engineering, data architecture, or large‑scale data platform development. Expertise in Apache Spark for large‑scale batch and streaming workloads. You have deep hands‑on experience with Microsoft Fabric, including Data Engineering, Data Factory, Data Pipelines, and Lakehouse implementations. Advanced proficiency in SQL, Python, and/or Scala. You have hands‑on expertise with Microsoft Azure (preferred), AWS, or GCP cloud data services. Strong understanding of distributed systems, lakehouse patterns, and data modeling. You have proven experience designing and optimizing complex ETL/ELT workflows. Strong communication skills, leadership capability, and technical mentorship experience. Why you will love working with us Linde is a leading global industrial gases and engineering company with 2025 sales of $34 billion. We live our mission of making our world more productive every day by providing high-quality solutions, technologies and services which are making our customers more successful and helping to sustain, decarbonize and protect our planet. Linde serves a variety of end markets such as chemicals & energy, food & beverage, electronics, healthcare, manufacturing, metals and mining. Linde’s industrial gases and technologies are used in countless applications, enabling space exploration and launch technologies, delivering ultra-high-purity and specialty gases for semiconductor manufacturing, providing life-saving medical oxygen and enabling clean hydrogen production and carbon capture to reduce greenhouse gas emissions. Linde also delivers state-of-the-art gas processing solutions to support customer growth, efficiency improvements and emissions reductions. What we offer you! Linde offers competitive compensation and an outstanding benefits package. Enjoy access to health, dental, disability, and life insurance, paid holidays and vacation, an employee discount program, and opportunities for educational and professional growth. Additional compensation may vary depending on the position and organizational level. Build your future with us while making an impact every day! . Salary Range: $108,225 - $158,730. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, protected veteran status, pregnancy, sexual orientation, gender identity or expression or any other reason prohibited by applicable law. Linde Gas & Equipment Inc. acts responsibly towards its shareholders, business partners, employees, society and the environment in every one of its business areas, regions and locations across the globe. The company is committed to technologies and products that unite the goals of customer value and sustainable development. *The above statements are intended to describe the general nature and level of work being performed by employees assigned to this classification. They are not intended to be construed as an exhaustive list of all responsibilities, duties and skills required of employees assigned to this position. Therefore employees assigned may be required to perform additional job tasks required by the manager. #J-18808-Ljbffr