Data Engineer

About the Role We are seeking an experienced Data Engineer to design, build, and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data. The ideal candidate will have strong hands-on experience with SQL and Python, modern cloud data platforms, and Lakehouse/Medallion architectures. This is a hands‑on engineering role focused on building reliable data pipelines, processing large datasets, and developing scalable data solutions. Key Responsibilities Design, develop, and maintain scalable cloud data pipelines for high-volume data. Build batch and real‑time data processing solutions using Spark/PySpark, Kafka, and Airflow. Develop data ingestion, transformation, and integration workflows using SQL and Python. Design and implement Lakehouse and Medallion architecture solutions. Work with cloud data platforms including Databricks, Snowflake, AWS, and/or Azure. Build and optimise ETL/ELT pipelines for performance, scalability, and reliability. Process and integrate large volumes of manufacturing, operational, and IoT data. Troubleshoot data pipeline issues and improve data quality and performance. Collaborate with engineering, analytics, and business teams to develop production‑ready data solutions. Qualifications 5+ years of professional Data Engineering experience; additional experience is welcome for the right candidate. Strong proficiency in SQL and Python. Hands‑on experience building scalable data pipelines. Experience with Lakehouse and/or Medallion architectures. Experience with Databricks, Snowflake, AWS, and/or Azure. Strong experience with Apache Spark and/or PySpark. Experience with Apache Kafka and/or other streaming technologies. Experience with Apache Airflow or other data orchestration tools. Experience working with Delta Lake or similar data lake technologies. Strong understanding of ETL/ELT, data integration, and data transformation. Benefits Full‑time employees receive a benefits package, including: Medical, dental, and vision coverage 100% company contribution toward employee medical coverage 80% company contribution toward medical coverage for immediate dependents 15 days of PTO 10 paid holidays, including 8 fixed holidays and 2 floating holidays 401(k) enrollment with employee contributions Relocation assistance Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy. #J-18808-Ljbffr