Data Engineer - Data Integration & Analytics

Data Engineer – Data Integration & Analytics

Location: Addison, IL or Warren MI (on-site 4 days/week)

Duration: Full Time Employment

Description:

Data Engineer to lead in the development and delivery of enterprise applications to support business strategy and growth. This position will work closely with business and technology leaders to understand the enterprise objectives and build capabilities in Integration and Analytical applications to support Sales, Operations and Shared Services. This role will also be instrumental in advancing Customer & Supplier Integration and Advanced Analytics capabilities to lead the industry in the utilization of data to capture market share.

Responsibilities:

Solution Delivery:

• Perform BI solution development activities including requirements gathering, technical specifications, ETL design & development, unit & integration testing.
• Develop and support backend data models and ETL workflows on Databricks, with a focus on building scalable data processing pipelines using Python and Spark.
• Support data integration between supplier partners to provide accurate and up to date information to our internal and external customers.
• Review, interpret, and debug complex code. Develop maintainable code via proper structures, comments, and design.
• Generate automated, repeatable and stable processes to support data transformation, data load, data movement, and data synchronizations.
• Contribute toward the continuous improvement of our internal data capabilities.

Solution Definition, Data Architecture & Strategy:

• Perform source data analysis – data profiling, validation, conceptual and logical data modeling, etc. – to determine the suitability of the source data for meeting the reporting requirements.
• Facilitate and lead senior IT and business teams through challenging data issues.
• Meet with subject matter experts in different areas of the business, be able to quickly learn the concepts and business language relevant to their line of business, and develop an understanding of how their data supports their business processes.
• Assist in developing the roadmap for Analytics and Advanced Analytics across the company to enable the business strategy.
• Participate in information architecture strategies such as data management, data governance, master data management and metadata management.

Required Skills:

• Bachelor's degree in computer science, Engineering or Information Systems
• Experience working with Databricks (building data pipelines)
• 5+ years of Data Integration and Analytics experience
• 2 years of Integration / ETL experience
• Strong experience with ETL techniques, data processing concepts, and programming in Python (e.g., change data capture, slowly changing dimensions, data partitioning in Spark).
• Experience in data modeling and entity relationship diagram conventions and various data modeling patterns (e.g. – dimensional model, 3rd normal form)
• Experience with relational databases, including a STRONG understanding of SQL Server Database Management Systems (RDBMS) concepts

Preferred Experience:

• Power BI Experience
• Experience with Advanced Analytics – Optimization, Machine Learning and/or Predictive Analytics
• Knowledge of ERP systems