Data Engineer

Data Engineer

Overview As a Data Engineer within North America Supply Chain, you will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise data & analytics capabilities across the enterprise. Primary Responsibilities • Good understanding and application of modern data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow, SQOOP, DMS, Spark, and building out performant data consumption layers. • Design and build product features in collaboration with business and IT. • Design reusable components, frameworks, libraries like User Defined Functions. • Build continuous integration and test-driven development environment. • Performance/scalability tuning, algorithms and computational complexity. • Manage large data sets that are updated multiple times per day. • Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints. • Troubleshoot production support issues post - deployment and come up with solutions as required.

Preferred Experience • A Bachelor's degree in Business, Information Technology or related field. • 2+ years' experience in a professional organization collaborating across multiple functions. • Familiarity with Agile project delivery methods. • Experience with AWS components and services (E.G. EC2, EMR, S3, and Lambda). • Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow. • Strong programming, Python, shell scripting and SQL. • Good understanding of file formats including JSON, Parquet, Avro, and others. • Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake. • Experience with data warehousing, dimensional modeling and ETL development. • Demonstrable ability to quickly learn new tools and technologies. • Exceptional interpersonal and communication skills (written and verbal).