Data Engineer

Data Engineer

Overview As a Data Engineer within North America Supply Chain, you will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise data & analytics capabilities across the enterprise. Primary Responsibilities

• Good understanding and application of modern data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow, SQOOP, DMS, Spark, and building out performant data consumption layers.
• Design and build product features in collaboration with business and IT.
• Design reusable components, frameworks, libraries like User Defined Functions.
• Build continuous integration and test-driven development environment.
• Performance/scalability tuning, algorithms and computational complexity.
• Manage large data sets that are updated multiple times per day.
• Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints.
• Troubleshoot production support issues post - deployment and come up with solutions as required.

Preferred Experience

• A Bachelor's degree in Business, Information Technology or related field.
• 2+ years' experience in a professional organization collaborating across multiple functions.
• Familiarity with Agile project delivery methods.
• Experience with AWS components and services (E.G. EC2, EMR, S3, and Lambda).
• Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow.
• Strong programming, Python, shell scripting and SQL.
• Good understanding of file formats including JSON, Parquet, Avro, and others.
• Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake.
• Experience with data warehousing, dimensional modeling and ETL development.
• Demonstrable ability to quickly learn new tools and technologies.
• Exceptional interpersonal and communication skills (written and verbal).