Data Engineer

Data EngineerOverview As a Data Engineer within North America Supply Chain, you will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise data & analytics capabilities across the enterprise. Primary ResponsibilitiesGood understanding and application of modern data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow, SQOOP, DMS, Spark, and building out performant data consumption layers.Design and build product features in collaboration with business and IT.Design reusable components, frameworks, libraries like User Defined Functions.Build continuous integration and test-driven development environment.Performance/scalability tuning, algorithms and computational complexity.Manage large data sets that are updated multiple times per day.Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints.Troubleshoot production support issues post - deployment and come up with solutions as required.Preferred ExperienceA Bachelor's degree in Business, Information Technology or related field.2+ years' experience in a professional organization collaborating across multiple functions.Familiarity with Agile project delivery methods.Experience with AWS components and services (E.G. EC2, EMR, S3, and Lambda).Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow.Strong programming, Python, shell scripting and SQL.Good understanding of file formats including JSON, Parquet, Avro, and others.Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake.Experience with data warehousing, dimensional modeling and ETL development.Demonstrable ability to quickly learn new tools and technologies.Exceptional interpersonal and communication skills (written and verbal).