Data Engineer (Expert)-Data & Analytics-IT-Corp-US

Senior Data Engineer

The primary responsibilities of this role are to: lead and participate in design sessions with Enterprise and Hub Data Stewards, Engineering teams, Data Scientists, Product Managers, and business and IT stakeholders, that result in design documentation for data processing, storage, and delivery solutions. Understand business capability needs and processes as they relate to IT solutions through partnering with Product Managers and business and functional IT stakeholders, and apply this knowledge to identifying business problems that could be solved. Evaluate new technologies, like Domino or Redshift, or new languages, like Go or React, including performing POCs and presenting results to others, with a goal of providing technical recommendations. Challenge the team to improve processes and methodologies, like SCRUM or Kanban, and/or initiate piloting new ones. Implement data solutions according to design documentation using a variety of tools and programming languages, like Kafka, SQL and non-SQL databases, Scala, Node, etc., following the team’s established processes and methodologies, like SCRUM or Kanban. Facilitate and participate in code reviews, retrospectives, functional and integration testing, and other team activities focused on improving the quality of delivery. Provide reliable estimates for short term projects and assist in large scale project estimation. Collaborate with other data engineers and stewards within the team and across data, technical platforms, and product teams on aligning roadmaps, delivery dates, and integration efforts. Mentor junior and aspiring Data Engineers on the team and across the data community. Represent the team at various cross team meetings and events focused on design and planning, like Scrum of Scrums and Release Planning, sharing the results of team efforts, or brainstorming on process improvements. Create and maintain design and code documentation in GitHub, Haystack, SharePoint, and/or another repository used by the team.

Required Qualifications: Bachelor’s degree in Computer Science, Software Engineering, or related field, with five years of experience or Master's degree with three years of relevant experience or Ph.D. with one year of relevant experience or nine years of relevant experience is an acceptable substitute for the degree requirement. 3+ years of experience engineering data-intensive software using streaming and resource-based design principles. 3+ years of fluency in the Node programming language. 3+ years of fluency in the Scala programming language. 3+ years of experience with AWS Fargate. 3+ years of experience with AWS Lambda. 3+ years of experience with AWS DynamoDB. 3+ years of experience with AWS SNS. 3+ years of experience with a continuous integration tool. Demonstrated experience with data architecture and modeling, including designing both logical and physical models for datasets. Proficiency in working with relational databases such as Postgres, MySQL, Oracle, etc. Proven experience modeling large datasets in distributed databases such as (but not limited to) Apache Cassandra, Spanner, etc. Strong interpersonal skills and desire to work in a highly collaborative environment familiarity with the relevant industry trends