Data Engineer

Data Engineer

Seeking a highly skilled and motivated Data Engineer to join a dynamic team. As a key contributor, you will be responsible for integrating into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.

Responsibilities:

• Integrate into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.
• Perform data engineering and analytics tasks, including data ingestion, SQL orchestration, and data modeling.
• Troubleshoot and resolve issues during testing and validation activities.
• Design and build data ingestion pipelines.
• Participate in Agile methodology, delivering assigned stories according to engineering standards and guidelines.
• Collaborate in pair programming, code reviews, and documentation of data models.
• Implement automated tests, logging, and alerting for data processes.
• Provide data engineering consulting expertise, especially in Starburst and Immuta.
• Support data migration activities.

Key Deliverables:

• Completion of assigned stories, including design, data ingestion pipeline builds, data modeling, coding, analytics solutions, and documentation.
• Jira Stories and Epics for each Agile program increment.
• Deliver high-quality solutions accepted by the CDP Program Team's product owners, adhering to FRS engineering standards and guidelines.

Requirements:

• 5+ years of experience in data engineering.
• Experience with Databricks, Collibra, and/or Alteryx.
• Strong SQL skills and experience in building data ingestion pipelines.
• Familiarity with cloud-based data platforms, particularly AWS.
• Proficiency in Agile methodologies and tools such as Jira.
• Excellent troubleshooting and problem-solving skills.
• Ability to work collaboratively within a team and communicate effectively with stakeholders.
• Experience in Immuta and Starburst preferred.