Data Engineer

Data Engineer

Responsibilities:

• Participates in the analysis and development of technical specifications, programming, and testing of Data Engineering components.
• Participates creating data pipelines and ETL workflows to ensure that design and enterprise programming standards and guidelines are followed. Assist with updating the enterprise standards when gaps are identified.
• Follows technology best practices and standards and escalates any issues as deemed appropriate. Follows architecture and design best practices (as guided by the Lead Data Engineer, BI Architect, and Architectural team).
• Responsible for assisting in configuration and scripting to implement fully automated data pipelines, stored procedures, and functions, and ETL workflows that allow for data to flow from on-premises Oracle databases to Snowflake where the data will be consumable by our end customers.
• Follows standard change control and configuration management practices.
• Participates in 24-hour on-call rotation in support of the platform

Experience:

• 3+ years of experience in Data Engineering with excellent analytical reasoning and critical thinking skill
• Database Platforms: Snowflake, Oracle, and SQL Server
• OS Platforms: Linux OS and Windows Server
• Languages and Tools: PL/SQL, Python, T-SQL, StreamSets, Snowflake Streams and Tasks, and Informatica PowerCenter, DBeaver
• Drive and desire to automate repeatable processes.
• Excellent interpersonal skills and communication, as well as the willingness to collaborate with teams across the organization.
• Experience loading data from files in Snowflake file stages into existing tables.
• Experience creating and working with near-real-time data pipelines between relational sources and destinations.
• Experience working with StreamSets Data Collector or similar data streaming/pipelining tools (Fivetran, Striim, Airbyte etc…).

Mid-Level Job Type: Contract Job Location: Greater Lansing