Data Engineer

Job Description:

JOB SUMMARY

The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data API's, and ETL jobs, to meet the data needs of applications, services, micro services, data assets, and business intelligence and analytical tools. Working with data architects, application development teams, data analytics teams, business analytics, product managers, and the data governance COE, the Senior Data Engineer will design and develop interfaces between applications, databases, data assets, external partners, and third-party systems in a combination of cloud and on-premise platforms.

• Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
• Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud
• Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools
• Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
• Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Assists in planning, coordinating, and executing engineering projects
• Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
• Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams
• This list is not all-inclusive and you are expected to perform other duties as requested or assigned

ESSENTIAL DUTIES

• Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
• Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud
• Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools
• Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
• Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Assists in planning, coordinating, and executing engineering projects
• Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
• Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams
• This list is not all-inclusive and you are expected to perform other duties as requested or assigned

5+ w/Bachelors degree

Skills/Experience:

• Meet with the Product Owner to gather requirements
• Experience building ETL for analytical models
• Design and Develop Matillion orchestration jobs to integrate the data and Compare the results of the Data integration between the Source and Target
• Experience in implementing frame work solutions for data reconciliation
• Evaluate Results and discuss discrepancies with the Product Owner and Business and bring closure to the discrepancy
• Deploy code to Production

Matillion and Snowflake are the key requirements

Base Pay Information

The national base pay range below is a good-faith estimate of what Delta Dental may pay for new hires. Actual pay may vary based on Delta Dentals assessment of the candidates knowledge, skills, abilities (KSAs), related experience, education, certifications and ability to meet required minimum job qualifications. Other factors impacting pay include prevailing wages in the work location and internal equity.$74,000 - $170,900