Data Engineer III

Responsibilities Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team Investigates and analyzes feasibility of data integration prototypes and program requirements Develops specifications and plans the full range of programming actions to produce data integration components Develops and maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach Develops and maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data Builds complex unit tests to enable test driven development and automation to drive code reliability Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries Maintains data solutions in a divest state to ensure business functionality until replaced with new technology Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions Requirements Bachelor’s degree, preferably in a computer related field or equivalent relevant experience Five years of data integration development experience, or related experience Strong SQL knowledge and experience working with relational databases Excellent analytical skills to work with unstructured datasets Excellent knowledge of applicable programming languages, such as Python Strong knowledge of cloud services such as RDS, S3, SNS, CloudWatch and Lambda Strong knowledge of DBT/Informatica or other ETL/ELT tools preferred Strong knowledge of Snowflake Strong knowledge of data modeling Excellent ability to build processes supporting data transformation, data structures, metadata, dependency and workload management Strong ability to manipulate, process and extract value from large, disconnected datasets Strong knowledge of DevOps and/or DataOps practices, CI/CD pipelines, and containerization technologies preferred Excellent knowledge of orchestration or scheduling tools Excellent verbal and written communication skills Strong attention to detail, organizational and multi-tasking skills with the ability to adapt to changing priorities Ability to maintain confidentiality. #J-18808-Ljbffr