data engineer

Senior Data Engineer

Client is seeking a talented and motivated Senior Data Engineer to join their Data and Analytics team. Client is constantly enhancing their Data Engineering Platform for business and operational analytics. At client, they have state of the art technologies such as Oracle Fusion, Sales Force, Adobe to name a few. The Data platform will allow users to answer "what, "when and "how questions and allow them to ask "what if. You should be passionate about solving business problems using data. Integrating data from disparate sources to find hidden gems should be your second nature. You will be part of the team that is driven by data driven culture

Responsibilities

Design, build and maintain all facets of the Data Pipelines for Data Engineering team. Develop collaborative relationships and work with key business sponsors and other IT teams to solve complex problems with simple solutions Lead the development of ETL processes to integrate data from a wide variety of sources including S3 objects, Kafka, REST APIs, SQL Server Continue refining the Python data management framework developed internally Enhance existing data centric CI/CD framework utilizing BitBucket and Jenkins Ensure established standards are followed for code deployment between environments Participate in architecture design sessions and perform code reviews Follow and improve the established standards for design, development, and migration Mentor junior team members

Qualifications

Degree in Computer Science, Information Systems, Information Technology, or related engineering field Five + years experience as a Data Engineer or as a Data Lake Architect on AWS platform Required experience Deep knowledge of AWS Services such as S3, EMR, Redshift, DataPipeline, RDS, DynamoDB, STEP functions, Lambda Advanced SQL knowledge for Redshift ETL process design and implementation on AWS Jenkins, Bitbucket, Webhooks Containerized workload management using Docker Streaming data processing (Kafka)