AWS Data Engineer- Remote

AWS Data Engineer

Design, build and maintain big data workflows/pipelines to process billions of records in large-scale data environments with experience in end-to-end design and build process of near-real time and batch data pipelines. Develop, implement, and optimize streaming, data lake, and big data analytics solutions. Leads code review sessions to validate adherence with development standards and benchmark application performance by capacity testing. Leverages DevOps techniques and experience with DevOps tools - GitLab, Jira, or Jenkins for continuous integration, continuous deployment and build automation. Support reusable framework and data governance processes by partnering with LOBs for any code/requirements remediation. Collaborates with other developers and provides significant contributions to develop specifications to resolve business client questions, problems, and to address enhancement needs. Uses technical knowledge, creativity and company practices and priorities to obtain solutions to complex problems. Experience with software testing frameworks.

Bachelor's degree in information technology or related experience. Knowledge of all phases of software development including design, coding, testing, debugging, implementation, and support. Minimum 5 years' experience in field of data engineering involving analytics focused data warehouse environments like Oracle or Snowflake. Experience in AWS utilizing services such as S3, AWS CLI, and RDS is desired. Knowledge of RDBMS, SQL and ETL skills are must. Ability to thoroughly understand the business issues surrounding each project. Knowledge of standard change management tools and processes. Ability to work in a team environment. Experience with Bitbucket or Gitlab including deployment pipelines Understanding of data transformations, cleansing, and deduplications. Experience developing pipelines for both cloud and hybrid cloud infrastructures is desired. Intermediate knowledge of statistics, and skills with exploratory data analysis using Python or R is highly desirable. Experience with machine learning techniques (e.g., regression, decision trees, cluster analysis) using SAS or other statistical programming packages such as R, Python, Matlab is highly desirable. Experience working in an agile delivery environment. Ability to work independently and drive solutions end to end leveraging various technologies to solve data problems and develop solutions. Perform unit tests and conduct reviews with other team members to ensure code is designed with high code coverage Passionate for continuous learning, experimenting, applying, and contributing towards cutting edge open-source technologies and software paradigms. Ability to research and assess open-source technologies and components to recommend and integrate into the design and implementation. Proven track record of customer satisfaction and delivery success and ability to establish and maintain appropriate relationships with business and IT stakeholders. Ability to work in an advisory capacity to identify key technical business problems, develop and evaluate alternative solutions and make recommendations.