Sr Data Engineer

Data Engineering RoleResponsible for designing, developing, testing and implementing data engineering processes to generate analytical and reporting solutions. Also responsible for analyzing and preparing the data needed for data science based outcomes. Also responsible for managing and maintaining metadata data structures besides providing necessary support for post-deployment related activities when needed. Expected to actively look for automation opportunities, using artificial intelligence tools where appropriate, to reduce manual work and improve process efficiency. Accountable to deliver results in a timely manner using agile methodologies.Roles and ResponsibilitiesBuild technical data dictionaries and support business glossaries to analyze the datasetsPerform data profiling and data analysis for source systems, manually maintained data, machine generated data and target data repositoriesBuild both logical and physical data models for both Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) solutionsDevelop and maintain data mapping specifications based on the results of data analysis and functional requirementsPerform a variety of data loads & data transformations using multiple tools and technologies.Build automated Extract, Transform & Load (ETL) jobs based on data mapping specificationsMaintain metadata structures needed for building reusable Extract, Transform & Load (ETL) components.Analyze reference datasets and familiarize with Master Data Management (MDM) tools.Analyze the impact of downstream systems and productsDerive solutions and make recommendations from deep dive data analysis.Design and build Data Quality (DQ) rules neededMinimum QualificationBachelor's degree from accredited university or college with minimum of 2 years of professional experience OR Associates degree with minimum of 5 years of professional experience OR High School Diploma with minimum of 7 years of professional experienceNote: Military experience is equivalent to professional experienceEligibility Requirement: Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas, now or in the future, for this job.Desired CharacteristicsTechnical Expertise:Exposure to industry standard data modeling tools (e.g., ERWin, ER Studio, etc.).Exposure to Extract, Transform & Load (ETL) tools like Informatica or TalendExposure to industry standard data catalog, automated data discovery and data lineage tools (e.g., Alation, Collibra, TAMR etc.)Hands-on experience in programming languages like Java, Python or ScalaHands-on experience in writing SQL scripts for Oracle, MySQL, PostgreSQL or HiveQL - Experience with Big Data / Hadoop / Spark / Hive / NoSQL database engines (i.e. Cassandra or HBase)Exposure to unstructured datasets and ability to handle XML, JSON file formatsConduct exploratory data analysis and generate visual summaries of data. Identify data quality issues proactively.