ETL Developer

Perfict Global Data EngineerPerfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs. We provide excellent benefits such as Medical, Dental, Vision ++ a fun company to work!!!Job DescriptionWorks alongside Information & data Architects, Engineers, Data Scientists, and other stakeholders to design and maintain moderate to advanced data models. Responsible for designing, building, and maintaining large-scale databases that support web applications and other digital services. Responsible for developing ETL data pipelines and helping with data lineage requirements implementations and supporting reports that provide accurate and timely data for internal and external clients. This role requires familiarity of data architecture, data sources, data flow and extraction & manipulation of data sets of various sizes.Position ResponsibilitiesDesign, build, test and document solutions to implement, validate data lineage, solutions and stabilize data pipeline to ensure reliable operations.Design, implement and operate medium to large-scale, high-volume, high-performance data structures for reporting, analytics, and data science.Define, implement robust data lineage rules and standards, ensure thorough testing and validation is performed to create a quality product Must have a working experience with data modeling, data mapping, transformation and lineage.Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging best ETL data tools.Ensure data cataloging, lineage requirements are reviewed, implemented, and tested during the ETL process implementations.Design, develop, manage and build real-time data pipelines from a variety of sources.Collaborate with engineers to adopt best practices in data integrity, design, analysis, testing, validation, and documentation.Coordination with other teams to design optimal patterns for data ingest and egress and coordinate data quality initiatives and troubleshooting.Participate in sprint planning meetings as needed. Continually improve data lineage with the ETL automation and support production activities.Review and are familiar with automated processes for performance and fault tolerance.Design and implement security measures to protect data from unauthorized access or misuse.Keeps management informed of status of on activities through accurate, timely, and appropriate reporting. Contribute to Data Governance, system documentation and sharing of data asset knowledge.Position QualificationsBachelor's Degree in computer science, engineering or in a technology related field OR equivalent through a combination of education and/or technology experience OR 12 years of technology experience 6 years of experience using Informatica, 3 years IICS and Snowflake ETL development experience with Python programming, SQL 5 years of experience in Data Engineering, developing, data cataloging, lineage end-to-end scalable data applications and data pipelines 5 years of working knowledge of different databases (e.g., SQL & NoSQL) and AWS cloud technologies 4 years of experience developing strong collaborative relationships with key data, business partners 3 years of experience working with software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing 2 years of experience working in enterprise data warehouse solutions and platformsLicenses/CertificatesInformatica IICS certificationAmazon Web Services (AWS) Certified Solution Architect