Data Engineer

Perfict Global IT Consulting ServicesPerfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs. We provide excellent benefits such as medical, dental, vision ++ a fun company to work!Job Description: ResponsibilitiesDeveloping scripts to automate the audit and monitoring processTake business requirements and build queries to specCreate alert reporting when audit condition are metCreate automation to reduce the amount of manual review of audit scenariosComplete documentation of products and training business users to manage and maintain queries and reportsData PipelineBuild robust data pipelines: develop jobs to process, validate, transport, collate, aggregate, and distribute data. Build workflows that empower analysts to efficiently use data. Develop data virtualizations and actual data movement and transformation processes, using the appropriate technologies, tools and techniques to balance performance and cost objectives. Define and establish processes to maintain the integrity of data within our data pipeline and warehouse. Develop tests to validate, and monitor data transfer integrity and efficiency. Work collaboratively across the organization to address and predict data performance issues. Develop documentation for the tools and data products deployed.Required SkillsBachelor's degree3 – 5+ years of related experienceCloud Service – AzureAdvanced level SQLDatabricksPythonKnowledge of HIPAA rules and audit frameworksDevOps tools and processesPreferred SkillsPower BIMapReduce, HDFS