Data Engineer

About Us:

Perfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs.

We provide excellent benefits such as Medical, Dental, Vision ++ a fun company to work!!!

Job Description:

Responsibilities

• Developing scripts to automate the Audit and Monitoring process
• Take business requirements and build queries to spec
• create alert reporting when audit condition are met
• create automation to reduce the amount of manual review of audit scenarios
• complete documentation of products and training business users to manage and maintain queries and reports

Data Pipeline: Build robust data pipelines: develop jobs to process, validate, transport, collate, aggregate, and distribute data Build workflows that empower analysts to efficiently use data Develop data virtualizations and actual data movement and transformation processes, using the appropriate technologies, tools and techniques to balance performance and cost objectives. Define and establish processes to maintain the integrity of data within our data pipeline and warehouse Develop tests to validate, and monitor data transfer integrity and efficiency. Work collaboratively across the organization to address and predict data performance issues Develop documentation for the tools and data products deployed

Required Skills

• Bachelor's degree
• 3 – 5+ years of related experience
• Cloud Service – Azure
• Advanced level SQL
• Databricks
• Python
• Knowledge of HIPAA rules and audit frameworks
• DevOps tools and processes

Preferred Skills

• Power BI
• MapReduce, HDFS