Data Engineer

Job Title

Perfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs. We provide excellent benefits such as Medical, Dental, Vision ++ a fun company to work!!!

Responsibilities

Developing scripts to automate the Audit and Monitoring process

Take business requirements and build queries to spec

Create alert reporting when audit condition are met

Create automation to reduce the amount of manual review of audit scenarios

Complete documentation of products and training business users to manage and maintain queries and reports

Data Pipeline

Build robust data pipelines: develop jobs to process, validate, transport, collate, aggregate, and distribute data

Build workflows that empower analysts to efficiently use data

Develop data virtualizations and actual data movement and transformation processes, using the appropriate technologies, tools and techniques to balance performance and cost objectives

Define and establish processes to maintain the integrity of data within our data pipeline and warehouse

Develop tests to validate, and monitor data transfer integrity and efficiency

Work collaboratively across the organization to address and predict data performance issues

Develop documentation for the tools and data products deployed

Required Skills

Bachelor's degree

3 – 5+ years of related experience

Cloud Service – Azure

Advanced level SQL

Databricks

Python

Knowledge of HIPAA rules and audit frameworks

DevOps tools and processes

Preferred Skills

Power BI

MapReduce, HDFS