ETL Developer (SQL, Azure cloud, Azure Data Factory) | TELECOMMUTE | OSG

ETL Developer (SQL, Azure Cloud, Azure Data Factory)

Position: Contract

Work Hours: 8am-5pm HST preferred, but have flexibility

Salary: NA

Interview Process:

• How many rounds? 3
• Video vs. phone? Video

Description:

• Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning and other similar roles.
• Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated ecosystems.
• Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments
• Analyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities.
• Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition.
• May design schemas, write SQL or other data markup scripting and helps to support development of Analytics and Applications that build on top of data.
• Selects, develops and evaluates personnel to ensure the efficient operation of the function.
• ETL Development, 3-6 Years, Competent;

Summary of the project/initiative:

• Will implement, operate, enhance, and improve the Medicaid Datawarehouse solution that helps State of Hawaii aggregate and analyze Medicaid and HHS data.
• Awarded the initial contract in 2022 and scheduled to go-live in February, 2024.
• Our services will help Hawaii make decisions, reduce costs, and improve health outcomes for Medicaid and HHS programs.

Team structure: 1 Account Manager 1 Project Manager 1 Data Architect 1 ETL Lead 2 ETL Developers 1 Business Analyst 1 System Architect

Top 3 Skills:

• 3+ years of experience in data warehousing concepts, ETL concepts, and working with ETL/Data quality tools on any ETL platform
• 3+ years of experience in writing complex SQL queries, stored procedures and performance tuning
• 1+ years of experience with Microsoft Azure cloud services and data warehouse environment

Top 5-10 Responsibilities:

• Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced
• Efficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
• Assist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flows
• Investigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
• Developing ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsets
• Developing idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and Pipelines
• Ability to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problems
• Capturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using Tasks
• Optimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responses
• Must have the ability to build a highly efficient orchestrator that can schedule jobs, executing workflows, perform Data quality checks, and coordinate dependencies among tasks
• Responsible for testing of ETL system code, data design, and pipelines and data flows.