Azure Data Engineer

Azure Data Engineer

Location: Spring Texas (On-Site) Need Only Local to Houston, TX Experience; 10+ Years

Responsibilities

• Perform ETL, ELT operations and administration using modern tools, programming languages and systems securely and in accordance with enterprise data standards
• Assemble, model, transform large complex sets of data that meet non-functional and functional business requirements into a format that can be analyzed
• Automate data processing of data from multiple data sources
• Develop, deploy and version control code for data consumption, reuse for APIs
• Employ machine learning techniques to create and sustain data structures
• Perform root cause analysis on external and internal processes and data to identify opportunity for improvement, resolve data quality issues
• Lead data-related workshops with stakeholders to capture data requirements and acceptance criteria

Skills and Qualifications

We are looking for someone who has technical depth and broad tool experience related to data engineering and has the following required qualifications:

• Minimum bachelor's degree in: Data Science, Business Intelligence, Statistics, Computer Engineering or related field, or the equivalent combination of education, professional training, and work experience
• 5 or more years performing duties related to data engineering
• Advance English level
• Expert proficiency in at least one of these programming languages: Python, NoSQL, SQL, R, and competent in source code management
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management
• Create data validation methods and data analysis tools

Preferred Qualifications / Experience

• Excellent problem-solving skills and ability to learn through scattered resources
• Automate routine tasks via scripts, code
• Capacity to successfully manage a pipeline of duties with minimal supervision
• Experience supporting and working with cross-functional teams in a dynamic environment
• Modify existing reports, extracts, dashboards, and cubes as necessary
• Commitment to operations integrity and ability to hold self and others accountable for results

Required Proficiency:

• Advanced SQL
• Snowflake
• Tamr
• Python
• GitHub
• Intermediate Databricks
• Airflow