Senior Data Engineer

Job Description

Senior Data Engineer

Fort Mill, SC

Responsibilities:

\n
• Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
\n
• Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
\n
• Implement data integration solutions using HVR to ensure real-time data availability.
\n
• Write and optimize SQL queries for data retrieval and manipulation.
\n
• Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
\n
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
\n
• Document data processes and maintain data quality standards.
\n
• Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.
\n

Mandatory Skills:

\n
• Proven experience with AWS services, particularly Airflow and Glue.
\n
• Strong knowledge of Snowflake and its data warehousing capabilities.
\n
• Proficiency in SQL for data manipulation and analysis.
\n
• Experience with Python for data processing and automation tasks.
\n
• Hands-on experience with ETL processes and tools.
\n
• Strong understanding of cloud computing concepts and architectures.
\n

Preferred Skills:

\n
• Experience with HVR for data replication and integration.
\n
• Familiarity with data modeling and database design principles.
\n
• Knowledge of data governance and data quality best practices.
\n
• Experience with version control systems such as Git.
\n
• Understanding of Agile methodologies and project management practices.
\n

Qualifications:

\n
• Bachelor's degree in Computer Science, Information Technology, or a related field.
\n
• 6-8 years of experience in data engineering or a related role.
\n
• Strong analytical and problem-solving skills.
\n
• Excellent communication and collaboration abilities.
\n
• Ability to work independently and as part of a team in a fast-paced environment.
\n