Data Engineer

Job Description

Job Description

We are looking for a Data Engineer to support and enhance critical data operations in Greenville, South Carolina. This role focuses on keeping data platforms dependable, efficient, and scalable across both real-time and scheduled workflows. The ideal candidate will bring strong technical expertise in cloud-based data environments and a proactive approach to improving performance, automation, and data reliability.

Responsibilities:
• Oversee the health and performance of data pipelines that run across Snowflake, Kafka, and connected platforms.
• Investigate operational issues affecting data ingestion, transformation, or downstream delivery and drive timely resolution.
• Maintain stable batch and streaming processes by improving resiliency, uptime, and overall execution efficiency.
• Administer Snowflake resources, including warehouses, databases, permissions, and usage optimization.
• Manage Kafka infrastructure by tuning clusters, topics, partitions, and consumer group behavior for reliable throughput.
• Create and maintain automated solutions for deployment, monitoring, failure recovery, and routine workflow support.
• Develop operational scripts and utilities using Python, Bash, and related tools to reduce manual effort and improve consistency.
• Contribute to CI/CD practices that strengthen the release and maintenance process for data infrastructure.
• Partner with engineering and analytics teams to improve pipeline design, data performance, and delivery accuracy.
• Support data governance, security, compliance, and data quality standards through validation checks and alerting frameworks.• Experience working in data engineering or data platform operations roles.
• Strong hands-on knowledge of Python for scripting, automation, and operational support.
• Experience managing or supporting Apache Kafka environments and related streaming data workflows.
• Familiarity with Snowflake administration, performance tuning, and resource management.
• Solid understanding of ETL processes, including data ingestion, transformation, and delivery concepts.
• Experience working with AWS services in support of modern data infrastructure.
• Knowledge of Terraform or similar infrastructure-as-code tools for environment management and automation.