Data Engineer

Overview:

We are seeking a highly skilled Data Engineer to join a dynamic team in the Charlotte, NC area. This role focuses on the collection, modeling, storage, processing, and evaluation of large-scale data sets that are rapidly changing and complex. The goal is to leverage this data to optimize business processes and drive strategic decision-making.

Key Responsibilities:

• Develop and automate data pipelines and integration solutions to streamline the collection, processing, and analysis of diverse data sets using big data tools and ETL processes.
• Design and implement scalable, cloud-based data architectures ensuring data reliability and accessibility across various business functions.
• Establish and enforce data governance policies, including data lineage, retention, and access control, in collaboration with IT and data management teams.
• Collaborate with cross-functional stakeholders to gather requirements and deliver key project milestones, enabling user-driven data transformation and visualization.
• Work closely with IT and analytics teams to create custom data science solutions within an agile development framework.

Qualifications:

• Graduate degree in Computer Science, Information Systems, Applied Statistics, Mathematics, or Software Engineering.
• 3 to 5 years of relevant work experience.
• Proficiency in programming with Python, with a preference for experience in pySpark.
• Expertise in SQL and relational databases, with knowledge of NoSQL databases as an advantage.
• Experience in designing and optimizing large-scale cloud-based data architectures using platforms such as GCP, AWS, or Azure.
• Strong skills in ETL/ELT design and development in both batch and real-time environments.
• Knowledge of data modeling and performance optimization to support analytics and machine learning.
• Familiarity with CI/CD pipelines, unit testing, and Kubernetes is a plus.
• Solid understanding of data governance, security, and compliance practices.
• Ability to collaborate across teams and mentor others in agile, data-driven environments.

This is a unique opportunity to play a pivotal role in shaping the data landscape of our organization. We look forward to welcoming a candidate who is passionate about data engineering and eager to contribute to our success.