Senior Data Engineer

Job Description

Job Description

About Us



Smart Data is a technology consulting and talent solutions firm that partners with organizations to solve complex business and technology challenges. For more than 20 years, we’ve supported clients through software development, technology consulting, project delivery, and highly specialized technical talent solutions.

Our teams work closely with clients and consultants to build long-term partnerships, deliver high-quality technology solutions, and connect talented professionals with meaningful opportunities. We value collaboration, technical excellence, continuous improvement, and people who are comfortable taking ownership in evolving technology environments.

Role Overview

We are seeking a Senior Data Engineer to play a key role in a major data modernization initiative as the organization transitions its data warehouse and integration environment to Snowflake, dbt, Microsoft Fabric/Airflow, and IBM StreamSets.

This is more than a traditional development position. We are looking for someone who can be hands-on technically while also providing mentorship, knowledge transfer, and technical direction to an established data warehouse team as they adopt this new technology stack.

Snowflake, dbt, SQL, and Python coding skills are required for this position. Experience with Airflow on Fabric and/or IBM StreamSets is highly preferred and will be particularly valuable as the organization replaces legacy SAP Data Services processes and modernizes its data integration and orchestration capabilities.

The right person will become a key technical resource within the data engineering environment—helping establish best practices, guiding engineers through the transition, and taking increasing ownership as knowledge is transferred from existing subject-matter experts.

We are particularly interested in engineers who are actively using AI-assisted development tools to improve productivity, automate processes, and accelerate technical delivery.

What You'll Do

• Design, develop, and support data engineering solutions within a Snowflake data warehouse environment.
• Build and maintain data transformations and workflows using dbt.
• Write and maintain Python code supporting data engineering, automation, and integration processes.
• Support migration from existing SQL Server and legacy data warehouse environments into Snowflake.
• Work with IBM StreamSets to support data migration, integration, FTP, and enterprise data-feed processes.
• Use Airflow on Fabric to orchestrate data workflows, scheduling, StreamSets jobs, dbt jobs, and related processes.
• Help transition legacy data integration processes away from SAP Data Services and into the modern data engineering platform.
• Build and support enterprise data feeds integrating information from multiple systems.
• Implement and improve CI/CD practices across data engineering workflows.
• Establish development standards, reusable patterns, and best practices across the new technology stack.
• Provide hands-on technical mentorship and knowledge transfer to existing data warehouse engineers.
• Initially partner with key members of multiple data teams and progressively help expand knowledge across a broader group of approximately 15 team members.
• Help existing engineers transition their skills into Snowflake, dbt, Airflow on Fabric, and StreamSets.
• Collaborate with internal technical resources, IBM, and subject-matter experts during implementation and knowledge transfer.
• Use AI-assisted engineering tools to improve development, troubleshooting, testing, and productivity.
• Troubleshoot complex data integration, transformation, orchestration, and migration issues.
• Take increasing technical ownership of the modern data engineering ecosystem as the implementation matures.

Required Qualifications

• Strong hands-on Snowflake experience.
• Strong hands-on dbt experience.
• Strong Python coding skills.
• Strong SQL and relational database experience.
• Senior-level data engineering or data warehouse development experience.
• Experience developing and supporting enterprise data pipelines, integrations, and data feeds.
• Experience with data warehouse modernization, migration, or large-scale data movement.
• Ability to understand existing data processes and translate them into modern engineering patterns.
• Ability to provide technical mentorship, guidance, and knowledge transfer.
• Experience using AI-assisted engineering tools professionally, with examples of improved development productivity or technical delivery.
• Strong technical judgment, troubleshooting, and problem-solving capabilities.
• Ability to independently own technical deliverables and adopt new technologies quickly.
• Strong communication and collaboration skills.

Highly Preferred Qualifications

• Airflow on Fabric experience.
• IBM StreamSets experience.
• Experience with Microsoft Fabric.
• Experience migrating SQL Server or traditional relational data into Snowflake.
• Experience orchestrating dbt, StreamSets, database, or cloud-storage workflows.
• Experience modernizing or replacing legacy ETL/data integration platforms.
• Experience with SAP Data Services or similar enterprise ETL technologies.
• CI/CD implementation within data engineering environments.
• Experience establishing engineering standards and helping teams adopt new technologies.

Nice to Have

• Azure-based data or storage services.
• Experience working alongside managed service providers during technology implementations.
• Experience introducing new engineering tools or practices within an established organization.
• Previous experience serving as a technical mentor, lead, or senior resource for a data engineering team.

What Makes Someone Successful in This Role?

This position is particularly well suited for someone who enjoys being the person a team can turn to when adopting unfamiliar technology.

You should be comfortable building solutions yourself, but equally comfortable sitting alongside other engineers, explaining how and why something works, establishing repeatable patterns, and helping the team become self-sufficient.

We want someone who stays current with emerging technologies, actively uses AI to improve engineering productivity, and can explain the practical results of those improvements.

The goal isn't simply to bring in someone who can execute Snowflake and dbt work independently. We need someone who can help an established data warehouse team retool its skills, establish confidence with the new platform, and ultimately take technical ownership of the environment.

EEO Statement

Smart Data is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other protected characteristic under applicable law.

Engagement Type: Contract-to-Hire – 6-Month Minimum Contract Period

Location: Remote-Friendly | Raleigh-Durham, NC Area Preferred

Work Authorization: U.S. Citizenship Required – Sponsorship is not available