Data Engineer (MDM Platform)

Job Description

Data Engineer (MDM Platform)

\n

Snowflake · dbt · Python · Apache Airflow · Master Data Management (MDM)

\n

Raleigh, NC | Hybrid | Full-Time Opportunity

\n

\n

ABOUT US

\n

Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth through technology. With over 4,000 professionals across the US, Canada, Latin America, and India, Incedo combines expertise in AI, data analytics, and digital engineering to deliver impactful solutions across Banking & Payments, Telecom, Hi-Tech, Wealth Management, and Life Sciences. At Incedo, we foster a culture of innovation, collaboration, and continuous learning, empowering our people to solve complex challenges and shape the future of technology.

\n

\n

THE ROLE

\n

We are looking for a Data Engineer with strong Master Data Management (MDM) platform experience to design, develop, and maintain scalable data pipelines and data integration solutions. The ideal candidate will have hands-on expertise in Snowflake, dbt, Python, Apache Airflow, and Azure technologies, with a solid understanding of MDM concepts, data quality, and enterprise-scale data engineering practices.

\n

\n

WHAT YOU'LL DO

\n

\n
• Develop end-to-end ETL/ELT pipelines for data ingestion, transformation, standardization, and master data processing.
\n
• Build and optimize Snowflake SQL queries, dbt models, incremental loads, and data quality tests.
\n
• Implement MDM workflows including entity matching, survivorship, deduplication, and golden record creation.
\n
• Design and implement SCD Type 1 and Type 2 processes, change tracking, and historical data management.
\n
• Develop and orchestrate Apache Airflow DAGs, managing task dependencies, scheduling, retries, and error handling.
\n
• Integrate Azure Functions, Event Grid, Blob Storage, and ADLS Gen2 for event-driven processing and data exchange.
\n
• Develop Python-based solutions and integrate Snowflake with Elasticsearch for downstream data publishing.
\n
• Implement data validation, reconciliation, logging, monitoring, and performance optimization mechanisms.
\n
• Manage source code, deployments, and release processes using Git and CI/CD pipelines.
\n

\n

\n

WHAT YOU BRING

\n

Must Haves

\n

\n
• 3-5 years of experience in Data Engineering, Data Integration, or MDM-related roles.
\n
• Strong hands-on experience with Snowflake, SQL, dbt, Python, and Apache Airflow.
\n
• Experience developing and maintaining ETL/ELT pipelines in cloud-based environments.
\n
• Working knowledge of Azure services, Elasticsearch, and REST APIs.
\n
• Strong understanding of data modeling, data quality frameworks, incremental loading, and SCD Type 2 implementations.
\n
• Experience with Git, CI/CD pipelines, troubleshooting, and production support.
\n
• Understanding of Master Data Management concepts and best practices.
\n
• Strong analytical, problem-solving, and communication skills.
\n

\n

\n

Good to Have

\n

\n
• Prior experience working on MDM platforms and data governance initiatives.
\n
• Healthcare or pharmaceutical domain experience.
\n
• Experience with Snowpark.
\n
• Knowledge of event-driven architectures and modern data processing frameworks.
\n

\n

\n

WHY YOU'LL LIKE IT HERE

\n

\n
• Opportunity to work on enterprise-scale MDM and cloud data platforms.
\n
• Exposure to modern data engineering technologies and architectures.
\n
• Collaborative and innovation-driven work environment.
\n
• Continuous learning and career growth opportunities.
\n
• Flexible hybrid work model.
\n

\n

\n

EQUAL OPPORTUNITY

\n

We are an equal opportunity employer and celebrate diversity. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We are committed to creating an inclusive environment for all employee.

\n