Lead Data Integration Engineer

Role Description

Lead Data Integration Engineer positions offered by Kimberly-Clark USA, LLC (Irving, Texas). Work with Technical Architects, Product Owners and Business teams to translate requirements into technical design for data modelling and data integration.

• Utilize background in data warehousing, data modelling and ETL/ELT data processing patterns.
• Design and develop ETL/ELT pipelines with reusable patterns and frameworks.
• Design and build efficient SQLs to process and curate the data sets in HANA, Azure and Snowflake.
• Design and review data ingestion frameworks leveraging Python, Spark, Azure Data Factory, Snowpipe, etc.
• Design and build Data Quality models and ABCR frameworks to ingest, validate, curate and prepare the data for consumption.
• Review functional domain and business needs and identify the gaps in the requirements proactively prior to implementing solutions.
• Work with platform teams to design and build processes for automation in pipeline build, testing and code migrations.

Qualifications

• Requires a bachelor’s or foreign equivalent degree in computer science, applied computer science, IT or a related field.
• 10 years of experience in the job offered or 10 years of experience designing, developing, and building ETL/ELT pipelines, procedures, and SQLs on MPP platforms including HANA, Snowflake, Greenplum, or Teradata.
• 5 years of experience designing and building metadata driven data ingestion frameworks.
• Experience with building SAP BO/Data Services, Azure Data Factory, SnowSQL, and Snowpipe.
• Experience with building mini-batch, real-time and event-driven data processing jobs.
• Experience designing and developing object stores (including Azure ADLS, HDFS, and GCP Cloud Storage).
• Experience with Row and Columnar databases (including Azure SQL DW, SQL Server, Snowflake, Teradata, PostgresSQL, and Oracle).
• Experience with NoSQL databases (including CosmosDB, MongoDB, and Cassandra), ElasticSearch, Redis, and Data processing platforms Spark, Databricks, and SnowSQL.
• Experience leveraging Azure Stream Analytics, Azure Analysis Services, Data Lake Analytics, HDInsight, HDP, Spark, Databricks, MapReduce, Pig, Hive, Tez, SSAS, Watson Analytics, and SPSS for Data Analytics development and solution architecture.

Requirements

• Employee reports to office in Irving, TX, but may telecommute from anywhere in the U.S.
• Experience may be, but need not be, acquired concurrently.

Benefits

• Eligibility for a target bonus.
• Comprehensive benefits suite, including 401(k) and Profit Sharing plan.

Salary Range

$187,600 - $187,600 USD

The anticipated base pay range for this role is provided above for a fully qualified hire. Actual pay will depend on several factors, such as location, role, skills, performance, and experience. Please note that the stated pay range applies to US locations only.