Data Engineer

Position: Data Engineer

Location:Frisco, TX, Overland Park, KS

Duration:6+ Months

Work Type:Onsite

Payrate:$50.00 - 50.00/hr.

Overview:

TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services

Job Description:

• The enriched datasets are consumed by multiple downstream systems and teams, including the Customer Data Platform (CDP) and other analytics/research stakeholders.
• The platform is Azure-native and built primarily on Databricks (processing + some ML workloads) and Snowflake (analytics/warehouse).
• A major focus is building reliable, governed, vendor agnostic datasets while ensuring privacy/compliance, data governance, and cost efficiency.

Key Responsibilities:

• As a Data Engineer, you will: Data Ingestion & Pipeline Development Build and enhance ingestion pipelines for large batch and event-driven paths .
• Integrate data from: Third party enrichment vendors
• Digital platforms via Conversion API integrations Rewards/Promotions systems for offer issuance/redemption/consumption data Data Quality, Reliability & Operations
• Implement strong data validation, idempotency, replay/backfill strategies, and deduplication to prevent quality drift.
• Own monitoring, alerting, dashboarding, and operational readiness.
• Troubleshoot failures with root cause analysis not just reruns: Interpret Spark logs Diagnose performance issues
• Improve stability and SLA adherence Governance & Compliance
• Apply privacy, compliance, and governance requirements across pipelines and datasets.
• Support governance standards such as: Unity Catalog, lineage, access controls Managing PII vs non PII access
• Documentation of tables, schemas, catalogs, and cluster usage Cost Governance & Performance Optimization
• Design pipelines with cost awareness from day one: Cluster sizing, workload tuning, efficient compute/storage usage
• Trade-off decisions balancing cost vs quality vs SLA Collaboration & Ownership Work in a small, fast-moving team; be self-driven and ownership-oriented.
• Raise and manage data quality escalations when issues are detected.
• Contribute to evolving architecture (product is early-stage; first live month was recent).

Must-Have Skills :

• Recruiters should prioritize candidates with hands-on,
• Recent experience in: Strong coding: PySpark + SQL
• Databricks: notebooks/jobs, performance tuning fundamentals, medallion patterns Spark fundamentals: partitioning, skew/shuffle optimization, understanding failures via logs
• Snowflake: data modeling/usage for analytics/warehousing workloads Azure ecosystem: Azure Data Factory Azure-native integrations and services exposure
• Data engineering reliability patterns: validation, idempotency, replay/backfills, dedup,
• Auditability Data governance: Unity Catalog lineage, access control patterns.

TekWissen® Group is an equal opportunity employer supporting workforce diversity.