Senior Data Engineer

Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services Position: Senior Data Engineer Location: Bellevue, WA, 98008 Duration: 7 Months Job Type: Temporary Assignment Work Type: Onsite Job Description: We are seeking an experienced Senior Data Engineer to design, build, and optimize production-grade data solutions supporting Identity Resolution (IDR)and large-scale customer data initiatives. The ideal candidate will have proven experience delivering data solutions at billion-record scale, with strong expertise in Azure Databricks, PySpark, Python, Azure Data Factory, and distributed data processing. The role requires strong production-scale engineering judgment-the ability to identify technical and scalability constraints early, evaluate alternatives quickly, and deliver tested, scalable, and production-ready solutions. Experience with Identity Resolution or comparable high-throughput matching systems is highly preferred. Key Responsibilities Design and optimize large-scale data processing solutions capable of operating at 1B+ record scale. Develop scalable data pipelines using Azure Databricks, PySpark, Python, and ADF. Optimize Spark workloads including large-scale joins, partitioning, shuffling, data skew, memory, and compute utilization. Design and improve solutions for Identity Resolution, Entity Resolution, Record Linkage, Deduplication, or similar high-volume matching problems. Evaluate technical approaches against production data volumes and infrastructure constraints. Identify and communicate scalability and environment constraints earlyand recommend viable alternatives. Perform performance and scalability testing using production-like workloads. Build reliable data pipelines with appropriate validation, error handling, monitoring, and recovery mechanisms. Collaborate with architects, engineers, data scientists, and stakeholders to deliver solutions from design through production. Required Qualifications 7+ years of Data Engineering experience. Proven experience working with very large-scale datasets, preferably 1B+ records. Strong hands-on experience with Azure Databricks and PySpark. Strong Python and SQLskills. Experience with Azure Data Factory (ADF) and Azure data services. Strong understanding of distributed processing and Spark performance optimization. Experience delivering production-grade, scalable data solutions. Ability to identify technical constraints early and make timely technical decisions. Strong problem-solving and communication skills. Preferred Qualifications Experience with Identity Resolution / Entity Resolution / Record Linkage / Deduplication / Fuzzy Matching. Experience with Cosmos DB and low-latency APIs. Experience with Azure Functions or Azure Web Apps. Experience with Event Hub, Kafka, or Spark Structured Streaming. ML experience related to matching or customer data. Exposure to Generative AI, LLMs, RAG, or Agentic AI. Telecommunications or large-scale customer data experience. TekWissen Group is an equal opportunity employer supporting workforce diversity. #J-18808-Ljbffr TekWissen LLC