Data Engineer with Databricks and Spark
Tekwissen
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services
Position: Data Engineer with Databricks and Spark Location: Bellevue, WA Duration: 5 Months Job Type: Temporary Assignment Work Type: Onsite/Hybrid Job Description
Position: Data Engineer with Databricks and Spark Location: Bellevue, WA Duration: 5 Months Job Type: Temporary Assignment Work Type: Onsite/Hybrid Job Description
- This role builds, and maintains scalable data pipelines and lakehouse infrastructure on Microsoft Azure to support efficient extraction, transformation, and loading of data across batch and real-time workloads.
- It involves implementing and managing the Medallion Architecture (Bronze → Silver → Gold) using Azure Data Factory, Databricks-PySpark, and Azure SQL Database and Databricks unity catalogue.
- The role requires ensuring SLA-adherent data quality standards. Success is measured by pipeline reliability, data freshness SLA compliance, and the quality of Gold-layer datasets powering Power BI executive dashboards.
- The work supports organizational decision-making by delivering trusted, well-governed data to business executives and analytics consumers.
- Experience building and optimizing big data pipelines using Azure Data Factory, PySpark, and SQL across structured and semi-structured data sets
- Hands-on experience implementing Medallion Architecture (Bronze/Silver/Gold)
- Experience with Delta Lake - ACID transactions, incremental loading, schema evolution, partitioning strategies
- Experience performing root cause analysis on pipeline failures and data quality issues to resolve SLA breaches and identify platform improvement opportunities
- Working knowledge of: Azure Data Factory (ADF), ADLS Gen2, Azure SQL Database, Azure Blob Storage, Azure Key Vault, Azure Monitor / Log Analytics, Azure Event Hubs, Microsoft Fabric Lakehouse, Azure Active Directory / Entra ID (RBAC, Service Principals)
- Proficiency in Python and PySpark for data transformation, pipeline automation, and large-scale distributed processing; strong SQL skills including window functions, CTEs, and query optimization across relational and lakehouse engines
- Solid understanding of Medallion Architecture, dimensional modeling (Star Schema, SCD Types 1/2/3), and the trade-offs between lakehouse, data warehouse, and data lake patterns
- Ability to build robust ADF pipelines with ForEach, Lookup, Copy Activity, and Data Flows; incremental loading via watermark or CDC; error handling, retry logic, and dead-letter patterns
- Experience implementing SLA-based data quality checks (freshness, completeness, row count), monitoring via Azure Monitor and ADF diagnostic logs, and defining data quality agreements with business stakeholders.
- Experience with Git-based workflows, ADF Git integration, CI/CD pipeline promotion across Dev/Test/Prod using Azure DevOps or GitHub Actions
- Understanding of how Gold-layer data feeds Power BI - DirectQuery vs. Import mode trade-offs, dataset refresh patterns, and semantic model collaboration with BI teams
- Ability to manage work across multiple concurrent pipeline projects, prioritize by business impact, and communicate status clearly to technical and non-technical stakeholders
- Experience with Microsoft Fabric (Lakehouse, Notebooks, OneLake, Fabric Pipelines) - active migration or greenfield project
- Experience with real-time / streaming workloads using Azure Event Hubs or Structured Streaming in PySpark
- Experience delivering data platforms for executive-level reporting via Power BI semantic models
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Databricks and Spark in Bellevue, WA vacancy
- ...Data Engineer With Databricks And Spark This role builds, and maintains scalable data pipelines and lakehouse infrastructure on Microsoft Azure to support efficient extraction, transformation, and loading of data across batch and real-time workloads. It involves...Databricks
- Robinhood is seeking a Senior Software Engineer for their Data Compute team in Bellevue, WA. This... ...leading the migration to serverless Databricks and Delta Lake, and ensuring platform... ...candidates have extensive experience with Spark and data orchestration technologies such...DatabricksFlexible hours
$98k - $198k
Milliman, Inc is seeking a Senior Data Engineer in Seattle, WA, to enhance data infrastructure. The ideal candidate has 5+ years in data engineering, proficiency in Spark and SQL, and experience with healthcare data. Responsibilities include developing scalable data architectures...Databricks- ...Position : Principal - Data Engineer Location: Bellevue WA ( Hybrid) Rate... ...descriptions : We operate in an Azure + Databricks Lakehouse. We'll need a person with: • Azure experience - ADF for... ...and is programmed leveraging Spark (PySpark, SparkSQL) •...Databricks
- ...following: # Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (... ...Technology skills (7/10 or higher): # Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks (preferred) # Hands-on data pipeline...DatabricksPermanent employmentRemote work
- ...Data Engineer The Data Foundations team is looking for a Data Engineer... ...ELT/ETL pipelines using Databricks and dbt; build robust data workflows... ...in and lead code reviews with a focus on quality and long-term... ...experience with Databricks (Spark, Delta Lake) and Snowflake....Databricks
- ...Job Description Launch Your Data Career with Proof, Not Promises-At SynergisticIT... ...career in Data Science, Analytics, or Engineering , it's time to stop guessing and... ...Engineering Track: Python/Java, Spark, Airflow, Databricks ETL architecture, Snowflake, S...Databricks
- ...Lead Data Engineer Overview: TekWissen is a global workforce management... ...technology decisions across Databricks, Delta Lake, Snowflake, and... ...pipelines using: Databricks / Spark for large-scale processing Delta... ...Implement ETL/ELT pipelines with strong data modeling...DatabricksTemporary work
$125k - $140k
...America's top cosmetic surgery specialist, with 185+ board-certified surgeons who have... ...in the nation. SUMMARY The Data Engineer owns the end-to-end data platform, building... ...maintain scalable data pipelines in Databricks (Spark SQL, PySpark, Delta Lake). Stand up...DatabricksFull time$129.5k - $207k
...to the company. The Chewy Ads team is looking for Data Engineer III to help with integrating and processing data from various streams... ...modern data engineering approach and tools: Airflow, Spark, PySpark, Docker, Databricks, Glue, cloud-native EDW (Snowflake or equivalent),...DatabricksLocal areaFlexible hours$125k - $160k
...Data Engineer Opportunity At Curative AI, Inc. Curative AI, Inc. is... ...Operations, empowering them with industry-transforming AI technology... ...and ETL pipelines in Azure Databricks to integrate diverse data... ...Expertise with Azure Databricks, Spark, Delta Lake, and Azure Data...DatabricksFull timeH1b$173.1k - $276.8k
...and to the world. Progress starts with you. Job Description The Lead Data Engineer is a senior technical leader... ...distributed data systems using Hadoop, Spark, and modern lakehouse... ...designs. Advanced proficiency in Databricks, including: • Building and optimizing...DatabricksWork at officeLocal area$178.07k - $207k
Data Engineer III Bellevue, WA - Merchandising & Chewy Brands - Full time... ...containerized applications with microservices architecture.... ...platforms such as AWS Data platform, Databricks, Cloudera. Experience must... ...data pipelines using Python, Spark, Spark streaming and Kafka...DatabricksFull timeLocal areaFlexible hours- Unchain Data is seeking a Senior Software Engineer to join the Data Compute team in Bellevue, WA. This role... ...leading modernization efforts for Spark workloads. Applicants should have extensive experience with large-scale Spark and Databricks, and a proven track record in...Databricks
- ...Job Title The engineers would need to build new dashboards for the data in PDH Should have an understanding of Spark, Python, pyspark with Azure Databricks. The customer would like to interview this week for an immediate start. Please let me know if we have...DatabricksImmediate start
- ...Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark Build and optimize ETL/ELT... ...performance data lakes Collaborate with data scientists, analysts, and business... ...in code reviews and mentor junior engineers Diverse Lynx LLC is an Equal...Databricks
- ...Sr. Data Engineer- Azure Platform Location: Bellevue, WA Sr. Data Engineer- Azure platform... ...Data Engineering/Development experience with Very Strong SQL Strong development hands... ...using ADF and PySpark with Databricks Hands on experience prepare complex SQL...Databricks
$129.5k - $207k
...to the company. The Chewy Ads team is looking for Data Engineer III to help with integrating and processing data from various streams... ...modern data engineering approach and tools: Airflow, Spark, PySpark, Docker, Databricks, Glue, cloud-native EDW (Snowflake or equivalent),...DatabricksFull timeLocal areaFlexible hours- ...Job Description: We are seeking a highly skilled Data Engineer with strong expertise in SQL, Python, Apache Spark, and hands-on experience with Azure cloud services, including Azure Databricks and Azure Synapse Analytics. The ideal candidate will also have exposure...Databricks
- ...Data Engineer Location: Seattle, WA Responsibilities: • Design... ...ETL workflows using Azure Databricks and PySpark. • Build and... ...solutions. • Work closely with data architects, analysts, and... ...pipeline reliability. • Optimize Spark jobs for performance and cost...Databricks
- ...experience Azure Power BI Knowledge of Azure Data Factory ADLS Individuals with strong technical background in SQL SQL Server data engineering BI Kusto Data Analysis and strong... ..., Azure SQL, Azure Synapse Analytics, Databricks, Java, Python, Scala, Snowflake...Databricks
- ...advancement Training & development Role: Data Visualization Engineer — BI Dashboards & Visual Analytics... ...) who combines strong BI engineering with design intuition to deliver... ...integrating BI tools with Snowflake, Databricks, BigQuery, Azure Synapse, or Redshift...DatabricksWork from homeFlexible hours3 days per week
- ...Data Engineer Location: Redmond, WA (Open for WFM - Need to work in... ...data solutions using Apache Spark and Scala. Implement complex... ...visualization. Collaborate with cross-functional teams to integrate... ...e.g., Azure Data Lake, Azure Databricks, Synapse Analytics)....Databricks
- ...Data Bricks Data Engineer Location: Seattle, WA / Bellevue, WA / Everett, WA / Renton, WA / Richardson, TX / Plano, TX / Dallas, TX... ...complex data pipelines in Azure. • Hands-on experience with Azure Databricks: cluster management, job scheduling, workspace governance...DatabricksFull time
- ...Job Role : Data Engineer Location : Bellevue, WA (Remote) Job Type : Full time... ...and vendors. Empower teams with standardized dashboards, insights, and tooling... ...such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric...DatabricksPermanent employmentFull timeRemote workShift work
- ...Data Engineer Location: Seattle, WA (Hybrid) Position Type: Contract C2C Client... ...strategy. You will work closely with other data engineers, analysts, data... ...services (Azure Data Factory, Azure Databricks, Azure Function, Spark, Azure Blob/ADLS, Azure SQL, Snowflake...DatabricksContract work
- ...We are seeking an experienced Data Engineer specializing in Databricks platform for a 6-month contract position... ...COLLABORATION & COMMUNICATION Collaborate with cross-functional teams to support... ...Databricks Unity Catalog Spark and PySpark programming...DatabricksContract workFlexible hours
- ...Data Engineer With Databricks, SQL Our team builds and maintains data products within the Care & Retail domain, delivering reliable, scalable solutions that power easy & actionable insights across Consumer reporting. We support performance management, operational visibility...DatabricksWork experience placementFlexible hours
$100k
...industry. We focus on equipping you with the skills and experience... ..., Computer Science or Engineering or candidates with gaps in their... ...REST API's experience For data Science/Data Engineer, Data Analyst... ...Knowledge of Statistics, Databricks, Snowflake, Pyspark, PowerBI,...DatabricksH1b- ...Overview: Data Engineer II - Global Marketing Technology Who we... ...effectively personalize interactions with our guests. We are looking... ...(GCP), Azure Cloud, Azure Databricks, Snowflake ? Includes... ...Streaming - Kafka, EventHub, Spark, Snowflake Streaming • DevOps...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Databricks and Spark. Be the first to apply!
Related searches
- director data engineering Bellevue, WA
- junior big data engineer Bellevue, WA
- senior data engineer Bellevue, WA
- data platform engineer Bellevue, WA
- sr information security engineer Bellevue, WA
- senior data integration developer Bellevue, WA
- data developer Bellevue, WA
- data engineer Bellevue, WA
- data infrastructure engineer Bellevue, WA
- entry level big data engineer Bellevue, WA

