Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer with Databricks and Spark

Tekwissen

Overview:

TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client provider of digital technology and transformation, information technology and services


Position: Data Engineer with Databricks and Spark

Location: Bellevue, WA

Duration: 5 Months

Job Type: Temporary Assignment

Work Type: Onsite/Hybrid

Job Description

  • This role builds, and maintains scalable data pipelines and lakehouse infrastructure on Microsoft Azure to support efficient extraction, transformation, and loading of data across batch and real-time workloads.
  • It involves implementing and managing the Medallion Architecture (Bronze → Silver → Gold) using Azure Data Factory, Databricks-PySpark, and Azure SQL Database and Databricks unity catalogue.
  • The role requires ensuring SLA-adherent data quality standards. Success is measured by pipeline reliability, data freshness SLA compliance, and the quality of Gold-layer datasets powering Power BI executive dashboards.
  • The work supports organizational decision-making by delivering trusted, well-governed data to business executives and analytics consumers.
Required Skills:
  • Experience building and optimizing big data pipelines using Azure Data Factory, PySpark, and SQL across structured and semi-structured data sets
  • Hands-on experience implementing Medallion Architecture (Bronze/Silver/Gold)
  • Experience with Delta Lake - ACID transactions, incremental loading, schema evolution, partitioning strategies
  • Experience performing root cause analysis on pipeline failures and data quality issues to resolve SLA breaches and identify platform improvement opportunities
Azure Foundational Services :
  • Working knowledge of: Azure Data Factory (ADF), ADLS Gen2, Azure SQL Database, Azure Blob Storage, Azure Key Vault, Azure Monitor / Log Analytics, Azure Event Hubs, Microsoft Fabric Lakehouse, Azure Active Directory / Entra ID (RBAC, Service Principals)
Programming Languages:
  • Proficiency in Python and PySpark for data transformation, pipeline automation, and large-scale distributed processing; strong SQL skills including window functions, CTEs, and query optimization across relational and lakehouse engines
Data Architecture:
  • Solid understanding of Medallion Architecture, dimensional modeling (Star Schema, SCD Types 1/2/3), and the trade-offs between lakehouse, data warehouse, and data lake patterns
Pipeline Engineering:
  • Ability to build robust ADF pipelines with ForEach, Lookup, Copy Activity, and Data Flows; incremental loading via watermark or CDC; error handling, retry logic, and dead-letter patterns
Data Quality Experience:
  • Experience implementing SLA-based data quality checks (freshness, completeness, row count), monitoring via Azure Monitor and ADF diagnostic logs, and defining data quality agreements with business stakeholders.
DevOps for Data:
  • Experience with Git-based workflows, ADF Git integration, CI/CD pipeline promotion across Dev/Test/Prod using Azure DevOps or GitHub Actions
Reporting Layer Awareness:
  • Understanding of how Gold-layer data feeds Power BI - DirectQuery vs. Import mode trade-offs, dataset refresh patterns, and semantic model collaboration with BI teams
  • Ability to manage work across multiple concurrent pipeline projects, prioritize by business impact, and communicate status clearly to technical and non-technical stakeholders
Good to have skills:
  • Experience with Microsoft Fabric (Lakehouse, Notebooks, OneLake, Fabric Pipelines) - active migration or greenfield project
  • Experience with real-time / streaming workloads using Azure Event Hubs or Structured Streaming in PySpark
  • Experience delivering data platforms for executive-level reporting via Power BI semantic models

TekWissen® Group is an equal opportunity employer supporting workforce diversity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Databricks and Spark in Bellevue, WA vacancy
  •  ...Data Engineer With Databricks And Spark This role builds, and maintains scalable data pipelines and lakehouse infrastructure on Microsoft Azure to support efficient extraction, transformation, and loading of data across batch and real-time workloads. It involves... 
    Databricks

    Merican

    Bellevue, WA
    2 days ago
  • Robinhood is seeking a Senior Software Engineer for their Data Compute team in Bellevue, WA. This...  ...leading the migration to serverless Databricks and Delta Lake, and ensuring platform...  ...candidates have extensive experience with Spark and data orchestration technologies such... 
    Databricks
    Flexible hours

    Robinhood

    Bellevue, WA
    3 days ago
  • $98k - $198k

    Milliman, Inc is seeking a Senior Data Engineer in Seattle, WA, to enhance data infrastructure. The ideal candidate has 5+ years in data engineering, proficiency in Spark and SQL, and experience with healthcare data. Responsibilities include developing scalable data architectures... 
    Databricks

    Milliman, Inc

    Seattle, WA
    1 day ago
  •  ...Position : Principal - Data Engineer Location: Bellevue WA ( Hybrid) Rate...  ...descriptions : We operate in an Azure + Databricks Lakehouse. We'll need a person with: • Azure experience - ADF for...  ...and is programmed leveraging Spark (PySpark, SparkSQL) •... 
    Databricks

    Georgia IT Inc

    Bellevue, WA
    2 days ago
  •  ...following: # Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (...  ...Technology skills (7/10 or higher): # Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks (preferred) # Hands-on data pipeline... 
    Databricks
    Permanent employment
    Remote work

    Purple Drive

    Bellevue, WA
    1 day ago
  •  ...Data Engineer The Data Foundations team is looking for a Data Engineer...  ...ELT/ETL pipelines using Databricks and dbt; build robust data workflows...  ...in and lead code reviews with a focus on quality and long-term...  ...experience with Databricks (Spark, Delta Lake) and Snowflake.... 
    Databricks

    Merican

    Bellevue, WA
    4 days ago
  •  ...Job Description Launch Your Data Career with Proof, Not Promises-At SynergisticIT...  ...career in Data Science, Analytics, or Engineering , it's time to stop guessing and...  ...Engineering Track: Python/Java, Spark, Airflow, Databricks ETL architecture, Snowflake, S... 
    Databricks

    SynergisticIT

    Bellevue, WA
    1 day ago
  •  ...Lead Data Engineer Overview: TekWissen is a global workforce management...  ...technology decisions across Databricks, Delta Lake, Snowflake, and...  ...pipelines using: Databricks / Spark for large-scale processing Delta...  ...Implement ETL/ELT pipelines with strong data modeling... 
    Databricks
    Temporary work

    Merican

    Bellevue, WA
    2 days ago
  • $125k - $140k

     ...America's top cosmetic surgery specialist, with 185+ board-certified surgeons who have...  ...in the nation. SUMMARY The Data Engineer owns the end-to-end data platform, building...  ...maintain scalable data pipelines in Databricks (Spark SQL, PySpark, Delta Lake). Stand up... 
    Databricks
    Full time

    Sono Bello

    Bellevue, WA
    2 days ago
  • $129.5k - $207k

     ...to the company. The Chewy Ads team is looking for Data Engineer III to help with integrating and processing data from various streams...  ...modern data engineering approach and tools: Airflow, Spark, PySpark, Docker, Databricks, Glue, cloud-native EDW (Snowflake or equivalent),... 
    Databricks
    Local area
    Flexible hours

    Chewy

    Bellevue, WA
    6 hours ago
  • $125k - $160k

     ...Data Engineer Opportunity At Curative AI, Inc. Curative AI, Inc. is...  ...Operations, empowering them with industry-transforming AI technology...  ...and ETL pipelines in Azure Databricks to integrate diverse data...  ...Expertise with Azure Databricks, Spark, Delta Lake, and Azure Data... 
    Databricks
    Full time
    H1b

    Curative AI, Inc.

    Bellevue, WA
    4 days ago
  • $173.1k - $276.8k

     ...and to the world. Progress starts with you. Job Description The Lead Data Engineer is a senior technical leader...  ...distributed data systems using Hadoop, Spark, and modern lakehouse...  ...designs. Advanced proficiency in Databricks, including: • Building and optimizing... 
    Databricks
    Work at office
    Local area

    Visa

    Bellevue, WA
    1 day ago
  • $178.07k - $207k

    Data Engineer III Bellevue, WA - Merchandising & Chewy Brands - Full time...  ...containerized applications with microservices architecture....  ...platforms such as AWS Data platform, Databricks, Cloudera. Experience must...  ...data pipelines using Python, Spark, Spark streaming and Kafka... 
    Databricks
    Full time
    Local area
    Flexible hours

    Chewy

    Bellevue, WA
    2 days ago
  • Unchain Data is seeking a Senior Software Engineer to join the Data Compute team in Bellevue, WA. This role...  ...leading modernization efforts for Spark workloads. Applicants should have extensive experience with large-scale Spark and Databricks, and a proven track record in... 
    Databricks

    Unchain Data

    Bellevue, WA
    5 days ago
  •  ...Job Title The engineers would need to build new dashboards for the data in PDH Should have an understanding of Spark, Python, pyspark with Azure Databricks. The customer would like to interview this week for an immediate start. Please let me know if we have... 
    Databricks
    Immediate start

    ClifyX

    Seattle, WA
    6 hours ago
  •  ...Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark Build and optimize ETL/ELT...  ...performance data lakes Collaborate with data scientists, analysts, and business...  ...in code reviews and mentor junior engineers Diverse Lynx LLC is an Equal... 
    Databricks

    Diverse Lynx

    Seattle, WA
    6 hours ago
  •  ...Sr. Data Engineer- Azure Platform Location: Bellevue, WA Sr. Data Engineer- Azure platform...  ...Data Engineering/Development experience with Very Strong SQL Strong development hands...  ...using ADF and PySpark with Databricks Hands on experience prepare complex SQL... 
    Databricks

    My3Tech Inc

    Bellevue, WA
    3 days ago
  • $129.5k - $207k

     ...to the company. The Chewy Ads team is looking for Data Engineer III to help with integrating and processing data from various streams...  ...modern data engineering approach and tools: Airflow, Spark, PySpark, Docker, Databricks, Glue, cloud-native EDW (Snowflake or equivalent),... 
    Databricks
    Full time
    Local area
    Flexible hours

    Chewy

    Bellevue, WA
    2 days ago
  •  ...Job Description: We are seeking a highly skilled Data Engineer with strong expertise in SQL, Python, Apache Spark, and hands-on experience with Azure cloud services, including Azure Databricks and Azure Synapse Analytics. The ideal candidate will also have exposure... 
    Databricks

    United IT Solutions

    Seattle, WA
    3 days ago
  •  ...Data Engineer Location: Seattle, WA Responsibilities: • Design...  ...ETL workflows using Azure Databricks and PySpark. • Build and...  ...solutions. • Work closely with data architects, analysts, and...  ...pipeline reliability. • Optimize Spark jobs for performance and cost... 
    Databricks

    Diverse Lynx

    Seattle, WA
    2 days ago
  •  ...experience Azure Power BI Knowledge of Azure Data Factory ADLS Individuals with strong technical background in SQL SQL Server data engineering BI Kusto Data Analysis and strong...  ..., Azure SQL, Azure Synapse Analytics, Databricks, Java, Python, Scala, Snowflake... 
    Databricks

    Samprasoft

    Bellevue, WA
    6 hours ago
  •  ...advancement Training & development Role: Data Visualization Engineer — BI Dashboards & Visual Analytics...  ...) who combines strong BI engineering with design intuition to deliver...  ...integrating BI tools with Snowflake, Databricks, BigQuery, Azure Synapse, or Redshift... 
    Databricks
    Work from home
    Flexible hours
    3 days per week

    Globenet Consulting Corp

    Bellevue, WA
    4 days ago
  •  ...Data Engineer Location: Redmond, WA (Open for WFM - Need to work in...  ...data solutions using Apache Spark and Scala. Implement complex...  ...visualization. Collaborate with cross-functional teams to integrate...  ...e.g., Azure Data Lake, Azure Databricks, Synapse Analytics).... 
    Databricks

    Yantran LLC

    Redmond, WA
    14 days ago
  •  ...Data Bricks Data Engineer Location: Seattle, WA / Bellevue, WA / Everett, WA / Renton, WA / Richardson, TX / Plano, TX / Dallas, TX...  ...complex data pipelines in Azure. • Hands-on experience with Azure Databricks: cluster management, job scheduling, workspace governance... 
    Databricks
    Full time

    JConnect Infotech

    Bellevue, WA
    4 days ago
  •  ...Job Role : Data Engineer Location : Bellevue, WA (Remote) Job Type : Full time...  ...and vendors. Empower teams with standardized dashboards, insights, and tooling...  ...such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric... 
    Databricks
    Permanent employment
    Full time
    Remote work
    Shift work

    AceStack LLC

    Bellevue, WA
    1 day ago
  •  ...Data Engineer Location: Seattle, WA (Hybrid) Position Type: Contract C2C Client...  ...strategy. You will work closely with other data engineers, analysts, data...  ...services (Azure Data Factory, Azure Databricks, Azure Function, Spark, Azure Blob/ADLS, Azure SQL, Snowflake... 
    Databricks
    Contract work

    Argyle Infotech

    Seattle, WA
    4 days ago
  •  ...We are seeking an experienced Data Engineer specializing in Databricks platform for a 6-month contract position...  ...COLLABORATION & COMMUNICATION Collaborate with cross-functional teams to support...  ...Databricks Unity Catalog Spark and PySpark programming... 
    Databricks
    Contract work
    Flexible hours

    Purple Drive

    Seattle, WA
    4 days ago
  •  ...Data Engineer With Databricks, SQL Our team builds and maintains data products within the Care & Retail domain, delivering reliable, scalable solutions that power easy & actionable insights across Consumer reporting. We support performance management, operational visibility... 
    Databricks
    Work experience placement
    Flexible hours

    Merican

    Bellevue, WA
    6 hours ago
  • $100k

     ...industry. We focus on equipping you with the skills and experience...  ..., Computer Science or Engineering or candidates with gaps in their...  ...REST API's experience For data Science/Data Engineer, Data Analyst...  ...Knowledge of Statistics, Databricks, Snowflake, Pyspark, PowerBI,... 
    Databricks
    H1b

    SynergisticIT

    Bellevue, WA
    3 days ago
  •  ...Overview: Data Engineer II - Global Marketing Technology Who we...  ...effectively personalize interactions with our guests. We are looking...  ...(GCP), Azure Cloud, Azure Databricks, Snowflake ? Includes...  ...Streaming - Kafka, EventHub, Spark, Snowflake Streaming • DevOps... 
    Databricks

    Voluble Systems LLC

    Seattle, WA
    6 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer with Databricks and Spark. Be the first to apply!