Databricks QA / Data Testing Consultant -

Job Description

Job Description

Job Title: Databricks QA / Data Testing Consultant
Location: Frederick MD
Duration: 6 months (Extendable)
Pay Range: $60-65/Hour on W2/C2C (All Inclusive)
Request ID: 114927 -1

Position Summary:
Key Skills & Experience:Strong experience in Functional| Integration| Regression| and UAT testingStrong SQL and data validation/testing skillsExperience testing data pipelines| ETL processes| ADF| Databricks| or Azure data platformsExperience with AI-assisted test automation| test data generation| or Azure AI servicesExposure to test automation frameworks and toolsExperience with defect tracking and test management toolsAgile delivery experienceStrong stakeholder communication and coordination skillsPreferred: experience Insurance| US GAAP| IFRS| Finance Transformation| or Regulatory Reporting background
Essential Skills: Key Skills & Experience:Strong experience in Functional| Integration| Regression| and UAT testingStrong SQL and data validation/testing skillsExperience testing data pipelines| ETL processes| ADF| Databricks| or Azure data platformsExperience with AI-assisted test automation| test data generation| or Azure AI servicesExposure to test automation frameworks and toolsExperience with defect tracking and test management toolsAgile delivery experienceStrong stakeholder communication and coordination skillsPreferred:Banner Life / MYNA experienceInsurance| US GAAP| IFRS| Finance Transformation| or Regulatory Reporting background

Skills: Digital : Databricks
Experience Required: 8-10

Responsibilities
" Design, develop, and maintain scalable, high-performance data engineering solutions on Azure Databricks.
" Build and support batch and real-time data pipelines using Apache Spark and Structured Streaming.
" Design and implement Lakehouse and Medallion Architecture (Bronze, Silver, Gold) using Delta Lake.
" Develop reusable ETL/ELT frameworks, standardized data processing components, and enterprise data ingestion patterns.
" Ingest and process large-scale data from diverse enterprise sources, including databases, APIs, message queues, and file-based systems.
" Develop complex data transformation logic using PySpark, Python, and SQL.
" Create trusted, governed, and consumption-ready datasets for reporting, analytics, and downstream applications.
" Implement data quality, validation, reconciliation, audit, and governance controls across data pipelines.
" Manage and optimize Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Databricks SQL.
" Collaborate with business, analytics, architecture, and delivery teams in an Agile environment to deliver high-quality data products.
Required Technical Skills:
Databricks & Data Engineering
" Strong hands-on experience with Databricks, Lakehouse Architecture, and Delta Lake
" Expertise in PySpark, Python, and advanced SQL
" Experience with Apache Spark, Structured Streaming, Delta Live Tables (DLT), Databricks Workflows, and Unity Catalog
" Experience designing and implementing Medallion Architecture and modern Data Lake/Data Warehouse solutions
" Strong background in data ingestion, ETL/ELT, data transformation, optimization, and deployment practices
" Experience with event-driven and streaming technologies such as Kafka or Azure Event Hub
Cloud Platforms
" Client Azure (preferred)
" AWS or GCP experience is also valuable
Application Integration
" Working knowledge of React and/or Angular for front-end integration and data-centric application development
Domain Experience (Preferred)
" Experience in Finance, Insurance, Regulatory Reporting, or US GAAP reporting
" Understanding of financial data models, reporting processes, and governance requirements is highly desirable