Azure Databricks Data Engineer
Artech LLC
Job Description
Job Description
Job Title : Azure Databricks Data Engineer
Location: Frederick, MD – 100% Onsite
Duration: 6 Months
Applicants must be willing to work on W2.
Role Description:
Responsibilities
- Design, develop, and maintain scalable, high-performance data engineering solutions on Azure Databricks.
- Build and support batch and real-time data pipelines using Apache Spark and Structured Streaming.
- Design and implement Lakehouse and Medallion Architecture (Bronze, Silver, Gold) using Delta Lake.
- Develop reusable ETL/ELT frameworks, standardized data processing components, and enterprise data ingestion patterns.
- Ingest and process large-scale data from diverse enterprise sources, including databases, APIs, message queues, and file-based systems.
- Develop complex data transformation logic using PySpark, Python, and SQL.
- Create trusted, governed, and consumption-ready datasets for reporting, analytics, and downstream applications.
- Implement data quality, validation, reconciliation, audit, and governance controls across data pipelines.
- Manage and optimize Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Databricks SQL.
- Collaborate with business, analytics, architecture, and delivery teams in an Agile environment to deliver high-quality data products.
Databricks & Data Engineering
- Strong hands-on experience with Databricks, Lakehouse Architecture, and Delta Lake.
- Expertise in PySpark, Python, and advanced SQL.
- Experience with Apache Spark, Structured Streaming, Delta Live Tables (DLT), Databricks Workflows, and Unity Catalog.
- Experience designing and implementing Medallion Architecture and modern Data Lake/Data Warehouse solutions.
- Strong background in data ingestion, ETL/ELT, data transformation, optimization, and deployment practices.
- Experience with event-driven and streaming technologies such as Kafka or Azure Event Hub.
- Microsoft Azure (preferred).
- AWS or GCP experience is also valuable.
- Working knowledge of React and/or Angular for front-end integration and data-centric application development.
- Experience in Finance, Insurance, Regulatory Reporting, or US GAAP reporting.
- Understanding of financial data models, reporting processes, and governance requirements is highly desirable.
- 7+ years in Azure Databricks.
- 7+ years in PySpark.
- 7+ years in Python.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Data Engineer in Frederick, MD vacancy
- ...Job Description Job Description Request ID: 114928-1 Title: Azure Databricks Data Engineer Locations: Frederick, MD Duration: 06 Months Pay Range: $45-$50/Hour on W2/C2C (All inclusive) We are seeking a highly skilled Senior Azure Databricks Data Engineer...Databricks
$143.76k - $269.55k
...Agilent seeks an Analytics Engineering Lead to transform raw operational data into trusted business assets supporting executive decision-making across global... ...with modern cloud platforms: Microsoft Fabric, Databricks, Snowflake, or equivalent ~ Demonstrated expertise...Databricks$111.3k - $186.1k
...will work with highly motivated experts and innovators in the data center industry. You will be responsible for troubleshooting, project... ...BASIC QUALIFICATIONS - Bachelor's degree in Electrical Engineering, Mechanical Engineering, or a related field - Bachelor's...SuggestedLocal areaImmediate startFlexible hoursAmazon Data Services, Inc.
Frederick, MD13 hours ago- ...Role 1 Data Scientist Urbana, MD Contract Role Description: "Python Spark Efficient data manipulation... ...API Great coding practice Communication Nice to have Databricks Sentiment analysis Insurance especially commercial claims experience...DatabricksContract workImmediate start
Syntricate Technologies
Frederick, MD1 day ago - ...with expertise in Power BI, Tableau, and Data Engineering to design and develop advanced... ...architect-level experience in BI tools and Azure data services.Key Responsibilities:Design... ...pipelines using Azure Data Factory (ADF) and Databricks for data transformation and integration...Databricks
AceStack LLC
Frederick, MD3 days ago - ...Engineering Operations TechnicianHow would you like to be a part of Earth's most customer-centric company? You would work with teams of front... ...support the operations of some of the world's most powerful data centers. Our Data Center Engineering Operations team maintain and...For contractorsFor subcontractorWork at officeLocal areaShift workNight shiftWeekend workDay shift3 days per week1 day per weekWeekday work
A W S
Frederick, MD3 days ago - ...Description Job Description Job Title: Databricks QA / Data Testing Consultant Location:... ...pipelines| ETL processes| ADF| Databricks| or Azure data platformsExperience with AI-... ...scalable, high-performance data engineering solutions on Azure Databricks. " Build...Databricks
Artech LLC
Frederick, MD3 days ago - ...AWS Data Center Controls Team Member As part of the global controls team, you will work with highly motivated experts and innovators... ...Basic Qualifications: ~ Bachelor's degree in Electrical Engineering, Mechanical Engineering, or a related field ~ Bachelor's...Local areaImmediate start
A W S
Frederick, MD4 days ago $150k
...Senior Data Center Automation Engineer | BAS / SCADA / EPMS Remote-Based | Up to 50% Travel to Maryland, Iowa, Georgia| Up to $150,000 DOE Sponsorship now or in the future is not available with this position Work on the systems powering some of the most advanced...Full timeFor contractorsRemote workRelocationVantage Consulting
Frederick, MD13 hours ago- Epic seeks an Integration Project Engineer for their Madison, WI campus. This role requires significant travel across the U.S. to support the implementation of Epic systems within top health organizations. With a bachelor's degree in a relevant engineering or technical...Relocation package
$75k - $150k
...New grad or seasoned controls engineer, there's a seat for you: earn $75K-$150K programming PLCs, BAS logic and Ignition SCADA dashboards for hyperscale data centers in Frederick, MD, with real mentorship and an in-house training center. This Jobot Job is hosted by:...Temporary workLocal area$140k - $155k
...translational research, biomedical informatics, and data science applications to research centers... ...experts in biomedical science, software engineering, and program management, we focus on... ...multi-cloud environment across AWS, Azure, and GCP, building a scalable, secure, and...Local areaFlexible hoursAxle Inc
Frederick, MD2 days ago- ...you’ll help share the client's marketing data strategy. This includes driving data... ...with cross-functional teams such as IT and engineering to integrate data from various sources into... ...working within data platforms like Databricks/Snowflake, and analytics modeling platforms...DatabricksFull time
FocusKPI
Frederick, MD3 days ago $18 - $50 per hour
...university graduation and completion of the program Position Overview: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and Digital Thread initiatives within the Capital PreSales organization....Remote jobHourly payFull timeInternshipLocal areaSiemens
Frederick, MD2 days ago- Edgewater Federal Solutions, Inc. seeks a Microsoft Security Engineer to administer and monitor security controls across Microsoft 365, Entra ID, and Azure. The role supports identity security, vulnerability remediation, and incident response in hybrid environments with...Remote job
- Edgewater Federal Solutions is seeking a Microsoft Security Engineer to administer and monitor security controls across Microsoft 365, Entra ID, and Azure. You will investigate alerts, coordinate remediation, and support governance and compliance initiatives. The role...Remote job
$60k - $140k
...Lead or Field Automation Supervisor About the Role Albireo Energy is seeking Field Automation Engineers at all experience levels to support mission-critical data center projects in Frederick, Maryland. This role is ideal for professionals ranging from early-career...Temporary workFor subcontractorLocal areaAlbireo Energy
Frederick, MD9 days ago- ...Description Job Description Job Title: Five9 Contact Center Engineer Location: Frederick MD Duration: 6 months (Extendable)... ...with enterprise systems like CRM platforms| databases| and AWS or Azure cloud services.Testing & Troubleshooting: Diagnose complex...
Artech LLC
Frederick, MD3 days ago - ...Insurance Company in Frederick, MD is seeking a Principal Software Engineer to design and build leading digital life-insurance platforms.... ...C#, .NET, distributed systems experience, and cloud skills (Azure). This hybrid opportunity offers a competitive compensation package...
$127.5k - $170k
...Senior Network Engineer Location Frederick, MD (Hybrid) Compensation $127,5... ...support hybrid cloud networking, including Azure hub-and-spoke architectures, routing, and... ...Application Development, Infrastructure, Data, and Product teams to deliver secure and...Piper Companies
Frederick, MD13 hours ago$32.88 - $57.5 per hour
...Description Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations...Hourly payFor contractorsFor subcontractorH1bLocal areaRelocationShift workAmazon
Frederick, MD4 days ago$27.98 - $48.99 per hour
Job ID: 10541919 | Amazon Data Services, Inc. - A19 This is an exciting opportunity to be part of the launch team for our new Fredericksburg... ...You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations...Hourly payDay shiftAfternoon shift$55 - $65 per hour
...solving skills . Ability to work effectively in a challenging, fast-paced environment . Preferred Experience with Azure Cloud, AKS, OpenShift, and containerized applications . Knowledge of modern DevOps and cloud-native development practices ....Diverse Lynx
Frederick, MD22 hours ago$109.62k - $126.79k
...govern secure, scalable, and highly available Azure cloud architectures, ensuring alignment... ...and Accountability Act (HIPAA), General Data Protection Regulation (GDPR), Payment... ...integrity A proven ability to mentor engineers, architects, and technical teams while fostering...Full timeRemote workSyms Strategic Group, LLC (SSG)
Frederick, MD3 days ago- ...followed| so that the Company and our customers keep our and their data as safe as possible.Advanced knowledge of Continuous Integration... ..., AKS, OpenShift etc. • Cloud based infrastructure, e.g., Azure. • Workflow: versioning, branching, merging, pull requests •...
Real Soft
Frederick, MD4 days ago $30.91 - $54.18 per hour
...Data Center Technician Join our dynamic AWS team and become a critical guardian of global cloud infrastructure! You'll play a pivotal... ...You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations...Hourly payFor contractorsH1bWork at officeWorldwideRelocationFlexible hoursShift workNight shiftDay shiftA W S
Frederick, MD4 days ago$120k - $150k
...Piper Companies is seeking a Application Engineer to join a life insurance company located in Frederick, MD. This offers 2 remote... ...Core frameworks Experience building cloud-native applications (Azure preferred; AWS/GCP acceptable) Containerization tools such...Remote work2 days per weekPiper Companies
Frederick, MD1 day ago- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Frederick, MD3 days ago $107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Frederick, MD3 days ago- ThompsonGas seeks a Marketing Lifecycle Manager - On-Site in Frederick, MD to drive digital email marketing strategies and lifecycle automation. You will own campaigns from design to results, optimize journeys, and deliver measurable impact on conversion, retention, and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Frederick, MD
- data engineering intern summer Frederick, MD
- data science developer Frederick, MD
- data center engineer Frederick, MD
- data developer Frederick, MD
- data engineer machine learning Frederick, MD
- data engineer Frederick, MD
- data engineer analytics Frederick, MD
- finance data engineer Frederick, MD
- health data Frederick, MD