Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Databricks & Data Engineering

Q1 Technologies, Inc

Job Description

Job Description

Role Descriptions: Design| develop| and maintain scalable| high-performance data engineering solutions on Azure Databricks.Build and support batch and real-time data pipelines using Apache Spark and Structured Streaming.Design and implement Lakehouse and Medallion Architecture (Bronze| Silver| Gold) using Delta Lake.Develop reusable ETL/ELT frameworks| standardized data processing components| and enterprise data ingestion patterns.Ingest and process large-scale data from diverse enterprise sources| including databases| APIs| message queues| and file-based systems.Develop complex data transformation logic using PySpark| Python| and SQL.Create trusted| governed| and consumption-ready datasets for reporting| analytics| and downstream applications.Implement data quality| validation| reconciliation| audit| and governance controls across data pipelines.Manage and optimize Databricks Workflows| Delta Live Tables (DLT)| Unity Catalog| and Databricks SQL.Collaborate with business| analytics| architecture| and delivery teams in an Agile environment to deliver high-quality data products. Required Technical Skills:Databricks & Data EngineeringStrong hands-on experience with Databricks| Lakehouse Architecture| and Delta LakeExpertise in PySpark| Python| and advanced SQLExperience with Apache Spark| Structured Streaming| Delta Live Tables (DLT)| Databricks Workflows| and Unity CatalogExperience designing and implementing Medallion Architecture and modern Data Lake/Data Warehouse solutionsStrong background in data ingestion| ETL/ELT| data transformation| optimization| and deployment practicesExperience with event-driven and streaming technologies such as Kafka or Azure Event HubCloud PlatformsMicrosoft Azure (preferred)AWS or GCP experience is also valuableApplication IntegrationWorking knowledge of React and/or Angular for front-end integration and data-centric application developmentDomain Experience (Preferred)Experience in Finance| Insurance| Regulatory Reporting| or US GAAP reportingUnderstanding of financial data models| reporting processes| and governance requirements is highly desirable Essential Skills: Design| develop| and maintain scalable| high-performance data engineering solutions on Azure Databricks.Build and support batch and real-time data pipelines using Apache Spark and Structured Streaming.Design and implement Lakehouse and Medallion Architecture (Bronze| Silver| Gold) using Delta Lake.Develop reusable ETL/ELT frameworks| standardized data processing components| and enterprise data ingestion patterns.Ingest and process large-scale data from diverse enterprise sources| including databases| APIs| message queues| and file-based systems.Develop complex data transformation logic using PySpark| Python| and SQL.Create trusted| governed| and consumption-ready datasets for reporting| analytics| and downstream applications.Implement data quality| validation| reconciliation| audit| and governance controls across data pipelines.Manage and optimize Databricks Workflows| Delta Live Tables (DLT)| Unity Catalog| and Databricks SQL.Collaborate with business| analytics| architecture| and delivery teams in an Agile environment to deliver high-quality data products. Required Technical Skills:Databricks & Data EngineeringStrong hands-on experience with Databricks| Lakehouse Architecture| and Delta LakeExpertise in PySpark| Python| and advanced SQLExperience with Apache Spark| Structured Streaming| Delta Live Tables (DLT)| Databricks Workflows| and Unity CatalogExperience designing and implementing Medallion Architecture and modern Data Lake/Data Warehouse solutionsStrong background in data ingestion| ETL/ELT| data transformation| optimization| and deployment practicesExperience with event-driven and streaming technologies such as Kafka or Azure Event HubCloud PlatformsMicrosoft Azure (preferred)AWS or GCP experience is also valuableApplication IntegrationWorking knowledge of React and/or Angular for front-end integration and data-centric appl


Responsibilities
" Design, develop, and maintain scalable, high-performance data engineering solutions on Azure Databricks.
" Build and support batch and real-time data pipelines using Apache Spark and Structured Streaming.
" Design and implement Lakehouse and Medallion Architecture (Bronze, Silver, Gold) using Delta Lake.
" Develop reusable ETL/ELT frameworks, standardized data processing components, and enterprise data ingestion patterns.
" Ingest and process large-scale data from diverse enterprise sources, including databases, APIs, message queues, and file-based systems.
" Develop complex data transformation logic using PySpark, Python, and SQL.
" Create trusted, governed, and consumption-ready datasets for reporting, analytics, and downstream applications.
" Implement data quality, validation, reconciliation, audit, and governance controls across data pipelines.
" Manage and optimize Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Databricks SQL.
" Collaborate with business, analytics, architecture, and delivery teams in an Agile environment to deliver high-quality data products.
Required Technical Skills:
Databricks & Data Engineering
" Strong hands-on experience with Databricks, Lakehouse Architecture, and Delta Lake
" Expertise in PySpark, Python, and advanced SQL
" Experience with Apache Spark, Structured Streaming, Delta Live Tables (DLT), Databricks Workflows, and Unity Catalog
" Experience designing and implementing Medallion Architecture and modern Data Lake/Data Warehouse solutions
" Strong background in data ingestion, ETL/ELT, data transformation, optimization, and deployment practices
" Experience with event-driven and streaming technologies such as Kafka or Azure Event Hub
Cloud Platforms
" Microsoft Azure (preferred)
" AWS or GCP experience is also valuable
Application Integration
" Working knowledge of React and/or Angular for front-end integration and data-centric application development
Domain Experience (Preferred)
" Experience in Finance, Insurance, Regulatory Reporting, or US GAAP reporting
" Understanding of financial data models, reporting processes, and governance requirements is highly desirable

Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Databricks & Data Engineering in Frederick, MD vacancy
  •  ...Job Description Job Description Request ID: 114928-1 Title: Azure Databricks Data Engineer Locations: Frederick, MD Duration: 06 Months Pay Range: $45-$50/Hour on W2/C2C (All inclusive) We are seeking a highly skilled Senior Azure Databricks Data Engineer... 
    Databricks

    Artech LLC

    Frederick, MD
    25 days ago
  • $111.3k - $186.1k

     ...will work with highly motivated experts and innovators in the data center industry. You will be responsible for troubleshooting, project...  ...BASIC QUALIFICATIONS - Bachelor's degree in Electrical Engineering, Mechanical Engineering, or a related field - Bachelor's... 
    Suggested
    Local area
    Immediate start
    Flexible hours

    Amazon Data Services, Inc.

    Frederick, MD
    16 hours ago
  • $96k - $166.3k

     ...Data Center Chief EngineerJoin our dynamic Data Center Engineering Operations Team and become a critical architect of the infrastructure that powers global cloud computing. You'll play a pivotal role in maintaining the heartbeat of Amazon Web Services' physical infrastructure... 
    Suggested
    H1b
    Work at office
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    A W S

    Frederick, MD
    5 days ago
  • $82.9k - $134.3k

     ...world. JOB SUMMARY: As a key member in the Advanced Data Analytics team, the Data Analyst will work with this and a cross...  ...encompasses the acquisition, processing and machine learning of engineering or service data and application to preventive maintenance and... 
    Suggested
    Permanent employment
    Full time

    Oshkosh

    Frederick, MD
    16 days ago
  •  ...AWS Data Center Controls Team MemberAs part of the global controls team, you will work with highly motivated experts and innovators...  ...professional.Basic Qualifications:Bachelor's degree in Electrical Engineering, Mechanical Engineering, or a related fieldBachelor's degree in... 
    Suggested
    Local area
    Immediate start

    A W S

    Frederick, MD
    1 day ago
  •  ...Engineering Operations Technician How would you like to be a part of Earth's most customer-centric company? You would work with teams...  ...who support the operations of some of the world's most powerful data centers. Our Data Center Engineering Operations team maintain and... 
    For contractors
    For subcontractor
    Local area
    Shift work
    Night shift
    Weekend work
    Day shift
    3 days per week
    1 day per week
    Weekday work

    AWS

    Frederick, MD
    16 hours ago
  •  ...you’ll help share the client's marketing data strategy. This includes driving data...  ...with cross-functional teams such as IT and engineering to integrate data from various sources into...  ...working within data platforms like Databricks/Snowflake, and analytics modeling platforms... 
    Databricks
    Full time

    FocusKPI

    Frederick, MD
    16 hours ago
  •  ...The Opportunity We're seeking a Head of Data & Analytics to join a large, nationwide...  ...professionals spanning data analytics and data engineering, providing coaching, mentorship,...  ...or data warehouses, such as Snowflake, Databricks, Azure, Google Cloud, Redshift, or comparable... 
    Databricks
    Immediate start

    Emerson Zane

    Frederick, MD
    17 days ago
  • $132.23k - $176.31k

     ...the AI‑powered world, connecting people, data, and applications through our expansive...  ...The role requires close partnership with engineering, analytics, Adobe, Salesforce, and...  ...implementation, and operational strategy of Databricks as the strategic platform for marketing... 
    Databricks
    Full time
    Temporary work

    Lumen

    Frederick, MD
    2 days ago
  •  ...Senior BI Developer with expertise in Power BI, Tableau, and Data Engineering to design and develop advanced dashboards, reporting...  ...and maintain ETL pipelines using Azure Data Factory (ADF) and Databricks for data transformation and integration. Develop and deploy... 
    Databricks

    Prophecy Technologies

    Frederick, MD
    1 day ago
  •  ...your long-term career development while valuing your unique skills and experiences. **Your role and responsibilities** As a Data Engineer with Advanced Analytics expertise, you will specialize in formulating mathematical approaches to solve complex business problems... 
    Immediate start
    Worldwide

    IBM

    Frederick, MD
    7 hours ago
  • Job Title: Data Analyst / Reporting Developer Work Location: Frederick County, MD (local to DMV) Availability: 8:00 AM-5:00 PM ET, Monday-Friday Public-sector experience: Highlight state, local, or federal work prominently where applicable. Certification evidence:... 
    Local area
    Monday to Friday

    TechnoGen

    Frederick, MD
    2 days ago
  • $60 - $65 per hour

     ...A client of Innova Solutions is immediately hiring for a Data Integration Engineer . Position type: Full-Time Contract (W2) Role: Data Integration Engineer Duration: 12 Months Contract Location : Fort Detrick MD 21702 (Onsite Role) Required Skills: Data... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Immediate start
    Worldwide
    Flexible hours

    Innova Solutions

    Frederick, MD
    1 day ago
  • $82.1k - $172.4k

    Job Title: Data ScientistJob Category: ScienceTime Type: Full timeMinimum Clearance Required to Start: TS/SCI with PolygraphEmployee Type: RegularPercentage of Travel Required: Up to 10%Type of Travel: Local* * *CACI has an immediate need for a Data Scientist - Mid-level... 
    Contract work
    Work experience placement
    Local area
    Immediate start
    Flexible hours

    CACI International

    Frederick, MD
    2 days ago
  • $96k - $166.3k

     ...will work with highly motivated experts and innovators in the data center industry. You will be responsible for troubleshooting project...  ...and applicable local codes. - Bachelors degree in Electrical Engineering Mechanical Engineering or a related field - Bachelors degree... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Flexible hours

    Amazon

    Frederick, MD
    6 days ago
  • $105k - $120k

     ...Bioinformatics/Data ScientistFrederick, MDAxle is a bioscience and information technology company that offers advancements in translational...  ...and abroad. With experts in biomedical science, software engineering, and program management, we focus on developing and applying... 
    Local area

    Axle Informatics

    Frederick, MD
    2 days ago
  • $107.66k - $161.7k

     ...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture...  ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Frederick, MD
    16 hours ago
  •  ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with...  ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Frederick, MD
    16 hours ago
  •  ...Job Description Job Description Job Title: Databricks QA / Data Testing Consultant Location: Frederick MD Duration: 6 months (Extendable...  ..., develop, and maintain scalable, high-performance data engineering solutions on Azure Databricks. " Build and support batch... 
    Databricks

    Artech LLC

    Frederick, MD
    25 days ago
  • $32.88 - $57.5 per hour

     ...Description Join our dynamic team and become a critical guardian of technological infrastructure! As a Data Center Engineering Technician, you'll play a pivotal role in maintaining the heartbeat of mission-critical technology infrastructure, ensuring seamless operations... 
    Hourly pay
    For contractors
    For subcontractor
    H1b
    Local area
    Relocation
    Shift work

    Amazon

    Frederick, MD
    2 days ago
  • Data Center Technician Join our dynamic AWS team and become a critical guardian of global cloud infrastructure! You'll play a pivotal...  ...You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations... 
    For contractors
    Work at office
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Weekend work
    Day shift

    A W S

    Frederick, MD
    2 days ago
  • $27.98 - $48.99 per hour

    Data Center Technician AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure...  ...You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations... 
    Hourly pay
    For contractors
    Shift work
    Night shift
    Afternoon shift

    A W S

    Frederick, MD
    2 days ago
  • Applying for tech roles and coming up short on experience? IT training builds the practical skills behind help desk, networking, and cloud roles. This listing is for a training program, not a job opening. What you'll learn Computer hardware and software, networking...

    Dreambound

    Frederick, MD
    17 hours ago
  • $60k - $140k

     ...Lead or Field Automation Supervisor About the Role Albireo Energy is seeking Field Automation Engineers at all experience levels to support mission-critical data center projects in Frederick, Maryland. This role is ideal for professionals ranging from early-... 
    Full time
    Temporary work
    For subcontractor
    Local area

    Albireo Energy

    Frederick, MD
    3 days ago
  • $120k - $140k

     ...commercial vehicle fleets, by developing innovative hardware and data analytics solutions. Inventors of the award- winning and...  ...We are seeking a motivated and technically proficient Solutions Engineer to serve as a trusted advisor to customers throughout the sales... 
    Remote job
    Full time
    H1b

    Aperia Technologies

    Frederick, MD
    16 hours ago
  •  ...passionate and forward-thinking experts. We're one of the largest engineering and system integration firms in the United States providing...  ...experience in control system integration, mission-critical facilities, data centers, industrial automation, or a comparable regulated... 
    Contract work
    For subcontractor
    Local area

    E Tech Group

    Frederick, MD
    15 days ago
  • $100.39k

     ...Amazon, our tech isn't just a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing products...  ...not limited to - This position will be hands on in one of our data centers in Virginia, Oregon, Ohio, Mississippi, or California.... 
    Full time
    Summer work
    Internship
    Local area
    Monday to Friday

    Amazon

    Frederick, MD
    16 hours ago
  • $90k

     ...support of an established technology company with experienced engineering, estimating, project management, and installation teams. What...  ...security systems Structured Cabling: Cat6/Cat6A, copper cabling, data drops, and network infrastructure Fiber Optics: Fiber... 
    Full time
    Contract work
    For contractors

    Advantage.Tech

    Frederick, MD
    2 days ago
  • $77.2k - $96.5k

    Qualifications: ~ Bachelor’s degree in business, Accounting, MIS, Finance, or related field ~3+ years supporting or implementing Oracle EBS R12 and/or Oracle Cloud Financials ~ Hands-on experience with Order-to-Cash (O2C) and/or Procure-to-Pay (P2P) processes ~...
    Full time
    Shift work

    World Wide Technology

    Frederick, MD
    3 days ago
  • $203.1k - $218.3k

     ...Lumen is the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and connected ecosystem. We enable secure, high‑performance connectivity across cloud, edge, and AI workloads for enterprises, governments... 
    Full time
    Contract work
    Temporary work

    Lumen

    Frederick, MD
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks & Data Engineering. Be the first to apply!