Get new jobs by email
- ...PowerShell, Bash) and ability to reduce manual operational work. Strong understanding of cloud-based platforms such as Azure DataBricks + Unity Catalog, AWS S3 and RDS. Strong experience in ETL / ELT work. Understanding of CI/CD concepts, safe deployment patterns, rollback...Suggested3 days per week
$120k - $202.5k
...to SSIM Center of Excellence which establishes Best Practices for each platform as well as use cases for Reuse. Lead Iceberg/Horizon/Unity Catalog interoperability across AWS, Azure, and Google Cloud Platform Open Platforms & Open Table Formats Architect open data...SuggestedTemporary workFlexible hours- ...Exposure to streaming technologies such as Kafka, Kinesis, or EventBridge for near real-time data processing. Familiarity with Databricks Unity Catalog and governance capabilities (RBAC, data masking, auditing). Experience using metadata/catalog tools such as Informatica EDC...SuggestedTemporary workFlexible hours
- ...experience. ~3+ years of hands-on Databricks development. ~ Strong expertise in: Databricks Delta Lake Delta Live Tables (DLT) Unity Catalog Databricks Workflows Python and/or Scala Advanced SQL ETL/ELT development and data modeling Experience with Sales Incentive...Suggested
- ...Delta Lake pipelines. Build and manage ETL/ELT workflows and data lakehouse architecture. Work with Azure/AWS , Databricks Workflows, Unity Catalog, and cloud storage. Optimize performance, data quality, and cost of Databricks workloads. Mentor engineers and provide...Suggested
- ...backlogs. Key Responsibilities & Skills: Develop and support scalable data pipelines using Azure Databricks , including Unity Catalog, Delta Lake, PySpark, and Lakeflow/DLT. Build and manage Databricks Asset Bundles and CI/CD processes for data engineering...SuggestedContract workLocal area
- ...Required Qualifications: Azure Databricks expertise - hands-on with Unity Catalog governance, Delta Lake, PySpark, Lakeflow/DLT pipelines, and Databricks Asset Bundles for CI/CD Microsoft Fabric experience - lakehouse architecture, OneLake, Data Pipelines/Dataflows...Suggested
- ...Databricks Workflows, AWS Glue) API integration for external data source ingestion Platforms & Tools Databricks (Delta Lake, Unity Catalog, Genie) Cloud platforms - AWS (S3, Glue, Athena) and/or Azure/Google Cloud Platform equivalents Data warehousing...Suggested
- ...existing business logic and ETL processes into scalable, code-driven Databricks notebooks. Implement data governance practices using Unity Catalog, including access, security, schema management, and lineage. Support CI/CD and DevOps automation for Databricks...Suggested
- ...Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables (DLT). Experienced in optimizing Medallion architectures using Unity Catalog for unified governance and PySpark for advanced analytics processing. Optimized storage solutions leveraging Delta Lake...Suggested
- ...transformation storage analytics and reporting workloads Lead implementation of Delta Lake medallion architecture Databricks SQL Unity Catalog and workflow orchestration Optimize Apache Spark jobs clusters notebooks pipelines and workloads for performance...Suggested
- ...Spark (PySpark/Scala/Spark SQL). ~ Experience building ETL/ELT pipelines using Databricks. ~ Strong knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture. ~ Experience with Azure Databricks (preferred) or AWS Databricks. ~ Strong SQL...SuggestedFull time
- ...Create DAGs using Airflow to orchestrate creation of trusted and refined data. Enforce data quality, lineage, and governance using Unity Catalog and/or Glue Catalog; embed expectations and validation into pipelines. Drive Spark performance engineering:...Suggested
$65 - $75 per hour
...allocation. Governance & Platform Optimization: Implement enterprise-grade data governance, lineage, and security frameworks using Unity Catalog, while continuously evaluating and integrating modern Databricks features (e.g., Delta Live Tables, MLflow, Vector Search)....SuggestedHourly payContract workTemporary workWork experience placement- ...Responsibilities Architectural Strategy & Governance: Design the target Databricks Lakehouse architecture utilizing Delta Lake, Photon, and Unity Catalog. Establish global code refactoring standards, optimization benchmarks, and PySpark best practices. Resolve highly...SuggestedRemote work
- ...Clustering. Enforce Governance: Implement robust data governance, access controls, and end-to-end data lineage via Databricks Unity Catalog. Streamline DevOps: Deploy and orchestrate pipelines using Databricks Asset Bundles (DABs), CI/CD workflows, and automated...
- ...frameworks to the Databricks Lakehouse Platform. Architect and implement scalable Lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Databricks Workflows. Design and govern end-to-end data pipelines for batch, streaming, CDC, and real-time data...
- ...real-time streaming pipelines using Structured Streaming Governance, Security & Compliance Implement fine-grained access control using Unity Catalog Define enterprise-wide data governance, lineage, and auditing frameworks Ensure compliance with security and regulatory...
- ...ingestion, transformation, and integration initiatives. Strong experience with Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog . Design data pipelines using Azure/AWS cloud services and Databricks. Implement data governance, security,...Contract work
$110k - $145k
...architecture Kafka or other event-streaming technologies Terraform or other infrastructure-as-code tools Microsoft Purview, Unity Catalog, Collibra, or Informatica Data mesh and data-product operating models Master data management and reference data...Visa sponsorship- ...Workflows/Jobs to schedule and orchestrate pipelines. Implement data governance, security, access controls, and data lineage using Unity Catalog. Collaborate with data architects, analysts, data scientists, application teams, and business stakeholders....Local area
- ...dictionaries while automating metadata ingestion and scanning processes. Applies lineage and classification standards (Purview/Unity Catalog). Connects catalog to BI and ETL/ELT pipelines. Expands glossary coverage with stewards. Implements catalog APIs...Long term contractRemote work
- ...on Azure and Databricks technical expert for the engagement Own Databricks-specific architecture decisions - workspace design, Unity Catalog governance strategy, and compute/cluster architecture - not just build within an existing design Work directly with the...Remote work
- ...and end-to-end system design. Production Databricks Depth : Extensive experience with Delta Lake, Spark (PySpark & Spark SQL), Unity Catalog, job orchestration, and performance tuning (partitioning, clustering, Z-ordering, file compaction). Financial Time-Series...
- ...Position : Sr. Azure Data Engineer with Strong exp with ADF, Azure Databrick, Unity Catalog. (LOCAL to NJ / 12+ Years exp. MUST) Location : Duration : 12+ Months Should have 12+ years of exp. As Azure Data engineer In depth knowledge of ADLS and Unity Catalog and performance...Local area
- ...SQL Proficient in Python, SQL, or PowerShell for troubleshooting and automation Experience in CDC replication, Databricks unity catalog, Airflow orchestration Nice to have: AI integration to the OPS. Working at OpenKyber OpenKyber is a diverse, prosperous...Local area
- ...~ Strong production experience with Databricks . ~ Expert-level experience with: Apache Spark, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows / Job Orchestration, Spark performance tuning ~ Strong Financial Services / Structured Finance experience...
- ...as a product, and federated computational governance ~ Modern Data Platform Technologies: Proficiency: Databricks (Unity Catalog, Delta Lake), Starburst/Trino (federated query), Collibra (data governance), or Immuta (dynamic data access control) Ability...
$90k - $150k
...systems and highly scalable enterprise applications. Familiarity with Dependency Injection frameworks such as Autofac, Ninject, or Unity. Experience developing and supporting .NET Core applications running in Linux environments. Experience with TDD (Test-...Full timeTemporary workWork experience placementRemote workFlexible hours- ...Doctor of Medicine | Family Practice Location: Unity, ME Employer: CompHealth Pay: Competitive weekly pay (inquire for details) Start Date: ASAP About the Position If you are seeking a balanced lifestyle in a beautiful location, with a variety...Weekly payFull timeImmediate start
CompHealth
Unity, ME1 day ago
