Get new jobs by email
- ...PowerShell, Bash) and ability to reduce manual operational work. Strong understanding of cloud-based platforms such as Azure DataBricks + Unity Catalog, AWS S3 and RDS. Strong experience in ETL / ELT work. Understanding of CI/CD concepts, safe deployment patterns, rollback...Suggested3 days per week
- ...existing business logic and ETL processes into scalable, code-driven Databricks notebooks. Implement data governance practices using Unity Catalog, including access, security, schema management, and lineage. Support CI/CD and DevOps automation for Databricks...Suggested
- ...Required Qualifications: Azure Databricks expertise - hands-on with Unity Catalog governance, Delta Lake, PySpark, Lakeflow/DLT pipelines, and Databricks Asset Bundles for CI/CD Microsoft Fabric experience - lakehouse architecture, OneLake, Data Pipelines/Dataflows...Suggested
- ...ingestion, transformation, and integration initiatives. Strong experience with Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog . Design data pipelines using Azure/AWS cloud services and Databricks. Implement data governance, security,...SuggestedContract work
- ...Databricks Workflows, AWS Glue) API integration for external data source ingestion Platforms & Tools Databricks (Delta Lake, Unity Catalog, Genie) Cloud platforms - AWS (S3, Glue, Athena) and/or Azure/Google Cloud Platform equivalents Data warehousing...Suggested
- ...Exposure to streaming technologies such as Kafka, Kinesis, or EventBridge for near real-time data processing. Familiarity with Databricks Unity Catalog and governance capabilities (RBAC, data masking, auditing). Experience using metadata/catalog tools such as Informatica EDC...SuggestedTemporary workFlexible hours
- ...transformation storage analytics and reporting workloads Lead implementation of Delta Lake medallion architecture Databricks SQL Unity Catalog and workflow orchestration Optimize Apache Spark jobs clusters notebooks pipelines and workloads for performance...Suggested
- ...experience. ~3+ years of hands-on Databricks development. ~ Strong expertise in: Databricks Delta Lake Delta Live Tables (DLT) Unity Catalog Databricks Workflows Python and/or Scala Advanced SQL ETL/ELT development and data modeling Experience with Sales Incentive...Suggested
- ...Delta Lake pipelines. Build and manage ETL/ELT workflows and data lakehouse architecture. Work with Azure/AWS , Databricks Workflows, Unity Catalog, and cloud storage. Optimize performance, data quality, and cost of Databricks workloads. Mentor engineers and provide...Suggested
- ...Spark (PySpark/Scala/Spark SQL). ~ Experience building ETL/ELT pipelines using Databricks. ~ Strong knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture. ~ Experience with Azure Databricks (preferred) or AWS Databricks. ~ Strong SQL...SuggestedFull time
- ...existing project backlogs. Key Responsibilities & Skills Develop and support scalable data pipelines using Azure Databricks , including Unity Catalog, Delta Lake, PySpark, and Lakeflow/DLT. Build and manage Databricks Asset Bundles and CI/CD processes for data engineering...SuggestedContract workLocal area
$120k - $202.5k
...to SSIM Center of Excellence which establishes Best Practices for each platform as well as use cases for Reuse. Lead Iceberg/Horizon/Unity Catalog interoperability across AWS, Azure, and Google Cloud Platform Open Platforms & Open Table Formats Architect open data...SuggestedTemporary workFlexible hours- ...dictionaries while automating metadata ingestion and scanning processes. Applies lineage and classification standards (Purview/Unity Catalog). Connects catalog to BI and ETL/ELT pipelines. Expands glossary coverage with stewards. Implements catalog APIs...SuggestedLong term contractRemote work
- ...Create DAGs using Airflow to orchestrate creation of trusted and refined data. Enforce data quality, lineage, and governance using Unity Catalog and/or Glue Catalog; embed expectations and validation into pipelines. Drive Spark performance engineering:...Suggested
- ...frameworks to the Databricks Lakehouse Platform. Architect and implement scalable Lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Databricks Workflows. Design and govern end-to-end data pipelines for batch, streaming, CDC, and real-time data...Suggested
- ...Responsibilities Architectural Strategy & Governance: Design the target Databricks Lakehouse architecture utilizing Delta Lake, Photon, and Unity Catalog. Establish global code refactoring standards, optimization benchmarks, and PySpark best practices. Resolve highly...Remote work
- ...real-time streaming pipelines using Structured Streaming Governance, Security & Compliance Implement fine-grained access control using Unity Catalog Define enterprise-wide data governance, lineage, and auditing frameworks Ensure compliance with security and regulatory...
- ...Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables (DLT). Experienced in optimizing Medallion architectures using Unity Catalog for unified governance and PySpark for advanced analytics processing. Optimized storage solutions leveraging Delta Lake...
- ...on Azure and Databricks technical expert for the engagement Own Databricks-specific architecture decisions - workspace design, Unity Catalog governance strategy, and compute/cluster architecture - not just build within an existing design Work directly with the...Remote work
- ...Workflows/Jobs to schedule and orchestrate pipelines. Implement data governance, security, access controls, and data lineage using Unity Catalog. Collaborate with data architects, analysts, data scientists, application teams, and business stakeholders....Remote work
- ...Clustering. Enforce Governance: Implement robust data governance, access controls, and end-to-end data lineage via Databricks Unity Catalog. Streamline DevOps: Deploy and orchestrate pipelines using Databricks Asset Bundles (DABs), CI/CD workflows, and automated...
$65 - $75 per hour
...allocation. Governance & Platform Optimization: Implement enterprise-grade data governance, lineage, and security frameworks using Unity Catalog, while continuously evaluating and integrating modern Databricks features (e.g., Delta Live Tables, MLflow, Vector Search)....Hourly payContract workTemporary workWork experience placement$110k - $145k
...architecture Kafka or other event-streaming technologies Terraform or other infrastructure-as-code tools Microsoft Purview, Unity Catalog, Collibra, or Informatica Data mesh and data-product operating models Master data management and reference data...Visa sponsorship- ...~ Strong production experience with Databricks . ~ Expert-level experience with: Apache Spark, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows / Job Orchestration, Spark performance tuning ~ Strong Financial Services / Structured Finance experience...
- ...and end-to-end system design. Production Databricks Depth : Extensive experience with Delta Lake, Spark (PySpark & Spark SQL), Unity Catalog, job orchestration, and performance tuning (partitioning, clustering, Z-ordering, file compaction). Financial Time-Series...
$90k - $150k
...systems and highly scalable enterprise applications. Familiarity with Dependency Injection frameworks such as Autofac, Ninject, or Unity. Experience developing and supporting .NET Core applications running in Linux environments. Experience with TDD (Test-...Full timeTemporary workWork experience placementRemote workFlexible hours- ...SQL Proficient in Python, SQL, or PowerShell for troubleshooting and automation Experience in CDC replication, Databricks unity catalog, Airflow orchestration Nice to have: AI integration to the OPS. Working at OpenKyber OpenKyber is a diverse, prosperous...Local area
- ...as a product, and federated computational governance ~ Modern Data Platform Technologies: Proficiency: Databricks (Unity Catalog, Delta Lake), Starburst/Trino (federated query), Collibra (data governance), or Immuta (dynamic data access control) Ability...
- ...Position : Sr. Azure Data Engineer with Strong exp with ADF, Azure Databrick, Unity Catalog. (LOCAL to NJ / 12+ Years exp. MUST) Location : Duration : 12+ Months Should have 12+ years of exp. As Azure Data engineer In depth knowledge of ADLS and Unity Catalog and performance...Local area
$24 per hour
...experiences opportunities to grow as our company grows. When you join Asset Living, you become part of a dynamic team that thrives on unity, unique talents, and a universal culture of winning. Recognized as one of the nation's Best and Brightest Places to Work and...Hourly payPermanent employmentFull timeWork at officeImmediate startNight shiftWeekend workAsset Living
Alaska12 hours ago
