Get new jobs by email
$108k - $200k
...off each full calendar year pro-rated quarterly based on hire date, nine paid holidays, 8 hours of Lifetime paid time off, 8 hours of Unity Day paid time off, 401(k) with company match, company-paid pension plan, business casual attire, and more. To learn more about the...SuggestedFull timeTemporary workPart timeCasual workWork at office- ...PowerShell, Bash) and ability to reduce manual operational work. Strong understanding of cloud-based platforms such as Azure DataBricks + Unity Catalog, AWS S3 and RDS. Strong experience in ETL / ELT work. Understanding of CI/CD concepts, safe deployment patterns, rollback...Suggested3 days per week
- ...Job Responsibilities: Shift Information: 2nd Shift - five - 8 hour days (Mon - Fri) and offers a 60 shift premium. Awareness, Unity, Empowerment At Magna, we believe that a diverse workforce is critical to our success. That's why we are proud to be an equal opportunity...SuggestedPermanent employmentLocal areaShift workAfternoon shift
$118k - $222k
...off each full calendar year pro-rated quarterly based on hire date, nine paid holidays, 8 hours of Lifetime paid time off, 8 hours of Unity Day paid time off, 401(k) with company match, company-paid pension plan, business casual attire, and more. To learn more about the...SuggestedFull timeTemporary workPart timeCasual workWork at officeRemote workWork from home- ...customized, and creative workouts in the setting of our client's choice. We are a highly collaborative team that runs on FUEL (Fun, Unity, Earnings, and Leadership). Team members enjoy benefits that include competitive compensation rates, discounts, and complimentary continuing...SuggestedFull timePart time
$120k - $202.5k
...to SSIM Center of Excellence which establishes Best Practices for each platform as well as use cases for Reuse. Lead Iceberg/Horizon/Unity Catalog interoperability across AWS, Azure, and Google Cloud Platform Open Platforms & Open Table Formats Architect open data...SuggestedTemporary workFlexible hours- ...frameworks to the Databricks Lakehouse Platform. Architect and implement scalable Lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Databricks Workflows. Design and govern end-to-end data pipelines for batch, streaming, CDC, and real-time data...Suggested
- ...Workflows/Jobs to schedule and orchestrate pipelines. Implement data governance, security, access controls, and data lineage using Unity Catalog. Collaborate with data architects, analysts, data scientists, application teams, and business stakeholders....SuggestedRemote work
- ...Create DAGs using Airflow to orchestrate creation of trusted and refined data. Enforce data quality, lineage, and governance using Unity Catalog and/or Glue Catalog; embed expectations and validation into pipelines. Drive Spark performance engineering:...Suggested
- ...Responsibilities Architectural Strategy & Governance: Design the target Databricks Lakehouse architecture utilizing Delta Lake, Photon, and Unity Catalog. Establish global code refactoring standards, optimization benchmarks, and PySpark best practices. Resolve highly...SuggestedRemote work
- ...backlogs. Key Responsibilities & Skills: Develop and support scalable data pipelines using Azure Databricks , including Unity Catalog, Delta Lake, PySpark, and Lakeflow/DLT. Build and manage Databricks Asset Bundles and CI/CD processes for data engineering...SuggestedContract workLocal area
$65 - $75 per hour
...allocation. Governance & Platform Optimization: Implement enterprise-grade data governance, lineage, and security frameworks using Unity Catalog, while continuously evaluating and integrating modern Databricks features (e.g., Delta Live Tables, MLflow, Vector Search)....SuggestedHourly payContract workTemporary workWork experience placement- ...Delta Lake pipelines. Build and manage ETL/ELT workflows and data lakehouse architecture. Work with Azure/AWS , Databricks Workflows, Unity Catalog, and cloud storage. Optimize performance, data quality, and cost of Databricks workloads. Mentor engineers and provide...Suggested
- ...ingestion, transformation, and integration initiatives. Strong experience with Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog . Design data pipelines using Azure/AWS cloud services and Databricks. Implement data governance, security,...SuggestedContract work
- ...experience. ~3+ years of hands-on Databricks development. ~ Strong expertise in: Databricks Delta Lake Delta Live Tables (DLT) Unity Catalog Databricks Workflows Python and/or Scala Advanced SQL ETL/ELT development and data modeling Experience with Sales Incentive...Suggested
- ...transformation storage analytics and reporting workloads Lead implementation of Delta Lake medallion architecture Databricks SQL Unity Catalog and workflow orchestration Optimize Apache Spark jobs clusters notebooks pipelines and workloads for performance...
- ...real-time streaming pipelines using Structured Streaming Governance, Security & Compliance Implement fine-grained access control using Unity Catalog Define enterprise-wide data governance, lineage, and auditing frameworks Ensure compliance with security and regulatory...
- ...Clustering. Enforce Governance: Implement robust data governance, access controls, and end-to-end data lineage via Databricks Unity Catalog. Streamline DevOps: Deploy and orchestrate pipelines using Databricks Asset Bundles (DABs), CI/CD workflows, and automated...
- ...Exposure to streaming technologies such as Kafka, Kinesis, or EventBridge for near real-time data processing. Familiarity with Databricks Unity Catalog and governance capabilities (RBAC, data masking, auditing). Experience using metadata/catalog tools such as Informatica EDC...Temporary workFlexible hours
- ...Databricks Workflows, AWS Glue) API integration for external data source ingestion Platforms & Tools Databricks (Delta Lake, Unity Catalog, Genie) Cloud platforms - AWS (S3, Glue, Athena) and/or Azure/Google Cloud Platform equivalents Data warehousing...
- ...Required Qualifications: Azure Databricks expertise - hands-on with Unity Catalog governance, Delta Lake, PySpark, Lakeflow/DLT pipelines, and Databricks Asset Bundles for CI/CD Microsoft Fabric experience - lakehouse architecture, OneLake, Data Pipelines/Dataflows...
- ...Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables (DLT). Experienced in optimizing Medallion architectures using Unity Catalog for unified governance and PySpark for advanced analytics processing. Optimized storage solutions leveraging Delta Lake...
- ...on Azure and Databricks technical expert for the engagement Own Databricks-specific architecture decisions - workspace design, Unity Catalog governance strategy, and compute/cluster architecture - not just build within an existing design Work directly with the...Remote work
- ...dictionaries while automating metadata ingestion and scanning processes. Applies lineage and classification standards (Purview/Unity Catalog). Connects catalog to BI and ETL/ELT pipelines. Expands glossary coverage with stewards. Implements catalog APIs...Long term contractRemote work
- ...existing business logic and ETL processes into scalable, code-driven Databricks notebooks. Implement data governance practices using Unity Catalog, including access, security, schema management, and lineage. Support CI/CD and DevOps automation for Databricks...
- ...Spark (PySpark/Scala/Spark SQL). ~ Experience building ETL/ELT pipelines using Databricks. ~ Strong knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture. ~ Experience with Azure Databricks (preferred) or AWS Databricks. ~ Strong SQL...Full time
$110k - $145k
...architecture Kafka or other event-streaming technologies Terraform or other infrastructure-as-code tools Microsoft Purview, Unity Catalog, Collibra, or Informatica Data mesh and data-product operating models Master data management and reference data...Visa sponsorship- ...and end-to-end system design. Production Databricks Depth : Extensive experience with Delta Lake, Spark (PySpark & Spark SQL), Unity Catalog, job orchestration, and performance tuning (partitioning, clustering, Z-ordering, file compaction). Financial Time-Series...
- ...~ Strong production experience with Databricks . ~ Expert-level experience with: Apache Spark, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows / Job Orchestration, Spark performance tuning ~ Strong Financial Services / Structured Finance experience...
- ...SQL Proficient in Python, SQL, or PowerShell for troubleshooting and automation Experience in CDC replication, Databricks unity catalog, Airflow orchestration Nice to have: AI integration to the OPS. Working at OpenKyber OpenKyber is a diverse, prosperous...Local area