Get new jobs by email
- ...experience strongly preferred Consulting/client-facing experience preferred Technical requirements Deep hands-on Databricks PySpark / Spark AWS cloud data environment Data ingestion, transformation, orchestration and automation End-to-end data architecture and pipeline...SuggestedContract work
- ...sources. Implement data transformations, cleansing, enrichment, and validation processes. Create scalable solutions using PySpark, Spark SQL, and Delta Lake. Collaborate with business stakeholders, data architects, analysts, and application teams to define data requirements...SuggestedHourly payLocal areaRemote work
- ...BigQuery, Cloud Storage, Dataflow, and Dataproc. Implement data lakehouse solutions using Databricks and Delta Lake. Optimize Spark jobs and data pipelines for performance and cost efficiency. Implement data quality checks, validation, and error-handling...Suggested
$65.05 per hour
...experience designing, implementing, and maintaining distributed systems. ~ Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger. ~ Knowledge of Apache Iceberg and object storage such as S3 or Ozone. ~ Strong Python development for...SuggestedContract work- ...training, serving, and observability, and be the final escalation point for the most elusive infrastructure problems (GPU capacity, Spark tuning, production incidents) Own and evolve our paved-road framework (the shared CI/CD spine, model-workflow scaffolding, and Databricks...SuggestedRemote work
- ...infrastructure Key Responsibilities: Administer and optimize Microsoft Fabric environments Lakehouse Warehouse Data Factory Spark Notebooks Semantic Models Ensure platform reliability through monitoring incident management RCA and performance tuning...Suggested
- ...capital, and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate...SuggestedWork at office
$138k - $200.1k
...Experience with cloud platforms and data services, including AWS, Azure, or Google Cloud Platform, and big data frameworks such as EMR or Spark. ~ Strong understanding of modern data architectures, including data lakes, data warehouses, lakehouses, and streaming platforms...Suggested16 hoursContract workTemporary workWork experience placementCasual workWork at officeLocal areaWork visaFlexible hours- ...cost optimization. Establish scalable data-lakehouse patterns for SAP and non-SAP data using Delta Lake, medallion architecture, Spark, Python, SQL, streaming, and batch pipelines. Administer and support Informatica platforms, such as PowerCenter, IDMC/IICS,...Suggested
- ...Experience optimizing cost and performance in cloud data warehouses. Hands-on experience with Cribl, Apache Kafka, Kafka Connect, Spark Streaming, or Apache Flink Required Years of Experience: MUST have 5 to 7+ years of Data Engineering experience....SuggestedContract workWork experience placementWork at officeRemote work
$150k - $240k
..., and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate quality...SuggestedWork at officeLocal areaRemote workWorldwide- ...orchestration pipelines. Fabric Data Development Build and manage pipelines using Fabric Data Factory. Develop transformations using Spark notebooks (PySpark/SQL). Create and model Fabric Warehouses. Work with OneLake for unified storage and data access. Performance...SuggestedContract workRemote work
- ...data solutions. Key Responsibilities: Build and maintain scalable ETL/ELT pipelines using Databricks. Leverage PySpark/Spark and SQL to transform and process large datasets. Integrate data from multiple sources including Azure Blob Storage, ADLS and...Suggested
- ...edge as an organization. What You ll Do Pipeline Design & Development Build and maintain scalable data pipelines using Apache Spark and Databricks, including batch and streaming workloads Develop Delta Live Tables (DLT) workflows that automate data quality checks...Suggested
$90 - $105 per hour
...implement, test, deploy, and maintain scalable ETL/ELT pipelines and governed raw, clean, and curated data layers using Python, PySpark, Spark SQL, Foundry Code Repositories, Pipeline Builder, Databricks, and Delta Lake. Design and implement Foundry Ontologies...SuggestedHourly payWork at office- ...experienced D365 Sr Finance Consultant to join one of our enterprise client engagements. The ideal candidate should have strong expertise in Spark, Kafka, AWS, Azure, or Google Cloud Platform along with experience working in fast-paced enterprise environments. MUST...
- ...development. Strong experience designing and implementing enterprise-scale data pipelines. Hands-on expertise with: Python PySpark Spark SQL SQL Kafka Databricks Delta Lake Snowflake Hive Experience building data solutions on AWS cloud platforms. Strong understanding of...
- ...Position Type: Full Time We are seeking an experienced Databricks Architect with strong hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake . The ideal candidate will design, develop, and optimize scalable data engineering solutions on the Databricks...Full timeRemote work
- ...deployment and adoption. Design and develop Databricks Apps and production-grade data/AI solutions using Python or Scala, SQL, Apache Spark, Delta Lake, and Databricks platform services. Build reference architectures and scalable solutions across batch/streaming data...
- ...different environments. Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments. Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management. Translate business requirements into technical blueprints, run proof-of-concepts...
- ...Job Title: Data Engineer Databricks / Scala / Spark / Kafka Work Location: Richardson, TX | Indianapolis, IN | Tampa, FL | Hartford, CT | Phoenix, AZ | St. Louis, MO (Hybrid) Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also...Long term contract
- ...experience designing and developing enterprise-scale data engineering solutions Hands on experience with Databricks and Apache Spark for large-scale data processing Strong experience with MS Azure data platforms and services Hands on experience designing...Contract work
- ...experience designing and developing enterprise-scale data engineering solutions Hands on experience with Databricks and Apache Spark for large-scale data processing Strong experience with Microsoft Azure data platforms and services Hands on experience designing...
$170k - $180k
...HBase, Aerospike, Cassandra, or MongoDB) Ecosystem Integration: Support and integrate core Hadoop ecosystem tools including Hive, Spark, and HDFS. We're looking for someone with: ~4+ years of experience administering distributed Big Data Platforms. ~...Work experience placementWork at officeLocal areaRemote workMonday to Friday- ...maintaining Infrastructure-as-Code solutions using Terraform and CI/CD pipelines. ~ Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architecture concepts. ~ Experience developing automation solutions and reusable engineering components. ~...
- ...Big data movement and transport Data warehousing fundamentals - schema design (star/snowflake), fact and dimensions, SCDs Spark Kafka AWS, Azure, or Google Cloud Platform Java/Python programming background Role Overview We are seeking an...
$56 - $61 per hour
...building enterprise-grade data pipelines, processing high-volume datasets, and delivering scalable analytics solutions using PySpark, Spark SQL, and AWS cloud technologies. Responsibilities: The candidate will design, develop, and maintain scalable data...Contract workTemporary workLocal areaRemote work- ...related areas. Strong enterprise experience with Databricks. Expert knowledge of: Databricks Lakehouse, Delta Lake, Apache Spark, PySpark, Spark SQL, SQL, Medallion Architecture, Unity Catalog Strong experience designing ETL/ELT pipelines and data platforms...
- ...Responsibilities Databricks Engineering: Build scalable, secure data solutions on the Databricks Lakehouse Platform using Apache Spark, Delta Lake, and cloud-native services. Implement batch, streaming, ETL, ELT, analytics, and ML-enabled data pipelines. Apply medallion...Work experience placementLocal areaRemote work
- ...architecture using GKE with Cloud SQL and Pub/Sub. Big Data Experience working with large-scale data processing frameworks such as Apache Spark, Dataflow, or BigQuery. Example: Building ETL pipelines that process terabytes of daily event data and transform it for downstream...