Get new jobs by email
- ...Description Want to be your own boss? With the Spark Driver™ app, you can make some extra cash by shopping and delivering for customers of Walmart and other local businesses. Available in more than 3,650 cities and all 50 states, the Spark Driver platform makes it possible...SuggestedExtra incomeFor contractorsLocal area
Spark Driver
Wisconsin2 days ago - ...mesh patterns. Strong command of data modeling (3NF, Star/Snowflake, Data Vault 2.0). Advanced proficiency in SQL, Python/PySpark, and Spark performance tuning. Deep knowledge of Azure security & networking (Managed Identity, Private Link, VNet integration, Azure Firewall)...SuggestedContract workWork experience placement
- ...Experience optimizing cost and performance in cloud data warehouses. Hands-on experience with Cribl, Apache Kafka, Kafka Connect, Spark Streaming, or Apache Flink Required Years of Experience: MUST have 5 to 7+ years of Data Engineering experience....SuggestedContract workWork experience placementWork at officeRemote work
- ...capital, and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate...SuggestedWork at office
$90 - $105 per hour
...implement, test, deploy, and maintain scalable ETL/ELT pipelines and governed raw, clean, and curated data layers using Python, PySpark, Spark SQL, Foundry Code Repositories, Pipeline Builder, Databricks, and Delta Lake. Design and implement Foundry Ontologies...SuggestedHourly payWork at office- ...looking for a highly experienced Senior Data Engineer with 10+ years of experience and strong hands-on expertise in Databricks, Apache Spark, PySpark, Python, SQL, AWS, and Delta Lake . The ideal candidate should have extensive experience designing and developing scalable...Suggested
- ...experience designing and developing enterprise-scale data engineering solutions Hands on experience with Databricks and Apache Spark for large-scale data processing Strong experience with MS Azure data platforms and services Hands on experience designing...SuggestedContract work
- ...Big data movement and transport Data warehousing fundamentals - schema design (star/snowflake), fact and dimensions, SCDs Spark Kafka AWS, Azure, or Google Cloud Platform Java/Python programming background Role Overview We are seeking an...Suggested
- ...maintaining Infrastructure-as-Code solutions using Terraform and CI/CD pipelines. ~ Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architecture concepts. ~ Experience developing automation solutions and reusable engineering components. ~...Suggested
- ...Position Type: Full Time We are seeking an experienced Databricks Architect with strong hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake . The ideal candidate will design, develop, and optimize scalable data engineering solutions on the Databricks...SuggestedFull timeRemote work
- ...experience strongly preferred Consulting/client-facing experience preferred Technical requirements Deep hands-on Databricks PySpark / Spark AWS cloud data environment Data ingestion, transformation, orchestration and automation End-to-end data architecture and pipeline...SuggestedContract work
- ...billing systems, revenue reconciliation, deferred revenue, and financial reporting. Databricks certifications (Data Engineer, Spark Developer, or equivalent). Experience with MLflow, AutoML, or basic ML-enabled analytics use cases. Experience with Power...SuggestedLong term contract
$138k - $200.1k
...Experience with cloud platforms and data services, including AWS, Azure, or Google Cloud Platform, and big data frameworks such as EMR or Spark. ~ Strong understanding of modern data architectures, including data lakes, data warehouses, lakehouses, and streaming platforms...Suggested16 hoursContract workTemporary workWork experience placementCasual workWork at officeLocal areaWork visaFlexible hours- ...infrastructure Key Responsibilities: Administer and optimize Microsoft Fabric environments Lakehouse Warehouse Data Factory Spark Notebooks Semantic Models Ensure platform reliability through monitoring incident management RCA and performance tuning...Suggested
- ...data solutions. Key Responsibilities: Build and maintain scalable ETL/ELT pipelines using Databricks. Leverage PySpark/Spark and SQL to transform and process large datasets. Integrate data from multiple sources including Azure Blob Storage, ADLS and...Suggested
- ...experience in design, implement and maintain Java ,Python, Microservice, Spring Boot, Spring Cloud, RESTful services, Kafka, Swagger, Spark, MongoDB, Flink, Ab Initio, Docker, Opeshift, Kubernetes technologies Strategize, Design data architecture for specific business...Flexible hours
- ...architecture using GKE with Cloud SQL and Pub/Sub. Big Data Experience working with large-scale data processing frameworks such as Apache Spark, Dataflow, or BigQuery. Example: Building ETL pipelines that process terabytes of daily event data and transform it for downstream...
- ...related areas. Strong enterprise experience with Databricks. Expert knowledge of: Databricks Lakehouse, Delta Lake, Apache Spark, PySpark, Spark SQL, SQL, Medallion Architecture, Unity Catalog Strong experience designing ETL/ELT pipelines and data platforms...
$125k - $226.25k
...implementing enterprise-scale data platforms. Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture. Strong hands-on experience with Snowflake, including data modelling, performance...Temporary workFlexible hours$150k - $240k
..., and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate quality...Work at officeLocal areaRemote workWorldwide- ...and maintain scalable data solutions. Strong experience with Microsoft Azure data services Hands-on expertise in Databricks, Apache Spark, and data engineering workflows Proficiency in Alteryx for data preparation and analytics Strong knowledge of SQL, ETL/ELT processes...Full timeWorldwide
- ...different environments. Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments. Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management. Translate business requirements into technical blueprints, run proof-of-concepts...
- ...Responsibilities Databricks Engineering: Build scalable, secure data solutions on the Databricks Lakehouse Platform using Apache Spark, Delta Lake, and cloud-native services. Implement batch, streaming, ETL, ELT, analytics, and ML-enabled data pipelines. Apply medallion...Work experience placementLocal areaRemote work
- ...development. Strong experience designing and implementing enterprise-scale data pipelines. Hands-on expertise with: Python PySpark Spark SQL SQL Kafka Databricks Delta Lake Snowflake Hive Experience building data solutions on AWS cloud platforms. Strong understanding of...
$65.05 per hour
...experience designing, implementing, and maintaining distributed systems. ~ Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger. ~ Knowledge of Apache Iceberg and object storage such as S3 or Ozone. ~ Strong Python development for...Contract work- ...orchestration pipelines. Fabric Data Development Build and manage pipelines using Fabric Data Factory. Develop transformations using Spark notebooks (PySpark/SQL). Create and model Fabric Warehouses. Work with OneLake for unified storage and data access. Performance...Contract workRemote work
- ...sources. Implement data transformations, cleansing, enrichment, and validation processes. Create scalable solutions using PySpark, Spark SQL, and Delta Lake. Collaborate with business stakeholders, data architects, analysts, and application teams to define data requirements...Hourly payLocal areaRemote work
- ...cost optimization. Establish scalable data-lakehouse patterns for SAP and non-SAP data using Delta Lake, medallion architecture, Spark, Python, SQL, streaming, and batch pipelines. Administer and support Informatica platforms, such as PowerCenter, IDMC/IICS,...
- ...training, serving, and observability, and be the final escalation point for the most elusive infrastructure problems (GPU capacity, Spark tuning, production incidents) Own and evolve our paved-road framework (the shared CI/CD spine, model-workflow scaffolding, and Databricks...Remote work
- ...experience designing and developing enterprise-scale data engineering solutions Hands on experience with Databricks and Apache Spark for large-scale data processing Strong experience with Microsoft Azure data platforms and services Hands on experience designing...
