Get new jobs by email
- ...preferred. Knowledge of automation tools and AI-assisted development practices. Preferred exposure to distributed data (Kafka, MQ, Spark), distributed cloud services, Snowflake, C++ or Groovy, and CI/CD tools such as Jenkins, Harness, Ansible, and Docker. Education Requirements...SuggestedHourly payWork experience placementLocal area
- ...Experience with cloud architecture and technologies, in particular Amazon Web Services Experience with technologies like Spark, Kubernetes, Docker, Jenkins, Hive, Terraform is highly desirable For applications and inquiries, contact:****@*****.***...SuggestedLocal areaRemote work
- ...Job Summary We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based data platforms. The ideal candidate will have hands-on experience designing and implementing scalable data solutions...Suggested
- ...minimum 2 years hands-on Microsoft Fabric experience. Skills & Tools: Expert-level Microsoft Fabric: Lakehouse, Delta Lake, Spark, Pipelines, OneLake. Deep SQL Server: stored procedure analysis, database design patterns, query optimization. Hands-on...Suggested
- ...for accuracy before they enter client deliverables. Skills & Tools Expert-level Microsoft Fabric: Lakehouse, Delta Lake, Spark, Pipelines, OneLake. Deep SQL Server: stored procedure analysis, database design patterns, query optimization. Hands-on SSIS...SuggestedRemote workShift work
- ...Catalog, Lakeflow / Delta Live Tables, Databricks SQL, Photon, Serverless, Auto Loader, Databricks Apps, Vector Search Apache Spark (expert): PySpark and Scala; internals DAG execution, shuffle optimisation, memory tuning, adaptive query execution, Structured Streaming...SuggestedWorldwide
$148k - $216k
...familiarity with specialized ML lifecycle and data processing tools and platforms such as MLflow, Kubeflow, SparkML, Synapse ML, SQL, Spark/PySpark, dbt, and Airflow. Cloud Foundations: Practical experience operating within a major cloud ecosystem-e.g., AWS, Google Cloud...SuggestedRemote workFlexible hours- ...Responsibilities: Lead architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Apache Spark (Core, SQL, Structured Streaming). Establish lakehouse patterns with Delta Lake (ACID transactions, schema evolution, time travel...SuggestedWork at office
- ...Snowflake Data Engineer Location: Plano, TX Local F2F Required SnowSQL Apache Spark Design, develop, and maintain data pipelines using Snowflake and modern data engineering tools. Build and optimize data models (dimensional, star/snowflake schemas)...SuggestedLocal area
- ...lineage, auditability, and integration with enterprise governance services such as Purview. Optimize solution performance by tuning Spark workloads, cluster policies, partitioning strategy, file sizing, caching, and compute cost management for large-scale data...SuggestedPermanent employmentFull timeContract workRemote work
$90k - $200k
...Redshift, Aurora, Presto, BigQuery, Oracle DevOps: git, docker, subversion, Kubernetes, Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR Popular Certifications: AWS Cloud Practitioner, Microsoft Azure Data Fundamentals...SuggestedWork at officeRemote workVisa sponsorshipFlexible hours$750 per month
...semantic models, business entity mappings, data dictionaries, and governed analytical datasets required. Strong experience with Apache Spark, PySpark, SQL, Python, DataOps automation, CI/CD pipelines, and cloud-native data engineering practices required. Experience...SuggestedWork experience placementWork at officeRemote workFlexible hours- ...engineering, ETL development, or data platform development. ~ Strong hands-on development experience with: Python, PySpark / Apache Spark, Advanced SQL. ~ Experience with Machine Learning model development, training, and tuning. ~ Experience working with large-...SuggestedContract workRemote workVisa sponsorship
$135.81k - $231.25k
...managing and processing data across systems, particularly in Azure Databricks Knowledgeable in big data technologies (e.g., Hadoop, Spark) and their integration with cloud platforms for handling large volumes of data securely and efficiently Experience with...SuggestedFull timeContract workTemporary workPart timeCasual workWork at officeLocal areaMonday to FridayShift work- ...including: SQL and data modeling Microsoft Fabric Data Engineering Lakehouse architecture OneLake Apache Spark and PySpark Fabric Notebooks Fabric Data Factory Data Pipelines and ETL/ELT Data Warehousing Real-Time...Suggested
- ...advanced analytics use cases Data Engineering & Use Case Delivery: Build and optimize batch and streaming data pipelines using Spark and Delta Lake Develop data products and domain-oriented pipelines aligned to enterprise data strategies Lead end-to-end use...Temporary workRelocationFlexible hours
- ...Augmented Generation (RAG) solutions for metadata discovery and data catalog search. Build metadata extraction pipelines from SQL, Spark jobs, stored procedures, Airflow, dbt, and BI tools. Automate impact analysis, dependency mapping, and data governance...3 days per week
- ...Databricks notebooks, workflows, and jobs for production pipelines Ensure data quality, governance, and lineage across pipelines Optimize Spark jobs for performance (partitioning, caching, tuning) Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)...Full time
$143k - $243k
...quality, and sustainable healthcare for all. Our company culture: Our talented employees - or athenistas, as we call ourselves - spark the innovation and passion needed to accomplish our vision. We are a diverse group of dreamers and do-ers with unique knowledge,...Full timeTemporary workWork at office- ...Permission Sets Application Roles Security Trees Integration Development Vault REST API Direct Data API Spark Messaging Vault Java SDK REST API Design Web API Development API Security Integration Architecture...
- ...Preferred Skills Data Operations: Experience managing Lakehouse architectures and data platform components (e.g., Apache Spark, Trino, Apache Ranger, Apache Iceberg, Apache Superset, data catalogs). Security & Governance: Familiarity with AWS Secrets Manager...
$139k - $257.55k
...data platforms like Databricks, Snowflake. ~ Proficiency in SQL and at least one modern data transformation framework (e.g., dbt, Spark, Dataflow). ~ Hands-on experience building and maintaining high-capacity data integration solutions in cloud environments (AWS,...Temporary workLocal areaWorldwide- ...to Azure-native services. Oversee Azure IaaS and PaaS services including Key Vault, Synapse, Data Factory, Databricks, Apache Spark, SQL MI, APIM, App Gateway, and App Services. Implement and enforce cloud security, cost management, and compliance protocols in...Permanent employmentLocal area3 days per week
- ...business analysts, and cross functional teams to gather and translate business requirements into technical solutions. Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency. Ensure data quality, reliability, and compliance through...Contract work
$175k - $220k
...participating alongside returning investors Altimeter Capital, Avenir Growth Capital, D1 Capital Partners, K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures, and XN. This milestone follows Sigma reaching $200M in annual recurring revenue in April 2026, with...Full timeWork at officeFlexible hours- ...Data Factory (ADF) and pipeline orchestration. Proficiency in Python (PySpark, Pandas, NumPy) and SQL . Experience with Spark SQL , performance tuning, and distributed data processing. Solid understanding of Azure ecosystem : ADLS, Synapse Analytics,...Contract workRemote work
- ...pattern-driven ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks. Transform & Structure Data: Use Spark SQL, DBT, and Azure Synapse to transform raw data into structured, analytics-ready formats. Implement data quality checks and schema...Hourly payLocal areaFlexible hours3 days per week
- ...enforcement, and governance-as-code. Develop metadata-driven frameworks for scalable data ingestion, transformation, and publishing using Spark and Delta Lake. Build reusable platform services, libraries, templates, and integrations that accelerate development and promote...Temporary work
- ...years of experience with cloud and infrastructure on Azure (preferred), AWS, or Google Cloud Platform. ~ Hands-on experience with Spark, Python, and SQL to build, test, and maintain data pipelines (including writing clear, maintainable code and queries). ~...Temporary workWork at office
- ..., Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure SQL . Experience building scalable data pipelines, optimizing Spark workloads, and implementing data governance and security is required. Knowledge of CI/CD, Terraform, Azure DevOps, Unity Catalog, and...Remote work