Get new jobs by email
$175k - $195k
...: Who You Are Quantifind is seeking a Senior Platform Engineer to work on Quantifind's Apache Spark pipeline that generates risk signal results from diverse data sources such as Sanctions, PEP records, Negative News, Court & Arrest records, and much more. You will...SuggestedFull timeWork at officeImmediate startWork from homeFlexible hours- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...to provide his employees with access to affordable, high‑quality health care. And what started as doing the right thing, ended up sparking a health care revolution. Now 30 years later, we partner with employers across the nation to provide value‑driven health and wellness...SuggestedLocal area
- ...minimum 2 years hands-on Microsoft Fabric experience. Skills & Tools: Expert-level Microsoft Fabric: Lakehouse, Delta Lake, Spark, Pipelines, OneLake. Deep SQL Server: stored procedure analysis, database design patterns, query optimization. Hands-on...Suggested
- ...for accuracy before they enter client deliverables. Skills & Tools Expert-level Microsoft Fabric: Lakehouse, Delta Lake, Spark, Pipelines, OneLake. Deep SQL Server: stored procedure analysis, database design patterns, query optimization. Hands-on SSIS...SuggestedRemote workShift work
$143k - $243k
...quality, and sustainable healthcare for all. Our company culture: Our talented employees - or athenistas, as we call ourselves - spark the innovation and passion needed to accomplish our vision. We are a diverse group of dreamers and do-ers with unique knowledge,...SuggestedFull timeTemporary workWork at office- ...lineage, auditability, and integration with enterprise governance services such as Purview. Optimize solution performance by tuning Spark workloads, cluster policies, partitioning strategy, file sizing, caching, and compute cost management for large-scale data...SuggestedPermanent employmentFull timeContract workRemote work
$90k - $200k
...Redshift, Aurora, Presto, BigQuery, Oracle DevOps: git, docker, subversion, Kubernetes, Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR Popular Certifications: AWS Cloud Practitioner, Microsoft Azure Data Fundamentals...SuggestedWork at officeRemote workVisa sponsorshipFlexible hours- ...Responsibilities: Lead architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Apache Spark (Core, SQL, Structured Streaming). Establish lakehouse patterns with Delta Lake (ACID transactions, schema evolution, time travel...SuggestedWork at office
- ...Catalog, Lakeflow / Delta Live Tables, Databricks SQL, Photon, Serverless, Auto Loader, Databricks Apps, Vector Search Apache Spark (expert): PySpark and Scala; internals DAG execution, shuffle optimisation, memory tuning, adaptive query execution, Structured Streaming...SuggestedWorldwide
- ...advanced analytics use cases Data Engineering & Use Case Delivery: Build and optimize batch and streaming data pipelines using Spark and Delta Lake Develop data products and domain-oriented pipelines aligned to enterprise data strategies Lead end-to-end use...SuggestedTemporary workRelocationFlexible hours
- ...Snowflake Data Engineer Location: Plano, TX Local F2F Required SnowSQL Apache Spark Design, develop, and maintain data pipelines using Snowflake and modern data engineering tools. Build and optimize data models (dimensional, star/snowflake schemas)...SuggestedLocal area
- ...Augmented Generation (RAG) solutions for metadata discovery and data catalog search. Build metadata extraction pipelines from SQL, Spark jobs, stored procedures, Airflow, dbt, and BI tools. Automate impact analysis, dependency mapping, and data governance...Suggested3 days per week
- ...Databricks notebooks, workflows, and jobs for production pipelines Ensure data quality, governance, and lineage across pipelines Optimize Spark jobs for performance (partitioning, caching, tuning) Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)...SuggestedFull time
$148k - $216k
...familiarity with specialized ML lifecycle and data processing tools and platforms such as MLflow, Kubeflow, SparkML, Synapse ML, SQL, Spark/PySpark, dbt, and Airflow. Cloud Foundations: Practical experience operating within a major cloud ecosystem-e.g., AWS, Google Cloud...SuggestedRemote workFlexible hours- ...engineering, ETL development, or data platform development. ~ Strong hands-on development experience with: Python, PySpark / Apache Spark, Advanced SQL. ~ Experience with Machine Learning model development, training, and tuning. ~ Experience working with large-...Contract workRemote workVisa sponsorship
- ...including: SQL and data modeling Microsoft Fabric Data Engineering Lakehouse architecture OneLake Apache Spark and PySpark Fabric Notebooks Fabric Data Factory Data Pipelines and ETL/ELT Data Warehousing Real-Time...
$135.81k - $231.25k
...managing and processing data across systems, particularly in Azure Databricks Knowledgeable in big data technologies (e.g., Hadoop, Spark) and their integration with cloud platforms for handling large volumes of data securely and efficiently Experience with...Full timeContract workTemporary workPart timeCasual workWork at officeLocal areaMonday to FridayShift work$750 per month
...semantic models, business entity mappings, data dictionaries, and governed analytical datasets required. Strong experience with Apache Spark, PySpark, SQL, Python, DataOps automation, CI/CD pipelines, and cloud-native data engineering practices required. Experience...Work experience placementWork at officeRemote workFlexible hours- ...Skills: ~9+ years of IT experience ~ Azure Databricks ~ Azure Data Factory (ADF) ~ PySpark ~ Python ~ Apache Spark ~ Azure Data Engineering ~ Experience building scalable ETL/ELT data pipelines Preferred Skills: SQL Gen...Contract workRelocation
$110k
...retirement or somewhere in-between, we encourage you to grow with us. Pride. Our private fleet drivers are proud to represent the Walmart spark on the road. It symbolizes their dedication to delivering on our customer promise, while prioritizing safety on the road. Pride in...Daily paidPermanent employmentFull timeTemporary workPart timeLocal areaImmediate startWeekend workAfternoon shift- ...schemas, Data Vault, Kimball, Inmon). • Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop). • Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. • Understanding of data governance...Work at officeRemote workFlexible hours
- ...to Azure-native services. Oversee Azure IaaS and PaaS services including Key Vault, Synapse, Data Factory, Databricks, Apache Spark, SQL MI, APIM, App Gateway, and App Services. Implement and enforce cloud security, cost management, and compliance protocols in...Permanent employmentLocal area3 days per week
- ...pattern-driven ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks. Transform & Structure Data: Use Spark SQL, DBT, and Azure Synapse to transform raw data into structured, analytics-ready formats. Implement data quality checks and schema...Hourly payLocal areaFlexible hours3 days per week
- ...platform engineering, cloud infrastructure, distributed data processing, and platform operations. Technical Skills: AWS, Apache Spark, Apache Flink, Apache Airflow, Kubernetes, Python, Iceberg, HDFS. Business / Domain Skills: Data Engineering, Cloud Platform...Full time
- ...technical leadership or lead engineer role. ~ Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.). ~ Proficient in programming languages such as Python and SQL; experience with Shell...Work at office3 days per week
$124.7k - $180.65k
...database and strong SQL development experience required, Experience with DB2 preferred. ~ Experience with Big data technologies Hadoop, Spark and No-SQL database like Cassandra preferred. ~ Experience with scheduling tools like Control M, CA-ESP or Autosys desirable. ~...Full timeWork experience placementWork at officeLocal area- ...Lake, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure SQL. Experience building scalable data pipelines, optimizing Spark workloads, and implementing data governance and security is required. Knowledge of CI/CD, Terraform, Azure DevOps, Unity Catalog,...Remote work
- ...Warehousing Data Mapping & Lineage Data Documentation Data Quality Analysis Preferred Python dbt Spark/PySpark Azure, AWS, or Google Cloud Platform Git/GitHub Data Governance Tools BI Platforms (Power BI, Tableau,...Day shift
- ...years of experience with cloud and infrastructure on Azure (preferred), AWS, or Google Cloud Platform. ~ Hands-on experience with Spark, Python, and SQL to build, test, and maintain data pipelines (including writing clear, maintainable code and queries). ~...Temporary workWork at office