Data Engineer: Streaming IoT on Databricks & Delta Lake
Sunbelt Rentals
Sunbelt Rentals, Inc. in Fort Mill, SC seeks a Data Engineer to develop and maintain data ingestion and transformation pipelines on Databricks using Python and SQL, and to build streaming and batch workflows that process high-frequency IoT telemetry data from fleet devices. You will create and manage Delta Lake tables across Bronze, Silver, and Gold layers, write reliable, well-structured pipeline code, and monitor data quality while collaborating with senior engineers, analysts, and data #J-18808-Ljbffr Sunbelt Rentals
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer: Streaming IoT on Databricks & Delta Lake in Fort Mill, York County, SC vacancy
- Sunbelt Rentals, Inc. is seeking a Senior Data Engineer to design, build, and maintain end-to-end IoT data pipelines into Databricks, focusing on streaming ingestion, data quality, and Delta Lake operations. The role requires strong Python/SQL, Spark, and Kafka experience...Databricks
$130.32k - $179.18k
...and maintain end-to-end IoT data pipelines from edge devices into Databricks using the medallion... ...development and optimization of streaming ingestion pipelines... ...and enforce data engineering best practices, including... ...Architect and manage Delta Lake tables, including partitioning...DatabricksFull timeTemporary workFlexible hoursNight shiftWeekend workSunbelt Rentals
Fort Mill, York County, SC2 days ago$113.34k - $155.85k
...Develop and maintain data ingestion and... ...transformation pipelines on Databricks using Python and... ...Build and support streaming and batch... ...process high-frequency IoT telemetry data... ...Create and manage Delta Lake tables across Bronze... ...Collaborate with senior engineers, analysts, and...DatabricksFull timeTemporary workFlexible hoursNight shiftWeekend work- ...Data EngineerWe are seeking an experienced Data Engineer to design, build, and enhance data ingestion pipelines and metadata... ...to Airflow, dbt, or Databricks for orchestration and transformationBasic... ...pipeline readinessAzure data platform exposure (ADF, Synapse, Data Lake)...Databricks
Euclid
Fort Mill, York County, SC4 days ago $39.86 - $62.29 per hour
...of IT experience and deep expertise in data engineering and cloud-based data platforms (Snowflake... ...including data ingestion, data lakes, data warehouses, reporting, and analytics... ...including: SnowSQL, Snowpark, Snowpipe Tasks, Streams, Stored Procedures Time Travel, Zero-...SuggestedCapgemini
Fort Mill, York County, SC3 days ago- Incedo Inc. is a high-growth Digital, Data and AI Transformation Specialist firm headquartered... ...AI @ Scale through the “Power of 3”: Engineering & Operations excellence. Job... ...Experience with Snowflake, Redshift, or Databricks. Experience working with large-scale distributed...Databricks
- We are seeking a Mid-Senior Data Engineer with strong expertise in AWS-based... ...data engineering, real-time streaming technologies, and enterprise-... ...Familiarity with data lake/lakehouse architectures and table... ...table formats such as Iceberg, Delta, or Hudi Experience working...
$40.1 - $66.83 per hour
...advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the... ...PostgreSQL, and other data stores. Implement messaging and streaming solutions using Kafka. Write clean, maintainable, and testable...Work from homeLPL Financial Holdings, Inc.
Fort Mill, York County, SC4 days ago$39.86 - $62.29 per hour
Data Engineer (AWS Glue, Airflow, Lambda, Postgres) We are seeking a skilled Data Engineer with... ..., and curation across data lake layers. Develop and manage Airflow DAGs... ...of data lake formats (Parquet, Iceberg, Delta). Understanding of data modeling, partitioning...Contract work- ...Capgemini is looking for an experienced Developer based in South Carolina to design, implement, and optimize data engineering solutions. With over 10 years of IT experience, the ideal candidate will have deep expertise in Snowflake and cloud platforms including AWS and...
Capgemini
Fort Mill, York County, SC3 days ago - ...modernization, migration, and platform engineering initiatives, aligning... ...with security, networking, data, application, and operations... .../Aurora/DynamoDB), messaging/streaming (MSK/Kinesis/SQS), and serverless... ...platforms (e.g., SAS, Databricks, EMR, MSK/Kinesis) and data governance...Databricks
eTeam
Fort Mill, York County, SC4 days ago - ...role focuses on designing, developing, and automating end-to-end data pipelines to deliver scalable data integration and data... ...practices. Strong communication and leadership skills. Preferred AWS certifications (Solutions Architect, Data Engineer). #J-18808-Ljbffr...
Signature IT World Inc
Fort Mill, York County, SC3 days ago - # Data Engineer**Job Duties:**Design and implement efficient large-scale data solutions in areas data ingestion, data curation, data quality... ..., Tableau and MicroStrategy. Manage and query data in data lakes and/or cloud data repositories Google BigQuery and AWS Redshift...Full timeRelocation
Pantar Solutions
Weddington, NC4 days ago - ...AWS Data EngineerLocation: Austin Tx, Fort Mill or NY – hybridContractVisa: USC & GCJob DescriptionArchitect and implement data pipelines... ...with security standards.Lead and mentor a team of data engineers.Collaborate with cross-functional teams including Data Scientists...
AceStack LLC
Fort Mill, York County, SC4 days ago $95k - $120k
...Data Engineer The Data Engineer will be responsible for a wide variety of tasks which include all aspects of the development and delivery of data solutions and maintaining the enterprise data warehouse. You will work closely with business analysts, product managers,...Full timeWork at officeFlexible hoursTwo Harbors Investment Corp
Fort Mill, York County, SC2 days ago$130.32k - $179.18k
...technical stakeholders What You'll Bring 5+ years of experience in data science or quantitative analytics, with demonstrated impact on... ...choice Proficiency in Python and SQL; experience with Spark / Databricks a strong plus Experience building and deploying ML models in a...DatabricksFull timeTemporary workFlexible hoursNight shiftWeekend workSunbelt Rentals
Fort Mill, York County, SC2 days ago- ...We are seeking a Lead Data Engineer with strong experience in delivering enterprise-scale cloud data and analytics solutions. The ideal candidate will have expertise in Google Cloud Platform (GCP), technical project leadership, and end-to-end delivery of modern data platforms...
Techvilla Solutions
Fort Mill, York County, SC3 days ago - Incedo Inc. is seeking an experienced Data Engineer with strong AWS OpenSearch expertise to design and maintain scalable data pipelines and search solutions. The role emphasizes Python, SQL, and cloud-native architectures to support analytics and real-time search across...
$39.86 - $62.29 per hour
Capgemini is seeking a skilled Data Engineer (AWS Glue, Airflow, Lambda, Postgres) in Fort Mill, South Carolina. The role involves designing and building scalable data pipelines and performing analytics on AWS and Postgres platforms. The ideal candidate should have 6+ years...- Role Data Engineer (Snowflake, AWS) - Location: Fort Mill, SC / ONSITE - Duration: Long Term Project - Experience: 10+ Job Role and Responsibilities Responsible for designing, developing and maintaining scalable data pipelines and ETL processes using AWS Glue. This role...
- Coforge is hiring a senior Data Engineer in Fort Mill, SC to design and support robust ETL pipelines using Snowflake, DBT, Python and Airflow. You will own data integration across source systems, ensure data quality and drive reconciliation across stages. You will analyze...
- ...Apache Airflow, AWS Glue, Amazon S3, SQL Server/T-SQL, Informatica Location: Fort Mill SC Job Description: We at Coforge are hiring Data Engineer with the following skill sets. Strong hands-on experience in Snowflake, DBT, Python, Apache Airflow, AWS Glue, Amazon S3, SQL...
- ...This role bridges enterprise data architecture and applied AI, defining how AI/ML technologies... ...predictive analytics into existing data-engineering processes. Collaborate with data-... ...Azure AI Services , AWS SageMaker , Databricks ML , and OpenAI APIs . Define...Databricks
Euclid Innovations
Fort Mill, York County, SC3 days ago - ...with leaders across fleet, operations, supply chain, finance, data engineering, and other business functions.Help strengthen how... ....The opportunity to work with large, complex datasets using Databricks, Power BI, Python, R, and SQL.Direct exposure to senior operational...Databricks
- Tech Mirrors in Fort Mill, SC is seeking a Data Engineer specializing in Snowflake and AWS. The ideal candidate will design, develop, and maintain scalable data pipelines and ETL processes using AWS Glue, and collaborate with data professionals to ensure data quality. Responsibilities...
- A tech recruitment firm is searching for an ETL/Data Tester in Fort Mills, SC with a hybrid work model. The ideal candidate should have a minimum of 8 years of experience in ETL/Data Testing and 12+ years overall. Key skills required include Snowflake, Automation using...Contract work
- ...organization continuing to invest heavily in its data and analytics capabilities.Partner... ...of Finance, Analytics, Data Engineering, and Data Governance.Join a team focused... ...tools and platforms including Power BI and Databricks.An opportunity to combine business partnership...Databricks
$50 per hour
...Responsibilities: Lead the demonstration of consistency to the company data standard policies and procedures. Adapt quickly to new... ...with AWS, Azure, or other cloud providers. Experience with Databricks, ADF, Glue, ETL, and ELT processes. Proven ability to work...DatabricksHourly payWork at officeAxelon
Fort Mill, York County, SC5 days ago- ...seeking an AWS ETL Technical Lead to design and develop scalable data pipelines and warehouse solutions. This role involves leading... ...familiarity with CI/CD practices. Preferred certifications include Solutions Architect and Data Engineer. #J-18808-Ljbffr Signature IT World Inc
$175.92k - $293.14k
...LPL Financial is seeking a VP, Principal Engineer / Tech Lead to design modern cloud-based data capabilities that transform enterprise compensation processing. The role includes providing hands-on technical leadership and collaborating with various teams to modernize...LPL Financial
Fort Mill, York County, SC3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer: Streaming IoT on Databricks & Delta Lake. Be the first to apply!
Related searches
- data center engineer Fort Mill, York County, SC
- senior cloud data engineer Fort Mill, York County, SC
- sr information security engineer Fort Mill, York County, SC
- etl data engineer Fort Mill, York County, SC
- data engineer analytics Fort Mill, York County, SC
- data engineer machine learning Fort Mill, York County, SC
- finance data engineer Fort Mill, York County, SC
- data engineer Fort Mill, York County, SC
- data developer Fort Mill, York County, SC
- senior data center engineer Fort Mill, York County, SC