Sr. Data Engineer (Mid-Senior Level) - AWS & Streaming

Full Time Fort Mill, SC (3 days hybrid) Posted 3 months ago

ABOUT US

Leadership

SERVICES

JD Edwards Oracle Cloud AI Solutions NetSuite Salesforce Implementation Blockchain TrakSYS MES Managed IT Services Microsoft Dynamics 365 Power BI

INDUSTRIES

PRODUCTS

OneXcel IoT Solutions

RESOURCES

Whitepapers

CAREERS

Contact Us Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming Full Time Fort Mill, SC (3 days hybrid) Posted 3 months ago eone Infotech Job Description : Experience Level – 13-15+ Years Job Description We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms. Key Responsibilities: Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python Build event-driven workflows using AWS Lambda Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation Optimize data processing performance, scalability, reliability, and cost in cloud environments Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline Required Skills: Strong hands-on experience with Python and PySpark Proven expertise in AWS Glue, Lambda, and other cloud-native data services Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns) Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection) Strong understanding of distributed data processing and scalable architecture patterns Good-to-Have Skills: Experience with Apache Flink for real-time stream processing and stateful computations Knowledge of KSQL or other streaming SQL engines Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi Experience working in enterprise or financial data environments Job Qualification : Number of Positions : Multiple First Name Last Name Email Contact Number Current Location Zip code Relevant Experience Total Experience Key Skills Upload Resume Not readable? Change text. Enter Captcha Code Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming Full Time Fort Mill, SC (3 days hybrid) Posted 3 months ago eone Infotech Key Responsibilities: Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python Build event-driven workflows using AWS Lambda Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation Optimize data processing performance, scalability, reliability, and cost in cloud environments Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline Required Skills: Strong hands-on experience with Python and PySpark Proven expertise in AWS Glue, Lambda, and other cloud-native data services Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns) Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection) Strong understanding of distributed data processing and scalable architecture patterns Good-to-Have Skills: Experience with Apache Flink for real-time stream processing and stateful computations Knowledge of KSQL or other streaming SQL engines Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi Experience working in enterprise or financial data environments Job Qualification : Number of Positions : Multiple First Name Last Name Email Contact Number Current Location Zip code Relevant Experience Total Experience Key Skills Upload Resume Not readable? Change text. Enter Captcha Code IT Services JD Edwards Oracle Cloud AI Solutions NetSuite Salesforce Implementation Blockchain Traksys Microsoft Dynamics 365 Services Power BI Industries Health and Personal Care Manufacturing: Food & Beverages Energy, Utilities, Oil and Gas Paper goods, Construction and Industry Automation Automation IT Finance Company Leadership About Us Contact Us Careers Contact 515 Plainfield Av, Suite 203 Edison, NJ08817 View email address on click.appcast.io View phone number on click.appcast.io © 2026 eOne Infotech All Rights Reserved #J-18808-Ljbffr EOne Infotech