Lead Data Engineer (Fort Mill)
Coforge
Lead Data Engineer
Location : Fort Mill SC
Skills : Snowflake, AWS glue, Hive, Python and Pyspark.
Experience: +10 years
We at Coforge are hiring Lead Data Engineer with the following skill sets.
Design, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
Utilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
Implement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
Manage containerized applications using Docker and orchestrate them with Amazon EKS.
Design and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
Work with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Ensure data quality, integrity, and security throughout the data lifecycle.
Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Mandatory Skills
Strong experience with AWS services, particularly Glue and Lambda.
Proficiency in PySpark for data processing.
Expertise in Infrastructure as Code (IAC) using Terraform.
Solid SQL skills for data manipulation and querying.
Experience with containerization using Docker and orchestration with EKS.
Hands-on experience with data warehousing solutions like Snowflake or Redshift.
Familiarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
Proven ability to work in a cloud environment.
Preferred Skills
Experience with data governance and data quality frameworks.
Knowledge of data modeling and database design principles.
Familiarity with Agile methodologies and project management tools.
Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities.
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
8-12 years of experience in data engineering or a related role.
Proven track record of delivering data solutions in a cloud environment.
Strong understanding of data architecture and data management best practices.
- ...Senior Data Engineer Fort Mill, SC Responsibilities: Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake. Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks...SuggestedFull time
Coforge
Fort Mill, York County, SC4 days ago - ...Job Title: Senior AWS Data Engineer Experience: 8+ Years Skills: AWS Glue, Lambda, Pyspark, Python Location: Fort Mill, SC Job Description : Develop migration workflows based on the approved metadata extraction design. Implement support for full...SuggestedFull time
Coforge
Fort Mill, York County, SC4 days ago - ...security controls including SSO, MFA, dynamic data masking, row-level security, and secure... ...recommendations for improvement. Data Engineering Design, develop, and maintain scalable... ...and operational mindset. Ability to lead Snowflake architecture and administration...SuggestedFull time
NLB Services
Fort Mill, York County, SC4 days ago - ...Job Description Job Title: Senior AWS Data Engineer \n Experience: 8+ Years \n Skills: AWS Glue, Lambda, Pyspark, Python \n Location: Fort Mill, SC \n \n Job Description : \n \n \n Develop migration workflows based on the approved metadata extraction...Suggested
Coforge
Fort Mill, York County, SC14 days ago - ...Broad River Retail is looking for a Business Intelligence Developer in Fort Mill, SC. This position focuses on empowering business leaders through quality information and robust data analysis, supporting key initiatives, and driving business impact. The ideal candidate...Suggested
BROAD RIVER RETAIL
Fort Mill, York County, SC2 days ago - Pike Corporation in Fort Mill, SC offers an Engineering Intern role supporting a wide range of engineering initiatives and projects. This position emphasizes hands-on learning, data management, and documentation under supervision. You will assist in creating project schedules...Internship
- Pike Engineering in Fort Mill, SC seeks an Engineering Intern to assist on a variety of projects and initiatives. You will help create schedules, maintain spreadsheets, and support documentation and clerical tasks as part of project teams. Required are a High School Diploma...Internship
$79 - $89.94 per hour
...Description Job Description AI/ML Engineer Location: Fort Mill, SC Onsite Flexibility: Onsite... ...aligned with enterprise governance and data standards. Participate in architecture... ...About the Client This client is a leading provider of financial markets data...Contract workWorldwideWork visaGTT, LLC
Fort Mill, York County, SC20 days ago- ...Developer Location: 580 Kingsley Park Dr, Fort Mill, SC 29715 - Hybrid (3 days/ week in... ...hosted web application. Collaborate with data modelers, analysts, and business users to... ...within a team. Responsibilities: • Lead the demonstration of consistency to the LSEG...Contract workWork at office3 days per week
Hays
Fort Mill, York County, SC4 days ago $50 per hour
...Python Developer Location: Fort Mill, SC Onsite Flexibility: Hybrid... ...will collaborate with data modelers, analysts, and business... ...teams. Key Responsibilities Lead the demonstration of... ...includes software developers, data engineers, analysts, and infrastructure...Contract workWork at officeWorldwideWork visaGTT, LLC
Fort Mill, York County, SC3 days ago$84 per hour
...AI Engineer Location: Fort Mill, SC Duration: 12 Months Client: Apex Visa Restrictions: No OPT, CPT & H1b Sub Vending: No Pay Rate: $60/Hr on W2... ...and storing large volumes of structured and unstructured data Skills/Requirements (required): Expert understanding...H1bIntellisoft Technologies
Fort Mill, York County, SC5 days ago$25 - $30 per hour
...financial goals.Job Overview:LPL Financial is seeking a motivated Data Engineering Intern to help build and optimize the data platforms that... ...deserves objective financial guidance. As the nation’s leading independent broker-dealer, we offer an integrated platform of...Hourly payFull timeSummer workInternshipSummer internshipWork at officeWork from homeMonday to Friday$40.1 - $66.83 per hour
...advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the sustainable... ...in designing and developing micro servicesAbility to lead design discussions with Architecture TeamGood analytical, problem...Work from home$159.96k - $266.56k
...:LPL Financial is seeking a highly accomplished VP, Principal Data Engineer to drive the modernization of the investor experience across the... ...that enhance the investor experience.Responsibilities:Lead the delivery of scalable, high-quality, and cost-effective data...Work from home- ...security controls including SSO, MFA, dynamic data masking, row-level security, and secure... ...recommendations for improvement. Data Engineering Design, develop, and maintain scalable... ...and operational mindset. Ability to lead Snowflake architecture and administration...Ongoing contractLocal area
NLB Services
Fort Mill, York County, SC3 hours ago - ...Job Description Job Description Data Engineer Technology | Rock Hill, SC (Hybrid) | Full-Time Mission Statement: At ARC... ...services that help power the world. ARC Energy Services exists to lead as a trusted services provider by delivering dependable...Full timeFor contractorsCasual workWork at officeRemote work
Arc Energy Services
Rock Hill, SC3 days ago $18 - $50 per hour
...career with us at Siemens Digital Industries Software! We are a leading global software company dedicated to the world of computer... ...: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and...Remote jobHourly payFull timeInternshipLocal areaSiemens
Rock Hill, SC1 day ago$107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Rock Hill, SC2 days ago- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Rock Hill, SC2 days ago - ...Job Title AI Software Engineer Intern Date posted 14-Oct-2026 Job ID 137214 City / Township / Village POUGHKEEPSIE, DURHAM, San Jose, New York State / Province New York, North Carolina, California Country United States Work arrangement Hybrid...Contract workFixed term contractInternshipShift work
IBM
Rock Hill, SC4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Fort Mill). Be the first to apply!
- clinical data coordinator remote Fort Mill, York County, SC
- data collection Fort Mill, York County, SC
- test data management Fort Mill, York County, SC
- data internship Fort Mill, York County, SC
- data intern Fort Mill, York County, SC
- data network cabling Fort Mill, York County, SC
- data Fort Mill, York County, SC
- data tech Fort Mill, York County, SC
- data loss prevention analyst Fort Mill, York County, SC
- sap master data Fort Mill, York County, SC