Lead Data Engineer (Fort Mill)
COFORGE Marketing
Lead Data Engineer
Location : Fort Mill SC
Skills : Snowflake, AWS glue, Hive, Python and Pyspark.
Experience: + 10 years
We at Coforge are hiring Lead Data Engineer with the following skill sets.
Design, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
Utilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
Implement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
Manage containerized applications using Docker and orchestrate them with Amazon EKS.
Design and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
Work with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Ensure data quality, integrity, and security throughout the data lifecycle.
Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Mandatory Skills
Strong experience with AWS services, particularly Glue and Lambda.
Proficiency in PySpark for data processing.
Expertise in Infrastructure as Code (IAC) using Terraform.
Solid SQL skills for data manipulation and querying.
Experience with containerization using Docker and orchestration with EKS.
Hands-on experience with data warehousing solutions like Snowflake or Redshift.
Familiarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
Proven ability to work in a cloud environment.
Preferred Skills
Experience with data governance and data quality frameworks.
Knowledge of data modeling and database design principles.
Familiarity with Agile methodologies and project management tools.
Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities.
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
8-12 years of experience in data engineering or a related role.
Proven track record of delivering data solutions in a cloud environment.
Strong understanding of data architecture and data management best practices.
- ...Snowflake Data EngineerLocation - Fort Mill, SC12 months plus contractRate – DOEStart – ImmediatelyThe candidate should have a deep understanding... ...updated on the latest technologies and best practices in data engineering.QualificationsBachelor's degree in Computer Science,...Suggested
Staffing the Universe
Fort Mill, York County, SC10 hours ago - ...Senior Data Engineer Fort Mill, SC Responsibilities: Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake. Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks...Suggested
COFORGE Marketing
Fort Mill, York County, SC5 days ago - ...Job Title: Sr. Software Engineer Location: Fort Mill – SC Onsite Work Arrangement:Onsite Employment Type: Contract About the Role We are seeking an experienced Sr. Software Engineer to join our team. Top skills required for this role: Python, ....SuggestedContract workLocal area
ThemeSoft
Fort Mill, York County, SC3 days ago - ...Greetings From Skysoft Role: .NET Lead Developer With Python Location: Fort Mill, South Carolina Work... ...application development, establish engineering standards, conduct code reviews,... ...service boundaries, API contracts, data models, error handling, and application...SuggestedH1b
Skysoft USA
Fort Mill, York County, SC3 days ago - ...We are looking for an experienced Data Automation Engineer with strong expertise in Python, PyTest, database testing, SQL, and ETL validation to support data quality and automation initiatives. Key Responsibilities: Develop and maintain Python-based automation frameworks...Suggested
Axiom Global Technologies
Fort Mill, York County, SC11 hours ago - ...security controls including SSO, MFA, dynamic data masking, row-level security, and secure... ...recommendations for improvement. Data Engineering Design, develop, and maintain scalable... ...and operational mindset. Ability to lead Snowflake architecture and administration...Ongoing contractLocal area
Nlb Services
Fort Mill, York County, SC5 days ago - ...Job Title: Senior AWS Data Engineer Experience: 8+ Years Skills: AWS Glue, Lambda, Pyspark, Python Location: Fort Mill, SC Job Description : Develop migration workflows based on the approved metadata extraction design. Implement support for full...Full time
Coforge
Fort Mill, York County, SC4 days ago - ...AWS Data EngineerLocation: Fort Mill, SC Duration: Longterm Contract Note: We need candidate to work onsite from Day 1 (Hybrid)Key Responsibilities:Design, develop, and maintain scalable data pipelines and data integrations across systemsImplement data ingestion, transformation...Contract work
E-Solutions
Fort Mill, York County, SC4 days ago - ...AWS Data EngineerLocation: Austin Tx, Fort Mill or NY – hybridContractVisa: USC & GCJob DescriptionArchitect and implement data pipelines... ..., and compliance with security standards.Lead and mentor a team of data engineers.Collaborate with cross-functional teams including...
AceStack LLC
Fort Mill, York County, SC4 days ago - ...Hiring: Python Data Automation Engineer – Fort Mill, SC We are seeking a skilled Data Automation Engineer with expertise in Python automation PyTest automation framework development database testing and ETL validation The ideal candidate will have a strong background...Long term contract
New York Technology Partners
Fort Mill, York County, SC1 day ago - ...Job Description Job Title: Senior AWS Data Engineer \n Experience: 8+ Years \n Skills: AWS Glue, Lambda, Pyspark, Python \n Location: Fort Mill, SC \n \n Job Description : \n \n \n Develop migration workflows based on the approved metadata extraction...
Coforge
Fort Mill, York County, SC21 days ago $60 - $87 per hour
Description Principal AWS Data Engineer: This is a top-level technical leader who designs, builds... ...is hands-on, but they will oversee and lead the team from a data perspective (... ...This is a Contract position based out of Fort Mill, SC. Pay and Benefits The pay range for...Contract workTemporary work- Data Engineer - Fort Mill, SC - Contract - W2 - $44-54 Per HR Description Engage in platform administration and data engineering within a cloud environment. Collaborate with teams to enhance the data ecosystem and ensure operational excellence. Design scalable data solutions...Contract work
- Pike Corporation in Fort Mill, SC offers an Engineering Intern role supporting a wide range of engineering initiatives and projects. This position emphasizes hands-on learning, data management, and documentation under supervision. You will assist in creating project schedules...Internship
$159.96k - $266.56k
LPL Financial is seeking a VP, Principal Data Engineer to modernize the investor experience... ...streaming solutions. Key Responsibilities Lead the delivery of scalable, high-quality,... ...tools. Compensation and Location Location: Fort Mill, SC (onsite) Salary: USD 159,959 to 266...- Pike Engineering in Fort Mill, SC seeks an Engineering Intern to assist on a variety of projects and initiatives. You will help create schedules, maintain spreadsheets, and support documentation and clerical tasks as part of project teams. Required are a High School Diploma...Internship
$66 per hour
...employment Visa at this time. AI/ML Engineer Location: Fort Mill, SC Onsite Flexibility: Onsite... ...with enterprise governance and data standards. Participate in architecture... ...About the Client This client is a leading provider of financial markets data and...Contract workWorldwideWork visaGlobal Technical Talent, an Inc. 5000 Company
Fort Mill, York County, SC2 days ago- ...Data EngineerThe Data Engineer will be responsible for a wide variety of tasks which include all aspects... ...in 2009, Two Harbors has grown into a leading publicly traded residential mortgage... ...returns to our stockholders.LocationFort Mill, SCCoppell, TXEmployee...Flexible hours
Two Harbors Investment Corp
Fort Mill, York County, SC4 days ago $40.1 - $66.83 per hour
...Software Engineer IIWhere Ambition Meets InnovationBuild a career that... ...services.Build and optimize data pipelines using AWS Glue and PySpark... ...micro servicesAbility to lead design discussions with Architecture... ...onsite presence at our Fort Mill SC office 2–3 days per week, as...Work at officeWork from home2 days per week3 days per weekThe Private Trust Company, an affiliate of LPL
Fort Mill, York County, SC3 days ago- ...Global Technical Talent, Inc. is seeking a Python Developer in Fort Mill, SC to develop and maintain an AWS-hosted web application with a React frontend and Python backend. You will collaborate with data modelers, analysts, and business users across product teams to ensure...Contract work
Global Technical Talent
Fort Mill, York County, SC5 days ago $121.98k - $130.53k
...Senior Data EngineerThe Senior Data Engineer is a data expert and plays a key role in the development and deployment of innovative big data platforms for advanced analytics and data processing. Supports building scalable and effective solutions using modern technology...First American
Fort Mill, York County, SC4 days ago- Must Have Skills ETL process validation Database Testing and SQL Complex Queries Handson experience with cloud platforms such as AWS Azure or GCP Strong Python programming skills with handson experience in PyTest Experience designing developing and maintaining...
GAC Solutions
Fort Mill, York County, SC1 day ago - Position Summary We are seeking an experienced Data Engineer to design, build, and enhance data ingestion pipelines and metadata frameworks that support data lineage, modernization, and analytics enablement. The ideal candidate has hands-on experience with AWS Glue , Python...
$50 per hour
...Python Developer Location: Fort Mill, SC Onsite Flexibility: Hybrid... ...application. Collaborate with data modelers, analysts, and... ...teams. Key Responsibilities Lead the demonstration of consistency... ...software developers, data engineers, data modelers, analysts, and...Contract workWork at officeWorldwideWork visa- ...Shoe Carnival is seeking an eCommerce Integration Engineer to own data reliability and automation across our OMS and SFCC platforms. You will build Python-based automation on Heroku, manage CI/CD via GitHub, and monitor data pipelines for disruption-free operations....
Pho Prime, LLC
Fort Mill, York County, SC5 days ago - ...Job Description Job Description Data Engineer Technology | Rock Hill, SC (Hybrid) | Full-Time Mission Statement: At ARC... ...services that help power the world. ARC Energy Services exists to lead as a trusted services provider by delivering dependable...Full timeFor contractorsCasual workWork at officeRemote work
Arc Energy Services
Rock Hill, SC10 days ago - AI/ML Engineer (Hands On Exp In AWS Bedrock) Location: Austin, TX and South Carolina 6-month... ..., LLM evaluation, dispositioning, data migration, and productionization. Review... ...software architecture with recent experience leading GenAI or Agentic AI delivery pods. Confirmed...Contract work
- LPL Financial seeks a VP, Principal Data Engineer to modernize investor data platforms across Reporting, Statements and Letters for 2.4M+... ...cloud-native services with strict standards and best practices. Lead engineering pods, mentor teams, and drive cloud transformation...
$18 - $50 per hour
...career with us at Siemens Digital Industries Software! We are a leading global software company dedicated to the world of computer... ...: Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and...Remote jobHourly payFull timeInternshipLocal areaSiemens
Rock Hill, SC3 days ago- ...Manager of AI Engineering (Patient Experience)Job#: 3054844Job Description:Manager of AI Engineering... ...an experienced AI Engineering Manager to lead the development of enterprise AI and... ...a HIPAA-regulated environment, ensuring data privacy and security controls.Required QualificationsA...Full time
Apex Systems
Fort Mill, York County, SC13 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Fort Mill). Be the first to apply!
- data tech Fort Mill, York County, SC
- data visualization Fort Mill, York County, SC
- data loss prevention engineer Fort Mill, York County, SC
- data loss prevention analyst Fort Mill, York County, SC
- sap master data Fort Mill, York County, SC
- data collection Fort Mill, York County, SC
- test data management Fort Mill, York County, SC
- data cabling installation Fort Mill, York County, SC
- health data Fort Mill, York County, SC
- data network cabling Fort Mill, York County, SC