Senior Data Engineer
Euclid
Data Engineer
We are seeking an experienced Data Engineer to design, build, and enhance data ingestion pipelines and metadata frameworks that support data lineage, modernization, and analytics enablement. The ideal candidate has hands-on experience with AWS Glue, Python/PySpark, ETL pipelines, and metadata management tools, with the ability to work in a dynamic, cloud-centric data environment.
Key Responsibilities
Design, develop, and maintain data ingestion and ETL pipelines for metadata integration across systems like SQL Server, Informatica, AWS Glue, and Azure Data Factory.
Implement end-to-end data lineage tracing, including source-to-target mapping, column-level lineage, and job dependency tracking.
Automate metadata ingestion and transformation for lineage reporting and quality validation.
Identify static, orphaned, or unused tables/jobs and contribute to data-quality improvement.
Collaborate with data architects, analysts, and AI strategist to align metadata ingestion with modernization goals.
Participate in the deployment and hardening of solutions in AWS (and Azure as applicable).
Contribute to modernization and AI-readiness initiatives through metadata standardization and automation.
Required Skills & Experience
8–10 years of experience in Data Engineering / ETL Development.
Strong experience with:
AWS Glue, S3, Redshift, Lambda
SQL (SQL Server, Oracle, or Snowflake) – complex queries, stored procedures, performance tuning
Python / PySpark for metadata parsing and ETL automation
ETL Tools: Informatica, AWS Glue, Azure Data Factory
Data Lineage / Metadata Management: Collibra, Alation, or custom lineage repositories
CI/CD & Orchestration: GitHub, Jenkins, or Azure DevOps
Nice to Have
Experience with BladeBridge or similar lineage analysis tools
Familiarity with Client Batch Processing
Exposure to Airflow, dbt, or Databricks for orchestration and transformation
Basic understanding of AI/ML data pipeline readiness
Azure data platform exposure (ADF, Synapse, Data Lake)
Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Fort Mill, York County, SC vacancy
- ...We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines...Senior
EOne Infotech
Fort Mill, York County, SC2 days ago - ...Microsoft Dynamics 365 Power BI INDUSTRIES PRODUCTS OneXcel IoT Solutions RESOURCES Whitepapers CAREERS Contact Us Sr. Data Engineer (Mid-Senior Level) - AWS & Streaming Full Time Fort Mill, SC (3 days hybrid) Posted 3 months ago eone Infotech Job Description : Experience...SeniorFull time
- A tech recruitment firm is searching for an ETL/Data Tester in Fort Mills, SC with a hybrid work model. The ideal candidate should have... ...This is a contract position lasting 12 months, suitable for mid-senior level professionals. Benefits and specific details about the...SeniorContract work
- Capgemini is looking for an experienced Developer based in South Carolina to design, implement, and optimize data engineering solutions. With over 10 years of IT experience, the ideal candidate will have deep expertise in Snowflake and cloud platforms including AWS and...Senior
- ...Principal Data Engineer Location: Fort Mill or Austin (Hybrid) We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines...Suggested
United IT
Fort Mill, York County, SC1 day ago - ...helps customers create products and capture moments that reflect who they uniquely are. Shutterfly is looking for a Principal Data Engineer to join their team! As part of the Data Engineering team you will tackle the scalability, performance and distributed computing...
Shutterfly Career Site
Fort Mill, York County, SC1 day ago - ...Role: AWS Data Engineer Location: Fort Mill, SC Duration: Longterm Contract Note: We need candidate to work onsite from Day 1 (Hybrid) Key Responsibilities Design, develop, and maintain scalable data pipelines and data integrations across...Contract work
E-Solutions
Fort Mill, York County, SC4 days ago - ...Data Engineering Position Bachelor-level degree in engineering, information technology or computer science Must have 3 to 5 years of Data Engineering professional hands on work experience with a strong background in Python, Spark, Pyspark and Scala. Strong SQL...Work experience placement
My3Tech Inc
Fort Mill, York County, SC1 day ago - ...Role: Data Engineer Location: Fort Mill SC 29707 (Hybrid) 9-12+ Months Contract Detailed Job Description: Seeking a seasoned Data Engineer with 7 years of experience in dbt Data Build Tool to design, develop, and optimize data transformation pipelines...Contract work
AceStack LLC
Fort Mill, York County, SC4 days ago - Capgemini is seeking a Data Engineer in Fort Mill, SC, to design and maintain scalable data pipelines using AWS and Snowflake. The ideal candidate will have extensive experience with data engineering, including ETL processes, and proficiency in Python. Responsibilities...
$39.86 - $62.29 per hour
Overview We are seeking an experienced Developer with 10+ years of IT experience and deep expertise in data engineering and cloud-based data platforms (Snowflake/AWS). The ideal candidate will have strong hands-on experience in designing, implementing, and optimizing scalable...Contract work- ...industry and first-hand experience of defining its future.# Data Engineer (AWS & Snowflake)AtlantaChoosing Capgemini means choosing a company... ...Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal...Full timeLocal area
- ...LPL Financial LLC seeks AVP, Data Engineer Manager (Req 000121) in Fort Mill, SC to lead the design, development, and enhancement of data products and applications. NO Telecommuting permitted. Reqs: BS+5 OR MS+3 yrs exp. 10% domestic travel for business development meetings...Remote work
LPL Financial
Fort Mill, York County, SC2 days ago - ...Role Name : Data Engineer (Snowflake, AWS Glue Specialist) Location : Fort Mill, SC - 100% ONSITE JOB DESCRIPTION : Local Grade C2 Location Fortmill SC Must Have Skills Fivetran HVR AWS Glue Lambda Airflow Snowflake DBT Hiring Manager Johari Abhishek...Local area
eTeam
Fort Mill, York County, SC4 days ago - ...Job Description • Lead a team of 2-5 Data Engineers with varied experience level to design and build data pipelines from various data sources to a target data warehouse using real-time and batch data load strategies utilizing cutting edge cloud technologies. • Serve...
Insight Global
Fort Mill, York County, SC4 days ago - ...Job Title: Data Engineer (AWS Glue, Airflow, Lambda, Postgres) Role Overview We are seeking a skilled Data Engineer with strong hands-on experience in AWS-native data services, particularly Glue, Lambda, EventBridge, and workflow orchestration using Airflow...
Scout Exchange
Fort Mill, York County, SC3 days ago - ...Job Title: Data Engineer (Snowflake, AWS) Job Summary We are seeking an experienced Developer with 10+ years of overall IT experience and deep expertise in data engineering and cloud-based data platforms (Snowflake/AWS). The ideal candidate will have...
Scout Exchange
Fort Mill, York County, SC3 days ago - ...strategy into technical execution, ensuring data platforms enable both real-time and batch... ...• Lead, mentor, and grow teams of data engineers and engineering managers with diverse... ...years experience functioning as a lead or senior resource on a team. • Experience building...
Insight Global
Fort Mill, York County, SC1 day ago - ...Intelligence Developer in Fort Mill, SC. This position focuses on empowering business leaders through quality information and robust data analysis, supporting key initiatives, and driving business impact. The ideal candidate will possess a Bachelor's degree in a...
$64.89k - $173.04k
...bigger - helping to simplify health care one person, one family and one community at a time. Position Summary We're seeking a Data Engineer to design and implement data pipelines that power analytical capabilities. This hands-on role requires an understanding of data...Hourly payFull timeTemporary workWork experience placementLocal areaCVS Health
Rock Hill, SC2 days ago$83.43k - $222.48k
...responsibility for designing, building, and maintaining scalable data pipelines and architectures that enable reliable data access,... ...requirements and translate them into scalable and efficient data engineering solutions Build, optimize, and deploy forecasting models...Hourly payFull timeTemporary workWork experience placementLocal areaCVS Health
Rock Hill, SC2 days ago- Think Power Solutions in Fort Mill, SC is seeking a highly organized individual to oversee electrical distribution construction contractors. The role involves coordinating, scheduling, and monitoring contractors while ensuring compliance with safety standards and project...SeniorFor contractors
Think Power Solutions
Fort Mill, York County, SC1 day ago - We are seeking a skilled Quality Engineer with hands-on experience in Behavior-Driven Development (BDD) to ensure the quality and reliability of our data ingestion and pipeline solutions. The ideal candidate will collaborate with cross-functional teams to define, implement...
- A public retail company in Fort Mill, SC seeks a General Counsel to oversee all legal matters and ensure compliance with regulations. The ideal candidate will have a J.D., over a decade of legal experience, particularly with public companies, and strong M&A expertise. Responsibilities...Senior
- Guardian Fire Services in Fort Mill, SC, is seeking a Lead Fire Sprinkler Inspector to supervise fire sprinkler installations, repairs, and maintenance. The ideal candidate has over 3 years of experience in the fire safety industry, with a strong understanding of NFPA codes...Senior
$128.75k - $214.65k
LPL Financial LLC is seeking a Vice President, People M&A Lead. This senior role involves owning the People M&A strategy and leading integration for acquisitions of all sizes. The ideal candidate has over 10 years of HR leadership experience and a proven track record in...Senior- Ross Stores in Fort Mill seeks a Senior Director, IT - DC Systems to lead innovative technology solutions that enhance retail supply chain operations. This strategic leader will drive the vision, roadmap, and delivery of systems supporting end-to-end processes. The ideal...Senior
- ...Job Description As a Professional Land Surveyor - Senior Project Manager, you'll lead and manage surveying projects, supervise teams... ...and subdivisions Creating 3D surface models Preparing data for earthwork quantities Construction stakeout calculations...SeniorWork at officeImmediate start
Hatch Global Search
Fort Mill, York County, SC16 hours ago $99.09k - $165.11k
LPL Financial LLC is seeking a Transition Manager to lead the administrative transition experience for financial advisors. This role is essential in ensuring a well-orchestrated and seamless transition process that involves collaboration with advisors, internal teams, and...Senior- LPL Financial LLC is seeking a Vice President II for Product Management in Identity & Access Management (IAM) to drive product strategy and lead high-impact initiatives. This role requires expertise in product management, technology, and user experience to influence enterprise...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data science developer Fort Mill, York County, SC
- senior data center engineer Fort Mill, York County, SC
- aws data engineer Fort Mill, York County, SC
- data engineer analytics Fort Mill, York County, SC
- data engineer machine learning Fort Mill, York County, SC
- data developer Fort Mill, York County, SC
- finance data engineer Fort Mill, York County, SC
- data engineer Fort Mill, York County, SC
- etl data engineer Fort Mill, York County, SC
- senior cloud data engineer Fort Mill, York County, SC