Senior Data Engineer
Euclid
Data Engineer
We are seeking an experienced Data Engineer to design, build, and enhance data ingestion pipelines and metadata frameworks that support data lineage, modernization, and analytics enablement. The ideal candidate has hands-on experience with AWS Glue, Python/PySpark, ETL pipelines, and metadata management tools, with the ability to work in a dynamic, cloud-centric data environment.
Key Responsibilities
- Design, develop, and maintain data ingestion and ETL pipelines for metadata integration across systems like SQL Server, Informatica, AWS Glue, and Azure Data Factory.
- Implement end-to-end data lineage tracing, including source-to-target mapping, column-level lineage, and job dependency tracking.
- Automate metadata ingestion and transformation for lineage reporting and quality validation.
- Identify static, orphaned, or unused tables/jobs and contribute to data-quality improvement.
- Collaborate with data architects, analysts, and AI strategist to align metadata ingestion with modernization goals.
- Participate in the deployment and hardening of solutions in AWS (and Azure as applicable).
- Contribute to modernization and AI-readiness initiatives through metadata standardization and automation.
Required Skills & Experience
8–10 years of experience in Data Engineering / ETL Development.
Strong experience with:
AWS Glue, S3, Redshift, Lambda
SQL (SQL Server, Oracle, or Snowflake) – complex queries, stored procedures, performance tuning
Python / PySpark for metadata parsing and ETL automation
ETL Tools: Informatica, AWS Glue, Azure Data Factory
Data Lineage / Metadata Management: Collibra, Alation, or custom lineage repositories
CI/CD & Orchestration: GitHub, Jenkins, or Azure DevOps
Nice to Have
- Experience with BladeBridge or similar lineage analysis tools
- Familiarity with Client Batch Processing
- Exposure to Airflow, dbt, or Databricks for orchestration and transformation
- Basic understanding of AI/ML data pipeline readiness
- Azure data platform exposure (ADF, Synapse, Data Lake)
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Fort Mill, York County, SC vacancy
- ...Sr. AWS Data Engineer Location: Fort Mill, SC Work mode: Onsite Key Responsibilities Design, build, and support scalable data pipelines using AWS Glue , Lambda , and EventBridge for event-driven and batch processing . Build and...Senior
- ...Title: Data Architect Engineer Duration: 6 month contract (potential to extend or convert) Work Location: Charlotte, NC preferred. If remote, would need to come onsite once per month for 2 days once converted to full time. Job Description The Data Architect Engineer will...SuggestedFull timeContract workLocal areaRemote work
INSPYR Solutions
Fort Mill, York County, SC4 days ago - ...AWS Data Engineer Location: Fort Mill, SC Duration: Longterm Contract Note: We need candidate to work onsite from Day 1 (Hybrid) Key Responsibilities: Design, develop, and maintain scalable data pipelines and data integrations across systems Implement data...SuggestedContract work
E-Solutions
Fort Mill, York County, SC2 days ago $40.1 - $66.83 per hour
...At LPL Financial we consider it our mission to take care of our advisors so they can take care of their client. Joining as a Data Engineer II, you will be responsible for building and maintaining the sustainable, scalable capabilities that support delivery of the highest...SuggestedWork from homeLPL Financial Holdings, Inc.
Fort Mill, York County, SC1 day ago- ...role focuses on designing, developing, and automating end-to-end data pipelines to deliver scalable data integration and data... ...communication and leadership skills. Preferred AWS certifications (Solutions Architect, Data Engineer). #J-18808-Ljbffr Signature IT World IncSuggested
$170k - $240.75k
...moments that reflect who they uniquely are.We are seeking a Senior Principal Software Engineer to lead the design and development of next-generation... ...efficiency, and business KPIsPartner with Product, UX, and Data teams to translate AI capabilities into: Increased...SeniorRemote work- # Data Engineer**Job Duties:**Design and implement efficient large-scale data solutions in areas data ingestion, data curation, data quality, data visualization and data distribution using Informatica, Snaplogic, Tableau and MicroStrategy. Manage and query data in data...Full timeRelocation
Pantar Solutions
Weddington, NC1 day ago - ...Job Title: Senior AI Automation Engineer Location: Fortmill, SC (Onsite) Duration: Contract Job Description: Mandatory Skills Agentic AI workflows AI orchestration API's & MCP integration Job Description: Position...SeniorContract work
Apptad
Fort Mill, York County, SC4 days ago - LPL Financial is seeking an experienced financial planning professional to support advisor relationships and deliver comprehensive financial plans. You will collaborate with paraplanners, stay current on planning concepts, and present plans to clients. A CFP is preferred...Senior
LPL Financial
Fort Mill, York County, SC4 days ago - ...company in North America, seeks an Executive Assistant to provide high-level administrative support to the Chief People Officer and Senior Leadership Team. In this role, you will deliver exceptional administrative, clerical, and organizational support while managing a...Senior
Sunbelt Rentals
Fort Mill, York County, SC5 days ago $62.5k - $104.1k
...Job Overview: LPL Financial is seeking a motivated Data Engineering new grad to help build and optimize the data platforms that power analytics, business intelligence, and AI-driven decision-making. In this role you'll work with data engineering, analytics, and data...Full timeInternshipWork at officeWork from home- A behavioral health service provider is seeking a Behavior Analyst to create and oversee ABA treatment plans for patients. The role involves supervising a team of Behavior Technicians, conducting therapy sessions, and ensuring compliance with treatment protocols. Candidates...SeniorRelocation package
TEEMA Solutions Group
Fort Mill, York County, SC2 days ago - THE TEAM YOU WILL BE JOINING:A fast-growing, data-driven consumer services platform. One of the largest digital health platforms in the... ...clear, data-driven financial reports and presentations to senior leadership and cross-functional partners. Develop, maintain, and...Senior
- AccruePartners in Fort Mill, SC is seeking a results-driven FP&A professional to join our data-driven finance team. You will partner with senior leaders to analyze performance, build robust financial models, and deliver insightful reports that influence strategic decisions...Senior
AccruePartners
Fort Mill, York County, SC5 days ago - ...A leading financial services organization is seeking a senior transactional attorney to support product and commercial initiatives in a fast-paced, regulated environment. Responsibilities include drafting and negotiating agreements related to financial products, providing...SeniorFull timeContract work
TalentBridge
Fort Mill, York County, SC5 days ago - Sunbelt Rentals is seeking a seasoned Compensation Project Lead to drive job architecture, process improvements, and guidance on compensation policies. You will coordinate with HR Operations, HRIS, and business leaders to optimize systems and reporting. You will deliver...Senior
Sunbelt Rentals
Fort Mill, York County, SC2 days ago - ESP Associates, Inc. (ESP) is seeking a Survey Project Manager to lead surveying projects for the Fort Mill, SC area. The role encompasses field and office oversight, personnel management, and contract administration to ensure timely delivery on residential and commercial...SeniorContract workWork at office
Socket
Fort Mill, York County, SC1 day ago - ...Title: Senior Data Architect Client: Oncor Electric Delivery Location: Dallas, TX (Hybrid - 2-3 days onsite per week; must be onsite first week) Duration: 12+ Months (High possibility of extension) Visa: H4, GC-EAD, GC, USC only Interview Process:...Senior2 days per week3 days per week
Kasmo Global
Fort Mill, York County, SC3 days ago - ...Senior Cloud Engineer Location: Fort Mill SC Need Hybrid from Day 1 Duration: Longterm Contract Job Summary: 10+ years exp. required. As a Sr. Cloud Engineer, you will support the Infrastructure & Operations (I&O) teams in implementing and operationalizing cloud-native...SeniorContract work
E-Solutions
Fort Mill, York County, SC3 days ago - Senior QA Automation Engineer Location: Fort Mill, South Carolina - Onsite Experience: 8 12 Years Job Type: Contract W2 Only Job Summary We are seeking an experienced Senior QA Automation Engineer with 8 12 years of experience in software quality...SeniorContract work
- Path Construction is seeking a qualified Superintendent in Fort Mill, SC, with at least 5 years of construction management experience, particularly in hotel and hospitality projects. Key responsibilities include managing subcontractors, overseeing project phases, and ensuring...SeniorFor subcontractor
- ...Requirements: Five or more years of Network and Security Engineering experience, with an emphasis on security products from Radware, Fortinet, Cisco and Palo Alto. Expert knowledge and experience in well-known security technologies/products, such as DDoS, proxy...SeniorWork experience placement
Euclid Innovations
Fort Mill, York County, SC5 days ago - Path Construction Company is looking for a qualified Superintendent to join our team in Fort Mill, SC. This role requires 5+ years of experience in construction management, especially in hotel and hospitality projects. As a leading commercial general contractor, we pride...SeniorFor contractors
$80.75k - $134.52k
...annuity and insurance product lines. This role focuses on delivering data-driven insights, developing advisor-facing materials, and... ...advisor practices. Working closely with cross-functional partners and senior team members, the Sr. Analyst helps translate product features...SeniorWork from homeRelha LLC
Fort Mill, York County, SC4 days ago- ...Job Description Job Description R. Joe Harris & Associates, Inc. is seeking a Senior Engineer and Department Manager. This role offers the opportunity to lead transformative land development and civil site projects across residential, commercial, and municipal developments...Senior
$112k - $168k
...Security, working closely with security, IT personnel, software engineers, and partners across our businesses to identify and remediate... ...key performance indicators, security metrics, and incidents to senior management.Evangelize information security and foster a security...Permanent employmentWork at officeRemote work1 day per week$20.85 - $34.71 per hour
...Job Overview The Senior Billing Specialist will support the creation of routine sponsor invoices and the tracking of receivables, addressing... ..., and ad hoc billing Communicate with sponsors on required data for billing, inquiries, cash receipts, etc. Prepare standardized...SeniorWork experience placementLPL Financial
Fort Mill, York County, SC1 day ago- What We Do Performs a variety of collection activities including collection calls, correspondence, negotiating payment plans, and maintaining records of all communication. Provides customer service regarding collections issues, processes customer refunds, processes and...SeniorWork at office
First American Financial Company
Fort Mill, York County, SC3 days ago - ...compliance with financial standards. Establish robust financial systems for collecting, analyzing, verifying, and reporting financial data Providing tax advisory support, applying knowledge of tax laws, and coordinating with external consultants to manage tax filings...SeniorWork at office
- ...communities, and quality of life. We bring together planners, engineers, architects, construction management staff, environmental, strategic... ..., more connected transportation networks. HDR is looking for a Senior Transportation Project Manager to join our South Carolina...SeniorFull timeLocal area
HDR
Fort Mill, York County, SC1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior leadership Fort Mill, York County, SC
- senior manager automotive Fort Mill, York County, SC
- senior magento developer Fort Mill, York County, SC
- senior application administrator Fort Mill, York County, SC
- senior accountant work from home Fort Mill, York County, SC
- senior manager accenture Fort Mill, York County, SC
- remote senior project manager Fort Mill, York County, SC
- senior performance engineer Fort Mill, York County, SC
- senior tech Fort Mill, York County, SC
- srs Fort Mill, York County, SC