Technical Data Lead
Coforge
Technical Data Lead
Location – Fort Mill, SC
Responsibilities
- Design, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
- Utilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
- Implement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
- Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
- Manage containerized applications using Docker and orchestrate them with Amazon EKS.
- Design and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
- Work with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Mandatory Skills
- Strong experience with AWS services, particularly Glue and Lambda.
- Proficiency in PySpark for data processing.
- Expertise in Infrastructure as Code (IAC) using Terraform.
- Solid SQL skills for data manipulation and querying.
- Experience with containerization using Docker and orchestration with EKS.
- Hands-on experience with data warehousing solutions like Snowflake or Redshift.
- Familiarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
- Proven ability to work in a cloud environment.
Preferred Skills
- Experience with data governance and data quality frameworks.
- Knowledge of data modeling and database design principles.
- Familiarity with Agile methodologies and project management tools.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 8-12 years of experience in data engineering or a related role.
- Proven track record of delivering data solutions in a cloud environment.
- Strong understanding of data architecture and data management best practices.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Technical Data Lead in Fort Mill, York County, SC vacancy
- ...Coforge Limited in Fort Mill, SC seeks a Senior Data Business Analyst with deep expertise in data modelling, SQL, Python, and AWS to design and implement data models that drive business insights and decision-making. The role requires collaboration with cross-functional...Suggested
COFORGE Marketing
Fort Mill, York County, SC4 days ago - ...through our award-winning Gilbane University to build leadership and technical skills. In addition, you would work with an experienced team... ...partners by maintaining a fair and trustworthy environment Leads contractor meetings on a regular basis Maintains daily reports...SuggestedContract workFor contractorsFor subcontractorWork at officeFlexible hours
Gilbane Building Company
Rock Hill, SC3 days ago $140.5k - $234.1k
...this role, you will design, develop, and lead the implementation of large-scale enterprise... ...technologies to manage participant data for millions of advisors. You will contribute... ...modeling, architecture discussions, and technical design reviews with cross-functional teams...SuggestedFull timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago- ...LPL Financial Holdings Inc. is seeking an AVP Tech Lead to provide technical leadership for a development team focused on AWS-based, cloud-enabled advisor workstation experiences in New York. The role emphasizes scalable web applications and services, partnering with...Suggested
LPL Financial
Fort Mill, York County, SC1 day ago - ...Senior/Lead Software EngineerSeeking a highly experienced Senior/Lead Software Engineer to lead the migration of legacy Tibco-based... ...critical role focused on driving modernization initiatives, providing technical leadership, and ensuring the seamless execution of enterprise-...Suggested
Pipe Recruit
Fort Mill, York County, SC4 days ago $170.8k - $284.6k
...Job Overview: We are seeking a hands-on VPSoftware Engineering Lead (.NET/AWS) to design, develop, enhance, and optimize cloud-native... ...0% hands-on software engineering and solution delivery and 20% technical leadership and mentoring.The ideal candidate will lead...Full timeWork from homeLPL Financial
Fort Mill, York County, SC2 days ago- ...Description: Role Overview We are seeking a highly skilled Technical Lead to drive the evolution of our trading platforms. In this role,... ...optimize complex database schemas, ensuring high-performance data retrieval and integrity for real-time trading data....
- ...Position : Sr/Lead .NET Developer Location : Fort Mill,SC Duration : Full – Time... ...ABOUT US Incedo is a global AI, data, and digital transformation specialist that... ...solutions. The ideal candidate will provide technical leadership while designing and developing...Full time
Incedo Inc.
Fort Mill, York County, SC5 days ago - We are seeking an experienced Lead .NET Developer to join our team and drive the implementation of complex, high-quality software solutions... ...applications while mentoring junior developers and shaping technical direction. The ideal candidate combines deep technical...Work experience placementFlexible hours
$140.5k - $234.1k
Lead with Purpose, Unlock Your Team's PassionAt LPL, people leaders hold the key to the... ...solutions.In this role, you will combine technical expertise, leadership capabilities, and strategic... ...technologies, enterprise applications, data platforms, or AI-enabled productivity...Full timeWork from homeLPL Financial
Fort Mill, York County, SC4 days ago$106.1k - $176.9k
...performing solutions.The ideal candidate enjoys solving complex technical challenges, building innovative solutions, and working in an... ...object-oriented programming concepts, software design patterns, and data modeling principles.Strong analytical, troubleshooting, and...Full timeWork from homeLPL Financial
Fort Mill, York County, SC4 days ago$111.5k - $185.8k
...backend microservices and REST APIs with Java, Spring Boot, Spring Data JPA, OpenFeign, gRPC (Zeebe/Camunda clients), and Docker... ...with other designers and engineers on the team(s) to ensure that technical designs and implementations are consistent across the product(s...Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago$106.1k - $176.9k
...development processes, and platform capabilities; contribute to technical documentation and roadmaps.Design and implement REST and gRPC... ...EventBridge, Athena, or Glue).Experience building ETL processes or data pipelines using structured and unstructured data sources....Full timeWork from homeLPL Financial
Fort Mill, York County, SC4 days ago- ...WSP is seeking a Substation Lead Electrical Engineer (Station P&C) for our Ft. Mill, South Carolina office. You will guide design, due... ...meet client objectives and regulatory standards. You will analyze data, review calculations, develop specifications, and manage budgets...Work at office
WSP in the U.S.
Fort Mill, York County, SC3 days ago - ...Pike Engineering is seeking an experienced engineer to lead protection and control design for transmission substations, battery energy storage, and solar collector projects. You will guide a team, manage schedules and budgets, and support business development while ensuring...
Pike Corporation
Fort Mill, York County, SC6 days ago - ...business value. You will craft positioning, messaging, and content across campaigns, web, decks, and thought leadership. You will lead launches, enable sales teams, and collaborate with analysts relations to drive demand across life, P&C, and specialty markets for...
DXC Technology
Fort Mill, York County, SC2 days ago $118.14k - $196.83k
...to shape your success while helping clients pursue their financial goals.We are seeking an experienced AVP of DevOps Engineering to lead a team responsible for building and operating an AI-driven observability and reliability platform for enterprise-scale environments....Full timeWork from homeLPL Financial
Fort Mill, York County, SC4 days ago$159.75k - $225.5k
...a Senior Principal Software Engineer to lead the design and development of next-generation... .... This is a high-impact, hands-on technical leadership role responsible for shaping the... ...business KPIsPartner with Product, UX, and Data teams to translate AI capabilities into:...Remote workShutterfly
Fort Mill, York County, SC2 days ago- We are seeking a highly analytical and data-focused Senior Software Engineer to play a... ...# Responsibilities Migration Leadership: Lead and contribute to the end-to-end migration... ...migration roadblocks, and communicate complex technical findings to both technical and non-...
$103.71k - $138.28k
...network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network... ...ready connectivity, join us today. The Role The Lead Engineer position will require both technical expertise and project management competency. This...Full timeTemporary workFor contractorsFor subcontractorRemote workLumen
Rock Hill, SC4 days ago- ...the Index Delivery & Product team for a leading global financial markets organisation.... ...calculation logic, and historical index data from legacy platforms onto strategic index... ...ability to independently investigate complex technical and business challenges. Experience partnering...Full timeContract work3 days per week
Insight Global
Fort Mill, York County, SC4 days ago - ...the FTSE Russell ecosystem. The role is focused on workflow-led, data-heavy interfaces, auditability, approvals, exception handling,... ...written communication skills, including the ability to explain technical trade-offs to both engineers and non-engineers.Evidence of...WorldwideWork visaFlexible hours3 days per week
GTT
Fort Mill, York County, SC6 days ago $32.19 - $53.68 per hour
...databases, APIs, and secure coding practices.Problem Solving & Collaboration – Ability to work effectively across teams and solve technical challenges in a structured manner.Cloud & Modern Development Practices – Familiarity with cloud platforms, DevOps principles, and...Full timeInternshipWork at officeWork from homeLPL Financial
Fort Mill, York County, SC4 days ago- ...assisted development tools (e.g. Github Co-pilot) to improve efficiency, automate tasks and accelerate delivery There will be some non-technical expectations – example – co-ordination with offshore team members, provide status updates to leadership and actively participate...
TechDigital Corporation
Fort Mill, York County, SC1 day ago - ...Director, responsible for driving credit line increase strategy for the Card business and delivering data-driven insights to executive leadership. You will shape CLI policy, lead cross-functional teams across Product, Marketing, Technology and Operations to balance risk...
OneMain Financial Group
Fort Mill, York County, SC2 hours ago - ...their lifecycle, including; knowing what information systems are within their scope of responsibility, understanding what sensitive data is stored, transmitted, or processed on those information systems, enforcing the security principles of least privilege and least functionality...
Software Technology Inc
Fort Mill, York County, SC4 days ago - ...clinical operations. You will work on a product team with engineers, data scientists, and product managers, contributing to the full... ...years of experience in data science or artificial intelligence.Technical Skills:Expert-level programming skills in Python/PySpark and...Remote work
Apex Systems
Fort Mill, York County, SC2 days ago - ..., develop, and maintain GraphQL APIs and Data Solutions using Aurora, Postgres, and Amazon... ...productivity and code quality.Provide technical leadership, guidance and mentorship to junior... ...of experience in software development leading large scale initiatives in collaboration...Full time
OneMain Holdings
Fort Mill, York County, SC3 days ago - ...performance. This is a strong fit for an engineer who enjoys solving technical challenges, working across multiple projects, and building... ...cross‑functional teams to support successful project outcomes. Lead complex grid modernization initiatives while building project...Work at officeLocal area
WSP Global Inc.
Fort Mill, York County, SC3 days ago - ...helping maintain our AWS hosted web application. Collaborate with data modelers, analysts, and business users to ensure ongoing development with different product teams. Responsibilities: Lead the demonstration of consistency to the LSEG Data standard policies...
Hays
Fort Mill, York County, SC5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Data Lead. Be the first to apply!
Related searches
- data collection researcher Fort Mill, York County, SC
- clinical data Fort Mill, York County, SC
- data labeling Fort Mill, York County, SC
- data tech Fort Mill, York County, SC
- data visualization Fort Mill, York County, SC
- data collection Fort Mill, York County, SC
- provider data management Fort Mill, York County, SC
- data technician Fort Mill, York County, SC
- data Fort Mill, York County, SC
- data capturer Fort Mill, York County, SC