Technical Data Lead
Full-time
Coforge
Technical Data Lead
Location – Fort Mill, SC
Responsibilities
- Design, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
- Utilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
- Implement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
- Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
- Manage containerized applications using Docker and orchestrate them with Amazon EKS.
- Design and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
- Work with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Mandatory Skills
- Strong experience with AWS services, particularly Glue and Lambda.
- Proficiency in PySpark for data processing.
- Expertise in Infrastructure as Code (IAC) using Terraform.
- Solid SQL skills for data manipulation and querying.
- Experience with containerization using Docker and orchestration with EKS.
- Hands-on experience with data warehousing solutions like Snowflake or Redshift.
- Familiarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
- Proven ability to work in a cloud environment.
Preferred Skills
- Experience with data governance and data quality frameworks.
- Knowledge of data modeling and database design principles.
- Familiarity with Agile methodologies and project management tools.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 8-12 years of experience in data engineering or a related role.
- Proven track record of delivering data solutions in a cloud environment.
- Strong understanding of data architecture and data management best practices.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Technical Data Lead in Fort Mill, York County, SC vacancy
- ...Tech Mirrors is seeking a highly capable Technical Project Manager / Scrum Master to drive digital modernization initiatives on a remote US project. You will lead cross-functional teams and ensure delivery within scope, schedule, and budget. This six-plus-month contract...SuggestedContract workRemote work
Tech Mirrors
Fort Mill, York County, SC2 days ago - ...Coforge Limited in Fort Mill, SC seeks a Senior Data Business Analyst with deep expertise in data modelling, SQL, Python, and AWS to design and implement data models that drive business insights and decision-making. The role requires collaboration with cross-functional...Suggested
COFORGE Marketing
Fort Mill, York County, SC2 days ago - ...Data Test Lead Location : Fort Mill SC Skills : Data testing, ETL Testing,Python ,CI/CD, SQL Experience: +10 years We at Coforge are hiring Data Test Lead with the following skill sets. Data QE Engineer Responsibilities: Design, develop, and implement...Suggested
Coforge
Fort Mill, York County, SC5 days ago $140.5k - $234.1k
...this role, you will design, develop, and lead the implementation of large-scale enterprise... ...technologies to manage participant data for millions of advisors. You will contribute... ...modeling, architecture discussions, and technical design reviews with cross-functional teams...SuggestedFull timeWork from homeLPL Financial
Fort Mill, York County, SC2 days ago$170.8k - $284.6k
...Job Overview: We are seeking a hands-on VPSoftware Engineering Lead (.NET/AWS) to design, develop, enhance, and optimize cloud-native... ...0% hands-on software engineering and solution delivery and 20% technical leadership and mentoring.The ideal candidate will lead...SuggestedFull timeWork from homeLPL Financial
Fort Mill, York County, SC1 day ago- ...Senior/Lead Software EngineerSeeking a highly experienced Senior/Lead Software Engineer to lead the migration of legacy Tibco-based... ...critical role focused on driving modernization initiatives, providing technical leadership, and ensuring the seamless execution of enterprise-...
Pipe Recruit
Fort Mill, York County, SC2 days ago - ...ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth through technology... ...solutions. The ideal candidate will provide technical leadership while designing and developing scalable...Full time
Incedo Inc.
Fort Mill, York County, SC3 days ago $140.5k - $234.1k
Lead with Purpose, Unlock Your Team's PassionAt LPL, people leaders hold the key to the... ...solutions.In this role, you will combine technical expertise, leadership capabilities, and strategic... ...technologies, enterprise applications, data platforms, or AI-enabled productivity...Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago$106.1k - $176.9k
...performing solutions.The ideal candidate enjoys solving complex technical challenges, building innovative solutions, and working in an... ...object-oriented programming concepts, software design patterns, and data modeling principles.Strong analytical, troubleshooting, and...Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago$106.1k - $176.9k
...development processes, and platform capabilities; contribute to technical documentation and roadmaps.Design and implement REST and gRPC... ...EventBridge, Athena, or Glue).Experience building ETL processes or data pipelines using structured and unstructured data sources....Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago- ...LPL Financial seeks a Vice President of Product Management, Financial Planning Technology, to lead a product team serving 30,000+ financial professionals and 6,000 CFP® professionals. You will own strategy from discovery through delivery, partner with cross‑functional...
LPL Financial
Fort Mill, York County, SC3 days ago - ...Job Description Job Description FindTalent is seeking a Lead Protection & Control Engineer to join our team onsite in South Carolina... ...and high-voltage transmission projects. As a senior technical leader, you will be responsible for overseeing engineering deliverables...Full timeWork at office
FindTalent
Fort Mill, York County, SC18 days ago - ...Description: Role Overview We are seeking a highly skilled Technical Lead to drive the evolution of our trading platforms. In this role,... ...optimize complex database schemas, ensuring high-performance data retrieval and integrity for real-time trading data....
$159.75k - $225.5k
...a Senior Principal Software Engineer to lead the design and development of next-generation... .... This is a high-impact, hands-on technical leadership role responsible for shaping the... ...business KPIsPartner with Product, UX, and Data teams to translate AI capabilities into:...Remote workShutterfly
Fort Mill, York County, SC1 day ago- ...WSP is seeking a Substation Lead Electrical Engineer (Station P&C) for our Ft. Mill, South Carolina office. You will guide design, due... ...meet client objectives and regulatory standards. You will analyze data, review calculations, develop specifications, and manage budgets...Work at office
WSP in the U.S.
Fort Mill, York County, SC2 days ago - ...helping maintain our AWS hosted web application. Collaborate with data modelers, analysts, and business users to ensure ongoing development with different product teams. Responsibilities: Lead the demonstration of consistency to the LSEG Data standard policies...Full time
Hays
Fort Mill, York County, SC16 hours ago - ...DeveloperDesign end to end application and data architectures that integrate SQL... ...needs with high reliability and performance. Lead solution design workshops with product owners... .... Review solution designs and technical implementations to identify architectural...Day shift
Diverse Lynx
Fort Mill, York County, SC8 hours ago - ...ExperienceAzure cloud experience (needs 3 of the 5 listed below):Azure starburstAzure SQL DB, MySQL, PostgresAzure DatabricksAzure SynapseAzure data lakePowershellAre any of them flexible?Day to Day Responsibilities/project specifics: this person will be focused on data...Flexible hours
Software Technology Inc
Fort Mill, York County, SC3 days ago - ...operations and revenue objectives. Your technical skills will ensure Spectrum’s finance systems... ...with other Spectrum platforms and data sources Participate in Agile and Scrum... ...integration issues in ERP applications Lead code reviews, debug and test software, and...Work at officeLocal areaVisa sponsorship
SPECTRUM
Fort Mill, York County, SC7 days ago - ...clinical operations. You will work on a product team with engineers, data scientists, and product managers, contributing to the full... ...years of experience in data science or artificial intelligence.Technical Skills:Expert-level programming skills in Python/PySpark and...Remote work
Apex Systems
Fort Mill, York County, SC1 day ago $117.83k - $196.32k
...contributions.Requirements:Bachelor’s degree in Project Management, Computer Science, Information Systems, Communications, or a related technical field.7+ years of experience managing large-scale IT programs with budgets up to $5 million.3+ years of experience serving as a...Full timeWork at officeWork from homeLPL Financial
Fort Mill, York County, SC1 day ago- ..., develop, and maintain GraphQL APIs and Data Solutions using Aurora, Postgres, and Amazon... ...productivity and code quality.Provide technical leadership, guidance and mentorship to junior... ...of experience in software development leading large scale initiatives in collaboration...Full time
OneMain Holdings
Fort Mill, York County, SC1 day ago $103.33k - $128.66k
...Job Role - Snowflake Lead Developer - Platform Governance & Security Specialist Job... ...pair authentication Implement Dynamic Data Masking policies and Protegrity tokenization... ...and cost alignment Required Technical Expertise Snowflake Platform: Advanced...Full timeLocal areaFlexible hours3 days per week1 day per weekCapgemini
Fort Mill, York County, SC2 days ago- We are seeking a highly analytical and data-focused Senior Software Engineer to play a... ...# Responsibilities Migration Leadership: Lead and contribute to the end-to-end migration... ...migration roadblocks, and communicate complex technical findings to both technical and non-...
- ...the Index Delivery & Product team within a leading global financial markets organisation.... ...calculation logic, and historical index data from legacy platforms onto the firm's strategic... ...migrations independently, make informed technical decisions, validate the accuracy of...
Insight Global
Fort Mill, York County, SC16 days ago $90k - $120k
...control systems and industrial control panels. The Application Engineer will be responsible for reviewing customer requirements and technical specifications, understanding customer applications, and designing electrical panel circuitry to meet specific project needs....Full timeWork at officeImmediate startAtWork Personnel | Charlotte East
Fort Mill, York County, SC16 hours ago$70 per hour
...DeveloperImmediate Need – Oracle Mantas Developer – Fort Mill SC – Hybrid – CTS / LPL Financials - $70-Mantas (scenario development, customization, data structures, data mining, data ingestion processes, threshold setting and troubleshooting) and Oracle PL/SQL Job Title: Mantas...Keylent Inc
Fort Mill, York County, SC2 days ago$100k - $120k
...team! This is a hands-on, onsite opportunity with a fast-growing manufacturer that values collaboration, responsiveness, and technical problem-solving. In this role, you’ll help design control circuits for water and wastewater pump applications, working closely with...Full timeWork at officeInceed
Fort Mill, York County, SC2 days ago- ...ABOUT US Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth through technology... .... Mentor junior developers and contribute to technical decision-making. WHAT YOU BRING Must...Full time
Incedo Inc.
Fort Mill, York County, SC2 days ago - ...production support. Ensure best practices for security, scalability, and maintainability. Mentor junior developers and contribute to technical decision-making. Qualifications 8+ years of overall software development experience. 3+ years of experience with AWS...Full time
ThoughtStorm
Fort Mill, York County, SC2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Data Lead. Be the first to apply!
Related searches
- data collection researcher Fort Mill, York County, SC
- clinical data Fort Mill, York County, SC
- data labeling Fort Mill, York County, SC
- data tech Fort Mill, York County, SC
- data visualization Fort Mill, York County, SC
- data collection Fort Mill, York County, SC
- provider data management Fort Mill, York County, SC
- data technician Fort Mill, York County, SC
- data Fort Mill, York County, SC
- data capturer Fort Mill, York County, SC