Technical Data Lead
Coforge
Technical Data Lead
Location – Fort Mill, SC
Responsibilities
- Design, develop, and implement data pipelines using AWS Glue and Lambda to support data ingestion and transformation.
- Utilize PySpark for data processing and analysis, ensuring efficient data handling and performance optimization.
- Implement Infrastructure as Code (IAC) using Terraform (TF) to automate deployment and management of cloud resources.
- Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes.
- Manage containerized applications using Docker and orchestrate them with Amazon EKS.
- Design and optimize data warehouse solutions using Snowflake (SF) or Redshift (RS) to support analytics and reporting.
- Work with data lake technologies such as Iceberg, Lake Formation, and Delta tables to enhance data accessibility and governance.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Mandatory Skills
- Strong experience with AWS services, particularly Glue and Lambda.
- Proficiency in PySpark for data processing.
- Expertise in Infrastructure as Code (IAC) using Terraform.
- Solid SQL skills for data manipulation and querying.
- Experience with containerization using Docker and orchestration with EKS.
- Hands-on experience with data warehousing solutions like Snowflake or Redshift.
- Familiarity with data lake technologies such as Iceberg, Lake Formation, and Delta tables.
- Proven ability to work in a cloud environment.
Preferred Skills
- Experience with data governance and data quality frameworks.
- Knowledge of data modeling and database design principles.
- Familiarity with Agile methodologies and project management tools.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 8-12 years of experience in data engineering or a related role.
- Proven track record of delivering data solutions in a cloud environment.
- Strong understanding of data architecture and data management best practices.
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Technical Data Lead in Fort Mill, York County, SC vacancy
- ...Cloud, and Lightning components. Proficiency in Salesforce configuration, customization, and development. Technical Leadership Proven experience leading technical teams in Salesforce development projects. Ability to provide guidance, mentorship, and support to...Suggested
Syntricate Technologies
Fort Mill, York County, SC1 day ago $140.5k - $234.1k
...this role, you will design, develop, and lead the implementation of large-scale enterprise... ...technologies to manage participant data for millions of advisors. You will contribute... ...modeling, architecture discussions, and technical design reviews with cross-functional teams...SuggestedFull timeWork from homeLPL Financial
Fort Mill, York County, SC2 days ago- ...Data Test Lead Location : Fort Mill SC Skills : Data testing, ETL Testing,Python ,CI/CD, SQL Experience: +10 years We at Coforge are hiring Data Test Lead with the following skill sets. Data QE Engineer Responsibilities: Design, develop, and implement...Suggested
Coforge
Fort Mill, York County, SC3 hours ago - ...Job Description Job Description FindTalent is seeking a Lead Protection & Control Engineer to join our team onsite in South Carolina... ...and high-voltage transmission projects. As a senior technical leader, you will be responsible for overseeing engineering deliverables...SuggestedFull timeWork at office
FindTalent
Fort Mill, York County, SC13 days ago $106.1k - $176.9k
...performing solutions.The ideal candidate enjoys solving complex technical challenges, building innovative solutions, and working in an... ...object-oriented programming concepts, software design patterns, and data modeling principles.Strong analytical, troubleshooting, and...SuggestedFull timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago$140.5k - $234.1k
Lead with Purpose, Unlock Your Team's PassionAt LPL, people leaders hold the key to the... ...solutions.In this role, you will combine technical expertise, leadership capabilities, and strategic... ...technologies, enterprise applications, data platforms, or AI-enabled productivity...Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago$106.1k - $176.9k
...development processes, and platform capabilities; contribute to technical documentation and roadmaps.Design and implement REST and gRPC... ...EventBridge, Athena, or Glue).Experience building ETL processes or data pipelines using structured and unstructured data sources....Full timeWork from homeLPL Financial
Fort Mill, York County, SC3 days ago- ...Description: Role Overview We are seeking a highly skilled Technical Lead to drive the evolution of our trading platforms. In this role,... ...optimize complex database schemas, ensuring high-performance data retrieval and integrity for real-time trading data....
- ...operations and revenue objectives. Your technical skills will ensure Spectrum’s finance systems... ...with other Spectrum platforms and data sources Participate in Agile and Scrum... ...integration issues in ERP applications Lead code reviews, debug and test software, and...Work at officeLocal areaVisa sponsorship
SPECTRUM
Fort Mill, York County, SC2 days ago $159.75k - $225.5k
...a Senior Principal Software Engineer to lead the design and development of next-generation... .... This is a high-impact, hands-on technical leadership role responsible for shaping the... ...business KPIsPartner with Product, UX, and Data teams to translate AI capabilities into:...Remote workShutterfly
Fort Mill, York County, SC1 day ago- We are seeking a highly analytical and data-focused Senior Software Engineer to play a... ...# Responsibilities Migration Leadership: Lead and contribute to the end-to-end migration... ...migration roadblocks, and communicate complex technical findings to both technical and non-...
$89 per hour
...the FTSE Russell ecosystem. The role is focused on workflow-led data-heavy interfaces auditability approvals exception handling... ...written communication skills including the ability to explain technical trade-offs to both engineers and non-engineers. Evidence of...Contract workWorldwideWork visaFlexible hours3 days per weekthe Client
Fort Mill, York County, SC7 days ago$50 per hour
...assisted development tools (e.g. Github Co-pilot) to improve efficiency automate tasks and accelerate delivery There will be some non-technical expectations example co-ordination with offshore team members provide status updates to leadership and actively participate in...Hourly payIconma Portal
Fort Mill, York County, SC7 days ago- ...Description ABOUT US \n Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth... ...solutions. The ideal candidate will provide technical leadership while designing and developing scalable...
Incedo Inc.
Fort Mill, York County, SC14 days ago - ...clinical operations. You will work on a product team with engineers, data scientists, and product managers, contributing to the full... ...years of experience in data science or artificial intelligence.Technical Skills:Expert-level programming skills in Python/PySpark and...Remote work
Apex Systems
Fort Mill, York County, SC1 day ago - ..., develop, and maintain GraphQL APIs and Data Solutions using Aurora, Postgres, and Amazon... ...productivity and code quality.Provide technical leadership, guidance and mentorship to junior... ...of experience in software development leading large scale initiatives in collaboration...Full time
OneMain Holdings
Fort Mill, York County, SC2 days ago $112.06k - $186.84k
...outcomes.Requirements:Bachelor’s degree in Project Management, Computer Science, Information Systems, Communications, or a related technical field7+ years of experience managing large-scale IT programs with budgets up to $5M3+ years of experience serving as a Release...Full timeWork at officeWork from homeLPL Financial
Fort Mill, York County, SC5 days ago$117.83k - $196.32k
...contributions.Requirements:Bachelor’s degree in Project Management, Computer Science, Information Systems, Communications, or a related technical field.7+ years of experience managing large-scale IT programs with budgets up to $5 million.3+ years of experience serving as a...Full timeWork at officeWork from homeLPL Financial
Fort Mill, York County, SC16 hours ago- ...project - 6 months with extension every 3 months Fulltime and contract bothLocation: Onsite- 3 days a week, Fort Mill (South Carolina)Technical SkillsStrong knowledge of Java, Kotlin, Android SDKProficient in Object-Oriented design, Design patterns, problem solving,...Full timeContract work3 days per week
E-Solutions
Fort Mill, York County, SC3 days ago - Hi Devops Engineer Type :: COntract/ FT FORT MILL South Carolina You will be a platform owner for LaunchDarkly a SaaS feature flag management platform. Developer technologies involved will include: Required: C#/JavaScript/Python Launch Darkly or OpenFeature...Full timeContract work
Diverse Lynx LLC
Fort Mill, York County, SC19 days ago $50 per hour
...helping maintain our AWS hosted web application. Collaborate with data modelers, analysts, and business users to ensure ongoing development with different product teams. Key Responsibilities Lead the demonstration of consistency to the LSEG Data standard...Contract workWork at officeWorldwideWork visaGlobal Technical Talent
Fort Mill, York County, SC4 days ago$116.8k - $146k
...value of diversity in the global workplace.About the role:As a Lead Fabrication Follow-Up Engineer you will serve as the primary interface... ...between APX Supply Chain and Engineering while providing technical guidance and resolving issues to keep manufacturing on schedule...Remote workFlexible hoursShift workWESTINGHOUSE
Rock Hill, SC4 days ago- ...an experienced AI Engineering Manager to lead the development of enterprise AI and cloud... ...experience. This role combines hands-on technical leadership with people management, overseeing... ...a HIPAA-regulated environment, ensuring data privacy and security controls.Required...Full time
Apex Systems
Fort Mill, York County, SC1 day ago - Pike Engineering is seeking an experienced engineer to lead protection and control design for transmission substations, battery energy storage, and solar collector projects. You will guide a team, manage schedules and budgets, and support business development while ensuring...
$100k - $120k
...\n \n This is a hands-on, onsite opportunity with a fast-growing manufacturer that values collaboration, responsiveness, and technical problem-solving. In this role, you’ll help design control circuits for water and wastewater pump applications, working closely with...Work at officeInceed
Fort Mill, York County, SC3 days ago- ...Design end to end application and data architectures that integrate SQL platforms... ...with high reliability and performance. Lead solution design workshops with product owners... ...expectations. Review solution designs and technical implementations to identify architectural...Day shift
ICONMA
Fort Mill, York County, SC4 days ago - ...REST/SOAP and IntegrationHub. Deep understanding of mitigating business disruptions during these integrations. ~ Proven ability to lead and support platform upgrades and manage upgrade-related issues. Deep understanding of mitigation business disruption during these...
Alto Health Care Staffing
Fort Mill, York County, SC13 hours ago - ...years and have over one hundred years of product and application knowledge. Application Engineers will read customer requirements and technical specs, listen to customer requests, and design panel circuitry to achieve said goal. They need to fully understand the NEC and are...Full timeWork at officeRemote workFlexible hours
Advanced Industrial Devices
Fort Mill, York County, SC5 days ago - ...operating practices, and broader modernization initiativesThis is a senior individual contributor role with significant influence over technical direction and how the organization builds and operates its future cloud environmentLOCATIONFort Mill, SC, Charlotte metro areaOn-...
AccruePartners
Fort Mill, York County, SC2 days ago - Jobs Bridge Inc is among the fastest growing IT staffing / professional services organization with its own job portal. Jobs Bridge works extremely closely with a large number of IT organizations in the most in-demand technology skill sets. Job Description Skill Android ...Contract workTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Data Lead. Be the first to apply!
Related searches
- health data Fort Mill, York County, SC
- data loss prevention analyst Fort Mill, York County, SC
- data visualization Fort Mill, York County, SC
- clinical data Fort Mill, York County, SC
- data capturer Fort Mill, York County, SC
- data collection Fort Mill, York County, SC
- data labeling Fort Mill, York County, SC
- clinical data coordinator remote Fort Mill, York County, SC
- test data management Fort Mill, York County, SC
- data analysis part time Fort Mill, York County, SC