Lead Data Engineer

Openkyber

Position: Senior Data Engineer

Experience: 10+ Years

Employment Type: Contract W2

Job Summary
We are looking for an experienced Senior Data Engineer with 10+ years of experience in designing, developing, and maintaining scalable data pipelines and enterprise data platforms. The ideal candidate should have strong expertise in Python, SQL, PySpark, ETL/ELT, cloud platforms, data warehousing, and modern data engineering technologies.
Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines for large and complex datasets.

Develop data processing solutions using Python, PySpark, and SQL.

Build and optimize data pipelines using tools such as AWS Glue, Informatica, Azure Data Factory, Databricks, or equivalent technologies.

Design and implement data warehouses, data lakes, and lakehouse solutions.

Work with cloud platforms such as AWS, Azure, or Google Cloud Platform.

Develop data ingestion and transformation processes from structured and unstructured data sources.

Perform data profiling, validation, cleansing, and quality checks.

Optimize SQL queries, Spark jobs, and data pipelines for performance and scalability.

Work with databases including Oracle, PostgreSQL, SQL Server, Teradata, Snowflake, BigQuery, or Redshift.

Implement CI/CD processes and version control using Git, Jenkins, GitHub Actions, or Azure DevOps.

Collaborate with Data Architects, Business Analysts, DevOps Engineers, and application teams.

Monitor production pipelines, troubleshoot failures, and resolve data-related issues.

Ensure data security, governance, lineage, and compliance standards are followed.

Participate in architecture discussions, code reviews, technical documentation, and mentoring of junior engineers.

Required Skills

10+ years of experience in Data Engineering or related fields.

Strong hands-on experience with Python, PySpark, and SQL.

Strong understanding of ETL/ELT concepts and data pipeline development.

Experience with AWS, Azure, or Google Cloud Platform cloud environments.

Strong experience with Databricks / Spark and distributed data processing.

Experience with Snowflake, BigQuery, Redshift, Teradata, Oracle, or PostgreSQL.

Experience with data lakes, data warehouses, and lakehouse architecture.

Knowledge of Kafka or other streaming technologies is preferred.

Experience with Git and CI/CD tools.

Strong troubleshooting, analytical, and problem-solving skills.

Excellent communication and collaboration skills.

Preferred Skills

Experience with Informatica PowerCenter/IICS/IDMC, Talend, AWS Glue, ADF, or similar ETL tools.

Experience with Airflow, Control-M, or other workflow orchestration tools.

Knowledge of Terraform and cloud infrastructure.

Experience with Delta Lake / Delta Live Tables.

Knowledge of data governance, metadata management, and data quality frameworks.

Experience working in Agile/Scrum environments.

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Lead Data Engineer in Atlanta, GA vacancy

Sr. Lead Data Engineer
$205.32k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr Manager - Non People LeaderFlexible... ..., LLCSr. Lead Data EngineerJob Description: Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...
Suggested
Full time
Work at office
Local area
Remote work
Flexible hours
Cox Enterprises
Atlanta, GA
2 days ago
Lead Data Engineer
...Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building, and delivering trusted market‑leading technology products in a secure, stable, and scalable way. As a core...
Suggested
Shift work
Cooper Lighting Solutions
Atlanta, GA
4 days ago
Lead Data Engineer
...comprehensive electrical procurement, Ampacity specializes in expert-engineered, field-ready solutions that accelerate project timelines and... ...America. About this Role Ampacity is looking for a Lead Data Engineer to lead the rebuild and modernization of our data platform...
Suggested
Work at office
Local area
Work from home
Quanta Services
Atlanta, GA
4 days ago
Lead Data Engineer
...Lead Data EngineerStrategically architect, design, develop industry-specific solutions in support of core enterprise functions based... ...s and market best practices. Strong understanding of software engineering principles, databases and data modeling/design techniques; data...
Suggested
Syntricate Technologies
Atlanta, GA
4 days ago
Lead Data Engineer
...As a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and thousands of data assets. You will own, deliver, operate, and help architect the Enterprise Data Lake, Ingestion...
Suggested
Work at office
Worldwide
Flexible hours
Flint Hills Resources
Atlanta, GA
1 day ago
Lead ML & Data Engineer - Build Scalable Production Models
...The Coca-Cola Company is seeking a Senior Data/ML Engineer to lead the technical direction for end-to-end ML capabilities within our digital products in North America. You will define problem framing, data foundations, model training, deployment, and monitoring while...
Jobleads-US
Atlanta, GA
2 days ago
Lead Data Engineer
...you to discuss about this opportunity in details. Role 1: Sr. Data Engineer with Databricks, Python, Salesforce Automation Role 2: Sr. Data... ...source system analysis. Thanks & Regards, OpenKyber LEAD TALENT ACQUISITION SPECIALIST Direct Number:- Fax : Email: Website...
Long term contract
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Title: Data Engineer ( DATA ENGINEERING | DATA MODELING | PERFORMANCE): Location: Remote & hybrid, alternating weeks at the nearest office Duration: 4 months+ contract Number of Positions: 2 roles Responsibilities: DATA ENGINEERING | DATA MODELING |...
Contract work
Work at office
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Seeking a data engineer for hybrid contract role in Westmont IL. If interested , share your word document resume, work authorization, expected... ...enterprise data for AI/agentic consumption. Track record of leading workstreams and driving technical decisions across teams as a...
Hourly pay
Contract work
For contractors
Monday to Friday
Shift work
2 days per week
3 days per week
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Senior Data Engineer Location: Remote Employment: 6-Month Contract Experience: 4+ Years Job Summary: We are looking for a Senior Data Engineer with strong hands-on experience in dbt Core, dbt Cloud, Fivetran, and Snowflake . The candidate will design, develop, deploy,...
Contract work
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Lead Data Platform Engineer with Top Clothing Retailer / Department Store Chain : Job Tite: Lead Data Platform Engineer Start Date : 9/22/26 End Date: 1/30/27 Location : Plano, TX (Hybrid) Rate: up to $72.99/HR W2 Job Description: Design, implement...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Senior Data Engineer Remote prefer candidates form Charleston, SC Long Term W2 The Senior Data Engineer, leads the design and implementation of robust data solutions across multiple domains, driving technical excellence and scalability. This role mentor others, shape best...
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Role: Lead Data Engineer Location: Dallas, TX (Onsite) Duration: 6-12 Months Responsibilities: Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc. Collaborate...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Position: Senior Data Engineer Location: Boston, MA / Providence RI (Hybrid) Job Description: Required Qualifications 8... ...accountability, urgency, and continuous improvement. Experience leading technical initiatives and influencing teams without relying...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...We have an opening for Senior Data Engineer at Jersey City, NJ . Kindly apply with your updated resume if you are interested. Please find the job details below: Position: Senior Data Engineer Location: Jersey City, NJ (In-Person Interview) Duration:...
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Title: Lead Data Engineer Work Location: Newark, New Jersey 07068 Contract duration: Long term contract Required Qualifications: ~ Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent combination of education...
Long term contract
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Title: Sr. Data Engineer Location: Portland, OR Onsite Job Type: Contract Experience: 14+ Years Mandatory Interested candidates are required to include their LinkedIn URL, email address, and cell phone number along with their resume when submitting...
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Top Skills: Big Data exp: Spark, Nifi pipelines, data bricks Java, SQL, and PL/SQL ETL Development (They use SSIS)... ...to be available for onsite if needed) Job Overview: Leads software engineering projects and creates the development and delivery of enhanced...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Required Qualifications: Bachelor's degree in Information Systems, Information Technology, Computer Science, Engineering or equivalent experience Strong experience with SQL and PL/SQL development Experience working with relational databases such as SQL Server...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Role Summary: Seeking a Tech Lead to lead a team of developers in designing, developing, and delivering scalable AI/Data solutions. The role involves technical leadership,... ...Expertise in AI/LLM technologies: RAG, Prompt Engineering, Agentic Workflows, Vector Databases,...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
$67 per hour
...Role : Senior Data Engineer(Medicaid or Healthcare Experience(Required)) Client: Government of Nebrasaka(NeDHHS) Work Type : Remote Duration : 12 Months Max Payrate : 67$ Per Hour OpenKyber Inc. is a fast-growing Systems Integrator based in Princeton...
Hourly pay
Local area
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
Apache Kafka: Advanced Databricks: Advanced Google Cloud Platform (Google Cloud Platform): Intermediate Microsoft Azure: Intermediate For applications and inquiries, contact:****@*****.***
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Microsoft Fabric experience, ideally involving a production implementation Solid prior background in Apache Spark / distributed data engineering Experience with data pipelines, transformation and orchestration Strong SQL and Python/PySpark skills Understanding of Fabric...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Description: Senior Data Engineer - Data Platforms Role Overview We are seeking a Senior Data Engineer to design, build, and maintain scalable data engineering solutions that power analytics, reporting, and data products across the organization. This role works closely...
Worldwide
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
Lead enterprise data engineering for a Databricks-based lakehouse and streaming analytics platform at Norfolk Southern Corp . In this hybrid role in Atlanta, GA , you will set technical direction, modernize ingestion and transformation patterns, and help guide steady-state...
Work at office
Remote work
Shift work
Weekend work
Norfolk Southern Corp
Atlanta, GA
5 days ago
Lead Data Engineer
Data Engineering Lead (Marketing) Position Description (General role information, job purpose, main objectives of the role) Location: Atlanta, GA Duration: FULL TIME / C2H Mode: Hybrid ( 2 days a Week) This Data Engineering Lead (Marketing) position is part of Client...
Full time
For contractors
Work experience placement
2 days per week
ACI Infotech
Atlanta, GA
1 day ago
Technology Lead | Azure Data Engineering
...We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern...
Contract work
2T Consulting
Atlanta, GA
24 days ago
Tech Lead, ML & Data Engineering
...The Coca-Cola Company in Atlanta, GA is seeking a Senior Data/Machine Learning Engineer to lead end-to-end ML capabilities and ensure scalable data foundations. You will partner with product, design, data science, and platform teams to frame problems, define success metrics...
Jobleads-US
Atlanta, GA
2 days ago
Lead ML & Data Platforms Engineer
...The Coca-Cola Company in Atlanta is seeking a Senior Data/Machine Learning Engineer to lead end-to-end ML capabilities within product teams. You will set technical direction for ML systems, with a focus on data foundations, governance, and scalable pipelines. You will...
Jobleads-US
Atlanta, GA
2 days ago
Senior Data/Machine Learning Engineer
$171k - $198k
...are raising our standards for product craft and rebuilding the systems behind these experiences. As a Tech Lead specializing in Machine Learning and Data Engineering, you will lead the technical direction for end-to-end ML capabilities that ship as part of our product,...
Full time
Work at office
Local area
Relocation
The Coca-Cola Company
Atlanta, GA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!