Lead Data Engineer
Openkyber
Employment Type: Full-Time Experience: 10+ Years Location: Hybrid NY/NJ Job Overview EXL is looking for a Senior AWS Analytics Engineer with 10+ years of experience in data engineering, ETL, and cloud-based data platforms. The ideal candidate should have hands-on experience building and supporting data pipelines using AWS services, Python, SQL, and Spark/PySpark.
Key Responsibilities
- Develop and maintain data pipelines and ETL processes using AWS services.
- Work with AWS S3, AWS Glue, and Amazon Redshift for data ingestion, transformation, and storage.
- Develop data transformations using Python, SQL, and PySpark/Spark .
- Build and maintain batch data processing workflows.
- Use AWS Step Functions to orchestrate data pipelines and workflows.
- Support AWS infrastructure and deployments using CloudFormation .
- Troubleshoot data pipeline failures and resolve data-quality and performance issues.
- Work with large datasets and optimize data processing jobs.
- Collaborate with senior data engineers, architects, analysts, and business teams.
- Follow data engineering, security, monitoring, and CI/CD best practices.
Required Skills
- 10+ years of experience in Data Engineering / Cloud Data Engineering
- Hands-on experience with AWS Amazon S3 AWS Glue Amazon Redshift Python SQL Apache Spark / PySpark AWS Step Functions AWS CloudFormation
- Strong understanding of ETL/ELT and data pipelines
For applications and inquiries, contact:View email address on us.fitly.work
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Atlanta, GA vacancy
- Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical...SuggestedPermanent employmentTemporary workRelocation packageFlexible hours
Honeywell
Atlanta, GA2 days ago - Robert Half is working with a client in the Atlanta area seeking a Senior Lead Data Engineer.Lead the design, development, and optimization of enterprise data platforms and data warehouse solutionsDrive the migration and modernization of legacy data environments to SnowflakeArchitect...Suggested
Robert Half
Atlanta, GA1 day ago $205.32k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr Manager - Non People LeaderFlexible... ..., LLCSr. Lead Data EngineerJob Description: Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...SuggestedFull timeWork at officeLocal areaRemote workFlexible hoursCox Enterprises
Atlanta, GA2 days ago- ...Atlanta, GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 191597Apply: JobAs a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and...SuggestedWork at officeWorldwideFlexible hours
Georgia-Pacific
Atlanta, GA3 days ago - ...the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific... ...and our clients.Specific responsibilities for the Lead Machine Learning Engineer position include:...SuggestedWork at officeRemote workVisa sponsorshipWork visaFlexible hours
CapTech
Atlanta, GA3 days ago - ...comprehensive electrical procurement, Ampacity specializes in expert-engineered, field-ready solutions that accelerate project timelines and... ...America. About this Role Ampacity is looking for a Lead Data Engineer to lead the rebuild and modernization of our data...Full timeWork at officeLocal area
Quanta Services
Atlanta, GA2 days ago - ...uphold organizational standards. Develops business models to represent requirements, such as use cases, business process flows, and data flow diagrams.Negotiates agreements and commitments. Facilitates communication between business units and Information Technology from...Work at office
Synovus
Atlanta, GA4 days ago $134.5k - $265.1k
Position Summary Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of modern data and analytics solutions for clients across industries. In this role, you will help teams translate business needs into scalable data platform...Local areaVisa sponsorshipDeloitte
Atlanta, GA12 hours ago- ...impact that is felt by all. See where your commitment could take you.Who are we looking for?GHD is seeking a Lead Consultant - Data Architecture & Engineering to join our Americas Business Advisory practice. This role is a senior seller‑doer position for a technically...Work at officeLocal area3 days per week
GHD
Atlanta, GA4 days ago - ...Lead Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like,... ...technology and build a more sustainable, more inclusive world.Data engineers are responsible for building reliable and scalable data...Full timeLocal area
Capgemini
Atlanta, GA3 days ago - ***MUST HAVE CURRENT HEALTHCARE EXPERIENCE*** As a Lead Data Engineer, you will play a hands-on technical leadership role in evolving the data capabilities that power our client's solutions. You will lead complex initiatives across two closely connected areas: onboarding...
Harnham
Atlanta, GA1 day ago - ...Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building, and delivering trusted market‑leading technology products in a secure, stable, and scalable way. As a core...Shift work
Cooper Lighting Solutions
Atlanta, GA4 days ago - 100% Onsite Role - Onsite interview in MD Bachelor degree in Computer Science, Data Science, Engineering, or a related field 15+ years of experience in software or data engineering, with at least 4 years focused on ML systems or MLOps in a production environment. Demonstrated...
Openkyber, LLC
Atlanta, GA19 hours ago - ...Lead Data EngineerStrategically architect, design, develop industry-specific solutions in support of core enterprise functions based... ...s and market best practices. Strong understanding of software engineering principles, databases and data modeling/design techniques; data...
Syntricate Technologies
Atlanta, GA4 days ago - ...Required Qualifications: Bachelor's degree in Information Systems, Information Technology, Computer Science, Engineering or equivalent experience Strong experience with SQL and PL/SQL development Experience working with relational databases such as SQL Server...
Openkyber
Atlanta, GA2 days ago - ...Data Engineer Job Description We are looking for a Senior Data Engineer with 8+ years of experience building and supporting enterprise data platforms. The ideal candidate will have strong hands-on expertise with Microsoft Fabric, Azure, ETL/ELT, SQL, Python, and modern...
Openkyber
Atlanta, GA2 days ago - ...Role: Senior Data Engineer Location: Dallas, TX (Onsite) 6-12 Months Responsibilities Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc. Collaborate with cross-functional...
Openkyber
Atlanta, GA2 days ago - ...Job Title: AWS Glue Data Engineer (14+ Years Only) Location: Fort Mill SC / New York, NY / Florham Park, NJ (Hybrid) We are seeking a highly skilled AWS Data Engineer to design, develop, and optimize large-scale data pipelines and ETL workflows on AWS. The ideal...
Openkyber
Atlanta, GA2 days ago - ...Role : AWS Lead Data Engineer (3 Open Positions) Location : Newark City, NJ (Hybrid) Face to Face interview is required at Newark City, NJ (Hybrid) Job Summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As...Work at office
Openkyber
Atlanta, GA2 days ago - ...Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term W2 Consultants preferred. Skill Focus Azure , Snowflake, DB Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake...Remote work
Openkyber
Atlanta, GA2 days ago $40 - $50 per hour
...job summary: We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud...Hourly payContract workTemporary workWork experience placementOpenkyber
Atlanta, GA2 days ago- ...Job Description: We are seeking an experienced Senior Data Engineer to design, develop, and optimize scalable data platforms that power enterprise analytics, machine learning, and AI-driven solutions. The ideal candidate will bring deep expertise in modern data engineering...
Openkyber
Atlanta, GA2 days ago - ...Sr Data Engineer- with Talend, Kafka, PySpark, Python, EMR. Glue, Athena, Flink, APIs, Microservices, Data Pipelines , Data Streams, Data warehouse, Data Lake, Lakehouse , Data Modeling - ONSITE - Reading PA Senior Data Engineer 12 plus years of experience across Experience...
Openkyber
Atlanta, GA2 days ago - Apache Kafka: Advanced Databricks: Advanced Google Cloud Platform (Google Cloud Platform): Intermediate Microsoft Azure: Intermediate For applications and inquiries, contact:****@*****.***
Openkyber
Atlanta, GA2 days ago - ...Job Title: Senior Databricks Engineer Location: 100% Remote Interview Process: Video (2 Rounds) Job Description: Lead/Senior Databricks Data Engineer Position: Lead Databricks Data Engineer / Databricks Architect Experience: 10+ Years...Remote work
Openkyber
Atlanta, GA2 days ago - ...Senior Data Engineer Malvern, PA (Hybrid -3 day's onsite): Duration: Long term uties Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills Advanced...
Openkyber
Atlanta, GA2 days ago - ...Data/Database Administration - Data Engineer - Montvale, NJ - Contract W2/C2C - $55-65 per HR Join our team as a Data Engineer in a dynamic contract role based in Montvale, NJ. This position involves managing data platforms, supporting application operations, and troubleshooting...Contract work
Openkyber
Atlanta, GA2 days ago - ...Role Summary: Seeking a Tech Lead to lead a team of developers in designing, developing, and delivering scalable AI/Data solutions. The role involves technical leadership,... ...Expertise in AI/LLM technologies: RAG, Prompt Engineering, Agentic Workflows, Vector Databases,...
Openkyber
Atlanta, GA2 days ago - ...Description: Senior Data Engineer - Data Platforms Role Overview We are seeking a Senior Data Engineer to design, build, and maintain scalable data engineering solutions that power analytics, reporting, and data products across the organization. This role works closely...Worldwide
Openkyber
Atlanta, GA2 days ago - ...Job Title: Senior Data Engineer - Power BI, Power Automate, Snowflake & Python Specialist Looking for a v ersatile Senior Data Engineer to develop end-to-end data solutions for automotive and fleet management platforms. You'll deliver Azure pipelines, Snowflake data warehousing...
Openkyber
Atlanta, GA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches