Sr Data Engineer- Lead
Spruce Infotech
Must Have Skills:
• Pyspark
• Spark
• Azure Synapse
• Scala
• SQL
Nice to Have Skills:
• Java
• Python
Detailed Job Description:
• 8-10 Years of Total Experience with minimum 7-8 years of Experience in Data Engineering space on Scala & Spark, Pyspark + Azure Synapse+ Data Lake
• Design scalable Azure data architectures using ADLS, Azure Synapse for enterprise analytics using Spark framework.
• Strong hands-on experience with Azure Synapse Analytics, along with a good understanding or exposure to Microsoft Fabric
• Develop and manage data models across bronze, silver, gold layers to support reporting and analytics. Delta/Parquet file formats.
• Ensure performance, reliability, and security by optimizing jobs, monitoring pipelines, and enforcing governance.
• Deep understanding of Apache Spark architecture and distributed data processing concepts
• Proficient in Scala and Python
• Experience working with Azure Synapse. Experience with KQL to query Log Analytics.
• Working experience with source code repository like GIT/Azure Repos & build tools like Maven.
• Strong problem-solving skills and excellent communication skills.
• Lead and collaborate by mentoring engineers, driving best practices, and working with stakeholders end to end.
Minimum Years of Experience:
• 8-10 years
Certifications Needed:
• None
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Interview Process (Is face to face required?)
• Virtual
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr Data Engineer- Lead in Atlanta, GA vacancy
- ...diagrams, class models, etc. Proficiency in solutions design and requirements definition disciplines. A bachelor's in computer engineering, computer science or other related discipline or equivalent experience. Added bonus if you have: Experience with Cloud...Senior
Fisglobal
Atlanta, GA4 days ago - ...company's digital product offerings is critical to our success. Data and analytics processes drive many of those same capabilities... ...for the challenge? What you will be doing: The Data Engineering Lead will play a critical role in driving innovation and growth for...SeniorFull timeShift work
FIS
Atlanta, GA5 days ago - ...Senior Data Engineer With Databricks SQL PySpark My client is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies...SeniorLocal area
E-Solutions
Atlanta, GA5 days ago - The Travelers Indemnity Company is seeking a Senior Data Engineer in Atlanta, Georgia. As a key member of the Data Engineering team, you will design, build, and operationalize data solutions that support analytics and AI initiatives. The ideal candidate has a Bachelor’s...Senior
$78.9k - $147.5k
A healthcare solutions provider located in Atlanta is seeking a senior data engineer to support the design and maintenance of data infrastructure. This role requires at least five years of experience in data management, SQL, and data warehousing concepts. The ideal candidate...SeniorRemote job- A technology company in Atlanta is seeking an experienced data operations professional to oversee an automated data pipeline environment. Responsibilities include monitoring workflows, validating data quality, and assisting in customer onboarding. The ideal candidate will...Senior
- Ericsson GmbH is looking for a highly motivated Data Center Optical Engineer based in Atlanta, Georgia. The role is pivotal for ensuring the reliable installation, maintenance, and operation of optical transport within data centers. The ideal candidate must possess extensive...SeniorRemote job
- Georgia-Pacific is seeking a Data Engineer/Sr. Data Engineer in Atlanta, GA, to join the IT Data & Analytics Packaging & Cellulose Delivery Team. The role involves designing and maintaining data pipelines for the Corrugated business. The ideal candidate will have experience...SeniorWork at office3 days per week
- EY is seeking a highly skilled Senior Consultant Data Engineer specialized in cloud data engineering, particularly with Databricks. This role involves designing scalable data architecture and collaborating with clients to deliver tailored analytics solutions. Ideal candidates...SeniorFlexible hours
$99k - $164.8k
Kemper is looking for a Senior Data Engineer to guide the design and delivery of enterprise data platforms. In this role, you will leverage your expertise in Snowflake and AWS to provide technical leadership and oversee the development of data pipelines that support analytics...Senior- A leading payments technology provider is hiring a Senior AWS Cloud Data Engineer in Tampa, FL. You will design and maintain data infrastructure solutions, work closely with engineering teams, and ensure best practices. The ideal candidate needs a degree in Computer Science...Senior
$159.6k - $296.4k
Warner Bros. Discovery is looking for a Sr. Staff Data Engineer in Atlanta, Georgia to serve as the technical authority for CNN’s Data Platform. In this role, you will architect the systems powering analytics, data science, and machine learning across CNN products. You...Senior- A data-driven company located in Atlanta is seeking a Data Integration Specialist to enhance and optimize ETL workflows and implement data solutions. The ideal candidate will have advanced expertise in SQL Server, ETL concepts with Microsoft SSIS, and a bachelor’s degree...Senior
- Intercontinental Exchange Holdings, Inc. is looking for a Senior Data Engineer to join the Enterprise Architecture team. In this role, you will design and implement data pipelines while ensuring data quality and governance. You'll collaborate with stakeholders to enhance...Senior
- ...A recycling technology firm in Atlanta is seeking a Data Engineering Lead to design and maintain their data infrastructure. The ideal candidate has over 8 years of experience in data engineering, strong SQL skills, and a background in building production-grade data pipelines...
Page Mechanical Group Inc
Atlanta, GA1 day ago - ...growth and sustainability. We are very collaborative, transparent, data driven, value diverse perspectives and are looking for... ...executing those ideas to take Nexus to the next level. The Data Engineering Lead is responsible for designing, building, and maintaining the organization...Temporary workWorldwideFlexible hours
Page Mechanical Group Inc
Atlanta, GA1 day ago - ...Data Engineer We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data...Senior
Conflux Systems
Atlanta, GA2 days ago - ...Sr. Data Streaming Engineer Location: Atlanta, GA Position Type: Contract Rate: DOE $/hr. on w2 only No Visa sponsorship available for this Job (US Citizen, Green Card, GC-EAD only) Job Description • Sr. Engineer who has experience using Streamsets, Apache...SeniorContract workVisa sponsorship
Staffing the Universe
Atlanta, GA4 days ago - ...Role Name: Sr. Data Engineer Location: Atlanta, GA Experience: 6-8+ Years Roles & Responsibilities: Drive world-class design and development of analytical data pipelines. Adhere to processes to ensure data pulled from various sources meets quality...Senior
Prophecy Technologies
Atlanta, GA4 days ago - ...as assembly/integration, cross-discipline functions, knowledge engineering, industry expertise, or legacy evolution. Interacts with the customer... ...scope, plans, and deliverables for assigned projects. Leads the design, development, implementation, and support of information...Senior
Next Level Business Services, Inc.
Atlanta, GA6 days ago - ...Palantir Sr Data Engineer Location: NYC/ATL, US (Hybrid 3 days) Skills: EdgeX Foundry, IT infrastructure, IT networking, Palantir Foundry, PySpark, Python, data integration, data management, data processing, edge computing, information technology, programming, programming...Senior
Staffing the Universe
Atlanta, GA4 days ago - ...Senior Snowflake Data Engineer The Senior Snowflake Data Engineer is responsible for implementing scalable data transformation logic,... ...individual works closely with the Data Architect / Solution Design Lead and client technical team to help translate approved designs...Senior
RIT Solutions
Atlanta, GA4 days ago - ...Position: Sr. Oracle Data Engineer Location: Atlanta, GA (Onsite Role) Duration: 6 months with possible extension Pay Rate: $70-75/Hr on C2C Years of Exp: 10-15 years Oracle EBS price process configuration exp is must....SeniorWork experience placement
Futran Tech Solutions Pvt. Ltd.
Atlanta, GA5 days ago - ...Sr. Data Engineer Location: Plano, TX OR Atlanta, GA (Onsite from Day 1 F2F Required) Long Term Must Have: (Scala, Java Apache Flink) Job Description: 5+ years of software/data engineering experience using Java, Scala, and/or Python, with at least 3 years' experience...Senior
Yantran LLC
Atlanta, GA2 days ago $60 - $70 per hour
...Data Engineer Must be located in Atlanta, GA Long term opportunity | $60-$70 per hour (We are unable to partner with third parties... ...analytics and data science team that assist them in building industry-leading insights and solutions Skills & Qualifications Minimum...SeniorHourly paySciata
Atlanta, GA4 days ago- ...Sr. Data Engineer Do you get excited when you see Data? Constantly looking for value in Data? If that is you, then you're the one we're... ...of business data to necessary levels ~ Work with technical leads and architects to implement new standards, new technology, and...Senior
Professional Recruiters
Atlanta, GA2 days ago - ...Architect level experience leveraging Azure Storages: ADLS Gen2-Blobs, Containers, • Architect level experience leveraging Azure Data Ingestion tools: Azure Data Factory (ADF), Azure Event Hubs, Azure IoT Hubs, Azure Event Grid • Architect level experience using...Senior
ACI Infotech
Atlanta, GA4 days ago - ...We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data solutions using...SeniorContract work
Vir Healthway
Atlanta, GA3 days ago - ...We are seeking a Senior Data Engineer to lead the design, development, and maintenance of scalable, high-performance data solutions focused on Data Centralization, Governance, and Integrity. This is a highly technical role requiring expertise in Google Cloud Platform...SeniorFull timeRemote workMonday to Friday
RIT Solutions Inc/ Tech Dev IT/ Texperts Inc/ConceptsIT, Inc...
Atlanta, GA4 days ago - ...Sr Data Engineer Atlanta, GA (Hybrid) FTE Role Summary The Senior Data Engineer enables the delivery of modern... ...engineer works closely with solution architects, data product leads, and customer teams to translate requirements into production...Senior
VBeyond
Atlanta, GA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Data Engineer- Lead. Be the first to apply!
Related searches
- senior data center engineer Atlanta, GA
- data engineer manager Atlanta, GA
- data science developer Atlanta, GA
- etl data engineer Atlanta, GA
- entry level big data engineer Atlanta, GA
- data engineer Atlanta, GA
- big data cloud engineer Atlanta, GA
- junior big data engineer Atlanta, GA
- remote data engineer Atlanta, GA
- senior data engineer Atlanta, GA