Lead Data Engineer (Scala, Spark, Azure Synapse)
eTeam Inc
Lead Data Engineer (Scala, Spark, Azure Synapse)
Work Location & Reporting Address: Atlanta, GA 30313 (Onsite. Will consider candidates willing to relocate to client's location)
Must Have Skills:
- Pyspark
- Spark
- Azure Synapse
- Scala
- SQL
Nice to Have Skills:
- Java
- Python
Detailed Job Description:
- 8-10 Years of Total Experience with minimum 7-8 years of Experience in Data Engineering space on Scala & Spark, Pyspark Azure Synapse Data Lake
- Design scalable Azure data architectures using ADLS, Azure Synapse for enterprise analytics using Spark framework.
- Strong hands-on experience with Azure Synapse Analytics, along with a good understanding or exposure to Microsoft Fabric
- Develop and manage data models across bronze, silver, gold layers to support reporting and analytics. Delta/Parquet file formats.
- Ensure performance, reliability, and security by optimizing jobs, monitoring pipelines, and enforcing governance.
- Deep understanding of Apache Spark architecture and distributed data processing concepts
- Proficient in Scala and Python
- Experience working with Azure Synapse. Experience with KQL to query Log Analytics.
- Working experience with source code repository like GIT/Azure Repos & build tools like Maven.
- Strong problem-solving skills and excellent communication skills.
- Lead and collaborate by mentoring engineers, driving best practices, and working with stakeholders end to end.
Minimum Years of Experience: 8-10 years
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Scala, Spark, Azure Synapse) in Atlanta, GA vacancy
- ...experience leveraging Azure Storages: ADLS Gen... ...leveraging Azure Data Ingestion tools:... ...servers, Azure Synapse Analytics, Azure SQL... ...technologies likes: Spark, PySpark, Apache... ...languages like Python, Scala, R, Java, SQL, etc... ...Science, Data Engineering, advanced...SuggestedFull timeH1b
ACI Infotech
Atlanta, GA1 day ago - ...Role: Data Engineer Duration: FULL TIME (Accepting... ...requirements, be a SME for Azure Cloud and Databricks,... ..., Azure Databricks, Synapse Analytics,Azure DevOps:... ...engineering tools like Spark, Hadoop, Azure Data pipelines... ...(SQL, Python, Scala, Java, etc.,) ~ Expertise...SuggestedFull timeWork experience placementH1b
ACI Infotech
Atlanta, GA3 days ago - ...We are hiring a talented J Lead Databricks Data Engineer. Location: Atlanta, GA (... ...), and cloud services (AWS/Azure/GCP). Key responsibilities... ...governance, optimizing performance (Spark optimizations, Medallion... ...: Python, PySpark, Scala, SQL. Cloud Platforms: AWS...Suggested
CirrusLabs
Atlanta, GA3 days ago - ...Lead Data Engineer Join us as a Lead Data Engineer on the Corporate Data... ...using Databricks Pipelines and Azure Data Lake Storage (ADLS), Azure... ...such as Python, Java, or Scala for data processing and application... ...data pipelines, optimizing Spark jobs, implementing security...SuggestedShift work
Synovus
Atlanta, GA1 day ago - Infosys is looking for a Data Engineer in Atlanta, Georgia, to participate in the design and implementation... ..., particularly with Microsoft Fabric or Azure analytics services. Strong SQL skills and familiarity with Spark/PySpark are essential. The position includes responsibilities...SuggestedRelocation
- ...CapTech Machine Learning Engineers are responsible for... ...and implementing data-driven solutions... ...for the Lead Machine Learning Engineer... ...platforms (e.g., AWS, Azure, GCP). Designing... ...solutions using Python, Scala, or similar... ...Proficiency leveraging SQL, Spark, NoSQL, and/or...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
CapTech Consulting
Atlanta, GA18 days ago - ...Azure Data Engineer Seeking an Azure Data Engineer to support our public... ...division and customers, and leading the design and hands on implementation... ...native services such as Synapse, Data Lake Storage, Alation,... ...R, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive...Work experience placement
Software Technology Inc
Atlanta, GA1 day ago - ...Senior Data Engineer Location: Atlanta, GA Client- Southern... ...tools like Apache Spark, Hive, and Airflow .... ...based environments (e.g., Azure, AWS, GCP). Monitor... ...Azure Data Lake , Azure Synapse , AWS Redshift , or... ...with Python , Scala , or Java for data processing...Contract work
4P Consulting Inc
Atlanta, GA1 day ago - ...experience leveraging Azure Storages: ADLS Gen2-Blobs... ...leveraging Azure Data Ingestion tools: Azure... ...databases, SQL servers, Azure Synapse Analytics, Azure SQL,... ...Data technologies likes: Spark, PySpark, Apache NiFi,... ...languages like Python, Scala, R, Java, SQL, etc.,...
ACI Infotech
Atlanta, GA1 day ago - Job Tittle : Sr. Azure Data Engineer Location: Atlanta GA (Only Local profiles) Job Description Ability... ...of Azure services, including Azure Synapse Analytics, Azure Data Factory, Azure... ...data processing workflows using Python, Spark, SQL. Proven experience in designing and...Contract workLocal area
- ...ability to derive data-driven insights?... ...providers in the data engineering space to solve our... ...SQL, Python, and Spark, following... ...robust code in Python, Scala, Java, or similar... ...Redshift, Microsoft Synapse)preferred Experience... ...platforms (AWS, Azure, GCP) and container...Full timeRemote work
- ...Lead Data Engineer Location: Hybrid (Atlanta, GA preferred) About AssetMark:... ...for continuous improvements, including Azure/Fabric-based modernization , compliance... ...Azure , including tools like Azure Synapse, Data Lake, Data Factory , and Microsoft...
Fisec Global
Atlanta, GA4 days ago - ...Data Engineer This role will be responsible for transforming extensive... ...Responsibilities: ~ Lead a team of data engineers to develop... ...Analysis and Architecture, Spark, PySpark, Python, Sqoop, Pig,... ...-oriented language (Java, Scala, Python). ~5+ years of experience...
Samprasoft
Atlanta, GA2 days ago - ...Data Engineering Lead (Marketing) Position Description (General role information, job purpose, main... ...and implement scalable data solutions on Azure platform using Data Factory, Databricks... ...• Programming Languages: SQL, PYTHON, SCALA, R • API Development: Azure APIM, REST...Full timeFor contractorsWork experience placement2 days per week
ACI Infotech
Atlanta, GA3 days ago - ...automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data... ...processing terabytes of IoT telemetry on Azure Databricks (PySpark DLT,... ...). ~ Deep expertise in Apache Spark / PySpark with production experience...Permanent employmentTemporary workRelocation packageFlexible hours
Honeywell
Atlanta, GA7 days ago - Info Resume Edge in Atlanta, Georgia is seeking a Data Engineer to participate in the modernization and migration of Azure data systems to the Databricks Lakehouse Platform. The ideal candidate will have strong hands-on experience with SQL/T-SQL and a bachelor's degree...
- Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform . Support... ...Qualifications Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field. Proven experience...
$131.75k - $178.25k
...Description: Role: AI Data Engineer Architect... ...Thought Leadership: Lead workshops, produce... ...in Hadoop, Spark, and distributed data... ...: Skilled in AWS, Azure, or GCP data services... ..., BigQuery, Synapse, and columnar storage... ...review Python or Scala for data pipeline...TEPHRA
Atlanta, GA1 day ago- ...Managing Consultant, Data Engineer Department: Data Analytics Employment... ...consultants room to grow, lead, and build. The Role We... ...pipelines using tools like Azure Data Factory, AWS Glue, or... ...big data technologies such as Spark, Kafka, or Redshift Exposure...Full timeLocal areaRelocation
$90 - $95 per hour
...are currently seeking a Sr Data Engineer - Advisor to join our... ...maintain data pipelines using Scala and SQL on Apache Spark. Monitor and support... ...bottlenecks. Lead refactoring and cleanup of... ...skills. Experience with Azure Synapse. Working knowledge of...Hourly payTemporary workWork experience placementWork at officeLocal areaImmediate startRemote workFlexible hoursThe Nippon Telegraph and Telephone Corporation (NTT)
Atlanta, GA3 days ago- ...Overview: Job Title : Azure Data Engineer Location : Atlanta, GA Remote Duration : Long-Term We are looking for an experienced... ...languages Additional skills needed in Python & Scala. Technical Skills: 1. Microsoft Azure SQL 2. Azure as...Remote work
r2 Technologies, Inc.
Atlanta, GA4 days ago - ...country. Job Description CapTech Data Engineering consultants enable clients to build and... ...using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)... ..., Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
CapTech Consulting
Atlanta, GA4 days ago - ...Software solutions is looking for a Data Engineer for one of our clients.... ...experience ~ Cloud experience with Azure, AWS, Google Cloud, or another... ...Desired Skills Experience with Spark and Streamsets Experience with Java, Scala or Groovy Experience with...Contract work
Nava Software Solutions
Atlanta, GA1 day ago - ...Senior Data Engineer - Atlanta, GA Cargill's size and scale allows us... ...major cloud platforms (AWS, GCP, Azure). DATA ARCHITECTURE: Hands... ...Strong background with using Spark for data transformation,... ...programming skills in Python, Java, Scala, or similar languages. Expert...Work experience placementVisa sponsorshipWork visa
Cargill
Atlanta, GA4 days ago - ...Data Engineer Experience Level: 1–3 Years Location: Atlanta, Ga... ...implement ETL/ELT processes using Azure Data Factory, Azure... ...: Azure Data Lake, Azure Synapse, Azure Key Vault, Power BI, MSBI... ...solutions using big data tools like Spark, Hive, and Hadoop....Contract work
4P Consulting Inc
Atlanta, GA7 days ago - ...The Senior Data Engineer will serve as a key contributor and... ...architectural direction, and lead data‑driven initiatives... ...Develop SQL in Azure‑SQL and Snowflake technologies... ...Snowflake, Azure Synapse or AWS Redshift 4‑5 years... ...Familiarity with Spark/Databricks Familiarity...Work at office
Neighborly Software
Atlanta, GA1 day ago $106.9k - $176.5k
...world. Technology – Data and Decision Science – Data Engineering – Senior We are... ...(e.g., AWS, Azure, GCP). Collaborate... ...business objectives. Lead end-to-end data pipeline... ...and experience with Spark for big data... ...languages such as Python, Scala, or SQL....Summer holidayFlexible hoursEY
Atlanta, GA16 hours ago- ...Big Data Engineer: Various levels (Principal, Lead, Senior, Intermediate, Junior) Job Posting... ...processing: Apache Kafka and Spark Streaming ~ Experience... ...with Python (and/or Scala) and PySpark/Scala-Spark... ...deploying a new data platform on Azure/ AWS ~ Experience in...Work at office
Kaav Inc.
Atlanta, GA5 days ago $175.5k - $180k
Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey... ...owner, designing and leading the implementation of... ...polyglot environments (Scala, Java) when required by... ...using modern frameworks (Spark, LangChain, Databricks,... ...cloud providers (AWS, Azure, GCP) ~ Exceptional time...ApprenticeshipWork at officeLocal areaEasy workMcKinsey & Company
Atlanta, GA23 hours ago$90k - $150k
...Your role at GEI. The Data Engineer is responsible for designing, building... ...SQL; experience with PySpark or Spark is strongly preferred. Experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage,...Work at officeFlexible hoursGEI Consultants
Atlanta, GA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Scala, Spark, Azure Synapse). Be the first to apply!
Related searches
- azure specialist Atlanta, GA
- devops engineer azure Atlanta, GA
- cloud engineer azure Atlanta, GA
- azure infrastructure engineer Atlanta, GA
- azure developer Atlanta, GA
- azure data engineer Atlanta, GA
- microsoft azure architect Atlanta, GA
- data coordinator Atlanta, GA
- master data coordinator Atlanta, GA
- minimum data set coordinator Atlanta, GA