Technology Lead | Azure Data Engineering

Temporary

2T Consulting

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills

Azure Synapse Analytics
PySpark
Apache Spark architecture
Spark SQL
Data Lake architecture
Medallion Architecture
Data transformation and processing
Strong troubleshooting and problem-solving skills

Nice-to-Have

Microsoft Fabric
Experience with modern cloud data platforms

Responsibilities

Design, develop, and optimize data solutions using Azure Synapse Analytics.
Develop scalable data pipelines and transformations using PySpark and Spark SQL.
Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
Design and implement Data Lake and Medallion Architecture solutions.
Troubleshoot performance, data quality, and pipeline-related issues.
Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
Evaluate and leverage Microsoft Fabric capabilities where appropriate.
Provide technical leadership and contribute to solution architecture and development standards.

Required Qualifications

8+ years of experience in data engineering, cloud platforms, or related technology roles.
Strong hands-on experience with Azure Synapse Analytics.
Strong programming experience with PySpark and Spark SQL.
Deep understanding of Apache Spark and distributed data processing.
Experience designing and implementing Data Lake architectures.
Excellent communication and collaboration skills.
Strong analytical, troubleshooting, and problem-solving abilities.

Apply

Vacancy posted 23 days ago

Similar jobs that could be interesting for youBased on the Technology Lead | Azure Data Engineering in Atlanta, GA vacancy

Sr. Lead Data Engineer
$205.32k
...Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr... ...Description: Sr. Lead Data Engineer positions offered by Cox Automotive... ...deployment, and operation of technology architecture, solutions, and... ...Amazon RDS SQL Server, Azure SQL Instances, or Amazon DynamoDB...
Suggested
Full time
Work at office
Local area
Remote work
Flexible hours
Cox Enterprises
Atlanta, GA
1 day ago
Lead Data Engineer
...Description: Senior Data Engineer - Data Platforms Role Overview We are seeking a Senior Data Engineer to design, build, and maintain... ...engineers and promote best practices across the team Core Technologies: AWS Glue, PySpark, Python, Java, Apache Flink (Stream...
Suggested
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Position: Senior Data Engineer Location: Boston, MA / Providence RI (Hybrid) Job Description: Required Qualifications 8... ...accountability, urgency, and continuous improvement. Experience leading technical initiatives and influencing teams without relying...
Suggested
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Description: We are seeking an experienced Senior Data Engineer to design, develop, and optimize scalable data platforms that power... ..., Lakehouse platforms, and distributed data processing technologies. This role will play a critical part in building reliable, high...
Suggested
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Title: Sr. Data Engineer Location: Portland, OR Onsite Job Type: Contract Experience: 14+ Years Mandatory Interested candidates are required to include their LinkedIn URL, ****@*****.***, and cell phone number along with their...
Suggested
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Top Skills: Big Data exp: Spark, Nifi pipelines, data bricks Java, SQL, and... ...onsite if needed) Job Overview: Leads software engineering projects and creates the development... ...in information systems, Information Technology, Computer Science, Engineering or equivalent...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Ampacity specializes in expert-engineered, field-ready solutions that... ...efficiently—with the most reliable technology in the industry.... ...Ampacity is looking for a Lead Data Engineer to lead the rebuild... ...design and implement a scalable Azure and Databricks-based lakehouse...
Work at office
Local area
Work from home
Quanta Services
Atlanta, GA
13 hours ago
Lead ML & Data Engineer - Build Scalable Production Models
...The Coca-Cola Company is seeking a Senior Data/ML Engineer to lead the technical direction for end-to-end ML capabilities within our digital products in North America. You will define problem framing, data foundations, model training, deployment, and monitoring while...
Jobleads-US
Atlanta, GA
1 day ago
Lead Data Engineer
...Role Summary: Seeking a Tech Lead to lead a team of developers... ..., and delivering scalable AI/Data solutions. The role involves... ...using modern cloud, AI, and data technologies. Key Responsibilities... ...LLM technologies: RAG, Prompt Engineering, Agentic Workflows, Vector...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Lead Data Platform Engineer with Top Clothing Retailer / Department Store Chain : Job Tite: Lead Data Platform Engineer Start Date :... ...Datameer and Tableau. Experience with containerization technologies such as Docker and orchestration tools like Kubernetes....
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Position: Senior Data Engineer Experience: 10+ Years Employment Type: Contract W2... ...warehousing, and modern data engineering technologies. Key Responsibilities... ...using tools such as AWS Glue, Informatica, Azure Data Factory, Databricks, or equivalent...
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Position : Sr. Data Engineer Location: Newark, NJ (Hybrid) Duration: 12+ Months Contract Job Description: Bachelor's degree in Computer... ...in AWS. Knowledge of ETL/ELT, data modeling, and big data technologies. Familiarity with data warehousing concepts and cloud-based...
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...this opportunity in details. Role 1: Sr. Data Engineer with Databricks, Python, Salesforce... ...~ Experience with Microsoft Fabric or Azure Synapse Analytics; familiarity with Fabric... ...analysis. Thanks & Regards, OpenKyber LEAD TALENT ACQUISITION SPECIALIST Direct...
Long term contract
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Description: Senior Data Engineer - Data Platforms Role Overview We are seeking a Senior Data Engineer to design, build, and maintain... ...team ________________________________________ Core Technologies This role will work extensively with the following...
Worldwide
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
$67 per hour
...Role : Senior Data Engineer(Medicaid or Healthcare Experience(Required)) Client: Government of Nebrasaka(NeDHHS) Work Type... ...expected to maintain sufficient expertise across the complete technology stack-including Scala, Apache Spark, Hive, Drools, and the...
Hourly pay
Local area
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
Apache Kafka: Advanced Databricks: Advanced Google Cloud Platform (Google Cloud Platform): Intermediate Microsoft Azure: Intermediate For applications and inquiries, contact:****@*****.***
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...We have an opening for Senior Data Engineer at Jersey City, NJ . Kindly apply with your updated resume if you are interested. Please... ...Python, Snowflake or Databricks, and distributed processing technologies. Develops reliable data models and integrations across cloud...
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Role: Senior Data Engineer Location: Dallas, TX (Onsite) Duration: 6-12 Months Responsibilities: Design... ...solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc. Collaborate with cross-...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Required Qualifications: Bachelor's degree in Information Systems, Information Technology, Computer Science, Engineering or equivalent experience Strong experience with SQL and PL/SQL development Experience working with relational databases such as SQL Server...
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Job Title: Data Engineer ( DATA ENGINEERING | DATA MODELING | PERFORMANCE) Location: Remote & hybrid, alternating weeks at the nearest... ...troubleshoot bottlenecks. Collaborate with business and technology stakeholders across the delivery lifecycle. The Expertise...
Contract work
Work at office
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
As a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and thousands of data assets. You will own, deliver, operate, and help architect the Enterprise Data Lake, Ingestion Framework...
Work at office
Worldwide
Visa sponsorship
Flexible hours
Georgia-Pacific LLC
Atlanta, GA
5 days ago
Lead Data Engineer
Lead enterprise data engineering for a Databricks-based lakehouse and streaming analytics platform at Norfolk... ...cross-team dependencies. Tools and technologies Databricks, Spark, PySpark, Delta... ...Snowflake, BigQuery, HBASE, Cassandra, Azure, Kinesis, TIBCO EMS, IBM MQ Series,...
Work at office
Remote work
Shift work
Weekend work
Norfolk Southern Corp
Atlanta, GA
4 days ago
Lead Data Engineer
...Senior Data Engineer Remote prefer candidates form Charleston, SC Long Term W2 The Senior Data Engineer, leads the design and implementation of robust data solutions across multiple domains... .... ~ Deep hands-on experience with Azure and Databricks, including Delta Live...
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Seeking a data engineer for hybrid contract role in Westmont IL. If interested... ...cloud data platforms on Azure or AWS, including services... .... Track record of leading workstreams and driving technical... .... Experience with streaming technologies such as Kafka, Spark Streaming...
Hourly pay
Contract work
For contractors
Monday to Friday
Shift work
2 days per week
3 days per week
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
Data Engineering Lead (Marketing) Position Description (General role information, job purpose, main... ...is part of Client IT's Marketing Technology team focused on enabling the development... ...implement scalable data solutions on Azure platform using Data Factory, Databricks...
Full time
For contractors
Work experience placement
2 days per week
ACI Infotech
Atlanta, GA
5 days ago
Lead Data Engineer
Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building,... ...to‑end data solutions using Databricks Pipelines and Azure Data Lake Storage (ADLS), Azure Databricks. Develop,...
Shift work
Cooper Lighting Solutions
Atlanta, GA
5 days ago
Lead ML & Data Platforms Engineer
...The Coca-Cola Company in Atlanta is seeking a Senior Data/Machine Learning Engineer to lead end-to-end ML capabilities within product teams. You will set technical direction for ML systems, with a focus on data foundations, governance, and scalable pipelines. You will...
Jobleads-US
Atlanta, GA
1 day ago
M&A Integration Technology Lead
$142.3k - $195.7k
...investments, assessing technology platforms, infrastructure, applications, data, cybersecurity, operating... ...and expected synergies.Lead day-to-day integration... ...Information Systems, Engineering, or related field.8+ years... ...migration programs (Azure, AWS, or GCP)Cybersecurity...
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Atlanta, GA
12 hours ago
Tech Lead, ML & Data Engineering
...The Coca-Cola Company in Atlanta, GA is seeking a Senior Data/Machine Learning Engineer to lead end-to-end ML capabilities and ensure scalable data foundations. You will partner with product, design, data science, and platform teams to frame problems, define success metrics...
Jobleads-US
Atlanta, GA
1 day ago
IT - Technology Lead | Container Platform | Kubernetes
...Job Title: Azure SRE Lead Work Location : AtlantaGA30346 Vendor Rate... ...in Site Reliability Engineering (SRE) Strong expertise in... ...Experience in telemetry data collection, logging, metrics... ...Azure, or GCP) and container technologies (Kubernetes, Docker). Hands...
Contract work
Work at office
2 days per week
Cloudspace LLC
Atlanta, GA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technology Lead | Azure Data Engineering. Be the first to apply!