Technology Lead | Azure Data Engineering
2T Consulting
We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.
Must-Have Skills
- Azure Synapse Analytics
- PySpark
- Apache Spark architecture
- Spark SQL
- Data Lake architecture
- Medallion Architecture
- Data transformation and processing
- Strong troubleshooting and problem-solving skills
Nice-to-Have
- Microsoft Fabric
- Experience with modern cloud data platforms
Responsibilities
- Design, develop, and optimize data solutions using Azure Synapse Analytics.
- Develop scalable data pipelines and transformations using PySpark and Spark SQL.
- Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
- Design and implement Data Lake and Medallion Architecture solutions.
- Troubleshoot performance, data quality, and pipeline-related issues.
- Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
- Evaluate and leverage Microsoft Fabric capabilities where appropriate.
- Provide technical leadership and contribute to solution architecture and development standards.
Required Qualifications
- 8+ years of experience in data engineering, cloud platforms, or related technology roles.
- Strong hands-on experience with Azure Synapse Analytics.
- Strong programming experience with PySpark and Spark SQL.
- Deep understanding of Apache Spark and distributed data processing.
- Experience designing and implementing Data Lake architectures.
- Excellent communication and collaboration skills.
- Strong analytical, troubleshooting, and problem-solving abilities.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Technology Lead | Azure Data Engineering in Atlanta, GA vacancy
- ...Ampacity specializes in expert-engineered, field-ready solutions that... ...efficiently—with the most reliable technology in the industry.... ...Ampacity is looking for a Lead Data Engineer to lead the rebuild... ...design and implement a scalable Azure and Databricks-based lakehouse...SuggestedFull timeWork at officeLocal area
- ...Atlanta, GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 191597Apply: JobAs a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and...SuggestedWork at officeWorldwideFlexible hours
- ...automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data... ...through our Aerospace Technologies, Building Automation, Energy and... ...with production experience on Azure Databricks at scale.Strong proficiency...SuggestedPermanent employmentTemporary workRelocation packageFlexible hours
- ...possible through the power of technology. At CapTech, we’re... ...Machine Learning Engineers are responsible for designing... ...and implementing data-driven solutions for our... ...responsibilities for the Lead Machine Learning Engineer... ...platforms (e.g., AWS, Azure, GCP).Designing, developing...SuggestedWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...business partners as the primary interface between Information Technology and specific business areas, identifying business unit requirements... ...requirements, such as use cases, business process flows, and data flow diagrams.Negotiates agreements and commitments....SuggestedWork at office
- ...career and empower you with the right technology and training as you bring ideas... ...we looking for?GHD is seeking a Lead Consultant - Data Architecture & Engineering to join our Americas Business... ...with cloud data platforms such as Azure, Databricks, and Snowflake. • Experience...Work at officeLocal area3 days per week
- ...Lead Online Data EngineerWith a career at The Home Depot, you can be yourself and also be part of something bigger.Position Purpose:Consistent... ...and suitable candidate for the position.Online Data Engineer teams at The Home Depot translate business requirements and build...Work experience placementNight shift
Home Depot
Atlanta, GA2 days ago $160.06k - $183.33k
Lead Data Engineer - Cox Automotive Corporate Services, LLC (Atlanta, GA) Design simple and scalable solutions to complex data problems,... ...ensuring application performance and maintainability. Use new technologies and develop innovative solutions. Perform data analytics,...Work at officeRemote workFlexible hours- Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building,... ...to‑end data solutions using Databricks Pipelines and Azure Data Lake Storage (ADLS), Azure Databricks. Develop,...Shift work
- Inspire Brands is hiring a Lead Data and AI Engineer for the Enterprise Data Organization to design,... ...latest AI trends and integrate emerging technologies to drive improved system performance... ...in one of the cloud platforms like Azure, AWS, GCP is required, Azure specifically...Worldwide
- OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront... ...to work with cutting-edge technologies, collaborate with industry experts... ..., Spark, Scala, Azure Synapse/Microsoft Fabric, SQL.... ...Consultant 2Career RoleTechnology Lead - USAuto req ID: 153311BRFull timeTemporary workRelocation
- Job DescriptionInfosys McCamish – Technology Lead – Atlanta, GA, USAAs a Technology Lead, you will be responsible for leading end-to-end software development initiatives, managing cross-functional teams, and delivering scalable, high-performance applications. You will collaborate...
- ...Solution IT Inc. is looking for a Lead GCP Data Engineer/Analyst (Retail & CDP Focus) for one of its clients Atlanta, GA. (Hybrid 3 days... .... Experience with agentic AI frameworks or similar technologies is a strong plus. Work Site : Atlanta, GA. (Hybrid...Immediate start
SolutionIT
Atlanta, GA2 days ago $115k - $125k
Construction Technology Deployment Lead Rinvio is hiring a Construction Technology Deployment Lead for travel-based deployment of advanced construction technology and robotic equipment. This is a travel-heavy field role based near the Atlanta, GA market. Pay: $115,000...Contract work- ...Job Title: Azure SRE Lead Work Location : AtlantaGA30346 #### Contract... ...in Site Reliability Engineering (SRE) Strong expertise in... ...Experience in telemetry data collection, logging, metrics... ...Azure, or GCP) and container technologies (Kubernetes, Docker). Hands...Contract workWork at office2 days per week
Ipolarity LLC
Atlanta, GA2 days ago - ...TechMContact: Bhargav Chukka, Gulam Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage Feature...Hourly pay
- ...achieve what’s possible through the power of technology. At CapTech, we’re passionate about the... ...the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...achieve what’s possible through the power of technology. At CapTech, we’re passionate about the... ...the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) Advising...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- This OpportunityWSP is seeking a Technology Infrastructure Lead to support the Hartsfield-Jackson Atlanta International Airport Project Management... ...'s degree in Information Technology, Engineering, Construction Management, Computer Science, or related field...Full timeLocal areaFlexible hours
$148k - $195k
Make your mark for patientsWe are looking for a Digital Technology Lead, Omnichannel Marketing to join our Global Digital Technology team... ...capabilities & personalization of services)- patient/hcp data engineering & management technologiesdisruptive patient/hcp solutions...Permanent employmentContract workWork at officeLocal area2 days per week$240k - $260k
...InvescoAs one of the world’s leading independent global investment... ...Director, Global Digital Platform Technology Lead will define and deliver... ...across web, portal, API, data, content delivery, search, analytics... ...client trust. Architecture, Engineering and Delivery Leadership Set...Full timeWork at officeFlexible hours$127k - $160.55k
...to identify, optimize, and solve problems holistically with technology built by healthcare experts - driving real, measurable... ...interests that shape who you are.Position OverviewThe Senior Data Engineer leads the engineering workstreams that underpin the Payment Operations...Full timeWork at officeLocal areaVisa sponsorshipFlexible hours- Req ID:374073NTT DATA strives to hire exceptional, innovative and... ...seeking a Senior AWS Data Engineer to join our team in Atlanta,... ...is a $30 billion business and technology services leader, serving 75%... ...innovation. We are one of the world's leading AI and digital infrastructure...Contract workWork at officeRemote workFlexible hours
- ...Science, Business Analytics, Engineering, Mathematics, or related field... ...professional experience in data engineering, software engineering... ...platforms such as (AWS, GCP, Azure, Oracle) and modern data... ...expertise at the intersection of technology and business by tackling...ApprenticeshipEasy work
$105.4k - $207.8k
...Transformation (I&DT) practice. I&DT brings an engineering- and innovation-led mindset to how... ...builds, delivers, and scales technology-enabled solutions. Data Studio is Converge for Healthcare's... ...to develop client-facing materials, lead technical discovery conversations,...Local area$55.28 - $64.9 per hour
Our client is searching for a DevOps Engineer with DuckDB experience for a remote temp-to... ...Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-... ...and TEKsystems Global Services We’re a leading provider of business and technology services...Permanent employmentFull timeContract workTemporary workRemote work$164.74k - $169.7k
...5G network that will offer reliable connectivity for all. Sr Engineers, Data located in Atlanta, GA will develop data engineering solutions... ...Develop modern data architectures leveraging Microsoft Fabric, Azure Data Lake (ADLS), Snowflake, PostgreSQL, and MS SQL Server to...Full timeTemporary workPart timeWork experience placementLocal areaRemote workFlexible hours3 days per week- We are looking for a Data Engineer to join an opportunity in Atlanta, Georgia. In this role, you will design and support reliable data solutions that enable efficient reporting, analytics, and downstream business insights across cloud-based platforms. The ideal candidate...
$172.5k - $260.1k
...to level-up your career at the company leading workforce transformation in the... ...Metrics Foundations team is part of Slack's Data Engineering organization within Data & Insights and... ...-on experience with large-scale data technologies and platforms such as Snowflake, Spark...Full time- ...problem-solver who enjoys working on complex data systems and is passionate about data... ...RoleWe're seeking a talented Senior Data Engineer to join our Enterprise Architecture team... ...platform. In this pivotal position, you'll lead the design and implementation of scalable...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technology Lead | Azure Data Engineering. Be the first to apply!
Related searches
- technology lead Atlanta, GA
- azure developer Atlanta, GA
- azure specialist Atlanta, GA
- azure infrastructure engineer Atlanta, GA
- cloud engineer azure Atlanta, GA
- microsoft azure architect Atlanta, GA
- sap master data Atlanta, GA
- data coordinator Atlanta, GA
- data network cabling Atlanta, GA
- data collection Atlanta, GA