Sr. Data Engineer

Title: Sr. Data Engineer
Location: Atlanta GA (Local Candidates only
On-site/Remote/Hybrid: Hybrid (Tuesday through Thursday Onsite)
Duration: 12 Months with possibility of Extension
Interview Process: Webcam or in-Person


Required Skills
We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data solutions using modern technologies, particularly Microsoft Fabric and Azure-based platforms.


Work Location & Attendance

• Must be physically located in Georgia
• On-site: Tuesday to Thursday (per manager's discretion)
• Mandatory in-person meetings: All Hands, Enterprise Applications, All Staff
• Experience Required: 2-3 years

Key Responsibilities

• Assist in designing, building, and maintaining ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
• Support migration and maintenance of SSIS packages from legacy systems.
• Implement medallion architecture (Bronze, Silver, Gold) for data lifecycle and quality.
• Create and manage notebooks (Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
• Build curated datasets to support Power BI dashboards.
• Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets.
• Apply data governance policies in line with Microsoft Purview or Unity Catalog.
• Support monitoring, logging, and CI/CD automation using Azure DevOps.

Technical Stack

• Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)
• Azure Databricks
• SQL Server / SQL Managed Instances
• Power BI
• SSIS (migration and maintenance)
• LangGraph and RAG DB (for advanced data workflows)

Qualifications

• Bachelor's degree in computer science, Information Systems, or related field.
• 2-3 years of experience in data engineering or related roles.
• Proficiency in SQL, Python, Spark.
• Familiarity with LangGraph and RAG DB concepts.
• Hands-on experience with Microsoft Fabric and Power BI.
• Understanding of ETL/ELT pipelines and data warehousing concepts.

Preferred

• Knowledge of CI/CD automation with Azure DevOps.
• Familiarity with data governance tools (Microsoft Purview, Unity Catalog).
• Experience with SSIS package migration and maintenance.

Skills Required

• Bachelor's degree in computer science, Information Systems, or related field. Required 3 Years
• 3-5 years of experience in data engineering or related roles. Required 3 Years
• Familiarity with LangGraph and RAG DB concepts. Required 3 Years
• Understanding of ETL/ELT pipelines and data warehousing concepts. Required 3 Years
• Knowledge of CI/CD automation with Azure DevOps. Nice to have 3 Years
• Familiarity with data governance tools (Microsoft Purview, Unity Catalog). Nice to have 3 Years
• Experience with SSIS package migration and maintenance. Nice to have 3 Years

About Us:
InterSources Inc , is a Small, Woman, and Minority-Owned Business Enterprise, ISO/IEC 27001, SOC 2 Type 2 certified company with massive 18+ years of diversified experience in providing IT Consulting Services, Artificial Intelligence, Data Analysis, Application Development, Cloud Services, Cybersecurity, Digital Marketing, ERP Management, Custom Software Development, Web Development, UI/ UX Design, System Integration, QA Support etc. We make reasonable accommodations for clients and employees, and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud and Oracle partner company.