Data Engineer

Required Skills & Experience
• \t5+ years of experience in Data Engineering, Analytics, or Software Engineering.\n•\tStrong SQL skills for data analysis and pipeline development.\n•\tProficiency in Python (PySpark) for data pipeline creation and troubleshooting.\n•\tExperience with Databricks and Azure Data Factory.\n•\tEffective communication and collaboration across technical and business teams.\n•\tExperience structuring data for analytics and machine learning.\n\nPreferred Skills\n•\tExperience with Databricks Unity Catalog.\n•\tFamiliarity with data modeling and diagramming tools.\n•\tFocus on continuous improvement and data quality.\n•\tExposure to operational monitoring and incident response practices.

Job Description

The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India, you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.\nThis is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Global’s ability to deliver high-quality, actionable data to the business.\n\nPrimary Responsibilities\n•\tDesign and build scalable, reliable data pipelines for analytics and data science.\n•\tMonitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence.\n•\tTroubleshoot and fix bugs across the data platform, contributing to platform stability and performance.\n•\tImprove data quality, performance, and process efficiency.\n•\tDevelop and maintain metadata catalogs and optimize resource usage.\n•\tApply CI/CD and automated testing to ensure code quality and deployment reliability.\n•\tCollaborate across business, analytics, and IT teams to deliver data solutions.\n•\tWork with structured and unstructured data in both batch and streaming environments.\n•\tParticipate in on-call rotations and support deployment activities.