Sr. Data Engineer

Job Description One of Insight Global's clients is seeking a Sr. Data Engineer supporting data platforms with a data science & insights department. This position is responsible for designing, building, and maintaining scalable, reliable data pipelines that power D&H’s enterprise data platform. This role supports SAP BDC/Datasphere integration, Databricks Lakehouse architecture, curated data products, and AI-ready data modeling. The Senior Data Engineer plays a foundational role in modernizing legacy data environments and delivering governed, production-grade data assets for enterprise analytics and AI enablement. The Data Engineer will need to be analytical, technically inclined, detail-oriented, visually focused, and a self-learner. As a Subject Matter Expert in technical requirements, this role is critical in supporting and implementing data projects and solutions and effectively engaging with users and other IT staff. As a member of the Business Intelligence team, the individual will analyze the existing data warehouse database to ensure efficiency and accuracy to business functions and operational reporting, as well as modify the ETL processes for a complex and maturing data warehouse. Responsibilities include the following: Support, optimize and monitor current data warehousing, data modeling, data integration, business intelligence and ETL processes on NETEZZA platform with CTAS, CBT, zone map and work-load management. Provide assistance in troubleshooting and resolving data and system issues, stepping in when necessary to address outages and challenges. Maintain methods and procedures for tracking data quality, completeness, redundancy, and improvement. Analyze and troubleshoot issues across various applications from Access Tools (Cognos, Tableau and Excel), Data warehouse/Data Marts on Netezza Platform. Actively participate in design discussions, code reviews, and project-related team meetings. Develop processes that facilitate data transformation, manage data structures, metadata, dependencies, and workload management. Collaborate with business users to understand functional and data requirements, contributing to the enhancement of data models and pipelines. Apply expert-level analytical and problem-solving skills to troubleshoot and resolve technical issues. Develop, maintain, and continuously enhance scalable data pipelines, while also developing new data source integrations to support the growing volume and complexity of data. Proactively maintain and tune SQL code. Identify and capture lessons learned, best practices, and information gained during performance of tasks. Be part of a 24x7 on-call rotation for after-hour and weekend production support. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Skills and Requirements Bachelor’s degree (B. A.) from four-year college or university; or 8+ years related experience and/training; or equivalent combination of education and experience. 2+ years’ experience extracting and summarizing data from a variety of data source types using ETL tools. Experience in writing complex SQL statement to extract and analyze data. Experience interfacing with business users and understanding their requirements. Experience with Tableau and Cognos a plus. Insight Global