Lead Data Engineer

Job Description

We are seeking a hands-on Lead Data Engineer to support a large-scale Oracle Fusion migration and analytics modernization initiative. This individual will serve as the technical lead for the Data Engineering workstream, helping drive architecture decisions, delivery planning, estimations, mentoring, and execution. The team is migrating legacy Oracle financial data models into a Databricks Lakehouse environment, building near real-time data pipelines, modernizing DBT models, and supporting downstream Power BI reporting.

Key Responsibilities

• Lead architecture and technical design decisions for the Data Engineering team

• Own delivery planning, estimation, sprint execution, and technical oversight

• Mentor and provide guidance to Data Engineers

• Design and optimize Databricks Lakehouse solutions

• Build and support ingestion and transformation pipelines

• Lead DBT model development, conversion, and refactoring efforts

• Establish engineering standards and best practices

• Optimize Gold Layer Delta tables for Power BI consumption

• Partner closely with BI, QA, and Project teams to ensure successful delivery

• Identify technical risks, dependencies, and blockers proactively

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• 10+ years of Data Engineering experience

• 5+ years of Databricks experience

• Strong experience with:

○ Databricks

○ Unity Catalog

○ PySpark

○ SQL

○ DBT

○ Delta Lake

○ Lakeflow/DLT

○ Azure DevOps

○ Git

• Advanced dimensional modeling experience

• Experience leading technical teams and mentoring engineers

• Expertise optimizing data models for Power BI reporting and analytics

• Experience modernizing legacy ETL and SQL workloads • Oracle Fusion ERP experience

• BICC extraction experience

• Financial reporting or financial data domain experience

• Metadata-driven frameworks

• Code generation or AI-assisted development experience

• Agentic engineering experience