Data Engineer - EDW Refactor 1 & 2 - Offshore

Job Description

Compensation:

15 to 25 LPA - Exact compensation may vary based on several factors, including skills, experience, and education.

A Fortune 100 retail client of Insight Global is looking to hire elite Data Engineers to join their Enterprise Data Warehouse Team. This team is responsible for supporting and providing all 12 company business units with the data they need to optimize their BUs and increase efficiency/profitability. This company has a centralized data organization and is Google's largest customer. There are over 200 people that report to this director, and his teams are responsible for working with over 170 petabytes of data within BigQuery. This Data Engineer will be responsible for legacy redesigns, net new projects within all 12 business units, and will be using cutting-edge technology for all of it. The ideal candidate for this role can vary in years of experience but must be able to think systemically about computer science instead of just being able to code. For example, there are a hundred ways to cut code, but these candidates must understand what the trade-offs are of doing it each way and be able to explain why they would decide which way they chose to cut it. We are looking for someone with a growth mindset who is able to reflect on their prior work and think of what they would do differently next time to improve it. The overarching goal of this team is not just build a data set, but to build one that is robust using processes and techniques that will allow to work just as well on day 100 as it would on day 1.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Skills and Requirements

• hands on experience with LLM agents and a strong foundation in data engineering. The ideal profile should be able to design, build, and operationalize AI driven workflows that integrate with modern data platforms.

• Practical experience working with LLM agents, multi agent frameworks, or AI orchestration patterns (e.g., planners, evaluators, tool using agents).

• Strong understanding of prompt engineering, context management, and agent based task decomposition.

• Solid data engineering background, including experience with ETL/ELT pipelines, data modeling, orchestration tools, and cloud data ecosystems.

• Ability to integrate LLM based agents with existing data pipelines, APIs, and enterprise systems.

• Familiarity with Python based AI frameworks and modern AI tooling is preferred.

• engineer who can bridge AI agent capabilities with data engineering workflows, helping us accelerate automation, improve data quality, and build intelligent, long running AI processes.

• either Retail or Supply Chain/Distribution Center domain experience

• Supply Chain/Distribution Center = Labor management, Warehouse Management Systems (WMS), Inventory, Transportation

• Retail = Workforce management, labor optimization/planning, brick & mortar retail, store attribution, building services/facilities/HVAC/maintenance tickets/work orders/etc.

• Strong written + verbal communication (will be asking these resources to work directly with project management, product management, stakeholders to gather requirements, work through testing/validations, etc. They need to be able to drive the project forward, work independently and be okay interacting with end-users and key stakeholders)

• Ability to speak to the outcomes they have driven within their domains through their queries

• SQL expert

• ETL/BI development experience

• Jenkins (ideally 2+ years working experience in data engineering)

• GCP

• BigQuery

• GCS

• Python

• Dataform and/or DBT

• Must be a systemic-thinker • Experience supporting projects tied to order fulfillment, delivery, customer experience, inventory, transactions, expenses, discounts, COGS, LTL, etc.

• Candidates coming from a newer company in the online space such as Chewy, Amazon, Wayfair, Netflix (doesn't have to be a Fortune100; a legit startup within this space is fine too)

• T.A. (Teaching Assistant) experience in grad school

• Experience working with really high streaming/high velocity/fancy technologies (seeing that in action at a decent-sized company is great background experience)