Lead Data Engineer

Lead Data Engineer

The Disney Decision Science and Integration (DDSI) team leverages advanced technologies, data analytics, and scientific approaches such as optimization, and statistical modeling to build innovative tools that shape business decisions across The Walt Disney Company. We support Disney Entertainment (ABC, The Walt Disney Studios, Disney+, Hulu), ESPN, Disney Experiences (Theme Parks, Cruise Line, Consumer Products, DVC), and Corporate Finance with strategic applications that enable data-driven decision-making.

This is not a remote role. This team works in office.

What You Will Do

You will be responsible for planning and leading research and development related to advanced analytic data solutions, leveraging GenAI. You will work with business and technology leaders to understand scope and requirements, business needs, and data from across the Disney company in order to design and deliver the data pipelines necessary for our solutions. You will partner with the Decision Science Products, Decision Science, and client teams on critical projects. Other activities include planning, estimating, design, development, testing, production rollout and sustainment activities. You will also need to consult and collaborate with project team members, lead design reviews, do hands-on development, and communicate with colleagues and leaders.

Required Qualifications & Skills

• 7+ years overall experience in a data engineering development capacity using multiple environments (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion
• Experience translating project scope and high-level requirements into technical data engineering tasks
• Experience defining solutions to sophisticated data engineering problems in support of advanced analytic processes
• Experience with a variety of GenAI models, tools, and concepts
• Understanding of Knowledge Graphs, Data Mesh, and other data sharing platforms
• 3+ years using, designing and building relational databases (preferably Snowflake or PostgreSQL)
• 3+ years of experience leading and deploying code using a source control product such as GitLab/GitHub
• 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4
• Experience collaborating with multiple project teams in a fast-paced environment
• Experience with defining and estimating level-of-effort data engineering activities
• Experience with project and sprint planning
• Ability to communicate technical concepts and solutions to non-technical team members
• Experience designing and building data structures to support requirements
• Multiple years of experience with ELT/ETL data pipeline development and maintenance
• Multiple years of shown experience and expertise using SQL and Python
• Experience using containerization technologies such as Docker or Kubernetes
• Proven ability to work collaboratively in a multi-team environment

Preferred Qualifications

• Experience leading development of GenAI based systems including model selection, pipeline orchestration and deployment strategies
• Experience defining GenAI architectures
• Knowledgeable with Disney Parks attendance, reservations and/or products
• Experience with cloud based technologies, preferably AWS EMR, EC2, and S3
• Experience with advanced Snowflake offerings such as Snowpark, Data Exchange, Data Marketplace and Snowpipe

Education

• Bachelor's degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study and/or equivalent work experience

The hiring range for this position in Orlando, FL $135,200 to $181,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.