Data Engineer

Data EngineerAbout the Role"We Power the Magic!" That's our motto at Disney Experiences (DX). Our team creates world-class immersive digital experiences for the Company's premier vacation brands and segments. We are responsible for the end-to-end digital and physical Guest experience for all technology & digital-led initiatives across the Attractions & Entertainment, Food & Beverage, Resorts & Transportation and Merchandise lines of business.As a Data Engineer at Disney Experiences, you will assist in designing, building, and overseeing the deployment of technology architecture, solutions, and software aimed at capturing, managing, and utilizing structured and unstructured data from various sources. This role is designed for professionals who are passionate about data engineering and can work effectively within a collaborative team environment.The Data Engineer will create data ingestion pipelines including workloads and applications inside AWS. Implements, troubleshoots, and optimizes distributed solutions based on big data technologies like SQL, S3, Glue, MSK, Snowflake and Redshift to solve large scale processing problems in a Cloud DW environment. Designs syndicated and curated data views that will be used for reporting, analytics, and advanced applications. Apply technical expertise and mathematical concepts to challenging programming problems. Strong communication, interpersonal, and collaboration skills, including the ability to work effectively in an agile / scrum environment.ResponsibilitiesDesign and develop data pipelines in AWS & SnowflakeDesign and develop data views, assist with architecture decisions, deployment, and feedback.Develop and support data solutions using AWS services including CDK, CloudFormation, Kinesis, Lambda, SQS, SNS, S3, and EC2.Ability to debug and troubleshoot across a broad technical stack.Product ownership and strong business support in enterprise level theme park related environment.Working with a variety of business partner groups across Disney Parks and Resorts to implement optimal technical solutions.Provide data and system analysis needed for feature engineering.Develop and maintain data quality checks and validation processes to ensure reliable and accurate data assets.Required Qualifications:3+ years of Data Engineering or similar experience required, supporting SQL in a Data warehouse environment.Strong knowledge of Python and object-oriented programming concepts.Solid working experience with Snowflake native objects like SnowPipe, external/internal stages, external tables, integration objects, stored procedures (Snowflake Scripting), stream & task, data masking, time travel and cloning.Design scalable dimensional and analytical data models that support enterprise reporting, self-service analytics, and data product consumption.Ability to translate business requirements into scalable data solutions and curated datasets.Experience building data pipelines and complex data transformations.Experience with AWS S3, Glue, MSK, Redshift, Spark, or related ETL/Deployment tools.Working knowledge of Data Build Tool (DBT).Experience working in an Agile/Scrum development environment.Strong conceptual understanding of security at rest and in transit for big data pipelines.Strong troubleshooting and problem-solving skills with the ability to analyze and resolve data and system issues.Hands-on experience implementing data pipelines and data models within established architectural frameworks.Strong systems and data analysis skills, and experience with testing in data space.Experience with CI/CD pipelines and source control tools such as GitHub.Preferred QualificationsExperience with Airflow or other workflow orchestration tools.Experience supporting real-time data processing workloads.Familiarity with data governance, metadata management, and data lineage concepts.Exposure to machine learning or analytics use cases.Experience working with large-scale cloud-based data platforms.Required EducationBachelor's degree in computer science, Distributed Computing, Machine Learning, Mathematics or related field Required.