Senior Data Engineer

A Senior Data Engineer within AWS Specialist and Partner Organization will shape the data backbone for an internal deal intelligence platform that guides strategic partnerships and portfolio decisions. This role requires partnering across teams to consolidate data from diverse sources, resolve conflicts in real-world data, and collaborate with science and ML teams to enable forecasting, modeling, and data-driven decision making. Responsibilities Own the data architecture for your domain areas such as ingestion, entity resolution, and vendor relationship modeling, while contributing to broader platform architecture decisions. Deliver solutions with limited guidance when end-to-end data models and data flows are not yet defined. Onboard and integrate disparate data sources across Amazon (AWS, Retail, Procurement, Finance, vendor systems); resolve conflicts and drive cross-team alignment on data definitions and ownership. Evolve data sourcing and modeling toward governed, reusable data products and migrate within your domains without disrupting downstream consumers. Build and operate pipelines across distributed processing and orchestration on an open-lakehouse foundation on AWS (Glue/Spark, Airflow, Iceberg, Athena), governed by Lake Formation and cross-account IAM. Raise operational excellence with incremental, retry-safe loads, atomic publication, dependency-aware scheduling, and data-quality validation. Design data systems within your scope to support diverse access patterns, including batch analytics, governed BI, and ML training datasets. Partner with the science team to build data infrastructure for forecasting and reinforcement-learning work, including feature pipelines, training datasets, decision logs, and reward signals. Drive engineering and operational excellence best practices across the data infrastructure. Mentor and develop peers within the team. Balance short-term delivery needs with long-term architectural scalability. Requirements 5+ years of data engineering experience Experience with data modeling, warehousing, and building ETL pipelines Experience with distributed data processing using Spark (or equivalent) and workflow orchestration such as Airflow Strong SQL skills and proficiency in at least one scripting language (Python preferred) for data manipulation and pipeline development Experience designing data schemas and operating data stores in support of analytics and downstream consumers Experience working with cloud data services, with AWS preferred Technologies Glue Spark Airflow Iceberg Athena Lake Formation S3 IAM ElasticSearch EMR EC2 Lambda Hudi Delta Lake Python SQL Benefits Health insurance 401(k) matching Paid time off Parental leave Description Amazon Web Services is seeking a Senior Data Engineer to join the Specialist and Partner Organization (ASP). This role lives on a centralized team that manages strategic partnerships across Amazon, generating, managing, and executing complex deals with broad implications for AWS and other Amazon business units. The position sits within the Strategic Initiatives group, which focuses on building data infrastructure to support high-impact partnerships and cross-functional initiatives. About the Team This role is part of the AWS Specialist and Partner Organization (ASP). Specialists own end-to-end go-to-market strategy for their technology domains, providing both business and technical expertise to help customers succeed. Partner teams drive strategy, recruiting, development, and growth of key technology and consulting partners, collaborating to deliver solutions at scale for complex challenges. Diverse Experiences AWS values diverse experiences. If you do not meet all preferred qualifications, we encourage you to apply. Whether your career is just starting, follows a nontraditional path, or includes alternative experiences, your background may still be a strong fit. Why AWS? AWS is the world's most comprehensive and widely adopted cloud platform. We pioneered cloud computing and continue to innovate, earning the trust of startups and Global 500 companies alike to power their businesses with a robust set of products and services. Inclusive Team Culture AWS promotes curiosity and connection. Our employee-led and company-sponsored affinity groups foster inclusion and empower teams to bring diverse perspectives. Inclusion events strengthen collaboration and fuel ongoing innovation. Mentorship & Career Growth We aim to raise our performance bar through continuous learning, mentorship, and resources that help you grow into a more well-rounded professional. Work/Life Balance We value work-life harmony and offer flexibility to support both professional success and personal commitments, fostering an environment where you can thrive at home and at work. #J-18808-Ljbffr