Senior Data Engineer

Senior Data EngineerMicrosoft is a company where passionate innovators come to collaborate, envision what can be, and take their careers further. Imagine being at the forefront of a revolution powered by Data and AI (Artificial intelligence), transforming Marketing at Microsoft into a true "Frontier Organization" that drives impact at an unprecedented scale. As part of the Global Marketing Data Engineering team, you will have the opportunity to build cutting-edge data platforms that process and synthesize billions of demand signals, enabling personalized customer journeys, media innovation, and high impact campaigns that redefine customer engagement. By crafting data products that integrate, enrich, and serve deep insights across an infinite number of scenarios, you are not only shaping the future but experiencing it firsthand as we directly contribute to the evolution of our most advanced technologies like Purview and Fabric.Microsoft's mission is to empower every person and every organization on the planet to achieve more, and we're dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their highly qualified contributions each day.Join us to unleash your potential and play a pivotal role as a data innovator with world-changing impact - your journey starts here!ResponsibilitiesWe are looking for a Senior Data Engineer who is willing to work in a dynamic environment to solve real life day-to-day problems, leveraging Data and AI techniques. You will enjoy and be successful in this role if you are curious and willing to challenge the status quo and come up with data-driven solutions to ambiguous problems.Business Understanding & ImpactThis role enables Microsoft's Marketing organization to transform raw data into trusted, scalable, AI-ready data products that fuel campaign performance measurement, customer intelligence, audience engagement, revenue growth, and executive decision-making through the Microsoft Fabric ecosystem.The Senior Data Engineer is responsible for the following:Lead the design, development, and ownership of enterprise-scale marketing data products that power commercial and consumer marketing insights, campaign measurement, audience development, customer analytics, and AI-driven decision making.Architect, build, and maintain scalable data pipelines, ETL/ELT frameworks, and modern Lakehouse solutions using Microsoft Fabric, Azure, OneLake, and related data services to support analytics, reporting, and machine learning workloadsDesign and implement robust semantic models, business metrics, measures, and calculations using DAX and Direct Lake capabilities to establish a trusted and governed source of truth for marketing performance and customer insights.Drive end-to-end ownership of data architecture, including data modeling, ingestion, transformation, storage, governance, security, and consumption patterns across the data lifecycle.Partner with Marketing stakeholders, Technical Program Managers, Analysts, Data Scientists, and Product teams to translate business requirements into scalable data solutions that enable measurable business outcomes.Serve as the primary Subject Matter Expert (SME) for assigned marketing data domains, ensuring data quality, consistency, governance, accessibility, and business alignment across all data products.Build and evolve a strategic backlog of data capabilities, platform enhancements, and product features while driving execution through engineering and vendor partner teams to ensure timely delivery of business valueCollaborate with source-system owners to onboard and integrate data from CRM, digital marketing, web analytics, social platforms, advertising, customer engagement, commerce, and enterprise systems while ensuring security and compliance requirements are met.Develop proof-of-concepts and technical validations to evaluate new data sources, architectures, platform capabilities, and AI-powered engineering solutions, ensuring scalability, reliability, and maintainability.Establish and maintain comprehensive data quality frameworks, observability solutions, monitoring systems, and operational dashboards that proactively identify issues and ensure reliable, trusted data delivery.Implement Medallion Architecture patterns (Bronze, Silver, Gold) and domain-driven data product strategies that optimize performance, governance, discoverability, and data reuse across marketing organizationsDesign reusable engineering frameworks, scalable code patterns, and highly maintainable solutions that support long-term platform growth and engineering excellence.Leverage AI-assisted development tools, Copilot capabilities, and agentic engineering practices to accelerate solution delivery while maintaining quality, security, privacy, compliance, and human accountability standardsReview, validate, and govern AI-generated code, infrastructure definitions, documentation, tests, and data transformations to ensure production readiness, performance, security, and maintainability.Drive CI/CD automation, deployment standards, infrastructure-as-code practices, and DevOps excellence across development, testing, and production environments. ]Partner closely with Data Architects, Engineering teams, Operations teams, and peer developers to establish enterprise-scale data standards, architecture principles, and technical best practicesChampion data governance, privacy, compliance, and security principles by incorporating Microsoft standards and regulatory requirements into all data engineering solutionsMentor and support engineers across the organization through technical leadership, architecture guidance, code reviews, and knowledge sharing to elevate engineering capabilities and platform maturity.Influence long-term data strategy by providing recommendations on emerging technologies, AI capabilities, Fabric innovations, semantic modeling approaches, and data platform modernization efforts.Embody Microsoft's culture and values by fostering a growth mindset, customer obsession, collaboration, accountability, diversity and inclusion, and continuous learning.QualificationsMinimum Qualifications:Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineeringOR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineeringOR equivalent experience.Preferred Qualifications:Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineeringOR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineeringOR equivalent experience.2+ years experience with data governance, data compliance and/or data security.Proficient in designing data architectures, data models, and scalable data platforms that translate user scenarios into dependable technical solutions.Demonstrated analytical skills and problem understanding, with the ability to evaluate technical trade-offs and make responsible, data-informed decisions.Effective cross-team and technical communication skills, including the ability to explain complex architecture and data concepts clearly to technical and non-technical stakeholders.Experience managing stakeholder priorities, facilitating cooperative decision-making, and resolving conflicts across interconnected teams to support delivery and business outcomes.