Senior Data Engineer

Job Description At K&L Gates, we are looking for smart, imaginative and hard‑working people with diverse backgrounds, experiences and ideas to join us. Perhaps our search for talented visionaries and your search for important and impactful work lead to the same place. Job Summary We are seeking a Senior Data Engineer to join the Enterprise Applications, Data, and AI Platforms group, designing scalable Microsoft Fabric data platforms. The role involves establishing engineering standards, leading design, implementation, and optimization of Lakehouse, Warehouse, and Azure AI Foundry data pipelines; mentoring staff; collaborating with business and technology leaders; and delivering reliable governed products aligned with the firm’s AI strategy. The position reports to a Senior Manager and focuses on technical leadership. Key Relationships Director, Enterprise Applications, Data, and AI Platforms; Senior Manager, Data Engineering; Senior Manager, Automation and Development; Senior Manager, Enterprise Applications; Senior Applications Architect; Senior Data Architect; Team Lead, Workflow and Automation; Technical Program Manager; Project Manager; Cloud Platform Engineer; Security Engineer; Business Data Experts and Business Data Sponsors. Essential Duties Design scalable and resilient data platforms with Microsoft Fabric, including Lakehouse and Warehouse solutions on OneLake. Establish and maintain data engineering standards, patterns, and best practices across the data engineering group and the wider EA organization. Develop and oversee complex data pipelines using Fabric Data Factory, Dataflow Gen2, and Fabric Notebooks for ingestion, transformation, and advanced automation. Lead schema design, dimensional modeling, Medallion Architecture implementation, and semantic model development to enable analytics, reporting, and AI workloads. Optimize data performance, reliability, and cost by tuning, monitoring, and validating data quality. Ensure data governance, quality, and security standards are integrated into solutions, collaborating with governance leads on classification, lineage, and access controls. Maintain data pipelines supporting Azure AI Foundry workloads, including grounding datasets, vector indexing preparation, and feature data for retrieval‑augmented generation. Provide mentorship and guidance to junior data engineers through code reviews, design sessions, and technical coaching. Partner with business stakeholders to convert complex requirements into scalable data architectures within an Agile DevOps model, supporting CI/CD pipelines and maintaining architecture documentation. Advocate enterprise processes, procedures, security, standards, and knowledge‑first support as a role model. Define and oversee testing strategies for assigned data solutions, including quality standards and user acceptance frameworks. Leverage AI tools such as Microsoft Copilot and Claude to aid development and contribute to AI solutions on the Microsoft platform stack, adhering to governance standards and responsible use. Experience & Skills Required Hold a bachelor’s degree in a technical field; equivalent experience accepted. Ability to obtain Microsoft certifications including DP-600, DP-203, and AI-900. Understand Data Mesh and Microsoft Purview, including domain ownership, federated governance, metadata management, cataloging, and sensitivity labeling. Maintain a secure workspace and willingness to travel up to 10% for offices, vendor sites, conferences, or seminars. Participate in scheduled release windows and production support events, including evenings or weekends, with advance notice and flexible scheduling. Demonstrate the ability to implement data governance, ensure quality, optimize performance, and integrate security controls into enterprise data solutions. Translate complex business requirements into scalable architectures and communicate designs visually using diagramming, whiteboarding, and collaborative tools. Collaborate effectively with technical and executive stakeholders while mentoring engineers and leading technical decisions. Adapt to new technologies and utilize AI‑powered tools in enterprise settings to enhance productivity and achieve improved results. 5+ years designing enterprise data platforms using Microsoft Fabric, including pipelines, schema design, dimensional modeling, Medallion Architecture, and semantic layer development. Expertise in SQL and Python for data transformation and automation, utilizing Spark and CI/CD pipelines through Azure DevOps or GitHub Actions. Experience with Azure AI Foundry pipelines and real‑time, event‑driven architecture using Microsoft Fabric Real‑Time Intelligence. Proven experience applying enterprise data governance practices or contributing to data governance or architecture councils. Compensation Salary $128,000 – $249,000 per year, determined during the interview process and based on experience, expertise, business needs, and market factors. Background Check Successful completion of a background check is required. Equal Employment Opportunity The Firm is an equal opportunity employer. Employment decisions are based on merit, qualifications, and competence. Employment practices are not influenced by protected characteristics. The Firm complies with federal, state, and local disability laws and makes reasonable accommodations for applicants and employees with disabilities. For reasonable accommodation inquiries, please contact View email address on click.appcast.io. Fair Chance In accordance with the Los Angeles Fair Chance Ordinance, San Francisco Fair Chance Ordinance, and the California Fair Chance Act, qualified applicants for our Los Angeles and San Francisco offices with arrest and conviction records will be considered. #J-18808-Ljbffr K&L Gates