Sr. Data Engineer

Job Description

Job Description

Overview

The Senior Data Engineer will play a lead role in acquiring, transforming, and integrating data from enterprise systems into scalable data platforms. The role involves designing high-performance data solutions, mentoring junior engineers,and collaborating across different functions to ensure strategic data initiatives are delivered efficiently and effectively. This individual will have a strong track record in architecting and building robust Data Warehouses using Microsoft SQL Server and Azure technologies.

Strong expertise in healthcare data domains is highly preferred.

NOTE: THIS IS A HYBRID ROLE. MUST BE WILLING TO COMMUTE TO THE ADDISON, TX. OFFICE 3 DAYS PER WEEK!

Responsibilities

PRIMARY DUTIES

• Lead the integration of data from Clinical/Healthcare Practice Management Systems, Electronic Medical Record
Systems (EMRs), HR systems, Accounting, Customer Relationship Management systems (CRM), and other
enterprise systems.
• Architect and oversee the development of scalable data platforms and database architectures supporting
multiple business lines.
• Design and optimize complex ETL/ELT data pipelines using Azure Data Factory, other Azure services and python,
ensuring high reliability and performance.
• Orchestrate pipelines that leverage AI/LLMs for data extraction from various documents and sources.
• Drive initiatives to capture all necessary data and orchestrate the development of sustainable enterprise-grade
databases.
• Conduct advanced data profiling, cleansing, and transformation for analytics and reporting teams.
• Drive implementation of Master Data Management (MDM) strategies to ensure data consistency and integrity.
• Identify process improvement opportunities and spearhead automation to reduce delivery time and increase
quality.
• Establish and maintain comprehensive data lineage, monitoring, and operational tracking systems.
• Provide hands-on support while mentoring junior engineers and contributing to a culture of knowledge sharing
and continuous improvement.
• Collaborate closely with stakeholders to gather evolving data requirements and translate them into scalable
technical solutions.
• Maintain high standards for code quality through documentation, source control, code reviews, and rigorous
testing practices.
• Identify integration gaps, recommend solutions, and ensure continuous improvement of data processes.
• Establish and enforce best practices for data engineering and integration across the team.
• Explore and evaluate emerging Azure features, leading proofs of concept to assess fit for purpose.

Qualifications

MINIMUM QUALIFICATIONS AND REQUIREMENTS

• 7+ years of experience in database and ETL development roles.
• 4+ years of deep hands-on experience with Azure Data Factory (ADF).
• 3+ years of experience with healthcare and/or financial data or other highly regulated vertical segments.
• 2+ years of experience using python
• Strong working knowledge of Azure ecosystem tools.
• Advanced proficiency in T-SQL and SQL Server.
• Strong grasp of data modeling, indexing, and schema design principles.
• Proven ability to manage multiple priorities and drive solutions from conception to production.
• Effective collaborator and communicator, capable of interfacing with all stakeholders.
• Bachelor's degree or higher.

PREFERRED EXPERIENCE

• Experience working with data integration related to Healthcare EDI files, such as 835, 837, etc.
• Experience working on data extraction from documents using AI/LLMs.

NOTE: This position follows a hybrid work model with a minimum of 3 days per week in our Addison, TX office.