Sr. Data Engineer

Job Description

MID-LEVEL DATA ENGINEERROLE AND RESPONSIBILITIES

The Data Engineer will be responsible for acquiring, transforming, and integrating data from enterprise systems into scalable data platforms. This role will focus on building and maintaining reliable data pipelines, supporting data warehouse initiatives, and collaborating with cross-functional teams to deliver high-quality data solutions. The ideal candidate will have hands-on experience with Microsoft SQL Server, Azure data technologies, and ETL/ELT development. Experience working with healthcare data environments is a plus. PRIMARY DUTIES Develop and maintain integrations between Clinical/Healthcare Practice Management Systems, Electronic Medical Record (EMR) Systems, HR systems, Accounting systems, CRM platforms, and other enterprise applications. Support the design, development, and maintenance of enterprise data warehouses and data platforms. Build, monitor, and optimize ETL/ELT pipelines using Azure Data Factory, Azure services, SQL Server, and Python. Assist in implementing data extraction processes, including AI/LLM-based solutions for document and unstructured data processing. Collaborate with business and technical stakeholders to gather data requirements and translate them into technical solutions. Perform data profiling, cleansing, validation, and transformation activities to ensure data accuracy and consistency. Contribute to Master Data Management (MDM) initiatives by supporting data quality and governance processes. Identify opportunities to automate manual processes and improve data pipeline efficiency and reliability. Monitor data workflows, troubleshoot data issues, and support operational tracking and data lineage requirements. Work closely with senior engineers to support enterprise data initiatives and continuously develop technical expertise. Participate in code reviews, testing, documentation, and source control processes to maintain quality standards. Assist in identifying integration gaps and recommending improvements to existing data solutions. Follow established data engineering standards, best practices, and development methodologies. Support the evaluation and implementation of new Azure capabilities and technologies as needed. QUALIFICATIONS AND REQUIREMENTS 4-5 years of experience in database development, ETL/ELT development, or data engineering roles. 2+ years of hands-on experience with Azure Data Factory (ADF). Experience working with healthcare, financial, or other regulated industry data environments is preferred. 1-2 years of experience using Python for data integration, automation, or data processing. Working knowledge of Azure data services and cloud-based data solutions. Strong proficiency in T-SQL and Microsoft SQL Server . Understanding of data modeling, database design, indexing, and performance optimization concepts. Experience developing and supporting data pipelines from development through production. Strong analytical, problem-solving, and troubleshooting skills. Ability to collaborate effectively with both technical and non-technical stakeholders. Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field. PREFERRED EXPERIENCE Exposure to healthcare data integrations, including EDI transactions such as 835, 837, 270/271, or related healthcare data formats. Experience supporting data extraction and processing initiatives involving AI/LLM technologies . Familiarity with additional Azure services such as Azure SQL Database, Azure Synapse Analytics, Azure Databricks, Azure Functions, or Azure Storage. Experience using Git, Azure DevOps, or similar source control and CI/CD tools. Knowledge of data governance, data quality, and data security best practices. Job Requirements Azure Data Factory The Intersect Group