Sr. Data Integration Engineer

Salary: $100,000 - 140,000 per year Requirements:

• We require six or more years of professional experience in data engineering, data operations, data platform operations, or a related discipline.
• We prefer a bachelors degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience.
• We prefer experience leading teams and developing supervisory staff.
• We need advanced T-SQL expertise, including set-based rewrites, MERGE and upsert patterns, slowly changing dimensions, window functions, execution plan analysis, index tuning, statistics management, and performance troubleshooting.
• We need strong Python skills for data engineering use cases, including API-based data acquisition, file parsing, data validation, and packaged scheduled jobs.
• We expect experience integrating data from diverse sources such as delimited, fixed-width, JSON, and XML files, REST APIs with authentication and pagination, and direct database connections.
• We require proficiency with Git and collaborative workflows such as branching, pull requests, and code review.
• We need a code-first approach, with integration logic developed and maintained in T-SQL and Python under source control.
• We look for the ability to analyze pipeline and query performance and improve reliability, scalability, and cost efficiency.
• We require strong written communication skills for runbooks, technical documentation, incident reports, and communicating business impact to non-technical stakeholders.
• We expect strong problem-solving ability, attention to detail, and ownership of production systems.
• We prefer experience with Microsoft Azure data services such as Azure Data Factory or Microsoft Fabric, or comparable cloud orchestration platforms.
• We prefer experience migrating on-premises SQL Server integration workloads to a cloud platform.
• We prefer experience with dimensional modeling and data warehouse design.
• We prefer experience designing and rationalizing SQL Server Agent job dependencies and schedules.
• We prefer experience establishing version control, code review, and repeatable deployment practices for database code.
• We prefer experience implementing CI/CD pipelines for database projects.
• We prefer experience handling protected health information under HIPAA or similarly regulated data under an equivalent framework.
• We prefer experience with healthcare or pharmacy data, including claims, eligibility, prescription, or delivery data.
• We value familiarity with data governance, metadata management, and data lineage practices.

• We design, develop, and maintain data integration workflows that ingest partner and internal data from flat files over SFTP, REST APIs, and direct database connections.
• We build reusable, configuration-driven ingestion patterns that shorten the time needed to onboard new partner feeds.
• We develop and support T-SQL transformation logic that moves data from landing and staging layers into curated warehouse tables used for reporting, operational systems, and analyst queries.
• We design ingestion processes to be idempotent and safely re-runnable, with automated retry and restart handling for failures.
• We implement automated validation and quarantine steps so records that fail business quality rules are isolated, reported, and blocked from downstream use.
• We apply business-defined data quality checks, including schema validation, reconciliation, row-count and threshold testing, and anomaly detection.
• We set up monitoring, logging, and alerting for pipeline status, data freshness, and load completion, and we automate status communication to stakeholders.
• We investigate and resolve production data incidents, identify root causes, coordinate fixes, and document preventive actions in runbooks and post-incident reviews.
• We contribute to dimensional model design alongside the data architect and senior team members.
• We establish and maintain version control, code review, and repeatable deployment practices for database and pipeline code.
• We define and enforce development standards for data integration work through code review and technical guidance.
• We evaluate and recommend tooling, architecture, and migration sequencing for the platform modernization effort.
• We migrate established integration workflows to modernized patterns incrementally without disrupting production operations.
• We maintain documentation covering data feeds, dependencies, lineage, ownership, and escalation paths.
• We handle protected health information in line with HIPAA requirements, including least-privilege access, secure transmission and storage, and excluding PHI from logs and non-production environments.
• We coordinate with partner technical contacts to resolve questions about file formats, schemas, and connectivity.
• We provide occasional off-hours support for critical data load failures or production support rotations.
• We support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing evaluation.
• We maintain confidentiality of information processed and follow company policies and procedures.

• AI
• API
• Architect
• Azure
• CI/CD
• Cloud
• Data Warehouse
• Fabric
• Git
• Support
• JSON
• Machine Learning
• Python
• REST
• SQL
• XML
• Cursor
• Flow
• LESS
• pandas

More:

We are hiring a Senior Data Integration Engineer for a senior, hands-on role focused on building, operating, and modernizing the data integration and ingestion processes that feed our analytics environment. We work across the full integration lifecycle, from acquiring partner and internal data to transforming it into curated warehouse tables used by reporting platforms, operational systems, and business analysts. This position also helps advance reusable integration patterns, improve data delivery reliability, and support our broader data platform modernization effort. The role collaborates closely with data architects, business analysts, internal stakeholders, and external partner contacts. This is a hybrid position with 2 to 3 days of office presence required in Milwaukee, WI, and rare travel may occasionally be needed.

last updated 39 week of 2026