Sr. Data Integration Engineer
Summit Pharmacy Solutions LLC
Summary The Senior Data Integration Engineer is responsible for the design, development, and operation of the data integration and ingestion processes that deliver partner and internal data into our analytics environment. The role owns the flow of data from source acquisition through the curated data warehouse tables consumed by reporting platforms, operational systems, and business analysts. This is a senior, hands-on engineering position spanning the full integration lifecycle: acquiring data from a wide range of external partner and internal systems, validating and conditioning that data on arrival, transforming it into the structures that support analysis and operations, and operating those processes reliably in production. The role is concerned equally with building new integrations and with the continued performance, accuracy, and timeliness of those already in service. A central objective of the position is to advance reusable, well-instrumented integration patterns that shorten the time required to onboard new data sources and that improve the reliability and transparency of data delivery to the business. The Senior Data Integration Engineer will also contribute substantially to the planned modernization of our data platform, evaluating and recommending tooling, architecture, and migration approach for leadership consideration. The role sets technical direction and development standards for data integration work and collaborates closely with data architects, business analysts, stakeholders across the organization, and the technical contacts of our external data partners. Essential Duties and Responsibilities This list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.
. click apply for full job details
- Design, develop, and maintain data integration processes that acquire data from partner and internal sources, including flat file transfers over SFTP, REST API endpoints, and direct database connections.
- Develop reusable, configuration-driven ingestion patterns that reduce the effort and elapsed time required to onboard new partner data feeds.
- Develop and maintain the T-SQL transformation logic that carries data from landing and staging layers through to the curated warehouse tables supporting reporting, operational systems, and analyst queries.
- Design ingestion processes to be idempotent and safely re-runnable, incorporating automated retry and restart behavior for failed executions.
- Implement automated validation and quarantine processes so that records failing business-defined quality rules are isolated, reported, and prevented from reaching downstream consumers.
- Implement data quality rules defined by the business, including schema validation, reconciliation, row count and threshold checks, and anomaly detection.
- Establish monitoring, logging, and alerting for pipeline execution state, data freshness, and load completion, and automate the communication of ingestion status to stakeholders.
- Diagnose and resolve production data incidents, determine root cause, coordinate remediation, and document preventive measures through runbooks and post-incident review.
- Contribute to dimensional data model design in collaboration with the data architect and senior team members.
- Establish and maintain version control, code review, and repeatable deployment practices for database and pipeline code.
- Define and uphold development standards for data integration work through code review and technical guidance.
- Evaluate and recommend tooling, architecture, and sequencing for the platform modernization effort for leadership consideration.
- Migrate established integration workflows to modernized patterns incrementally and without disruption to production operations.
- Maintain documentation of data feeds, dependencies, lineage, ownership, and escalation paths.
- Perform all work involving protected health information in accordance with HIPAA requirements, including least-privilege access, secure transmission and storage of partner data, and the exclusion of PHI from logs and non-production environments.
- Coordinate with partner technical contacts, as needed, to resolve file format, schema, and connectivity questions.
- Provide occasional off-hours support for critical data load failures or production support rotations as needed to support timely response to critical data issues.
- Support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing performance evaluation.
- Maintain confidentiality of information processed & follow company policies and procedures.
- Advanced T-SQL development skills, including:
- Set-based rewriting of row-by-row and cursor-based logic.
- MERGE, upsert, and slowly changing dimension load patterns.
- Window functions and complex analytic queries.
- Execution plan analysis, index strategy, statistics management, and resolution of performance issues such as parameter sniffing.
- Transaction management and structured error handling within stored procedures, including correct rollback behavior on partial failure.
- Demonstrated proficiency in Python for data engineering applications, including API-based data acquisition, file parsing and format handling, data validation, and the development of packaged, scheduled jobs. Familiarity with common data libraries such as requests and pandas is expected.
- Demonstrated experience acquiring and integrating data from heterogeneous sources, including delimited, fixed-width, JSON, and XML file formats; REST APIs requiring authentication, pagination, and rate-limit handling; and direct database connectivity.
- Proficiency with Git and collaborative development workflows, including branching, pull requests, and code review.
- A code-first development approach, with integration logic authored and maintained in T-SQL and Python under source control.
- Ability to analyze pipeline and query performance and to improve the reliability, scalability, and cost efficiency of data workloads.
- Strong written communication skills, with the ability to produce runbooks, technical documentation, and incident reports, and to convey the business impact of technical issues to non-technical stakeholders.
- Strong problem-solving skills, attention to detail, and demonstrated ownership of production systems.
- Experience with Microsoft Azure data services such as Azure Data Factory or Microsoft Fabric, or comparable cloud orchestration platforms.
- Experience migrating on-premises SQL Server integration workloads to a cloud platform.
- Experience with dimensional modeling and data warehouse design.
- Experience designing and rationalizing SQL Server Agent job dependencies and scheduling.
- Experience establishing version control, code review, and repeatable deployment practices for database code.
- Experience implementing CI/CD pipelines for database projects.
- Experience handling protected health information under HIPAA, or comparably regulated data under an equivalent framework preferred.
- Experience with healthcare or pharmacy data, including claims, eligibility, prescription, or delivery data preferred.
- Familiarity with data governance, metadata management, and data lineage practices.
. click apply for full job details
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Sr. Data Integration Engineer in Milwaukee, WI vacancy
$100k - $140k
...We require six or more years of professional experience in data engineering, data operations, data platform operations, or a related discipline... ..., and packaged scheduled jobs. We expect experience integrating data from diverse sources such as delimited, fixed-width,...SeniorFull timeWork at office$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify and... ...and operationalizing scalable healthcare data platforms and integration pipelines across claims, payments, member, provider, eligibility...SeniorLocal areaVisa sponsorship- ...everything you need to create innovative new solutions on our engineering team. As a Sr. Data Engineer, you will design, build, and support scalable... ...maintain scalable data pipelines, data models, and data integration solutions that support engineering and test operations....SeniorFull time
- ...00 pieces of heavy equipment in our insatiable drive to be the best. Our work improves lives. Find out how a career as a Senior Data Engineer can change yours.The Senior Data Engineer builds the trusted data foundation that powers analytics, reporting, operational insight...Senior
- Data & ML Architect - New Resources ConsultingSummary: We’re looking for a Data & ML Architect to design and deliver modern data solutions... ...teams. You’ll design and model data environments, support data integration and transformation, and help implement end-to-end solutions....SeniorRemote workFlexible hours
- ...love to have you join us!Job DescriptionPosition Summary:As a Data Engineer -Enterprise Common Data Model/Common Data Layer, you will... ...test new data management solutions, including data acquisition, integration, and transformation pipelines using Microsoft Azure PaaS tools...SeniorFull timeWork experience placementWork at officeFlexible hours
$105.59k - $179.51k
...opportunity help us create the next generation data platform. Becoming Data-driven is at the... ...! We are looking for a Senior Data Engineer who is passionate about building trusted... ...: Define and evolve data integration frameworks, engineering standards, reusable...SeniorFull timeCasual workWork at officeLocal area- ...partner helping organizations modernize data ecosystems, build real-time analytics capabilities... ...and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data... ...data pipelines, ETL/ELT processes, and integrations using GCP services such as: BigQuery,...SeniorFull timeWork experience placementLive inWork at officeLocal area
- ...Primary Function Provide senior-level technical expertise in data center thermal management, with an emphasis on liquid cooling,... ...thermal storage. Evaluate data center cooling architectures, develop engineering concepts, support prototype and laboratory validation, and...SeniorFull timeTemporary workLocal areaWorldwide
- ...Mixpanel is seeking a seasoned Customer Engineer to embed with enterprise teams, driving analytics value and technical adoption of our platform... ...business benefits to executives. In this role, you’ll scope data ingestion, architecture, and rollout strategies, guide proof‑of‑...Senior
- ...make it happen.Your Role on Our Team:The Senior Manager of Data Engineering leads teams that design, build, operate, and continuously improve... ..., lakehouse or warehouse solutions, APIs, and event-driven integrations.· Experience implementing or governing AI-assisted...SeniorFull timeLocal area
$121.2k - $151.5k
...We are seeking a highly experienced Senior AI Data Engineer to help transform our Enterprise Data Platform into an AI-native, intelligent... ...ability to design and deliver scalable AI capabilities that integrate seamlessly with enterprise data platforms and business workflows...SeniorLocal area- ...support and resources of the fastest-growing brand in the construction industry to make it happen. Your Role On Our Team As a Senior Data Engineer, you will deliver innovative data products that enable Milwaukee Tool to make fast, data-driven decisions. Working closely with...SeniorWork at office
- Senior Snowflake Data Engineer / Architect with Cortex AI Job Summary We are seeking a Senior Snowflake Data Architect with strong... ...with ELT/data ingestion pipelines and enterprise data integration Experience with Power BI or Sigma Ability to develop...Senior
- ...Rockwell Automation, based in Milwaukee, seeks a Data Engineer to design and deliver scalable data management solutions powering the Enterprise Common Data Model. You will collaborate with technical leads, analysts, architects, and product owners to shape data-driven innovation...Senior
- ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The... ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...For contractorsWork at officeLocal area
$149k - $189k
...,000 per year Requirements: We require an MS in Mechanical Engineering or a related thermal sciences discipline; a PhD is preferred.... ...of relevant experience in thermal systems, HVAC/R, hydronics, data center cooling, heat transfer, or applied thermal-fluid product...SeniorFull timeTemporary work- About the RoleAs Senior Software Engineer, you will collaborate closely with design, product... ...critical thinking, experimentation, data, and industry best practices to implement... ...standards such as GDPR, PCI DSS, SOX, and CCPA.Integrate GenAI tools such as OpenAI, Gemini, and...SeniorRemote work
$85.91k - $162.89k
...tracking system.Job Description:As a Senior Consultant - Associate Data Engineer you will design, build, and optimize modern data solutions... .../Bicep) and test automation frameworks preferred- Experience integrating SaaS/ERP sources (e.g., Dynamics 365, Workday, Costpoint)...Full timeLocal areaWorldwide- ...PERM, hybrid in Wisconsin, MI Job Description Insight Global is seeking three Data Security Engineers to support one of the largest energy providers in the Midwest. These individuals will join the Cybersecurity organization and play a critical role in designing,...Permanent employment
- ...Job Title: Junior Data Engineer Location: Milwaukee, WI (preferred) / Richmond, VA Duration: 6month Contract to Hire Work Schedule: Hybrid, 3 days onsite (Tuesday, Wednesday, Thursday) and 2 days remote Description: Experience Required Approximately...Contract workRemote work
- ...Job Title: Data & Analytics Engineer Location: Milwaukee , WI Duration: 06 months contract JOB DESCRIPTION Data & Analytics... ...Database, and Azure Data Lake Experience with data integration tools such as SSIS, dbt, Azure Data Factory, or similar...Contract work
$105.4k - $124k
...learn new skills and discover what you excel at—all from Day One.Job DescriptionThe Infrastructure Data Analytics Engineer is responsible for acquiring, transforming, integrating, and analyzing data from infrastructure, platform, cloud, and enterprise technology systems....Full timeLocal area3 days per week- ...motivated candidate to join our talented Team. Job Title: Data Quality Engineer Location: Milwaukee, WI (Hybrid) Job Description:We... ...requires a proactive individual who ensures the accuracy, integrity, and reliability of our data systems.Experience:Experience...
$82.6k - $162.8k
...) using OneStream development tools and best practices.Support data management activities including data loads, mappings, transformations... ...queries using VB.NET and/or SQL to enable automation, support integrations, and troubleshoot data/process issues.Execute testing...Local areaRemote work$134.17k - $181.52k
...patients while transforming your career.Sr.Data Scientist - Process ModelingWhat you will... ..., platforms, and analytics to support engineering teams across our network, ensuring state... ...for the DS networkChange management to integrate tech transfer digital applications into...SeniorFull timeWork experience placementFlexible hours- This OpportunitykW Mission Critical Engineering, a member of WSP USA is currently initiating a search for a Senior Mechanical Engineer for... ...construction team members.Your ImpactCollect, compile, and analyze data from the physical work site, surveys, blueprints, schematics,...SeniorFor contractorsInternshipWork at office
- ...company match, and generous time off to recharge. Job Summary The Data Engineer designs, builds, and maintains the data platform... ...development of Fabric-based data pipelines and service bus integrations that enable real-time communication between Healthfuse's web...
- ...experience focuses on delivering robust data solutions using ADF for OBP and Snowflake... ...efficiently while maintaining data integrity and consistency across subject areas. -... ...practical knowledge of cloud based data engineering practices, including monitoring, cost management...Remote workDay shift
$86k - $100k
...digital innovation, we deliver intelligent, data-driven solutions to help our clients... ...Technology Enablement - PhD Data Science/Data Engineer for our Advisory practice.... ...research outcomes into actionable program integrity recommendations Clearly communicate mathematical...InternshipSeasonal workH1bWork at officeLocal areaRemote workNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Integration Engineer. Be the first to apply!
Related searches
- data engineer machine learning Milwaukee, WI
- aws data engineer Milwaukee, WI
- sr data engineer Milwaukee, WI
- finance data engineer Milwaukee, WI
- sr information security engineer Milwaukee, WI
- data center engineer Milwaukee, WI
- senior data integration developer Milwaukee, WI
- senior cloud data engineer Milwaukee, WI
- data engineer Milwaukee, WI
- data engineer analytics Milwaukee, WI






