Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Data Integration Engineer

Summit Pharmacy Solutions LLC

Summary

The Senior Data Integration Engineer is responsible for the design, development, and operation of the data integration and ingestion processes that deliver partner and internal data into our analytics environment. The role owns the flow of data from source acquisition through the curated data warehouse tables consumed by reporting platforms, operational systems, and business analysts.

This is a senior, hands-on engineering position spanning the full integration lifecycle: acquiring data from a wide range of external partner and internal systems, validating and conditioning that data on arrival, transforming it into the structures that support analysis and operations, and operating those processes reliably in production. The role is concerned equally with building new integrations and with the continued performance, accuracy, and timeliness of those already in service.

A central objective of the position is to advance reusable, well-instrumented integration patterns that shorten the time required to onboard new data sources and that improve the reliability and transparency of data delivery to the business. The Senior Data Integration Engineer will also contribute substantially to the planned modernization of our data platform, evaluating and recommending tooling, architecture, and migration approach for leadership consideration.

The role sets technical direction and development standards for data integration work and collaborates closely with data architects, business analysts, stakeholders across the organization, and the technical contacts of our external data partners.

Essential Duties and Responsibilities

This list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.
  • Design, develop, and maintain data integration processes that acquire data from partner and internal sources, including flat file transfers over SFTP, REST API endpoints, and direct database connections.
  • Develop reusable, configuration-driven ingestion patterns that reduce the effort and elapsed time required to onboard new partner data feeds.
  • Develop and maintain the T-SQL transformation logic that carries data from landing and staging layers through to the curated warehouse tables supporting reporting, operational systems, and analyst queries.
  • Design ingestion processes to be idempotent and safely re-runnable, incorporating automated retry and restart behavior for failed executions.
  • Implement automated validation and quarantine processes so that records failing business-defined quality rules are isolated, reported, and prevented from reaching downstream consumers.
  • Implement data quality rules defined by the business, including schema validation, reconciliation, row count and threshold checks, and anomaly detection.
  • Establish monitoring, logging, and alerting for pipeline execution state, data freshness, and load completion, and automate the communication of ingestion status to stakeholders.
  • Diagnose and resolve production data incidents, determine root cause, coordinate remediation, and document preventive measures through runbooks and post-incident review.
  • Contribute to dimensional data model design in collaboration with the data architect and senior team members.
  • Establish and maintain version control, code review, and repeatable deployment practices for database and pipeline code.
  • Define and uphold development standards for data integration work through code review and technical guidance.
  • Evaluate and recommend tooling, architecture, and sequencing for the platform modernization effort for leadership consideration.
  • Migrate established integration workflows to modernized patterns incrementally and without disruption to production operations.
  • Maintain documentation of data feeds, dependencies, lineage, ownership, and escalation paths.
  • Perform all work involving protected health information in accordance with HIPAA requirements, including least-privilege access, secure transmission and storage of partner data, and the exclusion of PHI from logs and non-production environments.
  • Coordinate with partner technical contacts, as needed, to resolve file format, schema, and connectivity questions.
  • Provide occasional off-hours support for critical data load failures or production support rotations as needed to support timely response to critical data issues.
  • Support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing performance evaluation.
  • Maintain confidentiality of information processed & follow company policies and procedures.
Qualifications

Requires six (6) or more years of professional data engineering, data operations, data platform operations, or related experience. Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent professional experience preferred. Experience leading teams and developing supervisory staff preferred.

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

Other qualifications include:
  • Advanced T-SQL development skills, including:
    • Set-based rewriting of row-by-row and cursor-based logic.
    • MERGE, upsert, and slowly changing dimension load patterns.
    • Window functions and complex analytic queries.
    • Execution plan analysis, index strategy, statistics management, and resolution of performance issues such as parameter sniffing.
    • Transaction management and structured error handling within stored procedures, including correct rollback behavior on partial failure.
  • Demonstrated proficiency in Python for data engineering applications, including API-based data acquisition, file parsing and format handling, data validation, and the development of packaged, scheduled jobs. Familiarity with common data libraries such as requests and pandas is expected.
  • Demonstrated experience acquiring and integrating data from heterogeneous sources, including delimited, fixed-width, JSON, and XML file formats; REST APIs requiring authentication, pagination, and rate-limit handling; and direct database connectivity.
  • Proficiency with Git and collaborative development workflows, including branching, pull requests, and code review.
  • A code-first development approach, with integration logic authored and maintained in T-SQL and Python under source control.
  • Ability to analyze pipeline and query performance and to improve the reliability, scalability, and cost efficiency of data workloads.
  • Strong written communication skills, with the ability to produce runbooks, technical documentation, and incident reports, and to convey the business impact of technical issues to non-technical stakeholders.
  • Strong problem-solving skills, attention to detail, and demonstrated ownership of production systems.
  • Experience with Microsoft Azure data services such as Azure Data Factory or Microsoft Fabric, or comparable cloud orchestration platforms.
  • Experience migrating on-premises SQL Server integration workloads to a cloud platform.
  • Experience with dimensional modeling and data warehouse design.
  • Experience designing and rationalizing SQL Server Agent job dependencies and scheduling.
  • Experience establishing version control, code review, and repeatable deployment practices for database code.
  • Experience implementing CI/CD pipelines for database projects.
  • Experience handling protected health information under HIPAA, or comparably regulated data under an equivalent framework preferred.
  • Experience with healthcare or pharmacy data, including claims, eligibility, prescription, or delivery data preferred.
  • Familiarity with data governance, metadata management, and data lineage practices.
Physical Demands

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. (The phrases "occasionally," "regularly," and "frequently" correspond to the following definitions: "Occasionally" means up to 1/3 of working time, "regularly" means between 1/3 and 2/3 of working time, and "frequently" means 2/3 and more working time.)

While performing the duties of this job, the employee is frequently required to sit; talk or hear; and use hands to handle, or touch objects or controls. The employee is regularly required to stand and walk. On occasion the incumbent may be required to stoop, bend or reach above the shoulders. The employee would rarely need to lift up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception, and ability to adjust focus.

Work Environment

The position is a hybrid position with 2 - 3 days office presence in Milwaukee, WI required. The colleague may perform work-related travel on rare occasions (less than 10%) with an emphasis on travel for impact.
. click apply for full job details
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Sr. Data Integration Engineer in Milwaukee, WI vacancy
  • $100k - $140k

     ...We require six or more years of professional experience in data engineering, data operations, data platform operations, or a related discipline...  ..., and packaged scheduled jobs. We expect experience integrating data from diverse sources such as delimited, fixed-width,... 
    Senior
    Full time
    Work at office

    Summit Pharmacy Solutions LLC

    Milwaukee, WI
    13 days ago
  • $127k - $150k

    Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify and...  ...and operationalizing scalable healthcare data platforms and integration pipelines across claims, payments, member, provider, eligibility... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Milwaukee, WI
    4 days ago
  •  ...everything you need to create innovative new solutions on our engineering team. As a Sr. Data Engineer, you will design, build, and support scalable...  ...maintain scalable data pipelines, data models, and data integration solutions that support engineering and test operations.... 
    Senior
    Full time

    Milwaukee Electric Tool

    Menomonee Falls, WI
    2 days ago
  •  ...00 pieces of heavy equipment in our insatiable drive to be the best. Our work improves lives. Find out how a career as a Senior Data Engineer can change yours.The Senior Data Engineer builds the trusted data foundation that powers analytics, reporting, operational insight... 
    Senior

    Michels Corporation

    Milwaukee, WI
    3 hours ago
  • Data & ML Architect - New Resources ConsultingSummary: We’re looking for a Data & ML Architect to design and deliver modern data solutions...  ...teams. You’ll design and model data environments, support data integration and transformation, and help implement end-to-end solutions.... 
    Senior
    Remote work
    Flexible hours

    New Resources Consulting

    Milwaukee, WI
    2 days ago
  •  ...love to have you join us!Job DescriptionPosition Summary:As a Data Engineer -Enterprise Common Data Model/Common Data Layer, you will...  ...test new data management solutions, including data acquisition, integration, and transformation pipelines using Microsoft Azure PaaS tools... 
    Senior
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Rockwell Automation

    Milwaukee, WI
    10 hours ago
  • $105.59k - $179.51k

     ...opportunity help us create the next generation data platform. Becoming Data-driven is at the...  ...! We are looking for a Senior Data Engineer who is passionate about building trusted...  ...: Define and evolve data integration frameworks, engineering standards, reusable... 
    Senior
    Full time
    Casual work
    Work at office
    Local area

    MGIC Investment

    Milwaukee, WI
    2 days ago
  •  ...partner helping organizations modernize data ecosystems, build real-time analytics capabilities...  ...and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data...  ...data pipelines, ETL/ELT processes, and integrations using GCP services such as: BigQuery,... 
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Milwaukee, WI
    1 day ago
  •  ...Primary Function Provide senior-level technical expertise in data center thermal management, with an emphasis on liquid cooling,...  ...thermal storage. Evaluate data center cooling architectures, develop engineering concepts, support prototype and laboratory validation, and... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    A.O. Smith

    Milwaukee, WI
    2 days ago
  •  ...Mixpanel is seeking a seasoned Customer Engineer to embed with enterprise teams, driving analytics value and technical adoption of our platform...  ...business benefits to executives. In this role, you’ll scope data ingestion, architecture, and rollout strategies, guide proof‑of‑... 
    Senior

    Jobleads-US

    Milwaukee, WI
    3 days ago
  •  ...make it happen.Your Role on Our Team:The Senior Manager of Data Engineering leads teams that design, build, operate, and continuously improve...  ..., lakehouse or warehouse solutions, APIs, and event-driven integrations.· Experience implementing or governing AI-assisted... 
    Senior
    Full time
    Local area

    Milwaukee Electric Tool

    Menomonee Falls, WI
    3 days ago
  • $121.2k - $151.5k

     ...We are seeking a highly experienced Senior AI Data Engineer to help transform our Enterprise Data Platform into an AI-native, intelligent...  ...ability to design and deliver scalable AI capabilities that integrate seamlessly with enterprise data platforms and business workflows... 
    Senior
    Local area

    Dematic

    Wauwatosa, WI
    2 days ago
  •  ...support and resources of the fastest-growing brand in the construction industry to make it happen. Your Role On Our Team As a Senior Data Engineer, you will deliver innovative data products that enable Milwaukee Tool to make fast, data-driven decisions. Working closely with... 
    Senior
    Work at office

    Milwaukee Tool

    Menomonee Falls, WI
    5 days ago
  • Senior Snowflake Data Engineer / Architect with Cortex AI Job Summary We are seeking a Senior Snowflake Data Architect with strong...  ...with ELT/data ingestion pipelines and enterprise data integration Experience with Power BI or Sigma Ability to develop... 
    Senior

    Staffxpert LLC

    Milwaukee, WI
    2 days ago
  •  ...Rockwell Automation, based in Milwaukee, seeks a Data Engineer to design and deliver scalable data management solutions powering the Enterprise Common Data Model. You will collaborate with technical leads, analysts, architects, and product owners to shape data-driven innovation... 
    Senior

    Jobleads-US

    Milwaukee, WI
    3 days ago
  •  ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The...  ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead... 
    For contractors
    Work at office
    Local area

    ADEX

    Milwaukee, WI
    3 days ago
  • $149k - $189k

     ...,000 per year Requirements: We require an MS in Mechanical Engineering or a related thermal sciences discipline; a PhD is preferred....  ...of relevant experience in thermal systems, HVAC/R, hydronics, data center cooling, heat transfer, or applied thermal-fluid product... 
    Senior
    Full time
    Temporary work

    A.O. Smith

    Milwaukee, WI
    9 days ago
  • About the RoleAs Senior Software Engineer, you will collaborate closely with design, product...  ...critical thinking, experimentation, data, and industry best practices to implement...  ...standards such as GDPR, PCI DSS, SOX, and CCPA.Integrate GenAI tools such as OpenAI, Gemini, and... 
    Senior
    Remote work

    Kohl's

    Menomonee Falls, WI
    10 hours ago
  • $85.91k - $162.89k

     ...tracking system.Job Description:As a Senior Consultant - Associate Data Engineer you will design, build, and optimize modern data solutions...  .../Bicep) and test automation frameworks preferred- Experience integrating SaaS/ERP sources (e.g., Dynamics 365, Workday, Costpoint)... 
    Full time
    Local area
    Worldwide

    Baker Tilly

    Milwaukee, WI
    3 days ago
  •  ...PERM, hybrid in Wisconsin, MI Job Description Insight Global is seeking three Data Security Engineers to support one of the largest energy providers in the Midwest. These individuals will join the Cybersecurity organization and play a critical role in designing,... 
    Permanent employment

    Insight Global

    Milwaukee, WI
    4 days ago
  •  ...Job Title: Junior Data Engineer Location: Milwaukee, WI (preferred) / Richmond, VA Duration: 6month Contract to Hire Work Schedule: Hybrid, 3 days onsite (Tuesday, Wednesday, Thursday) and 2 days remote Description: Experience Required Approximately... 
    Contract work
    Remote work

    Sunrise Systems

    Milwaukee, WI
    2 days ago
  •  ...Job Title: Data & Analytics Engineer Location: Milwaukee , WI Duration: 06 months contract JOB DESCRIPTION Data & Analytics...  ...Database, and Azure Data Lake Experience with data integration tools such as SSIS, dbt, Azure Data Factory, or similar... 
    Contract work

    Sunrise Systems

    Milwaukee, WI
    4 days ago
  • $105.4k - $124k

     ...learn new skills and discover what you excel at—all from Day One.Job DescriptionThe Infrastructure Data Analytics Engineer is responsible for acquiring, transforming, integrating, and analyzing data from infrastructure, platform, cloud, and enterprise technology systems.... 
    Full time
    Local area
    3 days per week

    US Bank

    Brookfield, WI
    2 days ago
  •  ...motivated candidate to join our talented Team. Job Title: Data Quality Engineer Location: Milwaukee, WI (Hybrid) Job Description:We...  ...requires a proactive individual who ensures the accuracy, integrity, and reliability of our data systems.Experience:Experience... 

    Ampcus

    Milwaukee, WI
    4 days ago
  • $82.6k - $162.8k

     ...) using OneStream development tools and best practices.Support data management activities including data loads, mappings, transformations...  ...queries using VB.NET and/or SQL to enable automation, support integrations, and troubleshoot data/process issues.Execute testing... 
    Local area
    Remote work

    Deloitte

    Milwaukee, WI
    3 days ago
  • $134.17k - $181.52k

     ...patients while transforming your career.Sr.Data Scientist - Process ModelingWhat you will...  ..., platforms, and analytics to support engineering teams across our network, ensuring state...  ...for the DS networkChange management to integrate tech transfer digital applications into... 
    Senior
    Full time
    Work experience placement
    Flexible hours

    Amgen

    Milwaukee, WI
    10 hours ago
  • This OpportunitykW Mission Critical Engineering, a member of WSP USA is currently initiating a search for a Senior Mechanical Engineer for...  ...construction team members.Your ImpactCollect, compile, and analyze data from the physical work site, surveys, blueprints, schematics,... 
    Senior
    For contractors
    Internship
    Work at office

    WSP Group

    Milwaukee, WI
    2 days ago
  •  ...company match, and generous time off to recharge. Job Summary The Data Engineer designs, builds, and maintains the data platform...  ...development of Fabric-based data pipelines and service bus integrations that enable real-time communication between Healthfuse's web... 

    Healthfuse

    Milwaukee, WI
    5 days ago
  •  ...experience focuses on delivering robust data solutions using ADF for OBP and Snowflake...  ...efficiently while maintaining data integrity and consistency across subject areas. -...  ...practical knowledge of cloud based data engineering practices, including monitoring, cost management... 
    Remote work
    Day shift

    TechDigital Group

    Glendale, WI
    3 days ago
  • $86k - $100k

     ...digital innovation, we deliver intelligent, data-driven solutions to help our clients...  ...Technology Enablement - PhD Data Science/Data Engineer for our Advisory practice....  ...research outcomes into actionable program integrity recommendations Clearly communicate mathematical... 
    Internship
    Seasonal work
    H1b
    Work at office
    Local area
    Remote work
    Night shift

    KPMG LLP

    Milwaukee, WI
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Data Integration Engineer. Be the first to apply!