Senior Data Engineer
Confidential
Summary
The Data Ops Engineer is responsible for improving, modernizing, and supporting data ingestion operations with a focus on building reliable, scalable, and resilient data pipelines. This role drives enhancements to existing ingestion processes through automation, monitoring, containerization, data quality controls, and operational best practices to improve reliability, reduce manual intervention, and ensure continuity of data operations. The Data Ops Engineer monitors pipeline health, troubleshoots production data issues, supports workflow orchestration and deployment, and maintains operational documentation to ensure trusted, timely delivery of data for analytics, reporting, business operations, and machine learning initiatives.
Essential Duties and Responsibilities
This list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.
- Design, operate, and maintain reliable batch and streaming data pipelines that support analytics, reporting, business operations, and machine learning.
- Modernize existing ingestion workflows by identifying opportunities to containerize solutions for scalability and resiliency.
- Monitor pipeline health, job performance, data freshness, data availability, and SLA adherence using observability, logging, and alerting tools.
- Troubleshoot production data incidents, identify root causes, coordinate remediation, and document preventive actions through runbooks and post-incident reviews.
- Implement data quality checks, schema validation, anomaly detection, and reconciliation processes to improve downstream dataset and dashboard reliability.
- Support orchestration, scheduling, deployment, and lifecycle management for data workflows using tools such as Azure Data Factory, Azure Synapse, Azure Databricks, cloud-native data services, or comparable platforms.
- Collaborate with data engineers, business stakeholders, product owners, data analysts, and data architects to understand requirements and resolve operational issues.
- Improve reliability, scalability, performance, and cost efficiency of data platforms, warehouses, lakes, and integration processes.
- Maintain documentation for data workflows, operational procedures, dependencies, lineage, ownership, escalation paths, and support processes.
- Establish or contribute to CI/CD, infrastructure-as-code, environment management, access controls, and governance practices for production data systems.
- Participate in on-call or production support rotations as needed to support timely response to critical data issues.
- Support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing performance evaluation.
- Maintain confidentiality of information processed & follow company policies and procedures.
Qualifications
Requires five (5) to seven (7) years of data engineering, data operations, data platform operations, or related experience. Bachelors degree in Computer Science, Engineering, Information Systems, or related field, or equivalent professional experience preferred. Experience leading teams and developing supervisory staff preferred.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
Other qualifications include:
- Strong SQL skills and experience working with relational databases, data warehouses, and lakehouse environments.
- Hands-on experience with ETL/ELT pipelines, workflow orchestration, data transformation, and production data operations.
- Working knowledge of Microsoft Azure or other cloud platforms, Linux or command-line tools, scripting languages such as Python or Bash, and version control systems such as Git.
- Familiarity with Azure tools and platforms such as Azure Databricks, Azure Data Factory, Azure Container Apps, Azure Synapse, Azure Event Hubs, and Service Bus.
- Experience supporting data pipelines, datasets, or platform operations used for AI and machine learning workloads, with an understanding of data quality, observability, governance, privacy, and responsible AI considerations.
- Understanding of monitoring, alerting, logging, incident response, root cause analysis, and operational runbook development.
- Experience with data quality, schema management, metadata, lineage, governance, security, and access-control concepts.
- Ability to analyze pipeline performance, optimize queries, manage dependencies, and improve cost-performance of data workloads.
- Clear communication skills for translating technical issues into business impact and coordinating with cross-functional teams.
- Strong problem-solving mindset, attention to detail, ownership, and comfort working in production environments.
- Pharmacy Benefit Management, healthcare industry knowledge, HIPAA, SOC2, or PBM/pharmacy data workflow experience preferred.
Language Skills
Ability to read, analyze, and interpret common scientific and technical journals, manuals, financial reports, and legal documents. Ability to prepare reports and correspondence. Ability to communicate effectively with vendors, clients, board members and/or other employees of the organization. Effective project management skills a must. Basic Microsoft Outlook, Project, Excel, Word and Power Point skills required with a basic knowledge and understanding of IT networking principles.
Physical Demands
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. (The phrases occasionally, regularly, and frequently correspond to the following definitions: Occasionally means up to 1/3 of working time, regularly means between 1/3 and 2/3 of working time, and frequently means 2/3 and more working time.)
While performing the duties of this job, the employee is frequently required to sit; talk or hear; and use hands to handle, or touch objects or controls. The employee is regularly required to stand and walk. On occasion the incumbent may be required to stoop, bend or reach above the shoulders. The employee would rarely need to lift up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception, and ability to adjust focus.
Work Environment
The position is a hybrid position with 2 3 days office presence in Milwaukee, WI required. The colleague may perform work-related travel on rare occasions (less than 10%) with an emphasis on travel for impact.
The above statement reflects the general details necessary to describe the principal functions of the occupations described and shall not be construed as a detailed description of all the work that may be inherent in the occupation.
EEO Statement
This company is an equal opportunity employers committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. The Company makes hiring decisions based solely on qualifications, merit, and business needs at the time.
Compensation details: 120000-140000 Yearly Salary
PI6011607c9f9f-26289-41303114
$128.4k - $149.8k
...Data Engineer Opportunity at American Transmission Company (ATC)At American Transmission Company (ATC), data is more than information. It is a strategic asset that helps us operate the electric grid safely, reliably, and efficiently. We're looking for a Data Engineer who...SeniorRelocationFlexible hours- ...Job Category: Information Technology Requisition Number: DATAE002046 Description Our Data Engineers help Delta Defense turn complex data into clear, actionable insights that support smarter business decisions. This hands-on role builds reliable data solutions...Suggested
- ...Data Engineer PositionUnder the direction of the Manager, Data & Analytics, this role will be the Data Engineer responsible for designing, building, and maintaining the data infrastructure that powers analytics, reporting, and data-driven decision-making across Evans Transportation...SuggestedWork at officeRemote work
- ...This position reports to:Pricing & Quotations Manager__The Senior Revenue Management Data Scientist will transform pricing, quotation, customer,... ....Partnering with quotation, sales, application engineering, and commercial operations teams to improve quote strategy...SeniorLocal areaMonday to Friday
- ...application teams to design and develop data layers and data stores (data services in... ...• Data analytics - implement known data engineering tasks including transformation, quality remediation... ...: Information TechnologyExperience level: Mid-Senior LevelIndustry: Information ServicesSuggestedImmediate startRemote work
- ...We are looking for an experienced ML Ops Engineer to build, automate, and maintain scalable machine learning infrastructure and deployment... ..., Kubernetes, and cloud services. Monitor model performance, data quality, system health, and production workloads. Collaborate...
- ...sustainable energy future.Ready to Power a Smarter World with us?The Senior Talent Acquisition Partner serves as a strategic advisor to... ...sourcing techniques, recruitment marketing, talent pipelining, and data-driven decision-making to build diverse talent pools and reduce...Senior
- ...sustainable energy future.Ready to Power a Smarter World with us?The Senior Manager, Human Resources serves as a strategic business partner... ...skills.Strong analytical skills and ability to leverage data to support talent insights and decisions.Comfortable operating in...SeniorLocal area
$42 - $56 per hour
...Senior CNC Programmer (3 & 5-Axis) Richfield, WI | Full-Time | 1st Shift (5:45 AM - 2:15 PM) | $42.00$56.00/hour Program the... ...years, Strohwig has invested in advanced machining technology, engineering expertise, and talented people. Our 210,000-square-foot...SeniorHourly payFull timeDay shift$35 - $50 per hour
...Senior Quality Inspector Richfield, WI | Full-Time | 1st & 2nd Shift Available Earn a 15% Shift Premium on 2nd Shift $... ...customers. If you take pride in precision, enjoy working with engineering drawings and CMMs, and want to be part of a collaborative...SeniorHourly payFull timeApprenticeshipShift workDay shiftAfternoon shift- North Shore Bank is seeking a Branch Supervisor to coordinate the fixed activities of the branch, supervise tellers, and support sales efforts. The role supports and demonstrates customer service standards while acting in a supervisory capacity when the Branch Manager ...Senior
- Job-ID32302343Reference26-00643 Summary : Seeking a Senior Quality Engineer with strong MDR remediation and medical device manufacturing quality experience to support compliance, validation, and risk management activities for regulated product families. Roles & Responsibilities...Senior
- ...Eras Senior Network is seeking an experienced Program Director to lead service delivery for Milwaukee and Waukesha County seniors. You... ...will guide Faith in Action and Mobility Management teams, oversee data entry and reporting, mentor volunteers, and promote...Senior
- ...himanshu.prajapat(at)collabera.com or feel free to call me on (***) ***-**** Essential functions (responsibilities): • The Senior Engineering Recruiter is responsible for managing the wing-to-wing recruitment and selection process either for a specific or multiple business...SeniorPermanent employmentFull time
- Generac is hiring a Technical Support Representative III in Waukesha, Wisconsin, to provide expert technical support to their authorized dealer network. The role involves troubleshooting complex issues, mentoring less experienced representatives, and ensuring effective ...Senior
$90k - $110k
...significantly through acquisitions and offers long-term career advancement opportunities. High-visibility role working directly with senior finance leadership and helping shape accounting processes during an exciting period of growth. Opportunity to grow into leadership...Senior$80k - $100k
...Senior AccountantCFS is partnered with a leading manufacturing organization seeking a Senior Accountant to join their growing team. Lots of opportunity to advance due to upcoming retirements.Why You Should Consider Joining This Company:Large Organization – Near 1,000+...Senior$90k - $106k
...growing high-tech manufacturing company seeking an experienced Senior Accountant / Cost Accountant. This role offers an excellent... ...Accounting experience to work closely with Finance, Operations, and Engineering.ResponsibilitiesSupport monthly, quarterly, and year-end close...SeniorLocal area- ...environments for residents. The role involves cleaning resident apartments, assisting care staff, and ensuring sanitary surroundings for our senior population. The ideal candidate will have excellent customer service skills and communicate effectively with residents. Join us to...Senior
$100k - $110k
...Senior Financial Analyst Our client operates 600+ stores across the United States and continues to experience exceptional growth,... ...cross-functional teams to collect, analyze, and interpret financial data. Assist with the annual budget and ongoing forecasting...SeniorCasual work$90k - $110k
...Senior Accountant CFS is partnering with a well-established construction organization seeking a Senior Accountant to join its growing accounting team. With upcoming retirements creating opportunities for advancement, this is an excellent role for someone looking...Senior$53k - $106k
...For more information, visit corporate.carrier.com or follow on Carrier social media at @Carrier. About This Role As a Field Engineer, you will be crucial to ALC’s business through the field commissioning of building automation systems created specifically for...Minimum wageFull timeTemporary workLocal area- A leading energy technology company is seeking a Senior Industrial Technical Support Specialist to provide advanced technical support to dealers. The ideal candidate will have over 7 years of experience in automotive repair or generators, with strong customer service and...SeniorRemote job
- Pieper Electric is seeking a Senior Manager, Operations to oversee day-to-day field and departmental operations. The selected candidate... .... The ideal candidate will have a strong background in engineering and project management, with 10+ years of relevant experience....Senior
- Green Bay Packaging seeks a Senior Structural Designer to lead the design and development of corrugated packaging, folding cartons, and paperboard solutions. In this role, you will translate customer requirements into manufacturable, cost-effective, and sustainable structural...Senior
- ...ensuring investments are aligned, resourced appropriately, and positioned to deliver measurable business value.Translate business and engineering needs into clear definitions of value, scope, requirements, and “ready” criteria.Define and maintain the definition of “ready”...SeniorVisa sponsorshipWork visaRelocation package
- ...term advancement and professional development opportunitiesThis is an opportunity to join a high level law firm and grow into a more senior position. If you are interested in learning more, or to apply, reach out to ****@*****.*** qualified applicants will...SeniorContract workWeekend workAfternoon shift
- Position Overview Design POP displays from conception to completion. Design projects by analyzing customer specifications/requirements, for example, structural and material recommendations, testing prototypes, and creating preliminary instruction sheets. ...Senior
- Senior Electrical Project ManagerGpac is a national executive search firm specializing in recruitment for the electrical construction industry. We have been retained by a local electrical contractor in the area to find a Senior Electrical Project Manager to join their...SeniorFor contractorsFor subcontractorLocal area
- ...strategies, and lifecycle risk mitigation.Partner with Component Engineering to reduce legacy dependency and improve product longevity.Value... ...on pricing trends, lead times, and supply-demand dynamics.Use data analytics to support sourcing decisions and cost...SeniorContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!




