Data Engineer
Confidential
Summary
The Data Ops Engineer is responsible for improving, modernizing, and supporting data ingestion operations with a focus on building reliable, scalable, and resilient data pipelines. This role drives enhancements to existing ingestion processes through automation, monitoring, containerization, data quality controls, and operational best practices to improve reliability, reduce manual intervention, and ensure continuity of data operations. The Data Ops Engineer monitors pipeline health, troubleshoots production data issues, supports workflow orchestration and deployment, and maintains operational documentation to ensure trusted, timely delivery of data for analytics, reporting, business operations, and machine learning initiatives.
Essential Duties and Responsibilities
This list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.
- Design, operate, and maintain reliable batch and streaming data pipelines that support analytics, reporting, business operations, and machine learning.
- Modernize existing ingestion workflows by identifying opportunities to containerize solutions for scalability and resiliency.
- Monitor pipeline health, job performance, data freshness, data availability, and SLA adherence using observability, logging, and alerting tools.
- Troubleshoot production data incidents, identify root causes, coordinate remediation, and document preventive actions through runbooks and post-incident reviews.
- Implement data quality checks, schema validation, anomaly detection, and reconciliation processes to improve downstream dataset and dashboard reliability.
- Support orchestration, scheduling, deployment, and lifecycle management for data workflows using tools such as Azure Data Factory, Azure Synapse, Azure Databricks, cloud-native data services, or comparable platforms.
- Collaborate with data engineers, business stakeholders, product owners, data analysts, and data architects to understand requirements and resolve operational issues.
- Improve reliability, scalability, performance, and cost efficiency of data platforms, warehouses, lakes, and integration processes.
- Maintain documentation for data workflows, operational procedures, dependencies, lineage, ownership, escalation paths, and support processes.
- Establish or contribute to CI/CD, infrastructure-as-code, environment management, access controls, and governance practices for production data systems.
- Participate in on-call or production support rotations as needed to support timely response to critical data issues.
- Support AI and machine learning initiatives by maintaining reliable, secure, and well-governed data pipelines and datasets used for model development, testing, deployment, monitoring, and ongoing performance evaluation.
- Maintain confidentiality of information processed & follow company policies and procedures.
Qualifications
Requires five (5) to seven (7) years of data engineering, data operations, data platform operations, or related experience. Bachelors degree in Computer Science, Engineering, Information Systems, or related field, or equivalent professional experience preferred. Experience leading teams and developing supervisory staff preferred.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
Other qualifications include:
- Strong SQL skills and experience working with relational databases, data warehouses, and lakehouse environments.
- Hands-on experience with ETL/ELT pipelines, workflow orchestration, data transformation, and production data operations.
- Working knowledge of Microsoft Azure or other cloud platforms, Linux or command-line tools, scripting languages such as Python or Bash, and version control systems such as Git.
- Familiarity with Azure tools and platforms such as Azure Databricks, Azure Data Factory, Azure Container Apps, Azure Synapse, Azure Event Hubs, and Service Bus.
- Experience supporting data pipelines, datasets, or platform operations used for AI and machine learning workloads, with an understanding of data quality, observability, governance, privacy, and responsible AI considerations.
- Understanding of monitoring, alerting, logging, incident response, root cause analysis, and operational runbook development.
- Experience with data quality, schema management, metadata, lineage, governance, security, and access-control concepts.
- Ability to analyze pipeline performance, optimize queries, manage dependencies, and improve cost-performance of data workloads.
- Clear communication skills for translating technical issues into business impact and coordinating with cross-functional teams.
- Strong problem-solving mindset, attention to detail, ownership, and comfort working in production environments.
- Pharmacy Benefit Management, healthcare industry knowledge, HIPAA, SOC2, or PBM/pharmacy data workflow experience preferred.
Language Skills
Ability to read, analyze, and interpret common scientific and technical journals, manuals, financial reports, and legal documents. Ability to prepare reports and correspondence. Ability to communicate effectively with vendors, clients, board members and/or other employees of the organization. Effective project management skills a must. Basic Microsoft Outlook, Project, Excel, Word and Power Point skills required with a basic knowledge and understanding of IT networking principles.
Physical Demands
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. (The phrases occasionally, regularly, and frequently correspond to the following definitions: Occasionally means up to 1/3 of working time, regularly means between 1/3 and 2/3 of working time, and frequently means 2/3 and more working time.)
While performing the duties of this job, the employee is frequently required to sit; talk or hear; and use hands to handle, or touch objects or controls. The employee is regularly required to stand and walk. On occasion the incumbent may be required to stoop, bend or reach above the shoulders. The employee would rarely need to lift up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception, and ability to adjust focus.
Work Environment
The position is a hybrid position with 2 3 days office presence in Milwaukee, WI required. The colleague may perform work-related travel on rare occasions (less than 10%) with an emphasis on travel for impact.
The above statement reflects the general details necessary to describe the principal functions of the occupations described and shall not be construed as a detailed description of all the work that may be inherent in the occupation.
EEO Statement
This company is an equal opportunity employers committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. The Company makes hiring decisions based solely on qualifications, merit, and business needs at the time.
Compensation details: 120000-140000 Yearly Salary
PI6011607c9f9f-26289-41303114
- ...support and resources of the fastest-growing brand in the construction industry to make it happen. Your Role On Our Team As a Senior Data Engineer, you will deliver innovative data products that enable Milwaukee Tool to make fast, data-driven decisions. Working closely with...SuggestedWork at office
- ...Role Overview The Principal Data Engineer is a senior technical authority responsible for defining the organization's data architecture, setting long-term technical strategy, and solving the most complex data engineering challenges. This role influences company-wide...Suggested
- ...Role Overview The Staff Data Engineer is a senior technical leader responsible for designing, scaling, and governing the organization's data platform and pipelines. This role sets data engineering standards, drives architectural decisions, and mentors engineers while...Suggested
- ...Senior Data EngineerThe Senior Data Engineer will design and build tools and processes that help clients derive meaningful insights from their data. They will help clients understand their data needs and how to use data to reach business goals. They will also provide mentoring...Suggested
$105.4k - $124k
...career. Try new things, learn new skills and discover what you excel at—all from Day One.Job DescriptionThe Infrastructure Data Analytics Engineer is responsible for acquiring, transforming, integrating, and analyzing data from infrastructure, platform, cloud, and enterprise...SuggestedFull timeLocal area3 days per week$111.61k - $131.3k
At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life,...Full timeWork experience placementLocal area3 days per week$131.6k - $249.78k
...clinical practice. Together, we develop and deploy category-defining, data-driven, software-as-a-service (SaaS) products for a broad... ...and is critical to our future. In this position as a Staff Data Engineer of IntelliScript’s Data Platform, you will be a trusted advisor...Full timeWork experience placementWork at officeRemote work- ...Job Description Job Description OverviewThe Junior Data Engineer supports the design, development, and maintenance of data pipelines and data infrastructure. This role focuses on building reliable, scalable data solutions that enable analytics, reporting, and data-...
$131.6k - $249.78k
...relevant experience in the design, development, and evaluation of Data Platform solutions such as Data Warehouses, Data Lakes, and... ...requirements Contribute to the vision and strategy for data engineering, ensuring alignment with organizational objectives Establish...Full timeWork at officeRemote work- ...made National Interstate one of the most respected names in commercial transportation insurance today. ( Interstate is looking for a Data Reporting Analyst to join their team. This individual will work a hybrid schedule out of the Richfield office.National Interstate’s...Full timePart timeSeasonal workLive outWork at officeRemote work
- ...Role Overview The Senior Data Analyst is a trusted analytical partner who leads complex analyses, develops insights that influence... ...and experimentation Familiarity with data modeling or data engineering concepts Domain expertise (e.g., finance, HR, operations,...
- ...Role Summary The Junior Data Analyst supports data collection, analysis, and reporting efforts to help teams make informed business decisions. This role focuses on transforming raw data into clear insights through dashboards, reports, and basic analytical models, while...
- ...NIIC National Interstate Insurance Company in Richfield, WI, seeks a Data Reporting Analyst to analyze large data sets, build reports and dashboards, and provide actionable insights to stakeholders. Hybrid schedule with on-site four days a week and one remote day; core...Work at officeRemote work
- ...procedures and operation methods.Design and maintain database as needed to ensure business functionality is achieved.Prepares test data and executes unit and system tests for technology development.Prepares test data and analyzes program performance during testing.Trains...Permanent employmentInternshipWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week
$32.54 - $55.66 per hour
Discover. Achieve. Succeed. #BeHereJob Summary:Pay is expected to be between: (expressed as hourly) $32.54 - $55.66. Final compensation is based on experience and will be discussed with you by the recruiter during the interview process.Hourly pay$119.77k - $140.9k
At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life,...Full timeLocal area3 days per week- ...analysis tools, state-of-the-art quality controls and cross-functional agility.Your Role on Our TeamAs a Metrology Data, Systems, and Automation Engineer, you will help modernize metrology operations by improving how measurement data is collected, organized, analyzed,...Full time
- ...Role Overview We are seeking a Principal Data Architect to lead the design and delivery of a modern investment data ecosystem... ...traders, analysts, and technology leaders Mentor internal data engineers and architects Drive adoption of modern data tools,...
- ...We are looking for an experienced ML Ops Engineer to build, automate, and maintain scalable machine learning infrastructure and deployment... ..., Kubernetes, and cloud services. Monitor model performance, data quality, system health, and production workloads. Collaborate...
$25 - $29 per hour
Job Title: Help Desk Technician Position Type: Contract (3+ Months) Location: Menomonee Falls, WI 53051 Salary Rate: $25-29/hrJob Description We are seeking a motivated Client Support - Associate to provide technical assistance and ensure smooth IT operations...Contract workWork experience placementWork at officeFlexible hours$110k - $135k
...Administration (NNSA) facility are encouraged to apply. Global Engineering & Technology (GET) is seeking a highly qualified individual to... ...laws, regulations, DOE orders, and DOE procedures for Restricted Data (RD), Formerly Restricted Data (FRD), National Security...Full timeTemporary workWork at officeRemote work- ...An IT staffing company is seeking a candidate for a role focusing on OTC master data management, ensuring compliance with defined standards and policies. The successful candidate will implement master data for SAP and provide ongoing maintenance while coordinating changes...
$117.5k - $249.78k
...clinical practice. Together, we develop and deploy category-defining, data-driven, software-as-a-service (SaaS) products for a broad... ...leadershipCoordinate with Product, Business Development, ML Engineering, and IT to bring new and exciting data science products to market...Full timeWork experience placementWork at officeLocal areaRemote work$165k - $185k
...position provides relocation support to the Germantown area. Global Engineering & Technology (GET) is seeking qualified individuals for the... ..., and DOE Office of Classification procedures for Restricted Data (RD), Formerly Restricted Data (FRD), and National Security Information...Full timeTemporary workWork at officeRelocation package- ...We are looking for a creative, detail-oriented, and strategic Data Visualization Analyst to transform trusted data into intuitive... ...dynamic, actionable dashboards. Partnering closely with data engineers, product teams, and cross-functional leaders across...Local areaShift work
- ...heavy gauge, large format, deep draw thermoforming. Our precision-engineered solutions serve Original Equipment Manufacturers across... ...pricing reviews, commercial negotiations, and contract renewals with data-driven analysis and a clear understanding of Hampel's cost...Contract workWork at office
$86.36k - $101.6k
...excel at—all from Day One.Job DescriptionThis individual provides data management support and analysis to Cash Analytics. They support... ...a quantitative field such as econometrics, computer science, engineering or applied mathematics, or equivalent work experience- Four to...Full timeWork experience placementLocal area3 days per week$119.77k - $140.9k
...resolving incidents.Understands and knows when to use different data structures. Understands when algorithms should be applied and... ...accepted testing frameworks and the testing pyramid.Approaches engineering work with a security lens and actively looks for vulnerabilities...Full timeWork at officeLocal areaRemote workFlexible hours3 days per week- ...Business Analyst /Data Analyst Location: Charlotte, NC Position Type: Contract Rate: DOE $/hr. on w2 only No Visa sponsorship available for this Job (US Citizen, Green Card,GC-EAD) Job Description Strong Documentation Skills: Gathering requirements and...Contract workVisa sponsorship
- ...Job Description Analyze HR data to uncover trends, risks, and opportunities Build dashboards and reports to visualize workforce insights Partner with HR leadership to support strategic decision-making Maintain and monitor HR data quality and integrity across systems Support...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- data collection Germantown, WI
- data visualization Germantown, WI
- clinical data Germantown, WI
- data Germantown, WI
- data modeling Germantown, WI
- data collection researcher Germantown, WI
- data analysis part time Germantown, WI
- provider data management Germantown, WI
- data network cabling Germantown, WI
- data center engineer


