Data Engineer II (Hybrid)

Data Engineer II (Hybrid) – Chicago, IL AMA Insurance (AMAI), part of the American Medical Association, provides insurance services to doctors. This role is responsible for data ingestion, transformation, automation, and validating file‑based integrations. It focuses on building and maintaining automation scripts for file extractions, managing structured and semi‑structured data files, and supporting reporting needs across the agency.

RESPONSIBILITIES

Data Preparation and Management Process and clean Excel, CSV, and other flat files for various claims and administration related data with high volumes Identify and resolve duplicates, inconsistencies, and data quality issues within these files Transform files to required schemes and formats for downstream consumption Load, stage, update, and extract data in Snowflake Perform manual and scheduled Snowflake runs Prepare and transform rate data across multiple processing stages and generate outbound data files and upload CSV outputs to EXL PowerShell Automation Develop and maintain PowerShell scripts from scratch and enhance existing scripts as needed Automate file transfers, processing FTP interactions, directory management, and email notifications Build automation solutions to improve operational efficiency SQL Server Development and Python Scripting Write and optimize SQL queries, including complex joins and transformations Update backend tables and support data corrections Prepare reports and datasets for analytics and operational needs Support database troubleshooting and data validation activities Develop Python scripts for file‑based automation, including file movement, copying, editing, and integration tasks Support end‑to‑end automation of data and file workflow May include other responsibilities as assigned.

REQUIREMENTS

Strong experience with SQL Server (complex queries, reporting, data updates) Hands‑on experience with Snowflake data loading, staging, and extraction Proficient in PowerShell scripting for automation and system integrations Proficient in Python scripting for automation and system integrations Proficient in Python scripting for file handling and automation Experience working with FTP servers and external system integrations Solid understanding of data quality, validation, and transformation Demonstrated ability to multi‑task and effectively manage multiple, concurrent projects with minimal supervision Polished interpersonal skills, including proven liaison and relationship building skills Written and verbal communication skills, including ability to collaborate with technical and non‑technical colleagues Salary range: $85,396 – $112,925. This is an exempt position. Employees are eligible to participate in an incentive plan. Address: 330 N. Wabash Avenue, Chicago, IL 60611. We are an equal opportunity employer, committed to diversity. All qualified applicants will receive consideration for employment. As an EOE/AA employer, the American Medical Association will not discriminate in its employment practices due to an applicant's race, color, religion, sex, age, national origin, sexual orientation, gender identity, or veteran or disability status. #J-18808-Ljbffr American Medical Association