Senior Data Engineers

Company Overview CCC Intelligent Solutions Inc. (CCC) is a cloud platform that provides intelligent experiences for the insurance economy, including insurers, repairers, automakers, and part suppliers. With more than 35,000 customers, CCC helps businesses streamline claims and repair processes through advanced AI and data solutions. Role Senior Data Engineer – Headquarters: Chicago, IL. The role involves developing large‑scale, end‑to‑end data pipelines across on‑prem and AWS cloud environments to support analytics, reporting, and data science initiatives. Responsibilities Design, build, and maintain data pipelines that ingest, cleanse, transform, and load data from multiple sources. Produce dimensional data models, data feeds, dashboards, and data science exploration tools. Develop automated tests for data flow components and content quality checks. Automate orchestration and error handling for production operations. Diagnose and resolve production support issues, providing technical expertise to support teams. Mentor junior engineers and guide performance tuning in distributed computing environments. Perform root‑cause analysis on data and processes, identifying improvement opportunities. Create metadata‑driven, fully parameterized data processing tools. Technical Environment Programming: Python and PySpark Big Data platforms: Hadoop, HDFS, YARN, AWS EMR, Redshift, Hive, HBase Storage & formats: Parquet, ORC, Hudi, Hive tables ETL orchestration: Apache Airflow, Apache Kafka Data integration: Sqoop, Spark SQL, Spark DataFrames Infrastructure: Terraform, AWS services Version control: GitLab, Subversion Other: Unix shell scripting, Advanced SQL for profiling and validation, JIRA dashboards Requirements Master’s degree in Computer Science, Computer Engineering, Management Information Systems, or a related field. Minimum 2 years of experience in software development, data processing, or data analysis. Hands‑on experience with the technologies listed in the Technical Environment section. Strong analytical skills, including root‑cause analysis and performance tuning. Salary $108,077/yr. – $125,282/yr. Benefits 401(k) match Paid time off Annual incentive plan and performance bonus Comprehensive health insurance Adoption assistance Tuition reimbursement Wellness programs Stock purchase plan options Employee resource groups Telecommuting is permitted. If you require reasonable accommodation to complete a job application, please contact View phone number on click.appcast.io. #J-18808-Ljbffr