Senior Data Engineer

Senior Data Engineer | Lincoln, Nebraska, United States Senior Data Engineer - Encounter Processing & Data Platform Location: Lincoln, NE (Remote/Onsite Flexibility) Job Type: C2C About the Role Join a mission-critical team as a Senior Data Engineer, serving as the technical owner of an enterprise data processing platform supporting Medicaid Encounter Processing and enterprise data ingestion. You will lead the ongoing maintenance, enhancement, and reliability of a high-impact system built with Scala, Apache Spark, Hive, and Drools on the Cloudera Data Platform (CDP). In this pivotal role, you will ensure operational continuity for a platform processing provider, member, reference, and encounter data vital to downstream Medicaid systems and reporting. Responsibilities - Own and maintain the Scala/Spark application framework supporting Medicaid Encounter Processing. - Lead production issue investigation, defect resolution, and root cause analysis for distributed data applications. - Manage Drools business rule implementation and ongoing rule maintenance. - Administer enterprise data ingestion for master data and source system files. - Oversee Spark and Hive batch processing workflows for high-volume data processing. - Coordinate production releases, version management, and deployment activities. - Tune and optimize application performance to ensure system reliability and scalability. - Develop and maintain comprehensive technical documentation and operational procedures. - Monitor and provide basic operational administration of the Cloudera Data Platform, collaborating with infrastructure and cloud operations teams. - Support regulatory and business-driven changes in a highly dynamic environment. Required Skills and Experience - 7+ years developing enterprise-scale distributed data processing applications. - Proven hands-on development experience with Scala. - Advanced expertise in Apache Spark (2.x/3.x), Apache Hive (3.x), and SQL. - Experience maintaining applications on Cloudera Data Platform (CDP 7.x) or similar Hadoop distributions. - In-depth experience implementing business rules using Drools Rules Engine. - Proficiency supporting Linux-based production environments and troubleshooting distributed Spark applications. - Strong background in Git and modern version control practices. Preferred Skills - Background in Medicaid, healthcare data, or Medicaid Encounter Processing. - Experience with Cloudera Manager, HDFS, and YARN. - Familiarity integrating with IBM DataStage. - Understanding of AWS infrastructure supporting Cloudera environments. - Experience working in Agile environments with Jira and Confluence. Benefits - Opportunity to serve as the primary technical owner of a mission-critical healthcare data platform. - Exposure to cutting-edge big data tools and enterprise cloud technologies. - Work in a collaborative, growth-driven environment with cross-functional teams. - Direct impact on Medicaid systems and healthcare data delivery. - Flexible work arrangements and a supportive culture that values technical expertise and innovation. How to Apply If you are an experienced Data Engineer passionate about enterprise-scale data platforms and ready to own critical healthcare technology, apply today with your updated resume. Candidates must be authorized to work in the United States without sponsorship.