Data Engineer

Data Engineer (Python, Java) Remote (50%) Columbia SCColumbia, South Carolina, United StatesAbout the JobData Engineer (Python, Java) Remote (50%) Columbia SCAuthorized to work in the USNo H1BGovernment Experience: PreferredOverall Exp 11+ yrsThe South Carolina Department of Health & Human Services (SCDHHS) is the State Medicaid Agency for South Carolina. This agency is focused on the modernization of the States Medicaid Management Information System (MMIS). The modernization is a major undertaking for SCDHHS and requires major transformation of culture, processes and technology. The modernization program supports the Departments transition from primarily a fee-for-service payor of claims towards a program and policy driver for health outcomes primarily through managed care programs. The programs strategy supports significant innovation in MMIS thinking and mindset and is aligned with MMIS innovation at the national level as well.Scope of the project:The Data Operations Hub (DOH) serves as the centralized platform and team responsible for ingesting, validating, transforming, securing, and provisioning all enterprise data to support analytics, reporting, operational efficiency, and regulatory compliance.Objectives to Be Fulfilled by Candidate:As a Software Developer (Java) Consultant at South Carolina Department of Health and Human Services (SCDHHS), you will be a key member of the Data Operations Hub Team. Your role involves designing, developing, and implementing analytical data solutions that align with the Agency's strategic goals. You will leverage your expertise in data architecture, data modeling, data migrations and data integration, collaborating with cross-functional teams to achieve target state architecture goals.Job ResponsibilitiesRepresent the Data Operations Hub team in various forums, advising on Data Solutions.Lead the design and maintenance of scalable data solutions, including data lakes and warehouses.Collaborate with cross-functional teams to ensure data product solutions supports business needs and enables data-driven decision-making.Evaluate and select data technologies, driving the adoption of emerging technologies.Develop architectural models using sparkx, or other data modeling tool available and other artifacts to support data initiatives.Serve as a subject matter expert in specific areas.Experience with modern data processing technologies such as Python, Java, Airflow, etc. using data mesh & data lake.Contribute to the data engineering community and advocate for agency data practices.Engage in hands-on coding and design to implement production solutions.Optimize system performance by resolving inefficiencies.Design reusable data frameworks using new technologies.Required Skills (rank in order of Importance):Experience as Data Engineer or similar role leading technologists to manage, anticipate and solve complex technical items within your domain of expertise.Hands-on experience in system design, application development, and operational stability.Expertise in architecture disciplines and programming languages.Deep knowledge of data architecture, modeling, integration, cloud data services, data domain driven design, best practices, and industry trends in data engineering.Practical experience with AWS/Azure services, and data engineering disciplines.Advanced experience in one or more data engineering disciplines, e.g, ETL/ELT, event processing.Proficiency in SQL, data warehousing solutions and cloud native relational databases, e.g. Snowflake, Athena, PostgresStrong problem-solving, communication, and interpersonal skills.Ability to evaluate and recommend technologies for future state architecture.Preferred Skills (rank in order of Importance):Business architecture knowledge and experience with architecture assessment frameworks.Required Education:Bachelor's or Master's degree in Computer Science or related field.Required Certifications:NA