Senior Python Data Engineer

Responsibilities: -

• Data Engineering & Pipeline Development
• Design, develop, and maintain ETL/ELT pipelines using Python, Spark, and Snowflake.
• Build data ingestion frameworks to collect and process data from multiple source systems.
• Develop scalable and efficient data transformation workflows.
• Create reusable components, utilities, and frameworks for data processing.
• Implement data validation, cleansing, enrichment, and reconciliation processes.
• Troubleshoot and resolve data pipeline performance and operational issues.
• Ensure code quality, maintainability, and adherence to engineering standards. Data Migration & Modernization
• Participate in Enterprise Data Warehouse (EDW) modernization and cloud migration initiatives.
• Analyze source systems, data models, ETL processes, and reporting structures.

Support migration of data from legacy platforms such as: -

Oracle

SQL Server

Teradata

Netezza

Hadoop

Develop source-to-target transformation logic.

Build and maintain ingestion pipelines for loading data into Snowflake.

Perform migration validation and reconciliation activities.

Support deployment and post-implementation stabilization activities. Snowflake Development

Develop and support Snowflake-based data solutions and data marts.

Develop and optimize:

Snowflake Tables.

Views

Streams

Tasks.

Snowpipe.

Stored Procedures.

Support structured and semi-structured data ingestion into Snowflake.

Monitor and improve Snowflake query performance and resource utilization.

Implement data security and access controls as per organizational standards. Python, Spark & Scala Development

Develop distributed data processing applications using Python and Spark.

Build transformation frameworks using PySpark and Scala.

Optimize Spark jobs for scalability and performance.

Implement logging, monitoring, and exception-handling mechanisms.

Participate in code reviews and technical discussions.

Follow secure coding and software development best practices. API Development & Integration

Develop and maintain RESTful APIs and integration services.

Build API-based solutions for data exchange and data consumption.

Implement authentication and authorization mechanisms.

Create API documentation and support API lifecycle management.

Collaborate with other application and integration teams. Healthcare Payer Data Support Work with healthcare payer datasets across: Membership & Enrollment

Member Demographics

Eligibility Data

Enrollment Data Claims Processing

Medical Claims

Professional Claims

Institutional Claims

Claims Adjudication Data Provider Management

Provider Master Data

Network Data

Contract Information Care Management

Case Management

Disease Management

Utilization Management Regulatory Reporting

HEDIS

Risk Adjustment

CMS Reporting

STAR Ratings Pharmacy Data

Pharmacy Claims

Medication Utilization

Clinical Quality Reporting Collaboration & Teamwork

Collaborate closely with Architects, Senior Engineers, Business Analysts, QA teams, and Project Managers. Participate in Agile ceremonies including sprint planning, estimation, daily stand-ups, and retrospectives.

Contribute to technical discussions and solution reviews.

Support peer engineers by sharing knowledge and best practices.

Assist in resolving technical and operational challenges.

Foster a collaborative and team-oriented work environment.

Testing & Production Support

Develop unit test cases and validation scripts.

Support SIT and UAT activities.

Perform data quality checks and reconciliation testing.

Participate in production deployments and release activities.

Troubleshoot production issues and provide timely resolution. Data Governance & Compliance

Adhere to enterprise data governance standards and policies.

Support implementation of data quality and data security controls.

Ensure compliance with:

HIPAA

PHI/PII Data Protection Standards

CMS Guidelines

Organizational Security Policies Required