Sr. Data Engineer

Sr. Data Engineer Location: Reading, PA Type: Contract Roles:

• Design, develop, and maintain large-scale batch and streaming pipelines using PySpark and Python.
• Build real-time and near real-time streaming applications with stateful processing, windowing, and checkpointing.
• Develop production-grade Python microservices for complex data transformations and business logic.
• Design and manage modern data lake architectures using Apache Iceberg on AWS S3, implementing schema evolution, partitioning, compaction, and time travel.
• Develop and deploy pipelines across AWS services including S3, EMR, Glue, Lambda, Athena, Redshift, and Aurora.
• Optimize Spark workloads for performance, scalability, and cost efficiency.
• Implement monitoring, logging, alerting, and recovery mechanisms for robust production operations.
• Contribute to CI/CD pipelines, participate in architecture discussions, and uphold engineering best practices.

Lenora Systems upholds the policy of equal employment opportunity. We commit to consider all eligible candidates for employment without discrimination on the grounds of age, lineage, nationality, hue, family or medical leave, gender identity or expression, genetic data, immigration status, marital circumstance, medical status, national origin, physical or psychological disability, political alignment, veteran or military status, race, ethnicity, faith, sex (including maternity), sexual preference, or any other attribute safeguarded by relevant local statutes, directives, and ordinances. Meet Greater Reading