Principal Data Engineer

Principal Data Engineer

Locations: Waltham, MA - Hybrid

About the Role

We are seeking a highly skilled and hands-on Principal Data Engineer to lead the design, and development of scalable real-time data platforms and distributed data processing systems. This role requires deep expertise in Java-based backend engineering, microservices architecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies.

The ideal candidate will have extensive experience building enterprise-scale streaming platforms, developing resilient microservices, optimizing large-scale data pipelines, and driving engineering best practices. This role will collaborate closely with Product, Architecture, Application Development, Analytics, SRE, and DevOps teams to deliver highly scalable, reliable, and high-performance data solutions.

How You Will Make an Impact

• Lead the design, and development of scalable real-time data platforms and event-driven streaming solutions using Apache Kafka, Apache Flink, Java, Spring Boot, and AWS cloud-native technologies.
• Design and implement high-performance batch and streaming data pipelines with advanced stream-processing capabilities including stateful processing, windowing, event-time processing, checkpointing, fault tolerance, and exactly once semantics.
• Develop scalable microservices, REST APIs, reusable data frameworks, and enterprise data processing components.
• Drive platform modernization, technical design reviews, engineering standards, and adoption of innovative technologies to improve scalability, reliability, performance, and operational efficiency.
• Design and maintain cloud-native infrastructure, CI/CD pipelines, deployment automation, and containerized applications using Kubernetes, Docker, Terraform/CloudFormation, ECS/EKS, and AWS services including S3, MSK, Redshift, Aurora, RDS, Lambda, Glue, and CloudWatch.
• Design optimized relational and analytical data models using Oracle, PostgreSQL, Redshift, and Aurora, including performance tuning, indexing, partitioning, and query optimization.
• Implement observability, monitoring, alerting, logging, data quality validation, and reconciliation frameworks to ensure operational excellence and platform reliability.
• Troubleshoot complex production issues, perform root-cause analysis, and collaborate with SRE and DevOps teams to improve platform stability, scalability, and deployment automation.
• Provide technical leadership, mentorship, and guidance to engineering teams while driving best practices, governance, and continuous improvement initiatives.

Required Experience

• Strong expertise in Java, Spring Boot, REST API development, and Microservices Architecture
• Proficiency in Python is preferred; experience with Node.js is a plus
• Strong hands-on experience with Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink, and AWS MSK
• Extensive experience designing and developing cloud-native applications on AWS
• Solid expertise in Kubernetes, Docker, Terraform/CloudFormation, ECS, and EKS environments
• Strong knowledge of Oracle, PostgreSQL, Amazon Redshift, and Amazon Aurora databases
• Experience with data modeling, database optimization, query tuning, indexing, and performance improvement strategies
• Proven experience developing and maintaining CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI/CD, Maven/Gradle, and SonarQube
• Strong expertise in monitoring, logging, and observability tools including CloudWatch, Prometheus, Grafana, ELK Stack, and related operational frameworks

What Sets You Apart

• Bachelor's or master's degree in computer science, Engineering, Information Systems, or a related field
• 8+ years of software engineering or data engineering experience
• 5+ years of hands-on experience with Apache Kafka and event-driven architectures
• 4+ years of experience with Apache Flink and real-time stream processing
• Strong experience designing scalable, fault-tolerant, and highly available distributed systems
• Proven experience leading enterprise-scale platform initiatives and mentoring engineering teams

SS&C Technologies offers a comprehensive total rewards package designed to support your wellbeing, growth, and future. Our benefits include medical, dental, and vision coverage; a 401(k) plan with company match; paid time off, holidays, and parental leave; and professional development reimbursement opportunity. Actual base salary will vary based on several factors, including but not limited to relevant skills, prior experience, education, demonstrated performance, and geographic location. Massachusetts: The expected base salary for the position is between 160,000 USD to 165,000 USD.

Applications will be accepted on an ongoing basis until the position is filled.

SS&C Technologies is an Equal Employment Opportunity employer and does not discriminate against any applicant for employment or employee on the basis of race, color, religious creed, gender, age, marital status, sexual orientation, national origin, disability, veteran status or any other classification protected by applicable discrimination laws.