Senior Scalability Engineer - Streaming & Realtime Systems

About Judi HealthJudi Health is an enterprise health technology company providing a comprehensive suite of solutions for employers and health plans, including:Capital Rx, a public benefit corporation delivering full-service pharmacy benefit management (PBM) solutions to self-insured employers,Judi Health™, which offers full-service health benefit management solutions to employers, TPAs, and health plans, andJudi, the industry's leading proprietary Enterprise Health Platform (EHP), which consolidates all claim administration-related workflows in one scalable, secure platform.Together with our clients, we're rebuilding trust in healthcare in the U.S. and deploying the infrastructure we need for the care we deserve. To learn more, visit RemotePosition SummaryJoin our Scalability team as a Senior Scalability Engineer focused on streaming and realtime systems. In this role, you will own the architecture and expansion of our streaming data infrastructure, including WAL-based database replication, change data capture (CDC) systems, and realtime event processing. Your work will handle systems processing hundreds of thousands to millions of records per batch while maintaining strict ordering guarantees and exactly-once semantics. Working closely with our clients and cross-functional teams, you\'ll build foundational streaming infrastructure while partnering directly with product teams to implement realtime capabilities that power critical business workflows.Position ResponsibilitiesOwn streaming infrastructure: Design, implement, and expand WAL-based replication systems that process database changes through Kinesis to Snowflake and Redshift, handling millions of records while maintaining strict ordering and delivery guarantees.Build CDC systems: Architect and implement change data capture infrastructure for cross-platform data synchronization, enabling realtime analytics and event-driven workflows across the organization.Develop shared libraries: Create reusable Kinesis/SNS consumer patterns and libraries used across multiple teams, establishing best practices for event processing, error handling, and observability.Partner with product teams: Work directly with teams to design and implement realtime data processing solutions tailored to their business needs, providing technical guidance and hands-on support.Ensure data reliability: Implement exactly-once processing semantics, dead letter queues, retry strategies, and monitoring to guarantee data integrity across streaming pipelines.Build observability: Develop monitoring, alerting, and dashboards for streaming pipelines to track throughput, lag, data quality issues, and system health using the LGTM stack.Demonstrate technical leadership: Mentor engineers on streaming architecture patterns, lead design reviews for event-driven systems, and represent the Scalability team in cross-functional planning.Make strong architectural choices through careful evaluation and prior experience with distributed systems.Responsible for adherence to the Capital Rx Code of Conduct, including reporting of noncompliance.Required Qualifications10+ years of software engineering experience with demonstrated progression into technical leadership roles.3+ years of experience leading technical initiatives, architecting distributed systems, or serving as a subject matter expert on streaming infrastructure.Strong expertise in Python (Flask/SQLAlchemy) for production applications.Deep PostgreSQL knowledge: Understanding of write-ahead logs, replication, logical decoding, and change data capture mechanisms.Production streaming experience: Proven track record building and operating high-throughput streaming systems using Kinesis, Kafka, or similar event streaming platforms.Distributed systems expertise: Strong understanding of ordering guarantees, exactly-once semantics, partition strategies, backpressure handling, and fault tolerance patterns.AWS experience: Production experience with Kinesis, S3, SNS/SQS, Lambda, ECS, and data pipeline orchestration.Data warehouse knowledge: Experience loading data into Redshift, Snowflake, or similar analytical databases.Systems thinking: Ability to design resilient, observable streaming architectures that balance throughput, latency, and reliability.Collaboration and communication: Strong written and verbal communication skills with ability to work autonomously while driving proactive collaboration in a remote environment.(Optional) Preferred QualificationsRust development experience or strong interest in learning Rust for high-performance systems.Infrastructure as code: Experience with Terraform or similar IaC tools for managing cloud infrastructure.Observability tools: Hands-on experience with Grafana, Prometheus, Loki, or similar monitoring/alerting platforms.Event-driven architectures: Background designing event sourcing, CQRS, or other event-driven patterns.Previous Pharmacy Benefits Manager (PBM) or healthcare technology experience.Base Salary: $160,000 - $200,000This range represents the low and high end of the anticipated base salary range for the NY - based position. The actual base salary will depend on several factors such as: experience, knowledge, and skills, and if the location of the job changes.Nothing in this position description restricts management's right to assign or reassign duties and responsibilities to this job at any time.Salary Range: $160,000 USD - $200,000 USDAll employees are responsible for adherence to the Capital Rx Code of Conduct including the reporting of non-compliance. This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.Judi Health values a diverse workplace and celebrates the diversity that each employee brings to the table. We are proud to provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, medical condition, genetic information, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.By submitting an application, you agree to the retention of your personal data for consideration for a future position at Judi Health. More details about Judi Health\'s privacy practices can be found at Judi Health