Senior Data Engineer

About the Role The Streaming Data Platform team builds and operates large-scale, real-time stream processing systems using modern open-source technologies. We design pipelines that power analytics, reporting, and downstream product use cases by delivering high‑quality data with low latency and high reliability. As a Senior Data Engineer, you will design, build, and operate production‑grade streaming data pipelines and storage systems that support near real‑time analytics across Fanatics Commerce. You will collaborate closely with platform and analytics teams, drive architectural decisions, and help shape the future of our data infrastructure. Responsibilities Design, build, and operate real‑time streaming data pipelines using Apache Flink and Kafka, delivering low‑latency data to analytical and operational consumers. Build and maintain Snowpipe Streaming integrations to continuously ingest event data into Snowflake with minimal latency. Develop and optimize Snowflake data models, including dynamic tables, streams, and tasks to support near real‑time analytics workloads. Design and maintain semantic layers and BI cubes using Cube.dev and/or MicroStrategy to support self‑serve analytics and reporting. Implement and maintain data pipelines that handle moderate to high data skew using techniques like bucketing, salting, and adaptive partitioning. Work with Apache Iceberg tables for streaming workloads, including partitioning strategies, compaction tuning, file sizing, and snapshot management. Collaborate with platform and analytics teams to model data for different consumption patterns, including real‑time dashboards and analytical queries. Optimize streaming jobs and storage layouts to improve query performance, reduce latency, and control infrastructure cost. Diagnose and resolve performance bottlenecks related to ingestion, skew, and distributed query execution. Contribute code, reviews, and documentation to shared data platform components and internal frameworks. Participate in design discussions and provide technical input on streaming architecture and data modeling decisions. Required Qualifications 5+ years of professional data engineering or software engineering experience. Production experience designing, building, and operating Kafka‑based streaming systems (required). Hands‑on experience with Apache Flink for building real‑time streaming applications in production. Experience with Snowflake, including Snowpipe Streaming, dynamic tables, streams, and tasks for near real‑time data ingestion and transformation. Experience building semantic layers or analytical cubes using Cube.dev and/or MicroStrategy. Solid understanding of data skew challenges and mitigation techniques (bucketing, salting, repartitioning, adaptive strategies). Working knowledge of Apache Iceberg for streaming or near‑real‑time workloads, including table layout and compaction concepts. Proficiency in Java and/or Python. Strong SQL skills and understanding of distributed query execution and performance tuning. Experience operating data pipelines in production, including monitoring, alerting, and incident response. Nice to Have Experience integrating streaming systems with MPP analytical databases such as StarRocks, Apache Pinot, or Apache Druid. Familiarity with data distribution strategies such as tablet distribution, bucketing, and colocation in MPP systems. Experience contributing to open-source data or analytics projects. Exposure to materialized views, primary key models, or real‑time OLAP optimizations. Experience with large‑scale event‑driven architectures and high‑throughput data systems. Where you’ll work and what’s required Location: San Mateo, CA Office Hybrid work environment flexibility, with Tuesdays, Wednesdays, and Thursdays in office; Mondays and Fridays remote. Ability to travel up to 10% of the time for partner meetings, events, and other related activities. What’s in it for you Culture: Join a team where you’re surrounded by top‑tier talent, driven by a shared passion to relentlessly enhance the fan experience. With a focus on collaboration, support, and continuous development, you’ll be empowered to help shape a culture that celebrates both individual and team successes. Benefits: We provide a wide range of health, financial, legal, and development assistance, including wellness programs with fitness and weight management partners, paid maternity paternity leave, and infertility treatment. Additionally, we offer flexible time off to help you recharge, along with a competitive 401k plan to support your financial future. At Fanatics, we’re dedicated to supporting you in all aspects of work and life. Salary range for this position is $160,000 - $190,000 (base pay only) and does not include short‑term or long‑term incentive compensation. When determining base pay, as part of a final compensation package, we consider several factors such as location, experience, qualifications, and training. #J-18808-Ljbffr