Senior Data Engineer

A leading proprietary trading firm is looking for an experienced Data Engineer to join its Chicago team. This suits someone who thrives in a technically advanced environment and wants to help keep the firm ahead in fast-moving global markets. What you'll be doing Design, build and roll out the Big Data stack (Kafka, Hadoop, Dremio and similar) Create, deploy and monitor data processing pipelines using Java, Python, Spark and Flink Partner with development teams on data modelling, ingestion and capacity planning Work alongside users to keep data accurate and available Serve as the in-house Big Data expert, advising users and developers on data questions 5+ years in an established data engineering environment 3+ years building Kafka streaming applications and/or running Kafka clusters 2+ years building applications or pipelines on Big Data backends (S3, HDFS, Databricks, Iceberg and the like) Hands-on with Apache Spark, Apache Flink or comparable tools Strong development skills in Java, Python and SQL Familiarity with common data science toolkits, particularly Python-based ones Practical Kubernetes and Docker experience Monitoring tooling — Prometheus/Grafana, Alert Manager, Alerta, OpsGenie Solid statistical analysis ability Proven troubleshooting and root-cause analysis Unix scripting (bash, Python or similar) About the firm A research-led trading firm where quantitative modelling, machine learning and engineering drive how markets are traded. A steadying presence in the markets since 1989, it supplies liquidity across trading venues and focuses on strong outcomes in both value and risk for investors. Using its own capital and technology, the firm builds proprietary systems and algorithms running in markets worldwide, with researchers, traders and engineers operating as one group — combining fast experimentation, serious infrastructure and real-time feedback to turn insight into execution. #J-18808-Ljbffr