Principal Data Engineer

Job Description

We're looking for an experienced, driven Principal Data Engineer to join our Chicago office. You'll do well here if you enjoy a fast-moving, innovative environment that keeps the firm at the leading edge of global financial markets.

\n

\n

What You'll Do

\n

\n
• Design, build and roll out our Big Data platform (Kafka, Hadoop, Dremio, etc.)
\n
• Develop, deploy and monitor data processing pipelines (Java, Python, Spark, Flink)
\n
• Partner with engineering teams on data modeling, ingestion and capacity planning
\n
• Work with users to keep data accurate and accessible
\n
• Serve as the go-to Big Data expert, advising users and developers on data questions
\n

\n

\n

What You'll Bring

\n

\n
• 5+ years in an established data engineering environment
\n
• 3+ years building Kafka streaming applications and/or managing Kafka clusters
\n
• 2+ years developing pipelines or applications on Big Data backends (S3, HDFS, Databricks, Iceberg, etc.)
\n
• Experience working in an "on-prem" / Linux environment is highly preferred
\n
• Experience with Apache Spark, Apache Flink or comparable tools
\n
• Strong Java, Python and SQL skills
\n
• Familiarity with common data science toolkits, particularly Python-based
\n
• Practical experience with Kubernetes and Docker
\n
• Exposure to monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
\n
• Solid statistical analysis skills
\n
• Proven troubleshooting and root-cause analysis ability
\n
• Unix scripting experience (bash, Python, etc.)
\n

\n

\n

About the Firm

\n

Our client is a research-led proprietary trading firm where quant modeling, machine learning and engineering drive how markets are traded. A steady liquidity provider for over three decades, the firm trades across global venues, delivering strong value and risk outcomes for investors. It runs on its own capital and in-house technology, building proprietary systems and algorithms. Researchers, traders and engineers work as one team, using fast experimentation, advanced infrastructure and real-time feedback to turn ideas into execution and execution into an edge.