Senior Market Data Engineer - Python

Location: Chicago, New YorkDepartment: TechnologyExperience Level: Experience ProfessionalsContact: Ashley RezinJob ID: REQ8361ROLE OVERVIEW We are looking for an experienced Senior Market Data Engineer to join our team. The ideal candidate will have a strong background in Python, cloud technologies, and extensive experience working with tick data and building robust tick data pipelines. Experience with Parquet-based file storage is required, and familiarity with Apache Iceberg is a significant plus. The role involves designing, implementing, and maintaining our market data processing systems, ensuring high availability, performance, and scalability. RESPONSIBILITIES Design and develop high-performance tick data pipelines to process and analyze large volumes of financial market data. Work with timeseries databases (e.g., KDB, OneTick) to store, query, and manage tick data efficiently. Utilize cloud technologies to optimize data processing and storage solutions. Leverage Parquet-based file storage for efficient data storage and retrieval. (Preferred) Integrate and manage data using Apache Iceberg for large-scale data lake management. Collaborate with other engineers and trading teams to define data requirements and integrate market data into our products and services. Ensure data quality and integrity by implementing robust data validation and error handling mechanisms. Continuously improve data processing latency and throughput to meet the needs of high-frequency trading environments. Develop and maintain documentation for data pipelines and architectures. QUALIFICATIONS Bachelor’s degree in Computer Science, Engineering, or a related field. 8+ years of experience in software engineering with a focus on market data. Proficient in Python and familiar with cloud platforms (AWS, GCP, Azure). Experience with Kubernetes and containerization. Demonstrated experience with tick data and building tick data pipelines. Experience with Parquet-based file storage is required. Experience with Apache Iceberg is a plus. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Experience working with timeseries databases (e.g., KDB, OneTick) and C++ is a plus. Experience with financial markets and trading concepts is a plus.