Senior Data Engineer - Real-Time Data Pipelines (Kafka/Spark)
IMC Trading
IMC Trading in Chicago seeks an experienced Data Engineer to join our growth-driven data team. You will architect and deploy large-scale data systems, build streaming and batch pipelines, and collaborate on data modeling, ingestion, and capacity planning to ensure data integrity and availability across the organization. You will work with Java, Python, Spark, and Flink, leveraging Kubernetes and Docker for deployment while monitoring with Prometheus/Grafana. #J-18808-Ljbffr IMC Trading
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Real-Time Data Pipelines (Kafka/Spark) in Chicago, IL vacancy
- DRW is seeking a Senior Software Engineer for Cumberland/Options Data in Chicago. You will own data products, design time-series data pipelines, and build batch and real-time processing systems. Collaborate with traders and researchers, implement APIs for fast data access...PipelineSenior
- ...next generation of its data platform. As data... ...they're expanding the engineering team responsible for building... ...that powers real-time analytics, machine learning... ...and distributed data pipelines using modern Big Data... ...Hands-on experience with Kafka, Spark, Flink, or similar streaming...PipelineSenior
Fintal Partners
Chicago, IL12 days ago $162.7k - $199.3k
...the future of real estate for a better... ...them.The Data Engineering team builds and... ...data products and pipelines that power JLL’... ...increasingly real-time assets that... ...job involvesAs Senior Data Engineering... ...Azure, Python, and Spark. Guide... ...technologies such as Kafka and Spark...PipelineSeniorFull timeLocal areaJones Lang LaSalle
Chicago, IL4 days ago$125k
...Job Description Senior Data Engineer Salary - $125,... ...status quo and make a real impact for our... ...you'll build data pipelines and products that... ...knowledge of Apache Spark, Delta Lake and Databricks... ...Exposure to real-time streaming technologies such as Kafka or Event Hubs....PipelineSeniorSummer workWork at officeFlexible hoursRetail Insight
Chicago, IL1 day ago- Cboe Data Vantage is seeking an experienced software engineer to build and optimize real-time financial analytics software. You will work with quants and developers to model financial instruments and perform portfolio analysis, ensuring performance and reliability for...Senior
$140k - $170k
Chicago, VAHybridFull Time$140k - $170k Join a growing, data-driven... ...We are seeking a Senior Databricks Data Engineer to design, build,... ...PySpark and Apache Spark Advanced SQL development... ...building ETL/ELT pipelines at enterprise... ...Experience with Kafka or event-driven architectures...PipelineSeniorFull timeMotion Recruitment
Chicago, IL12 hours ago- ...development. The real magic happens when... ...implementation of scalable data architectures for... ...of robust data pipelines, manage secure and... ...complex feature engineering workstreams,... ...modern frameworks (Spark, LangChain, Databricks... ..., GCP)Exceptional time management and...PipelineSeniorApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
Chicago, IL4 days ago $110k - $160k
...access to dynamic tools, real-time support, and a... .... What you'll do:Your data-driven mindset and ability... ...an accomplished data engineer joining the Data & Analytics... ...beyond maintaining pipelines—it's about delivering... ...streaming technologies (e.g., Kafka, Spark Streaming, Flink) and...PipelineSeniorWork at officeRemote workWorldwideMonday to FridayFlexible hoursNinjaTrader Group
Chicago, IL1 day ago$137.4k - $161.7k
...West Monroe is seeking a Senior Data Engineer to join our Data & AI... ...develop scalable data pipelines, and establish trusted... ...data pipelines using Spark, SQL, Python, and... ...receive unlimited flexible time off and ten paid... ...our clients, delivering real-world solutions.The combination...PipelineSeniorLocal areaImmediate startFlexible hoursWest Monroe Partners
Chicago, IL1 day ago$215.2k - $244.7k
...Monroe is seeking a Senior Architect to... ...developing Big Data strategy and... ...and processing pipelines for analysis using... ...such as Spark on Scala, Storm... ...(LLMs), prompt engineering, embeddings, vector... ...unlimited flexible time off and ten... ...clients, delivering real-world solutions...PipelineSeniorLocal areaImmediate startFlexible hoursWest Monroe Partners
Chicago, IL3 days ago$157k - $187k
...Partnership.We are hiring a Senior AI Engineer to join a newly formed... ...across the full stack—data pipelines, ML models, LLM-... ...shipping fast, learning from real user feedback, and... ...training, and real-time analytics.Work directly... ...tools (Databricks, Spark), and pipeline orchestration...PipelineSeniorTemporary workImmediate startWilliam Blair
Chicago, IL4 days ago$120k - $165k
...strategies and enable real transformation to... ...your future.The Data Forge team is seeking... ...Analytics Platform Engineer to help design, build... ...and maintain data pipelines supporting... ...solutions using Python, Spark, and AWS services.Support... ...: Chicago - 550 Van BurenType: Full timePipelineSeniorFull timeHuron Consulting Group
Chicago, IL4 days ago$169.28k - $211.6k
...implementation of scalable data ingestion frameworks using... ...Oversee and scale batch and real-time ingestion pipelines (e.g., via Event Hub, Service Bus, Kafka). Define and standardize... ...high‑performing team of data engineers, including senior engineers and/or technical...PipelineSeniorTemporary workWork at officeFlexible hoursIndependence Pet Group
Chicago, IL5 days ago$112.9k - $188.1k
...wellbeing. 18 paid time off (PTO) days... ...'s Central Data Platform team has... ...data engineering function into a... ...reliable, governed, real-time and batch... ...and operate the pipelines, data assets, semantic... ...Will As the senior technical engineer... ...using Spark, Python, Scala,...PipelineSeniorFull timeH1bLocal areaWorldwideShift work$140k - $165k
Chicago, IllinoisHybridFull Time$140k - $165k A well-established, global... ...organization is expanding its Data & AI engineering team and hiring a Data Engineer... ...on building modern data pipelines using Azure Databricks, Python, SQL, and Spark in a production environment. This...PipelineSeniorFull timeImmediate startMotion Recruitment
Chicago, IL1 day ago- ...150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to... ..., and customer lifecycle analysisDesign and automate data pipelines for real-time and batch processing of behavioral dataBuild scalable analytical...PipelineSeniorWork at officeRemote work
Interactive Brokers
Chicago, IL12 hours ago $125k - $180k
...entire ecosystem of real-world evidence to deliver real-time, actionable insights... ...Patient Evaluation Engine: a high-scale, multi... ...reason over clinical data to drive real-time clinical... ...are looking for a Senior Data Engineer to... ...underneath it — the pipelines, models, and...PipelineSeniorFull timeTempus
Chicago, IL12 hours ago$140k - $180k
...shaping the future of real estate for a better world... ...forward. About JLL and Data EngineeringJLL is a... ...our communities.The Data Engineering team at JLL sits at the... ...compose into larger agentic pipelines• Implement and extend... ...at 100% of salary Paid Time Off and Company...PipelineSeniorFull timeLocal areaShift workJones Lang LaSalle
Chicago, IL3 days ago- ...entire ecosystem of real-world evidence to deliver real-time, actionable... ....We are seeking a Senior Software Engineer to help design, build... ...and other patient data into research-ready... ...and scale the data pipelines and event-driven services... ...in Python, Spark, dbt, SQL, AirflowExperience...PipelineSeniorFull timeFlexible hours
Tempus
Chicago, IL3 days ago - ...helping organizations modernize data ecosystems, build real-time analytics capabilities,... ....You AreA hands-on Engineer with foundational experience... ...with clients, supporting senior architects, and contributing... ...architecture design, build data pipelines and models, perform...PipelineSeniorFull timeWork experience placementLive inWork at officeLocal area
Accenture
Chicago, IL3 days ago $136k - $153k
...some of our recent announcements.Senior Data Engineer at SpotHero:SpotHero is seeking a... ...layer up to the API.Build robust pipelines that make sure data is where it needs... ...and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience...PipelineSeniorCasual workWork at officeImmediate startFlexible hoursSpotHero
Chicago, IL12 hours ago$175k - $225k
...traditional strategies: real estate, venture... ...the TeamThe DRW C/FICCO Data Engineering team is essential to developing... ...processing and real-time streaming of time... ...systemsExperience with pipeline orchestration frameworks... ...platforms (e.g. Kafka), data lake platforms...PipelineSeniorTemporary workFlexible hoursDRW
Chicago, IL3 days ago- ...Tempus seeks a Senior Data Engineer to build and operate the data platform for a multi-modal healthcare AI system. The role spans pipeline development, warehouse management, cloud infrastructure... ..., genomics, and imaging data for real-time agent evaluation Own BigQuery...PipelineSenior
Ambry Genetics
Chicago, IL2 days ago $101.7k - $119.6k
...is seeking a talented Data Engineer to join our Data... ...documentation, data ingestion pipeline development, and... ...strategies Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and... ...unlimited flexible time off and ten paid... ...clients, delivering real-world solutions.The combination...PipelineLocal areaImmediate startFlexible hours2 days per weekWest Monroe Partners
Chicago, IL3 days ago$126.58k - $164.55k
...seeking a highly skilled Senior Analytics Engineer to serve as a technical... ...business intelligence, data engineering, commercial real estate, and artificial intelligence... ..., you will design data pipelines, build semantic models,... ...for eligible Full-time employees: Medical/...PipelineSeniorFull timeTemporary workThe Inland Real Estate Group of Companies
Oak Brook, IL4 days ago$190k - $225k
...leading commercial real estate... ...Computer Science, Engineering, MIS, or... ...experience in data engineering or... ...and pipelines at scale.Expert... ...streaming/real-time data processing (e.g., Kafka, Event Hubs,... ...Kinesis, Flink, Spark Structured Streaming... ...and coach senior and mid-level...PipelineTemporary workLocal areaFlexible hoursNewmark
Chicago, IL3 days ago$99k - $164.8k
...services are making a real difference to our... ...is seeking a Data Quality Engineer specializing in... ...principles.As a senior member of the data... ...integrity across pipelines and platforms, implementing... ....Experience with Spark, Kafka, Airflow, DBT,... ...; Remote-RI; Remote-NJType: Full timePipelineFull timeWork experience placementWork at officeLocal areaRemote workKemper Corporation
Chicago, IL3 days ago$229k - $309k
...shaping the future of real estate for a... ...forward. Sr. Director, Data Engineering (REMS)About JLL... ...data platforms and pipelines that power REMS... ...depend on accurate and timely data, and... ...architecture review with senior engineers as you... ...experience with PySpark/Spark; demonstrated...PipelineSeniorFull timeLocal areaJones Lang LaSalle
Chicago, IL2 days ago$137.45k - $231k
...Internet of Things (IoT) data to develop... ...and Analytics (MDA) Engineering team, you will... ...architect core Databricks pipelines, Gold Layer tables... ...will result in real-world impact -... ...ships.Serve as the senior technical lead for... ...base salary for full-time employees for this...PipelineSeniorFull timeRemote workFlexible hoursSamsara
Chicago, IL2 days ago$175k - $225k
...dedicated and experienced Data Engineer to join our Chicago... ...Data environment (Kafka, Hadoop, Dremio, etc... ...our data processing pipelines (Java, Python, Spark, Flink) Collaborate... ...; all full-time, permanent positions... ...infrastructure, and real-time feedback to turn...PipelinePermanent employmentFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Real-Time Data Pipelines (Kafka/Spark). Be the first to apply!
Related searches
- big data cloud engineer Chicago, IL
- entry level big data engineer Chicago, IL
- senior data quality engineer Chicago, IL
- data engineer graduate Chicago, IL
- senior cloud data engineer Chicago, IL
- software data engineer Chicago, IL
- data infrastructure engineer Chicago, IL
- data engineer manager Chicago, IL
- senior data center engineer Chicago, IL
- principal data engineer Chicago, IL