Senior Data Engineer: Scalable Batch & Streaming Pipelines
Jobot
Jobot is seeking a Lead Data Engineer in Chicago, IL to own design and expansion of our data platform, driving batch and streaming pipelines across hybrid cloud using Kubernetes, Kafka, and Databricks. You will mentor engineers, deliver high-quality code, and ensure data quality and SLAs in a fast-paced, Agile environment. Requirements include 5+ years in software/data engineering, Java/Scala, Python, and hands-on AWS cloud experience; familiarity with Delta Lake, Spark, Kubernetes, and data #J-18808-Ljbffr Jobot
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Scalable Batch & Streaming Pipelines in Chicago, IL vacancy
- Publicis Sapient in Chicago Hybrid is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across batch and streaming pipelines on cloud platforms. You will work with clients to translate requirements into data architectures...PipelineSenior
- Above Lending, a forward-thinking fintech in Chicago, seeks a Senior Data Engineer who writes SQL, builds pipelines, and analyzes raw data. You will own end-to-end data flows, design scalable models, and ensure data quality across stages. Strong SQL and Python skills, plus...PipelineSenior
- Above Lending in Chicago seeks a Senior Data Engineer who acts like an owner, writing SQL, building pipelines, and turning raw data into reliable, scalable solutions. This is a deeply hands-on role focused on data quality and practical results. In this role you’ll work...PipelineSenior
$135k - $165k
Job Description As a Senior Data Engineer/ Lead Engineer, you will be responsible for designing... ..., developing, and maintaining scalable Big Data solutions. You will work... .... Build and optimize batch and streaming data pipelines across modern cloud data platforms...PipelineSeniorContract workSapient
Chicago, IL2 days ago$175k - $225k
...Team The DRW C/FICCO Data Engineering team is essential to developing... ...valuable datasets and scalable data infrastructure... ...maintain systems for both batch processing and real-time streaming of time series datasets,... ...Experience with pipeline orchestration frameworks...PipelineSeniorFull timeTemporary workWork experience placementFlexible hoursDrw Inc
Chicago, ILmore than 2 months ago$160k - $220k
A leading technology firm in Chicago seeks a Senior Data Engineer to develop and manage extensive data products aligned with their innovative vision. Responsibilities encompass designing data pipelines, ensuring data security and compliance, and collaborating with cross...PipelineSenior$112.9k - $188.1k
...Grainger's Central Data Platform team... ...data engineering function into a... ...real-time and batch data products across... ...and operate the pipelines, data assets, semantic... ...problems into scalable data and AI-... ...Will As the senior technical engineer... ...in batch and streaming data...PipelineSeniorFull timeH1bLocal areaWorldwideShift workZoro Tools
Chicago, IL3 days ago- ...Chicago, IL Our client seeks a Senior Data Engineer to design, build, and operate large... ...Build and operate trusted data pipelines across secure cloud environments such... .... Build, schedule, and maintain scalable batch and streaming data workflows with orchestration frameworks...PipelineSeniorHourly payWork at officeLocal area2 days per week
Eliassen Group
Chicago, ILa month ago - Senior Data Engineer Location - Chicago, IL (3 days onsite mandatory) Rate - 65-70 Databricks... ...will design, build, and optimize scalable data pipelines and solutions leveraging... ...using Databricks and Delta Lake for batch and streaming data. Develop and maintain ETL/ELT...PipelineSenior
- Publicis Sapient is seeking a Senior Associate Data Engineer in Chicago with a hybrid work model. You will design, develop, and maintain scalable Big Data solutions, working with real-time... ...responsibilities include building end-to-end data pipelines, modernizing data platforms, and...PipelineSenior
$150k - $190k
...undertaking a major enterprise-wide Data & AI modernization... ...production-grade data pipelines, and helping establish engineering standards within a growing... ...downstream consumption. Develop scalable ETL/ELT solutions supporting both batch and streaming/CDC workloads. Build...PipelineSenior- Tiger Analytics is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on AWS. You will collaborate with data scientists, analysts, and AI teams to support analytics, machine learning, and Generative AI initiatives...PipelineSenior
- Hopscotch Primary Care is hiring a Senior Data Engineer to own and evolve the backbone of our data platform. This hands‑on role... ...day operations and AI applications. You will lead data pipelines, governance, and scalable data solutions, partnering with product, analytics,...PipelineSeniorRemote job
- Tiger Analytics is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines on AWS, collaborating with data scientists and AI teams. You will work with S3, Glue, Lambda, Redshift, Databricks, Spark, and Airflow to support pharma data...PipelineSenior
$88.9k - $165.1k
Publicis Groupe is looking for a Senior Data Engineer to join their team in Chicago, Illinois. The role involves troubleshooting production issues, building scalable data products, and improving cloud data platforms using technologies like Databricks and AWS. Ideal candidates...PipelineSenior$148k - $164k
Senior Data Engineer (Azure Databricks) Location: Chicago, IL (Hybrid 3 days onsite, 2 days remote) Job Type: Full-Time... ...experience designing, building, and maintaining scalable end-to-end data pipelines in modern cloud environments, with expertise in Azure...PipelineSeniorFull timeLocal areaRemote work3 days per weekFinoit Inc
Chicago, IL1 day ago- Senior Data Engineer - AI Systems Employment Type: Full-time Company: Permute... ...into reliable, scalable systems. We care as much... ...quickly, and build robust pipelines and infrastructure in a fast... ...production data platforms Streaming and batch data processing systems Data...PipelineSeniorFull time
- ...Job Title: Senior Data Engineer Location: Chicago, IL Experience: 10+... ...design, development, and maintenance of scalable, high-performance data solutions focused... ...automated, cost-efficient, and complex data pipelines. The ideal candidate will be a...PipelineSeniorFull timeRemote workMonday to Friday
Argyll Infotech, Inc.
Chicago, IL3 days ago $50 - $52.5 per hour
...Title: Senior Data Reporting Engineer Location: Deerfield, IL – Hybrid (4 Days... ...develop, automate, and optimize scalable data solutions supporting... ...Databricks, SQL, CI/CD pipelines, and development/DevOps... ...data feeds, or automated batch processes. Experience with...PipelineSeniorHourly payFull timeContract workTemporary workLocal areaRemote workChicago, ILa month ago- ...Hybrid Data Analyst Role This is Hybrid role (3 days in office / 2 day remote) About Interactive... ...analysis Design and automate data pipelines for real-time and batch processing of behavioral data Build scalable analytical infrastructure for reporting and visualization...PipelineSeniorWork at officeRemote work
Interactive Brokers
Chicago, IL1 day ago $10k
...fairlife.com. job purpose : The Sr. Data Engineer will play a key role in delivering... ...designs, builds, and operates the pipelines, data models, and reusable frameworks... ...Design, implement, and operationalize batch and streaming data pipelines that integrate...PipelineSeniorTemporary workWork at officeLocal area3 days per weekfairlife
Chicago, IL16 days ago$140k - $170k
...ABOUT THE ROLE We are looking for a Senior Data Engineer (remote) to own and evolve the backbone... ..., and maintain our data model, data pipelines, and data access layer that support our... ...to translate business needs into scalable data solutions. ABOUT YOU You would...PipelineSeniorTemporary workLive inRemote workFlexible hoursHopscotch Primary Care
Chicago, IL24 days ago$180k - $200k
Harbor Capital Advisors, Inc. is seeking a Lead Data Engineer to drive the design and delivery of scalable data platforms and AI-powered products. This role includes technical leadership and collaboration across teams in a hybrid work environment based in Chicago. The...PipelineSenior- ...services organization is expanding its Data & AI engineering team and hiring a Data Engineer to... ...Chicago and focuses on building modern data pipelines using Azure Databricks, Python, SQL,... ...Jobs/Workflows Exposure to streaming or CDC pipelines Experience supporting...PipelineSeniorFull timeImmediate start
- ...systems are continually re-engineered, optimized, and... ...looking for a proven Senior Data Engineer to work directly... ...architect robust and scalable analytical solutions.... ...services, including ETL pipeline implementation, data warehouse... ...and with developing a stream processing framework,...PipelineSenior
Belvedere Trading
Chicago, ILa month ago - ...now investing in the data foundation that... ...What You'll Do As a Senior Data Engineer on the Data & Analytics... ...goes well past pipeline maintenance: you will... ...data architecture, scalable workflows, and real... ...across both batch and real-time streaming use cases, including...PipelineSenior
- ...projects across Data, AI, Cloud, and Software Engineering. Our expertise in... ...are seeking a Senior Data Engineer with... ...on execution of scalable data platforms and pipelines. You will bridge... ...processes, batch data, and industrial... ...record building streaming and batch data architectures...PipelineSeniorFull timeContract workFor contractors3 days per week
- Senior Databricks Architect / Lead Data Engineer Location: Westchester, IL Duration: 6-12 Months... ...deep expertise in building scalable data engineering... ...and optimize complex data pipelines using PySpark and Databricks... ...platforms. Familiarity with streaming architectures, real-time...PipelineSenior
$199.1k - $223.4k
...West Monroe is seeking a Senior Architect to join our... ...developing Big Data strategy and roadmaps,... ...data flow and processing pipelines for analysis using modern... ...and implement scalable AI/ML and Generative AI... ...Models (LLMs), prompt engineering, embeddings, vector databases...PipelineSeniorLocal areaImmediate startFlexible hoursWest Monroe
Chicago, IL2 days ago$80.8k
...Data Engineer Job Locations US-IL... ...platform into a scalable, self-service data... ...with project teams, senior data engineers, architecture... ...cloud-based data pipeline development,... ..., and supporting batch and near-real-... ...CDC) concepts Streaming data fundamentals...PipelineFull timeTemporary workCasual workLive inWork at officeRemote workNight shiftWeekend workGATX
Chicago, IL4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Scalable Batch & Streaming Pipelines. Be the first to apply!
Related searches
- data engineer contract Chicago, IL
- big data cloud engineer Chicago, IL
- big data developer Chicago, IL
- finance data engineer Chicago, IL
- software data engineer Chicago, IL
- data engineer intern Chicago, IL
- hadoop big data developer Chicago, IL
- data engineer machine learning Chicago, IL
- senior data quality engineer Chicago, IL
- data visualization developer Chicago, IL