Lead Data Engineer: Build Large-Scale Data Pipelines & AI
Capital One
Capital One is seeking a Lead Data Engineer in Chicago, IL. You will help design large-scale data pipelines, collaborate with Agile teams, and mentor peers while leveraging Python, Spark, AWS, Snowflake, and Airflow to enable data-driven marketing decisions for millions of customers. The role emphasizes full-stack, cloud-based solutions, real-time data, and high-performance engineering in a fast-paced environment with a focus on innovation and impact. #J-18808-Ljbffr Capital One
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Build Large-Scale Data Pipelines & AI in Chicago, IL vacancy
- ...hands-on Senior / Lead Data Engineer to provide technical... ...the platforms, pipelines, and data products... ...services, plugins, and AI-enabled workflows... ...support across a large and growing... ...Significant experience building and operating production... ...modeling, large-scale dataset...Pipeline
$98k - $182k
A leading global marketing firm in Chicago seeks an experienced Data Engineer to build and maintain robust data pipelines. The ideal candidate will have over 5 years of experience in big data environments, utilizing technologies such as Apache Spark and AWS. Your contributions...Pipeline$98k - $182k
A leading advertising technology firm in Chicago is looking for a Senior Data Engineer to work on their Epsilon Activation Delivery Platform. This role involves building and maintaining data pipelines, optimizing data connectors, and mentoring junior engineers. Candidates...Pipeline$159.1k - $265.1k
...Our Deloitte AI & Engineering team works to transform... ...You’ll Do As a Lead AI and Data Science Engineer... ...and oversee data pipelines, model training workflows... ....Ability to build and sustain... ...they can mature and scale effectively with... ...experience working with large language models,...PipelineLocal area- ...Chicago, IL Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution,... ...Design and operate trusted data pipelines handling advertiser, customer,... ...artificial intelligence (AI) tools as part of its initial application...PipelineHourly payWork at officeLocal area2 days per week
Eliassen Group
Chicago, IL10 days ago $179.4k - $204.7k
## Lead Data EngineerApplylocations: Chicago, ILtime... ...EngineerDo you love building and pioneering in the... ...We are seeking Data Engineers who are passionate about... ...team builds robust, large-scale data pipelines using massive datasets... ...utilizing advanced AI tools to accelerate your...PipelineFull timePart timeInternshipH1bLocal area$128.47k - $208.77k
...Together, we are building a better... ...connects machines, data, and people... ..., and AI, we deliver solutions... ..., at global scale.You’ll build... ...where engineers like you can... ...SummaryAs a Lead Data Engineer... ...scalable data pipelines, microservices... ...experience on modern, large scale,...PipelineFull timePart timeWork at officeRelocationVisa sponsorshipRelocation packageFlexible hours- ...seeking a technical lead to own the full... ...design and ship agentic pipelines, remember and reason over data, and integrate... ...step tasks. You will build evaluation frameworks... ...vector stores, and scale deployments in... ...Collaboration with AI engineers, ML scientists, and...Pipeline
Lenovo
Chicago, IL2 days ago - ...Flexibility: RemoteAs a Senior Lead, Data Engineering, you will serve as a... ...the organization to build scalable, high-impact... ..., Azure DevOps, CI/CD pipelines, and infrastructure... ...and implement AI-enabled approaches that... ...analytics ecosystems at scale.Hands-on experience with...PipelineFull timeFor contractorsRemote work
$140k - $160k
...Responsibilities Lead the design and architecture... ...of end-to-end data pipelines and solutions on... ...and guide data engineers by promoting technical... ...and implement AI‑enhanced data pipelines... ...role architecting large‑scale data platforms.... ..., Springboot for building cloud‑native data...PipelineTemporary workWorldwideShift work2 days per week- ...TitleMust have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda... ...businessResponsibilities:• Lead data warehouse development... ...to apply.• Design and build large scale datasets for a wide range of... ...implement highly efficient data pipelines using a variety of technologies...Pipeline
Omni Inclusive
Chicago, IL2 days ago $128.47k - $208.77k
...Technology, Digital and Data Job Description... ..., we are building a better world,... ...build industry leading digital... ...telematics, and AI capabilities to... ...Senior Lead Data Engineer on the Data Engineering... ...Python data pipelines that build... ...control on medium to large teams Deploying...PipelineWorldwideRelocation packageCaterpillar Brazil
Chicago, IL3 days ago- ...Lead Data Engineer Firm Overview Hinshaw & Culbertson LLP is a... ...responsible for designing, building, and operating... ...This role owns core data pipelines, data models, and production... ..., and emerging AI initiatives. Essential... ...to work on enterprise-scale technology initiatives...PipelineCasual work
Hinshaw & Culbertson
Chicago, IL2 days ago $98k - $182k
...Delivery Platform team builds the core... ...-impact team of engineers operating at massive scale—trillions of user... ...flow through our pipelines every month. By... ...directly connects our data ecosystem to the... .... Pioneer AI-Assisted Engineering... ...the world's leading brands the data,...PipelineTemporary workFreelanceLocal areaFlexible hoursDigitas
Chicago, IL3 days ago$98k - $182k
...Epsilon Activation Delivery Platform team seeks a senior engineer to build and maintain high-scale data pipelines and integrations with major advertising and CTV... ...code using Spark (Scala/Python) and SQL Leveraging AI-assisted engineering tools Optimizing data connectors...PipelineFull timeFlexible hours$111.8k
Overview Lead Data Engineer | Build the Future of Data at GATX Remote (Chicago-area... ...to do more than just build pipelines on Databricks and AWS. You... ...analytics, reporting, and AI across the company.... ...in designing, building, and scaling data pipelines. Strong hands...PipelineTemporary workWork at officeRemote work$98k - $182k
...Delivery Platform team builds the core... ...‑impact team of engineers operating at massive scale—trillions of user... ...flow through our pipelines every month. By... ...directly connects our data ecosystem to the... .... Pioneer AI‑Assisted... ...Mentorship & Quality: Lead code reviews, enforce...Pipeline- DescriptionThe Data & AI Platform Engineer at Sabert Corporation is... ...responsible for designing, building, and optimizing... ..., reliable data pipelines integrating structured... ...frameworks, including large language models (... ...About Sabert:We are a leading global manufacturer...Pipeline
$128.47k - $208.77k
...Technology, Digital and Data Job Description... ..., we are building a better world,... ...build industry leading digital... ...telematics, and AI capabilities to... ...Senior Lead Data Engineer on the Data Engineering... ...Python data pipelines that build... ...control on medium to large teams Deploying...PipelinePart timeWorldwideVisa sponsorshipRelocation packageFlexible hours- ...Chicago is looking for a Senior Data Engineer to empower the company with... ...role involves selecting and building solutions using tools like... ...best practices for data pipelines. The ideal candidate will have... ..., alongside a background in large-scale distributed infrastructures...PipelineFull time
$180k - $200k
...DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture... ...of scalable data platforms, AI-powered data products, and... ...ecosystems—including data pipelines, storage, APIs, and AI-... ...client outcomes.In addition to building, you will mentor engineers,...PipelineFull timeWork at office- ...Caterpillar Inc. in Chicago, IL seeks a Lead Data Engineer for the Physical AI Platform. You will design, build, and maintain scalable data pipelines and microservices, collaborating with software engineers and data architects in an agile environment. Key responsibilities...Pipeline
Caterpillar Brazil
Chicago, IL1 day ago $90k - $200k
...Machine Learning Engineers are responsible... ...and implementing data-driven solutions... ...focus on building and deploying scalable... ...responsibilities for the Lead Machine Learning... ...transforming large datasets hosted... ...production-scale machine learning... ...RAG, and agentic AI architectures...Work at officeRemote workVisa sponsorshipWork visaFlexible hours$145.2k
...of the world’s leading brands and their... .... Design, build, and lead the evolution... ...enterprise data platform on AWS... ..., and future AI capabilities... ...production-grade data pipelines and processing... ...team of data engineers and cross-... ...including production-scale data lake or...PipelineFlexible hoursCoates Group
Chicago, IL8 days ago- ...Lead Data EngineerLocations: Richmond - VA / McLean -... ...deployment of scalable data engineering solutions that deliver... ...and implement data pipelines and workflows.Ensure... ...clients, enabling them to scale with flexibility,... ...digital experiences and build lifelong relationships...PipelineWork at office
InterSources
Chicago, IL3 days ago - ...modernizing its enterprise data platform to better... ...-making, and future AI capabilities across the... ...are seeking a hands-on Lead Data Engineer to lead the design,... ...unique opportunity to help build the foundation of TMH'... ...Design scalable data pipelines, data models, and...PipelineWork at officeRemote work2 days per week3 days per week
Tokio Marine Highland
Chicago, IL4 days ago $140k - $170k
...Join a growing, data-driven... ...Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions... ...enjoys solving large-scale data challenges... ...building ETL/ELT pipelines at enterprise scale... ...supporting AI, Machine Learning... ...engineers or leading technical initiatives...PipelineFull time$150k - $200k
...: (***) ***-****Data Engineer - Quantitative Trading... ...a high-caliber Data Engineer to join a... ...data ingestion pipelines to onboard both vendor... ...and apply AI-ready annotations... ...hands-on experience building and managing complex... ...control frameworks for large-scale financial datasets...PipelineFlexible hours$205k - $235k
...EY and help to build a better... ...with innovative AI-powered technology... ...applied AI engineering to deliver scalable... ...enterprise data assets to produce... ...Lead the build and scaling of neuro‑symbolic... ...patterns, and data pipelines. Direct cross... ...with large-scale cloud architectures...PipelineWork experience placementSummer holidayWork at officeFlexible hoursEY
Chicago, IL1 day ago$140k - $165k
...professional services organization is expanding its Data & AI engineering team and hiring a Data Engineer to support a large-scale cloud data platform initiative. This role is based in Chicago and focuses on building modern data pipelines using Azure Databricks, Python, SQL, and...PipelineFull timeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Build Large-Scale Data Pipelines & AI. Be the first to apply!
Related searches
- data engineer analytics Chicago, IL
- principal data engineer Chicago, IL
- senior cloud data engineer Chicago, IL
- data center engineer Chicago, IL
- director data engineering Chicago, IL
- data engineer graduate Chicago, IL
- big data devops engineer Chicago, IL
- azure data engineer Chicago, IL
- data engineer manager Chicago, IL
- sr data engineer Chicago, IL