Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Full-time

Robert Half

We are seeking a Lead Data Engineer to own the design, architecture, and delivery of scalable data platforms, AI‑powered data products, and enterprise‑grade data services. This role goes beyond hands‑on engineering and includes technical leadership, architectural decision‑making, and strong cross‑functional influence across the organization.

You will lead the development of end‑to‑end data ecosystems—including data ingestion, transformation pipelines, storage layers, APIs, and AI‑enabled services—leveraging modern cloud infrastructure and emerging AI/LLM capabilities. You will play a critical role in shaping how data is transformed into actionable insights and production‑grade tools that directly support investment decisions and client outcomes.

Key Responsibilities

  • Own the architecture and technical strategy for scalable, secure, and reliable data platforms
  • Lead the design and development of end‑to‑end data pipelines (batch and streaming) from ingestion to consumption
  • Build and support cloud‑native data platforms , including data lakes, warehouses, and analytics layers
  • Partner with data science and AI teams to productionize AI/ML and LLM‑enabled data products
  • Design and maintain APIs and data services used by downstream applications and analytics teams
  • Establish engineering best practices around data quality, observability, governance, and security
  • Serve as a technical leader and mentor , guiding engineers through design decisions and complex problem‑solving
  • Collaborate closely with product, analytics, investment, and business stakeholders to translate requirements into scalable technical solutions
  • Evaluate and introduce emerging technologies to continuously improve platform capabilities

Required Qualifications

  • 8+ years of experience in data engineering or platform engineering, with at least 2+ years in a technical lead or architect role
  • Strong experience designing and building cloud‑based data platforms (AWS, Azure, or GCP)
  • Deep expertise with SQL and Python , and strong experience with modern data processing frameworks
  • Proven experience designing data lakes, warehouses, and layered data architectures
  • Experience operationalizing AI/ML workloads , including data support for LLMs or advanced analytics
  • Strong knowledge of data modeling, ETL/ELT patterns, and performance optimization
  • Ability to influence architecture and technical direction across multiple teams

“Our specialized recruiting professionals apply their expertise and utilize our proprietary AI to find you great job matches faster.”

Vacancy posted 44 minutes ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Chicago, IL vacancy
  • $125k - $207k

     ...Lead Data Engineer As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud. Our developers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build products... 
    Suggested

    84.51°

    Chicago, IL
    4 days ago
  • $92k - $138k

     ...Role description Lead Data Engineer Lead II - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they... 
    Suggested
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Remote work
    Flexible hours

    UST Inc

    Chicago, IL
    4 days ago
  • $90k - $200k

     ...Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific...  ...our clients. Specific responsibilities for the Lead Machine Learning Engineer position include:... 
    Suggested
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech Consulting

    Chicago, IL
    4 days ago
  • $180k - $220k

     ...Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade data services. This role goes beyond hands-on engineering to include technical leadership, architectural... 
    Suggested
    Full time
    Work at office

    Harbor Funds

    Chicago, IL
    15 hours ago
  • $137.7k - $229.5k

    Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant...  ..., and fuel growth through innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will be responsible for:Support... 
    Suggested
    Local area

    Deloitte

    Chicago, IL
    4 days ago
  • DescriptionThe Data & AI Platform Engineer at Sabert Corporation is a hybrid role that plays a strategic and hands-on role at the intersection of...  ...our benefits click here.Learn More About Sabert:We are a leading global manufacturer of innovative food packaging products... 

    Sabert

    Chicago, IL
    4 days ago
  • $186k - $222k

     ...William Blair, the Premier Global Partnership.We are looking for a Lead AI Engineer to join a newly formed AI Innovation Function, part of the...  ...deployment patterns. You will work across the full stack—from data pipelines and ML models to LLM orchestration and Salesforce... 
    Temporary work

    William Blair

    Chicago, IL
    15 hours ago
  • $204.55k - $233.06k

     ...all the tools that makeup our enterprise data security program. In this role, you’ll work closely with endpoint security engineering, cyber defense, and insider risk operations...  ...with its subsidiaries and affiliates, is a leading global provider of real estate and... 
    Full time
    Local area
    Remote work

    Jones Lang LaSalle

    Chicago, IL
    3 days ago
  • $140k - $175k

    Position SummaryThe Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst, Data Analyst, IT Teams and key stake holders. This role will lead projects and coach... 
    Full time
    Work experience placement
    Work visa

    Ryan Specialty Group

    Chicago, IL
    2 days ago
  • $250k

     ...-ups across industries, and partner with leading global research organizations and universities...  ...From optimizing our core trading engine to building custom hardware, we leverage...  ...business needs. What You'll Do: Our data engineering internship is an intensive 10... 
    Full time
    Work experience placement
    Summer work
    Internship
    Visa sponsorship
    Work visa

    Jump Trading

    Chicago, IL
    15 hours ago
  • $155k - $175k

     ...Walker Sands is one of the fastest-growing integrated B2B marketing agencies in the world. We are looking for a Lead Data Engineer to help fuel that continued growth. The starting salary for this role is expected to be between $155,000 and $175,000 per year. Walker Sands... 
    Remote job
    Summer work
    Flexible hours
    Day shift

    Walker Sands

    Chicago, IL
    3 days ago
  • $125k - $207k

    84.51° Overview: 84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods...  ..._______________________________________________________   Lead Data Engineer (P3999) SUMMARY:   As a Lead Data Engineer, you will design... 
    Work at office

    84.51°

    Chicago, IL
    1 day ago
  •  ...Description Job Description Description: Hybrid At least 2 days per week in office in Chicago, IL   Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution, measurement, forecasting, and privacy-preserving... 
    Hourly pay
    Work at office
    Local area
    2 days per week

    Eliassen Group

    Chicago, IL
    8 days ago
  • $122.4k - $228k

     ...Application Deadline: 09/29/2026 Address: 320 S Canal Street Job Family Group: Data Analytics & Reporting Lead Data Engineer, Applied AI Data Ingestion & Integration (DII) team Team Overview We accelerate BMO’s AI journey by building enterprise-grade, cloud-native capabilities... 
    Full time
    Contract work
    Part time
    Local area

    Bank of Montreal

    Chicago, IL
    6 days ago
  • $27 - $42 per hour

     ...mindset, strong communication skills, advanced critical thinking, and the ability to navigate new challenges with confidence. As a Data Analytics Developer in Crowe’s Consulting Practice , your role will focus on designing and implementing data visualization and... 
    Hourly pay
    Internship
    Local area
    Immediate start
    Worldwide

    Crowe

    Chicago, IL
    1 day ago
  •  ...-day direction to a blended onshore/offshore engineering team. Design and develop Databricks-based batch and event-driven data solutions, including streaming ingestion, event...  ...model development and deployment. Lead design reviews, establish engineering standards... 
    Full time
    Work at office

    84.51˚

    Chicago, IL
    1 day ago
  • $94.4k - $293.8k

     ...About Accenture: Accenture helps the world's leading enterprises reinvent by building their digital core...  ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture Global

    Chicago, IL
    6 days ago
  • $140k - $190k

     ...employee engagement across the enterprise.Join our team as the expert you are now and create your future.We are looking for a Lead Data Engineer to provide technical leadership for our engineering team and take on one of our most strategically important challenges:... 
    Full time
    Local area
    Flexible hours

    Huron Consulting Group

    Chicago, IL
    15 hours ago
  •  ...by designing and implementing a scalable data architecture that enables better decision...  ...This hands-on individual contributor will lead the design and implementation of Guidant'...  ...technology initiatives.  Data Engineering & Architecture  ~ Design and implement Guidant... 
    Full time

    Guidant Power

    Chicago, IL
    a month ago
  •  ...I'm working with a top-tier hedge fund hiring multiple Data Center Operations Engineers in Chicago and Austin . Exceptional compensation + bonus 5 days onsite Mission-critical environment supporting some of the industry's most advanced infrastructure... 

    Private Company

    Chicago, IL
    12 days ago
  •  ..., IL V-Soft Consulting is currently hiring for a Senior Data Center Engineer for our premier client in Chicago, IL. Education and Experience...  ...professional experience ~7 years of managing experience leading IT engineering teams and environment ~10 years of... 
    Currently hiring
    Local area

    V-Soft Consulting Group, Inc.

    Chicago, IL
    25 days ago
  • $130k - $160k

     ...healthcare experiences at scale. Job Description The Senior Data Engineer designs, builds, and operates data pipelines and platform...  ..., performance tuning, and cost optimization in BigQuery. Lead development of efficient ELT pipelines using dbt Cloud, Python... 

    The Aspen Group

    Chicago, IL
    a month ago
  •  ...Data Centre Engineer, Low Latency Trading Location: Chicago, IL Type: Full time, Permanent Team: Infrastructure Operations / Trading Technology / Linux A leading global trading firm is seeking a hands on Data Centre Engineer to support the low latency infrastructure... 
    Permanent employment
    Full time
    Remote work
    Relocation
    Flexible hours

    Autonomai Recruitment

    Chicago, IL
    3 days ago
  •  ...Position: Data Engineer- Snowflake Location: Chicago, IL or Peoria, IL Travel required Duration: 6- 12 months Contract US Citizen/Green Card who are willing to work on W2 are advised to apply Job Description: ~ Looking for 12+ years in data engineering... 
    Contract work

    Delta System & Software, Inc.

    Chicago, IL
    15 hours ago
  •  ...Location: Chicago, IL (On-site) Employment Type: Internship Role Description This Financial Data Engineering Intern role at Solar Digital Agro LLC is an on-site position based in Chicago, IL. The intern will support the development and maintenance of financial... 
    Internship

    Solar Digital Agro LLC

    Chicago, IL
    a month ago
  • $150k - $175k

     ...Senior Data & AI Engineer | Python, Snowflake, dbt & Machine Learning Location: Downtown Chicago, IL | Hybrid, 3 Days Onsite Per Week...  ...****@*****.***. Lorie Gironda Senior Recruiting Lead | TalentFish ?? ****@*****.*** talentfish.com linkedin... 
    Full time
    Remote work
    Visa sponsorship
    2 days per week
    3 days per week

    TalentFish

    Chicago, IL
    15 hours ago
  •  ...Title: Senior Data Engineer (Python, AWS, Spark, Unix/Linux) Employment Type: Full-Time Location: Riverwoods, IL (Chicago Area)...  ...Senior Data Engineer (Python, AWS, Spark, Unix/Linux) to join a leading Financial Services organization. This role is ideal for professionals... 
    Full time
    Flexible hours

    Capgemini

    Chicago, IL
    12 days ago
  •  ...Job Title: Senior Data Engineer (Databricks) Primary Location: Chicago, IL (Hybrid – 3 days onsite / 2 days remote) Position Type:...  ...experience WHAT YOU'LL DO. (SKILLS USED IN THIS POSITION) Lead the design and build of scalable data pipelines and models in... 
    Full time
    Remote work
    3 days per week

    BinaryBees Business Solutions LLC

    Chicago, IL
    15 hours ago
  • $65 - $70 per hour

     ...person interview (In-person interview required)  Job Description: · We are seeking an experienced Senior Full Stack with Data Engineering with 8+ years of IT experience in designing, developing, and implementing scalable enterprise applications and data integration... 
    Contract work

    Long Finch Technologies

    Chicago, IL
    2 days ago
  • $300k

     ...-ups across industries, and partner with leading global research organizations and universities...  ...traders, quantitative researchers, and engineers who work together to examine the global...  ...impeccable statistical analysis and data mining skills, using the results of their... 
    Full time
    Internship
    Visa sponsorship
    Work visa

    Jump Trading

    Chicago, IL
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!