Lead Data Engineer
Robert Half
We are seeking a Lead Data Engineer to own the design, architecture, and delivery of scalable data platforms, AI‑powered data products, and enterprise‑grade data services. This role goes beyond hands‑on engineering and includes technical leadership, architectural decision‑making, and strong cross‑functional influence across the organization.
You will lead the development of end‑to‑end data ecosystems—including data ingestion, transformation pipelines, storage layers, APIs, and AI‑enabled services—leveraging modern cloud infrastructure and emerging AI/LLM capabilities. You will play a critical role in shaping how data is transformed into actionable insights and production‑grade tools that directly support investment decisions and client outcomes.
Key Responsibilities
- Own the architecture and technical strategy for scalable, secure, and reliable data platforms
- Lead the design and development of end‑to‑end data pipelines (batch and streaming) from ingestion to consumption
- Build and support cloud‑native data platforms , including data lakes, warehouses, and analytics layers
- Partner with data science and AI teams to productionize AI/ML and LLM‑enabled data products
- Design and maintain APIs and data services used by downstream applications and analytics teams
- Establish engineering best practices around data quality, observability, governance, and security
- Serve as a technical leader and mentor , guiding engineers through design decisions and complex problem‑solving
- Collaborate closely with product, analytics, investment, and business stakeholders to translate requirements into scalable technical solutions
- Evaluate and introduce emerging technologies to continuously improve platform capabilities
Required Qualifications
- 8+ years of experience in data engineering or platform engineering, with at least 2+ years in a technical lead or architect role
- Strong experience designing and building cloud‑based data platforms (AWS, Azure, or GCP)
- Deep expertise with SQL and Python , and strong experience with modern data processing frameworks
- Proven experience designing data lakes, warehouses, and layered data architectures
- Experience operationalizing AI/ML workloads , including data support for LLMs or advanced analytics
- Strong knowledge of data modeling, ETL/ELT patterns, and performance optimization
- Ability to influence architecture and technical direction across multiple teams
“Our specialized recruiting professionals apply their expertise and utilize our proprietary AI to find you great job matches faster.”
$125k - $207k
...Lead Data Engineer As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud. Our developers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build products...Suggested$92k - $138k
...Role description Lead Data Engineer Lead II - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they...SuggestedFull timeTemporary workPart timeWork at officeLocal areaRemote workFlexible hours$90k - $200k
...Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific... ...our clients. Specific responsibilities for the Lead Machine Learning Engineer position include:...SuggestedWork at officeRemote workVisa sponsorshipWork visaFlexible hours$180k - $220k
...Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade data services. This role goes beyond hands-on engineering to include technical leadership, architectural...SuggestedFull timeWork at office$137.7k - $229.5k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ..., and fuel growth through innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will be responsible for:Support...SuggestedLocal area- DescriptionThe Data & AI Platform Engineer at Sabert Corporation is a hybrid role that plays a strategic and hands-on role at the intersection of... ...our benefits click here.Learn More About Sabert:We are a leading global manufacturer of innovative food packaging products...
$186k - $222k
...William Blair, the Premier Global Partnership.We are looking for a Lead AI Engineer to join a newly formed AI Innovation Function, part of the... ...deployment patterns. You will work across the full stack—from data pipelines and ML models to LLM orchestration and Salesforce...Temporary work$204.55k - $233.06k
...all the tools that makeup our enterprise data security program. In this role, you’ll work closely with endpoint security engineering, cyber defense, and insider risk operations... ...with its subsidiaries and affiliates, is a leading global provider of real estate and...Full timeLocal areaRemote work$140k - $175k
Position SummaryThe Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst, Data Analyst, IT Teams and key stake holders. This role will lead projects and coach...Full timeWork experience placementWork visa$250k
...-ups across industries, and partner with leading global research organizations and universities... ...From optimizing our core trading engine to building custom hardware, we leverage... ...business needs. What You'll Do: Our data engineering internship is an intensive 10...Full timeWork experience placementSummer workInternshipVisa sponsorshipWork visa$155k - $175k
...Walker Sands is one of the fastest-growing integrated B2B marketing agencies in the world. We are looking for a Lead Data Engineer to help fuel that continued growth. The starting salary for this role is expected to be between $155,000 and $175,000 per year. Walker Sands...Remote jobSummer workFlexible hoursDay shift$125k - $207k
84.51° Overview: 84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods... ..._______________________________________________________ Lead Data Engineer (P3999) SUMMARY: As a Lead Data Engineer, you will design...Work at office- ...Description Job Description Description: Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution, measurement, forecasting, and privacy-preserving...Hourly payWork at officeLocal area2 days per week
$122.4k - $228k
...Application Deadline: 09/29/2026 Address: 320 S Canal Street Job Family Group: Data Analytics & Reporting Lead Data Engineer, Applied AI Data Ingestion & Integration (DII) team Team Overview We accelerate BMO’s AI journey by building enterprise-grade, cloud-native capabilities...Full timeContract workPart timeLocal area$27 - $42 per hour
...mindset, strong communication skills, advanced critical thinking, and the ability to navigate new challenges with confidence. As a Data Analytics Developer in Crowe’s Consulting Practice , your role will focus on designing and implementing data visualization and...Hourly payInternshipLocal areaImmediate startWorldwide- ...-day direction to a blended onshore/offshore engineering team. Design and develop Databricks-based batch and event-driven data solutions, including streaming ingestion, event... ...model development and deployment. Lead design reviews, establish engineering standards...Full timeWork at office
$94.4k - $293.8k
...About Accenture: Accenture helps the world's leading enterprises reinvent by building their digital core... ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve...Full timeWork experience placementLive inWork at officeLocal area$140k - $190k
...employee engagement across the enterprise.Join our team as the expert you are now and create your future.We are looking for a Lead Data Engineer to provide technical leadership for our engineering team and take on one of our most strategically important challenges:...Full timeLocal areaFlexible hours- ...by designing and implementing a scalable data architecture that enables better decision... ...This hands-on individual contributor will lead the design and implementation of Guidant'... ...technology initiatives. Data Engineering & Architecture ~ Design and implement Guidant...Full time
- ...I'm working with a top-tier hedge fund hiring multiple Data Center Operations Engineers in Chicago and Austin . Exceptional compensation + bonus 5 days onsite Mission-critical environment supporting some of the industry's most advanced infrastructure...
- ..., IL V-Soft Consulting is currently hiring for a Senior Data Center Engineer for our premier client in Chicago, IL. Education and Experience... ...professional experience ~7 years of managing experience leading IT engineering teams and environment ~10 years of...Currently hiringLocal area
$130k - $160k
...healthcare experiences at scale. Job Description The Senior Data Engineer designs, builds, and operates data pipelines and platform... ..., performance tuning, and cost optimization in BigQuery. Lead development of efficient ELT pipelines using dbt Cloud, Python...- ...Data Centre Engineer, Low Latency Trading Location: Chicago, IL Type: Full time, Permanent Team: Infrastructure Operations / Trading Technology / Linux A leading global trading firm is seeking a hands on Data Centre Engineer to support the low latency infrastructure...Permanent employmentFull timeRemote workRelocationFlexible hours
- ...Position: Data Engineer- Snowflake Location: Chicago, IL or Peoria, IL Travel required Duration: 6- 12 months Contract US Citizen/Green Card who are willing to work on W2 are advised to apply Job Description: ~ Looking for 12+ years in data engineering...Contract work
- ...Location: Chicago, IL (On-site) Employment Type: Internship Role Description This Financial Data Engineering Intern role at Solar Digital Agro LLC is an on-site position based in Chicago, IL. The intern will support the development and maintenance of financial...Internship
$150k - $175k
...Senior Data & AI Engineer | Python, Snowflake, dbt & Machine Learning Location: Downtown Chicago, IL | Hybrid, 3 Days Onsite Per Week... ...****@*****.***. Lorie Gironda Senior Recruiting Lead | TalentFish ?? ****@*****.*** talentfish.com linkedin...Full timeRemote workVisa sponsorship2 days per week3 days per week- ...Title: Senior Data Engineer (Python, AWS, Spark, Unix/Linux) Employment Type: Full-Time Location: Riverwoods, IL (Chicago Area)... ...Senior Data Engineer (Python, AWS, Spark, Unix/Linux) to join a leading Financial Services organization. This role is ideal for professionals...Full timeFlexible hours
- ...Job Title: Senior Data Engineer (Databricks) Primary Location: Chicago, IL (Hybrid – 3 days onsite / 2 days remote) Position Type:... ...experience WHAT YOU'LL DO. (SKILLS USED IN THIS POSITION) Lead the design and build of scalable data pipelines and models in...Full timeRemote work3 days per week
$65 - $70 per hour
...person interview (In-person interview required) Job Description: · We are seeking an experienced Senior Full Stack with Data Engineering with 8+ years of IT experience in designing, developing, and implementing scalable enterprise applications and data integration...Contract work$300k
...-ups across industries, and partner with leading global research organizations and universities... ...traders, quantitative researchers, and engineers who work together to examine the global... ...impeccable statistical analysis and data mining skills, using the results of their...Full timeInternshipVisa sponsorshipWork visa
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!







