Lead Data Engineer
$120k - $200kTata Consultancy Services
Lead Data Engineer
Must Have Technical/Functional Skills Data Bricks, DBT, Airflow, Roles & Responsibilities Lead Data Engineer Experience 8–15 Years
Role Overview: We are looking for a highly skilled Lead Data Engineer with strong hands-on experience in Databricks, dbt, and Python, and a proven track record of leading and executing data platform migration and modernization programs. The ideal candidate will have experience migrating legacy data warehouses, ETL platforms, and cloud/on-prem data ecosystems to a modern Databricks Lakehouse architecture using dbt-based transformation frameworks. This is a hands-on leadership role requiring deep technical expertise, solution design capabilities, and the ability to mentor engineering teams while driving enterprise-scale data modernization initiatives.
Key Responsibilities:
- Data Engineering & Development
- Design, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python.
- Develop and optimize ELT/ETL processes for large-scale data ingestion and transformation.
- Implement robust data quality, monitoring, and reconciliation frameworks.
- Build reusable data engineering components and frameworks.
Data Platform Migration & Modernization
- Lead migration of legacy data platforms, data warehouses, and ETL ecosystems to Databricks Lakehouse.
- Transform existing ETL workloads to modern ELT patterns using dbt.
- Analyze source environments and define migration approaches, roadmap, and execution strategy.
- Drive code conversion, performance optimization, and workload modernization efforts.
Databricks Engineering
- Develop solutions leveraging: Databricks Lakehouse Platform, Delta Lake, Unity Catalog, Databricks Workflows, Structured Streaming, Medallion Architecture (Bronze, Silver, Gold)
- Optimize Spark jobs and Databricks workloads for performance and cost efficiency.
dbt Development
- Build and maintain dbt models, macros, tests, and documentation.
- Implement incremental processing and reusable transformation frameworks.
- Establish data lineage, testing, and CI/CD best practices.
- Work closely with business and analytics teams to build trusted datasets.
Leadership & Collaboration
- Lead a team of data engineers and developers.
- Perform code reviews and enforce engineering standards.
- Collaborate with architects, product owners, business analysts, and stakeholders.
- Mentor junior engineers and drive adoption of best practices.
Salary Range- $120,000-$200,000 a year
Location: Irvine, CA
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Irvine, CA vacancy
- ...Cotality is hiring a Data Engineer to build scalable batch and streaming data pipelines on Google Cloud Platform. You will drive architecture, deliver reusable data capabilities, and lead technical work across large enterprise initiatives. Ideal candidates have 7+...SuggestedFlexible hours
- ...Cotality is seeking a Principal Data Engineer to lead scalable data pipelines and architecture in our Irvine, CA and Dallas, TX environments. You will drive design and delivery of enterprise-grade data capabilities across the company, leveraging GCP, Dataflow, BigQuery...Suggested
$160k - $198k
...Archipelago Companies' portfolio of brands (OluKai, Melin, Roark) and international subsidiaries (Arch-UK, Arch-EU). We're hiring a Lead Data Engineer to own our data infrastructure end to end: building the pipelines that bring data in from across the business, running our...SuggestedWork at office1 day per weekOluKai
Irvine, CA4 days ago$118.8k - $161.9k
...you care about.Workday PSA & Financials Data EngineerArmanino is proud to be among the... ...and aiding in the decision-making process.Lead and execute data analysis, transformation... ...escalation by partnering with cross team engineers on Workday design decisions.Collaborate with...SuggestedFull timeContract workLocal areaArmanino
Irvine, CA1 day ago$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ..., not years.ABOUT THE TEAMAs a Data Engineer on the Analytics Team, you will be... ...Dagster.Operate in a "player-coach" capacity, leading members of the team, while remaining hands...SuggestedFull timeWork experience placementImmediate startShift workAnduril Industries
Costa Mesa, CA21 hours ago$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving... ...sector solutions in software, data, AI, network, and hybrid cloud infrastructure... ...sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage...Local areaVisa sponsorshipDeloitte
Costa Mesa, CA3 days ago$105.4k - $207.8k
...Transformation (I&DT) practice. I&DT brings an engineering- and innovation-led mindset to how... ...and scales technology-enabled solutions. Data Studio is Converge for Healthcare's foundational... ...to develop client-facing materials, lead technical discovery conversations, and...Local areaDeloitte
Costa Mesa, CA1 day ago- The Data & AI Engineer is part of the Group Data division within the IT team and will provide data management solutions while helping evolve the organization's AI capabilities to support business growth, particularly in the U.S. This role will help architect, build, and...
Real Staffing Group
Irvine, CA3 days ago - Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain and manage the endtoend DBT project ensuring modularity reusability and adherence to established data standardsAdvanced SQL Jinja...
LTM
Irvine, CA21 hours ago $86.7k - $170.9k
...Summary Join Deloitte’s Core AI & Data practice and help organizations modernize... ...intelligence capabilities. As a Databricks Data Engineer, you will support the design, build, and... ...professional relationships Ability to lead projects or workstreams Ability to manage...Local areaVisa sponsorshipDeloitte
Costa Mesa, CA3 days ago$146k - $194k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...how it's modeled, and how it reaches the engineers, managers, and leaders who act on it.We'... ...directly with product-line Hardware Test leads, software engineering teams, and...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA3 days ago- Job Role : L3 Support IDMC (Informatica Intelligent Data Management)Job Location : Irvine,CaliforniaJob description :Provide L2 L3 production support for Informatica MDM platformMaintain high availability of MDM CDIPC and associated integrationsPerform root cause analysis...
LTM
Irvine, CA2 days ago $136.75k - $218.8k
...celebrate differences. We believe that belonging leads to better outcomes and a stronger... ...ones I can succeed as a Security Operations Engineer at Capital Group.The Security Operations... ..., and business stakeholders to support data-driven decision making.Partner with cybersecurity...Full timeTemporary workLocal areaFlexible hoursCapital Group
Irvine, CA4 days ago$307k - $428k
Redefine data analysis architecture. Design a shared component ecosystem (skills, sub-agents, RAG systems, embeddable UIs) across... ...highest-impact data analysis problems. Mentor staff/senior staff engineers. Lead the cultural transition from traditional software engineering...Google
Irvine, CA4 days ago$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and... ...data platform and tooling, advocating for engineering best practices, automation, and a... ...Familiarity with integrating data pipelines with leading BI tools (e.g., Tableau, Power BI,...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA1 day ago- ...operating system that turns thousands of data streams into a realtime, 3D command and control... ...in development, we partner across engineering, manufacturing, supply chain, operations,... ...footprint end-to-end. Serve as the technical lead for data products supporting production...Full timeWork experience placementImmediate start
Anduril Industries
Irvine, CA2 days ago - ...Description:We are seeking a highly motivated and self-driven Data Engineer with a strong background in building scalable batch and streaming... ...Apache Airflow is essential.In this role, you will serve as a lead (anchor) engineer, driving the design and delivery of reusable...Full timeWork experience placementLocal areaFlexible hours
CoreLogic
Irvine, CA4 days ago $146k - $194k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...in months, not years.ABOUT THE TEAMAnduril’s Infrastructure Engineering organization provides the digital foundations for all aspects of...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA13 hours ago- ...Job Title : Senior Data Engineer Location : 14410 My ford Road, Irvine, California, United States of America, 92606 Duration:4 Months Experience:8-10 year Job Description Job Title: Sr Data Engineer Worksite location: Remote with Bill rate, please keep...Remote work
I-Flow
Irvine, CA2 days ago - ...ETL pipelines on EMR (Spark) orchestrated in Airflow — including their monitoring, alerting, and recovery.Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.Own data quality for what you build — run the checks...Worldwide
TP-Link Systems Inc.
Irvine, CA21 hours ago $130k - $150k
...pioneer in an exceptional field. For 45 years, Balt has been leading the way - collaborating with physicians and institutions to... ...hesitate, come and join us! About this opportunity - Sr Data & AI Engineer - ON-SITE: IRVINE, CA Description: The Data & AI Engineer...Work at officeRemote workBALT Group
Irvine, CA4 days ago$52.79 - $81.94 per hour
...Description Role summary Data Engineer I is responsible for designing and developing modern, data-centric applications that support clinical and operational workflows across the healthcare system. These solutions leverage cloud technologies, big data platforms...Minimum wageFull timeLocal areaRemote workShift workProvidence Health & Service
Irvine, CA2 days ago- ...Senior Data EngineerInsight Global is seeking a Senior Data Engineer to join a growing analytics and data engineering team focused on enterprise reporting, analytics, and modern data platform initiatives. This individual will sit within the Data Strategy group, but will...
Insight Global
Irvine, CA21 hours ago - ...Sr. Data Engineer Location: Hybrid, 3x onsite in Costa Mesa, CA Duration: Long Term Contract Top Skills: ~ Must be able to use personal workstation or options are available for rent. They are a Microsoft shop. ~10+ years of experience in data engineering or...Long term contract
Group Nine LLC
Costa Mesa, CA1 day ago - ...States | Posted on 09/15/2026 We design, build, and run modern data platforms and AI-native systems that drive productivity,... ...experience with big data technologies, cloud platforms, and data engineering best practices. Key Responsibilities Design, develop...
Dataflix
Irvine, CA21 hours ago $110k - $150k
...Irvine, CA Duration - Fulltime Role Salary Range: $110,000-$150,000 a year Job Description Data Engineer - Lead (Tower) This role requires coordination between onshore, nearshore, and offshore teams Required Skills...Full timeDiverse Lynx
Irvine, CA21 hours ago$100k
...Cloud world /Oracle Java one (Las vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ..., Python/Java developers, Data analysts/ Data Scientists, Data Engineers, Machine Learning engineers for full time positions with clients...Full timeSynergisticIT
Irvine, CA1 day ago- ...Role : Data Engineer Location : Irvine, CA (Onsite) FTE only Job Description We are seeking project-based Platform Engineering delivery support with strong, hands-on technical depth in the following areas: • Databricks - advanced Spark,...
AceStack LLC
Irvine, CA3 days ago $65 - $95 per hour
...dimensional models following medallion architecture patterns, ensures data quality, and guarantees reliable data delivery for analytics on... ...and scripting Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience...Full timeContract workTemporary workLocal areaIrvine
Irvine, CA21 hours ago$34.47 - $38.46 per hour
...Irvine, CA Our dynamic Habit Burger team is building industry leading technology for our staff and restaurant guests. Customers love... ...services such as DoorDash, Grubhub and UberEats. We are seeking a Data Engineer to become part of our dynamic data team. In this role, you...Hourly payFlexible hoursTalentify.io
Irvine, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
