Lead Data Engineer
Circle K
Technical Lead Data Engineer
As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities.
Responsibilities:
- Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
- Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
- Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
- Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
- Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc.
- Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
- Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
- Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
- Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
Qualifications:
- Bachelor's or master's degree in computer science, Engineering, or a related field.
- Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
- Strong proficiency in SQL, Python and Spark programming languages.
- Strong experience with cloud platforms such as AWS, Azure, or GCP is a must.
- Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.
- Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.
- Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
- Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.
- Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.
- Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in United States vacancy
- ...divh2Lead Data Engineer-DE/h2pLocation: Scottsdale AZ (day 1 onsite)/ppDuration: Fulltime/ppJob Description:/ppMust have skill set: Java, Scala, Python, Spark, S3, Glue, Redshift/pulliYou have 6-8 years of relevant software development experience./liliYou have hands-on...SuggestedFull time
Zortech Solutions
Scottsdale, AZ4 days ago - ...Job Description: ~ Job Description: Data Engineer Lead Snowflake, DataStage / Informatica "1 Analyze and build ETL data assets using IBM DataStage / Informatica and On-Prem Databases such as Netezza. Propose design and implement solutions to migrate...Suggested
Mando Technologies
Frisco, TX3 days ago - ...Qualifications Remote Lead Data Engineer needs 7+ years experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales). Strong background in math, statistics, computer science...SuggestedRemote work
Global Channel Management
Dallas, TX2 days ago - ...As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and maintaining technical excellence within our data engineering team. Your deep expertise in data architecture, ETL processes, and data modeling will be instrumental in optimizing data workflows...SuggestedFlexible hours
Rearc
New York, NY2 days ago - ...The Technical Lead will be responsible for overseeing and leading technical projects in the areas of Snowflake , DBT , SQL , and... ...maintain database systems using snowflake and sql. 5. Implement data transformation and modeling using dbt (data build tool). 6. Write...Suggested
Omni Inclusive
Frisco, TX2 days ago $150k - $224k
...petabytes of sensitive evidence. Our team builds the distributed data backbone that powers AI-assisted evidence analysis across... ...organizations Organize Data, Discover Truth, and Act on It. As a Lead Data Engineer, you are the technical leader for your team: hands-on, design...WorldwideRelativity
Chicago, IL4 days ago$136.5k - $180.6k
...for the seventh year in a row! The Business Intelligence and Data team transforms complex, global data into strategic assets that inform decision-making across the organization. As a Lead Data Engineer, you will operate at the intersection of architecture and business...Permanent employmentFull timeH1bWork at officeLocal areaWork visaLogicMonitor
Austin, TX5 days ago- ...Primary skills -Data, Snowflake, EL Processing (Snap Logic), Power BI Job description - Key Responsibilities: Designing... ...of relevant work experience, including previous experience leading a team. Excellent problem-solving and analytical skills...Work experience placement
Apex Informatics
Dallas, TX5 days ago $129.91k - $160k
...is a force for good. Primary Responsibilities The DEA Lead Engineer is a hybrid role combining technical leadership and people management... .... EDUCATION AND EXPERIENCE: ~7+ years of experience in data engineering and analytics, including at least 2 years in a...Full timeTemporary workLocal areaFlexible hoursShift workDay shiftKeHE Distributors
Naperville, IL5 days ago$106.61k - $284.28k
...helping to simplify health care one person, one family and one community at a time. POSITION SUMMARY We are seeking a Lead Data Privacy Engineer to assist in leading our Data Protection Engineering, Monitoring, and Audit efforts. This role is responsible for...Hourly payFull timeTemporary workWork experience placementLocal areaCVS Health
Washington DC1 day ago$160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shiftDeliberate AI
Boston, MA1 day ago$135.04k - $202.56k
...Sr Staff Data Engineer - GE07DE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages... ...the future. Join our team as a Sr GenAI Data Engineer and lead the charge in developing cutting-edge AI solutions and data...Temporary workWork at office3 days per weekThe Hartford
Columbus, OH1 day ago- ...~ Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities Lead the design, development, and implementation of data solutions... ...technical leadership and mentorship to junior data engineers. Work closely with stakeholders to gather...Work experience placementImmediate start
Artech
Jersey City, NJ4 days ago $118k
...Lead, Data Governance Engineer Job Locations US-IL-Chicago ID 2026-4589 Category Information Technology Position Type Hidden (37968) Overview Founded in 1898 and headquartered in Chicago, IL, GATX Corporation (NYSE...Temporary workCasual workWork at officeNight shiftWeekend workGATX
Chicago, IL3 days ago- ...Lead Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) BigRio is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine...Contract workRemote work
Saviance
United States5 days ago - ...Role Value Proposition: The MetLife Corporate Functions Data Office is part of the Data and Analytics Organization (D&A) within... ...for MetLife as we head into our New Frontier strategy! The Lead Data Engineer plays a critical role in big data development within the data...Work at office
MetLife
Cary, NC4 days ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...Long term contractWork at office
InterSources
McLean, VA11 days ago $156.37k - $212.55k
...Job Description: The Lead Data Engineer at Northwestern Mutual Life Insurance Company in Milwaukee, Wisconsin will work on development, automation, TOIL elimination, incident response, root cause analysis, and monitoring improvements. Leverage software engineering skillset...Remote work2 days per weekNorthwestern Mutual Life Insurance Company
Milwaukee, WI4 days ago- ...About the job Lead Data Engineer Lead Data Engineer (Los Angeles, CA) Experience: 9-12 years Strong data engineering background Databricks is a must, along with experience in data modeling, building pipelines, orchestration, and supporting...
Inizio Partners
Los Angeles, CA4 days ago - ...resided in the US for the last 3 years of the past 5 years; ET time zone work schedule. Daily Responsibilities The Lead Data Engineer is responsible for building and maintaining scalable data pipelines and ensuring efficient data ingestion, transformation,...Full timeTemporary workRemote work
Powerhouse Institute Inc
United States3 days ago $197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of...Full timePart timeInternshipH1bLocal areaCapital One
McLean, VA3 days ago- ...Summary The Lead Data Engineer will design, build, and maintain the organization's enterprise data platform, leading the technical implementation of data pipelines, warehouses, and analytics infrastructure that powers business intelligence, reporting, and advanced...Work at office
WellDyne
Lakeland, FL1 day ago $70k - $130k
...brand strategies with real-time insights, Hearts & Science is a data-driven marketing agency with expert media planning and buying... ...This role will be reporting to the Senior Director, Data Engineering and be part of Data Engineering Team who build, enhance and optimize...Work experience placementWork at officeRemote workFlexible hours3 days per weekOmnicom Media
Chicago, IL5 days ago- ...Job title: Lead Data Engineer Work Location: San Francisco, CA. Type: Contract Tech Stack & Skills She's Looking For: Core (Must-Have): Backend / Data Engineering (Primary focus) End-to-end data pipeline experience Strong SQL...Contract work
VBeyond
San Francisco, CA3 days ago $112k - $135k
...Data Engineer Publicis Media is a social marketing and dynamic content center of excellence, specializing in connecting brands to consumers... ...support analytics, reporting, and downstream consumption. Lead performance, reliability, and scalability efforts across the...Temporary workFreelanceFlexible hoursStarcom Mediavest Group Germany Gmbh
Atlanta, GA4 days ago- ...Technical Lead At LMI, we're reimagining the path from insight to outcome at The New... ...for guiding a team that delivers modern data pipelines and advanced analytics in support... ...oversee a multidisciplinary team of data engineers and data scientists. Collaborate with...
LMI
Reston, VA1 day ago - ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...
Stepping Up Solutions
Sunnyvale, CA1 day ago $197.3k - $225.1k
...Lead Data Engineer (Bank Tech) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of...Full timePart timeInternshipH1bLocal areaCapital One
Richmond, VA3 days ago$75 per hour
...Sent: Monday, March 16, 2026 9:11 PM To: Mohammed Waseem Abbas Subject: [EXTERNAL] Rate Confirmation || Lead AWS Data Engineer with DynamoDB ( Need 12+ Years candidates ) Caution: EXTERNAL EMAIL. Please do not reply, forward, or open links/attachments...Long term contractH1bRelocationDamco Solutions
Miami, FL1 day ago$133.2k - $166.5k
...Founded in 1990, WWT is a global technology solutions provider leading the AI and Digital Revolution. WWT combines the power of... ...performance teams? Join WWT today! A Brief Overview As a Lead Data Engineer, you will serve as a strategic and technical leader in the design...Full timeShift workWorld Wide Technology
Sacramento, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- clinical data United States
- master data coordinator United States
- clinical data coordinator remote United States
- data intern United States
- data journalist United States
- data cabling installation United States
- data collection researcher United States
- data technician United States
- data mining United States
- minimum data set coordinator United States