Lead Data Engineer
Wawa
Job Description Job Title: Lead Data Engineer Location: Corporate Department: Information Technology
Job Summary: The Lead Data Engineer role designs and develops complex, scalable data solutions using data integration tools and technologies. The individual utilizes modern data platforms and storage tools to create prototypes and data products utilizing multiple components and variables. Design, build, and test data pipelines and solutions. Additionally, the Lead Data Engineer integrates and tests data pipelines with Advance Analytics and AI platforms. Principal Duties:
Job Summary: The Lead Data Engineer role designs and develops complex, scalable data solutions using data integration tools and technologies. The individual utilizes modern data platforms and storage tools to create prototypes and data products utilizing multiple components and variables. Design, build, and test data pipelines and solutions. Additionally, the Lead Data Engineer integrates and tests data pipelines with Advance Analytics and AI platforms. Principal Duties:
- Responsible for designing and implementing complex solutions for loading both structured and semi-structured data design into multiple target data systems.
- Design, develop, optimize, and maintain data pipelines and processes that adhere to data integration principles and business goals.
- Solve complex data problems by delivering insights that help our business to achieve their goals.
- Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
- Ensure that data pipelines are scalable, repeatable, and secure, and can serve multiple users within the company.
- Design and implement data ingestion techniques for real time and batch processes for structured and semi-structured data sources into Wawa's Raw, Refined, and Data Product layers of Wawa's enterprise data platform.
- Understand enterprise business areas and needs and translate into business requirements and propose end to end and simplified enterprise information architecture solutions.
- Design and implement data design methods, data structures, and modeling standards which work with multiple business intelligence tools.
- Work closely with Analytics team and implement their self-service and analytics requirements.
- Work with Data Science practitioners and developers to make sure that all data solutions are consistent.
- Collaborate with Analytics team to build solutions that enable business analytics.
- Develop quality scalable, tested, and reliable data services using industry best practices.
- Manage all activities centered on obtaining data and loading into a data lake environment.
- Assess the suitability and quality of candidate data sets for the data lake.
- Contribute to thought leadership in data solution technical design and implementation.
- Mentor to junior resources in technical best practices.
- Balance business requirements with technical feasibility and set expectations on new projects. Recommend and draft changes in development, maintenance and system standards.
- Design and build integration components and interfaces in collaboration with Architects and Infrastructure Engineers as necessary.
- Perform unit, component, integration testing of software components including the design, implementation, evaluation and execution of unit and assembly test scripts.
- Determine if the data received from the upstream systems are of good quality based on the rules and data quality validations defined and in case of any issues with the data quality analyze and come up with a preliminary summary of the root cause/issue.
- Assist the Analytics team by leveraging Wawa's Enterprise Data Platform ecosystem to design, and develop capabilities to deliver our solutions using Python, SQL, and Snowflake.
- Follow security standards for all data and tools that are being introduced in the team.
- Design and deliver certified data products (Bronze/Silver/Gold) with documented quality SLAs, lineage, and ownership.
- Partner with Data Governance on certification reviews, quality remediation, and policy adherence for production datasets.
- Build and maintain Snowflake-native transformation pipelines (SQL, stored procedures, tasks, streams, dynamic tables) with version control, testing, and CI/CD-gated deployment.
- Optimize warehouse cost and performance through query tuning, warehouse sizing, and consumption monitoring.
- Provide technical direction and design review for a workstream of 3-5 engineers; act as escalation point for production data issues.
- Handle multiple priorities simultaneously
- Work collaboratively with cross-functional teams
- Ability to build strong trusting relationships with business partners
- Passion for innovation and "can do" attitude to thrive in a fast-paced environment
- Ability to work in a fast-paced, team environment
- Excellent communication skills
- Basic project management skills required
- Work with the team to lead and maintain data strategy standards in all the data team is responsible for
- Ability to lead a team
- Bachelor's degree in Computer Science/Engineering preferred
- 8+ years database, data integration experience
- 5+ years experience with SQL, Scala/Python, Spark, and Modern Data Stack solutions
- 5+ years experience in designing and implementing data architecture (conceptual, logical, physical & dimensional models).
- Developing Enterprise Data & Analytics solutions on one or more of the following EDW platforms: Snowflake, Databricks, AWS, and BigQuery
- Experience implementing data solutions using open-source technologies
- Experience designing and implementing various data pipeline patterns and strategies
- Hands-on experience with dimensional modeling techniques and creation of logical and physical data models (entity relationship modeling, exposure to data warehouse design)
- Strong knowledge of data security principles
- Proven track record working with complex, interrelated systems and bringing that data together on enterprise platforms.
- Hands-on experience building Snowflake-native transformation pipelines using SQL, stored procedures, tasks, streams, and dynamic tables.
- Experience operating Snowflake at scale: warehouse sizing, cost monitoring, query optimization, and access control.
- Familiarity with data observability and quality tooling (e.g., Monte Carlo, Great Expectations, Snowflake data quality monitors) and applying it to certification SLAs.
- Demonstrated technical leadership: mentoring senior engineers, leading design reviews, and driving cross-team alignment on data standards.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Media, PA vacancy
- ...large-scale analytics efforts and deliver on critical visualization needs that support future planning and decision making, ensuring data can be visualized in formats and models that can be easily reviewed and analyzed. Partnering with relevant stakeholders to architect...SuggestedFlexible hours
- Data engineer with Data Bricks @ New Town Square PA Job Title: Data Engineer - Mid-level Location: Hybrid Work (2 days onsite in Newtown Square, PA) Type: 6+ Month Contract Rate: $Open /hr. Required Skills 3+ year (midlevel) overall years of Data Engineering Azure...SuggestedContract work
$58 - $68 per hour
...Akkodis is seeking a Tech Lead-Data Engineer for a Contract with a client in Malvern, PA. The ideal candidate will architect and lead development of largescale, eventdriven data platforms to deliver reliable analytics and machine learning datasets. Rate Range...SuggestedHourly payContract workTemporary workLocal area$67 - $72 per hour
The Fountain Group is seeking an experienced Full Stack Foundry Engineer for a fully remote position. This role involves the end-to-end delivery of Palantir Foundry applications, transforming raw data into operational decision interfaces. With 5+ years of experience in...SuggestedRemote job$122.43k - $183.64k
...Visa sponsorship/sponsorship assumption and other immigration support are not available for this position. The Senior Data Infrastructure Engineer designs, builds, and scales reliable data platforms that power online transaction processing, analytics, machine...SuggestedFull timeVisa sponsorship- ...Description Job Description Marketing Data Scientist CarGroup Holdings LLC (... ...operating as webuyanycar.com® USA, is a leading car buying service focused on delivering... ...continuous optimization Collaborate with Data Engineering and IT to ensuredata quality, integrity,...
- ...Driving. Ready to get in the driver's seat? Join us! As a Data Scientist III at Hagerty, you'll build the customer identity... ...Data Science team, working in close partnership with ML Ops, Data Engineering, and Marketing/Product. You'll help create a unified,...Work at officeRemote work3 days per week
- ...Manager For The Data & Ai Team Valorem Reply is an award-winning digital transformation... ...most recent years as a hands-on manager leading a team on enterprise scale data platform... ...to create working environments for data engineers and scientists, and general knowledge of...
$48 - $53 per hour
Boeing Future of Flight is seeking a mechanic for a contract assignment in Ridley Park, PA. The role involves interpreting engineering and supply chain data, developing support solutions, and writing technical documentation for aircraft systems. Candidates should have at...Hourly payContract work$94.8k - $118.5k
...create a safer, sustainable and more connected world. Job Description: Job Overview We are seeking a hands-on Data Engineer with 3-5 years of experience to build and support modern Supply Chain data products using Databricks, SQL/Python, and SAP data....Work experience placementLocal areaRemote work- ...PRESERVE OFFICE LOCATED IN NEWTOWN SQUARE, PA. WE WILL NOT CONSIDER REMOTE CANDIDATES! Role Overview The Senior Azure Data Engineer designs, builds, and optimizes large scale cloud data solutions on Microsoft Azure. The role requires deep hands on expertise with...Work at officeFlexible hoursShift work
- ...Job Title Data Engineer Location Malvern, PA Hybrid Duration 6+ months Interview Video Job Description Required Skills - Top 3-5 Key Words Required Technical Skills: Python, SQL, AWS Web services (Glu, S3, Lambda) Core...
- ...investing across all asset classes. We focus on data strategies including new sources of data... ...pipelines and market data platforms Lead the onboarding of new data products for... ...of AI/ML models Mentor junior engineers to develop production quality code, data...Visa sponsorship
- ...Data Engineer Data Engineer Address: 301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data pipelines...Full timeRemote work
- ...on integrity, candor and collaboration, backed by our market-leading data and technology. We invest heavily in our people and our partners... ...The Opportunity: We are seeking a talented ETL Data Engineer with strong experience in Python and Azure Synapse Analytics to...Work experience placementShift work
- ...Data Engineer Working at QVC Group means joining a live social shopping company with incredible teams, ambitious projects and amazing careers. QVC Group, Inc. is a Fortune 500 company with six leading retail brands - QVC®, HSN®, Ballard Designs®, Frontgate®, Garnet...Local areaRelocation package
$110k - $140k
...DATA ENGINEER Position Summary The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization’s data strategy and broader goals. This...Temporary workWork at office- ...Data Engineer Client: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okay Responsibilities ~ Data Engineers will be data mining, writing code, and creating...
- ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
$48 per hour
...duration of the specified project. Interprets and analyzes engineering data, reliability and maintainability data, supply chain data, and... ...Vision, 401K Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success...Hourly payFull timeContract work- ...Role Description: We are seeking a Senior Data Engineer with strong hands-on experience in building AWS-based data pipelines. The ideal candidate will have deep expertise in Python, AWS Glue, PySpark, and cloud-native data engineering solutions. This role involves...
- ...Description Job Description Bala Consulting Engineers is a 200-person engineering firm... ...adding talented commissioning engineers with data center experience who will travel to... .... This role joins a team of industry leading on-site commissioning/QA/QC electrical...Full timeContract workWork at officeLocal areaRemote workNight shiftWeekend work
- Two95 International Inc. is seeking a mid-level Data Engineer to join their team in a hybrid work setup, which requires 2 days onsite in Newtown Square, PA. This is a 6+ month contract position with an open rate. Ideal candidates need to have at least 3 years of experience...Contract work
- ...push forward into the future of industry leading technological solutions. Berkley... ...Responsibilities The Senior Information Security Engineer is responsible for implementing and... ...program to protect our organization's data and systems from cyber threats. They will...
$115k - $125k
Data Engineer (T1459142-PHI) Wayne, Pennsylvania Salary: USD115000 - USD125000 per year Location: Hybrid Wayne, PA (2 days on site/week required) We are seeking a Data Engineer with strong hands‑on experience in Azure Databricks and modern data pipeline development. This...2 days per week- ...Canada Benefits Information Security Engineer Location: Wayne, PA Team: Information... ...Energy. Our commitment to these values leads us to make better decisions and furthers... ...management, endpoint security, data classification and network access control...Full timePart timeWork visa
- Bridgeforce is seeking a data-focused professional for a remote position. The ideal candidate will translate business requirements into technical designs, enhance data processing, and support onboarding of new data sources. A Bachelor's or Master's degree in Computer Science...Remote job
$60k - $90k
Position Overview Bridgeforce Data Solutions team seeks an entrepreneurial mindset for a unique and exciting opportunity to be part of the team executing upon the design and creation of enhancements to the data environment. The duties of this role range from data modeling...Work experience placementInternshipWork at officeRemote work$72.9k - $131.6k
...Analyst, Actuarial Data Engineer The Role at a Glance As an Analyst, Actuarial Data Engineer, you will lead the design and implementation of new technology solutions of the Actuarial Architecture & Transformation team. You will develop data & analytics solutions using...Work experience placement- ...Data Engineer - AWS/Python/Angular Hybrid - Malvern PA About the team: Working in this team will require a developer who is... ...related components Work on features and POCs with industry-leading technologies and tools Work on greenfield space to shape...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!


