Data Engineer

Compunnel

Job Summary

We are seeking a seasoned Senior Data Engineer with strong experience solving complex data engineering problems. The project focuses on data transformation and modernization, including migrating from legacy platforms to cloud-enabled modern platforms. Extensive Databricks experience is required, along with strong AWS experience, including S3 and Lambda. Strong Python and PySpark skills are also required. Snowflake experience is a major plus and would make a candidate stand out. The role can be performed remotely; however, an onsite interview is required. The interview process includes a first round via Teams followed by an onsite round, with a technical assessment covering Python, PySpark, and SQL.

Key Responsibilities

• Design and implement data transformation solutions as part of legacy platform modernization initiatives.

• Develop and support scalable data engineering solutions using Databricks and AWS.

• Work with AWS services, including S3 and Lambda.

• Develop data processing and transformation workflows using Python and PySpark.

• Solve complex data engineering and data transformation problems.

• Support migration from legacy platforms to modern, cloud-enabled platforms.

• Collaborate with technical teams to deliver data modernization solutions.

Required Qualifications

• Senior-level experience in data engineering with a strong track record of solving data engineering problems.

• Extensive hands-on experience with Databricks.

• Strong AWS experience, including S3 and Lambda.

• Strong proficiency in Python and PySpark.

• Strong SQL skills.

• Experience with data transformation and platform modernization.

• Ability to successfully complete technical assessments covering Python, PySpark, and SQL.

• Ability to participate in an onsite interview.

Preferred Qualifications

• Experience with Snowflake is a major plus.

• Experience migrating legacy data platforms to modern, cloud-enabled platforms.

Apply

Vacancy posted 22 hours ago

Similar jobs that could be interesting for youBased on the Data Engineer in Philadelphia, PA vacancy

AVP, Lead Data Engineer
$152.9k - $221.1k
By joining Chubb as Lead Data Engineer for our North America Finance & Actuarial data platform, you'll set the engineering direction for a portfolio of strategic applications — Atlas, BAR, CDW, Posting, and Regulatory Reporting — that directly underpin financial, actuarial...
Suggested
Permanent employment
Work experience placement
Work at office
Local area
Chubb
Philadelphia, PA
2 days ago
Lead Data Engineer
OverviewLutron is seeking a Lead Data Engineer in Coopersburg, PA or Philadelphia, PA to help build and scale a modern, cloud-native data and AI platform powering analytics, real-time intelligence, and next-generation products. In this role, you will shape the architecture...
Suggested
Worldwide
Lutron Electronics
Philadelphia, PA
2 days ago
Data Engineer - East Region
Who You’ll Work WithAt Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their... ...organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...
Suggested
Temporary work
Local area
Slalom
Philadelphia, PA
4 days ago
Data Engineer
DescriptionWe are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In this role, you will build and enhance modern data pipelines and warehouse structures that support reporting, analytics, and business...
Suggested
Robert Half
Conshohocken, PA
1 day ago
Data Engineer
$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...
Suggested
Full time
Work at office
Remote work
Relocation
Visa sponsorship
Relocation package
DLA Piper
Philadelphia, PA
3 days ago
Lead Machine Learning / Data Science Engineer
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech
Philadelphia, PA
3 days ago
Lead Data Engineer
...Lead Engineer - Design and build robust, scalable ETLELT pipelines using PySpark to ingest data from diverse sources (databases, logs, APIs, files). - Transform and curate raw transactional and log data into analysis-ready datasets in the Data Hub and analytical data...
Q1 Technologies
Philadelphia, PA
4 days ago
Sr Data Engineer
Company DescriptionIntegriChain is the data and application backbone for market access departments of Life Sciences manufacturers.... ...platform design patterns across Integrichain.Hands-on Snowflake engineering: Design, build, optimize, and operate Snowflake data models, pipelines...
Visa sponsorship
Flexible hours
IntegriChain
Philadelphia, PA
3 days ago
Senior Data Engineer
OverviewWe are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into...
Susquehanna International Group
Bala Cynwyd, PA
1 day ago
Data Engineer
...Data Model And Structure DefinitionDesign and develop conceptual, logical, and physical data models for data sets across a variety of financial data sets. Collaborate with product management and the economic research team to understand data requirements and translate...
Kaav Inc.
Philadelphia, PA
4 days ago
Data Engineer
...Data Engineer Philadelphia, PA Experience: 5-9 years • Experience in big data, ETL project. • Demonstrable experience with big data tools: Hadoop, Apache Spark, Kafka • Demonstrable experience with data pipeline and workflow management tools: NiFi etc. •...
Keylent Inc
Philadelphia, PA
2 days ago
Data Engineer
...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower...
Full time
Flexible hours
Contact Government Services LLC
Philadelphia, PA
2 days ago
Data Engineer
...Data Engineer/Data Scientist Proven experience (6+ years) as a data engineer and data scientist, preferably in a fast-paced technology or analytics-driven environment. Telecom domain must. Big Data / ETL development background needed. Cloud technologies - AWS...
United IT
Philadelphia, PA
2 days ago
Data Engineer I
$90k - $100k
...Data Engineer IUS Cold owns and operates one of the most complex temperature-controlled logistics networks in North America. Every day, our systems coordinate the storage and movement of food at national scale across a network of state-of-the-art distribution centers,...
Permanent employment
Full time
Temporary work
Work at office
Flexible hours
USCS
Camden, NJ
2 days ago
Data Engineer
...Senior Data Engineer As a Senior Data Engineer, you will work with the team to build complex data pipelines using a new cutting-edge Data Ingestion Platform as well as several new and exciting products in the Big Data/Advanced Analytics space. You will operate in a...
Software Technology Inc
Blue Bell, PA
2 days ago
Lead AWS Data Engineer
...Lead AWS Data EngineerLocation: Philadelphia, PA- OnsiteContract positionRole Description We are seeking a Lead Data Engineer to design, build, and optimize large-scale data solutions on AWS. This role combines hands-on technical expertise with leadership responsibilities...
Diverse Lynx
Philadelphia, PA
4 days ago
Data Engineer
...Extract data from noisy, inconsistent sources Validate and reconcile outputs across multiple inputs Ensure correctness... ...intelligence Core Requirements Strong Python and backend/data engineering experience Experience building production data pipelines...
3B Staffing LLC
Philadelphia, PA
17 hours ago
Data Engineer
...Sr Data EngineerLocation: Philadelphia, PA/ Durham, NCCore engineering data skills. Strong in Python ideally using official SDKs to call REST APIs. Experience building ETL/ingestion pipelines: incremental syncs, idempotent upserts, backfills, error handling, retries and...
Yantran LLC
Philadelphia, PA
4 days ago
Data Engineer
...Senior Data Engineer - Data Strategy & ArchitectureLocation: Conshohocken, PAFounded in 1987, CenterSquare Investment Management is an independent, employee-owned real asset manager focused on listed real estate, private equity real estate and private real estate debt....
CenterSquare Investment Management
Conshohocken, PA
3 days ago
Lead Generative AI Data Engineer III
$159.1k - $265.1k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...growth through innovation. Work You’ll Do As a Lead AI and Data Science Engineer II on the team, you will be responsible for:...
Local area
Deloitte
Philadelphia, PA
1 day ago
Data Engineer
...and generous perks, Perpay is the best place to be in Philadelphia right now. About the Role: Our data team is organized across three groups: Data Engineering, Data Science, and Strategic Analytics. Data Engineering owns the warehouse, the orchestration layer,...
Odd job
Full time
Work at office
Local area
Relocation package
Weekend work
Perpay - Career's Page
Philadelphia, PA
2 days ago
Snowflake Data Engineer
...undergoing a major cloud modernization initiative focused on building scalable, high-performance data platforms that support mission-critical business applications. Their engineering organization is investing heavily in cloud architecture, automation, data engineering,...
Local area
Jobot
Philadelphia, PA
3 days ago
Data Engineer
$100k - $130k
...possible. To achieve this vision, Aramark will deliver strategic data assets that enable our operators to maximize the hospitality... ...experience for our consumers and clients. We are seeking a Data Engineer who will work hands-on and collaboratively with our enterprise...
Local area
Aramark
Philadelphia, PA
2 days ago
Data Engineer
We are UMG, the Universal Music Group. We are the world's leading music company. In everything we do, we are committed to artistry, innovation and entrepreneurship. We own and operate a broad array of businesses engaged in recorded music, music publishing, merchandising...
Summer work
Immediate start
Flexible hours
Universal Music Group
Philadelphia, PA
2 days ago
Snowflake Data Engineer
$90k - $150k
...calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You...
Work experience placement
Local area
Shift work
Jobot
Philadelphia, PA
4 days ago
Data Engineer-Philly or WHS
...Data Engineer Location: Philly or Whitehouse Station, NJ - Hybrid schedule 3 days in the office. Duration: 12 months + The Global Actuarial Systems team is a small, agile group of technology enthusiasts. We are tasked with solving the complex data needs of both US...
Full time
Work at office
Georgia IT Inc
Philadelphia, PA
2 days ago
Data Engineer - Operational Support (Co-op)
...supported to build a rewarding career with opportunities to grow, innovate and inspire. Make history with us.Operational Support Data Engineer (Co-op)We are seeking a motivated and curious Data Engineer to join our Enterprise Data & Analytics team. This co-op provides...
Full time
Campbell Soup Company
Camden, NJ
17 hours ago
Data Engineer - Agentic AI & ML Ops (Co-op)
...supported to build a rewarding career with opportunities to grow, innovate and inspire. Make history with us.Operational Support Data Engineer - Agentic AI & ML Ops (Co-op)We are seeking a motivated and curious Data Engineer - Agentic AI & ML Ops to join our Enterprise...
Full time
Campbell Soup Company
Camden, NJ
3 days ago
Data Engineer | Sports | Experienced Hire
...through cutting-edge technology, quantitative research, and deep trading expertise. We are looking for an experienced Quantitative Data Engineer to join our Prediction Markets team.We specialize in geopolitical and sports analytics across the globe. This is an opportunity...
Susquehanna International Group
Bala Cynwyd, PA
1 day ago
Senior Data Science Engineer
...advertising products powered by advanced machine learning, large-scale data processing, and cloud technologies. Our proprietary algorithms... ...seeking a creative, and curious Senior Data Science Software Engineer to join our team. In this role, you'll work at the intersection...
Full time
Temporary work
Part time
Work experience placement
Local area
Flexible hours
T-Mobile
Philadelphia, PA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!