Senior Data Engineer
Kaav Inc.
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows. Required Skills : Data Analysis,Data Warehouse Basic Qualification : Additional Skills : Data Engineer Background Check : No
Drug Screen : No
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows. Required Skills : Data Analysis,Data Warehouse Basic Qualification : Additional Skills : Data Engineer Background Check : No
Drug Screen : No
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Senior Data Engineer We are seeking a highly experienced and hands-on Senior Data Engineer to join our Data Engineering teams. You will play a key role in supplementing existing capacity, upgrading our data architecture, and ensuring the highest quality, performance...Senior
Randstad
Malvern, PA4 days ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...Senior
Samprasoft
Malvern, PA5 days ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...SeniorContract workImmediate startRemote work
3B Staffing LLC
Malvern, PA4 days ago $66.4 - $71.4 per hour
job summary: We are seeking a highly experienced and hands-on Senior Data Engineer to join our Data Engineering teams. You will play a key role in supplementing existing capacity, upgrading our data architecture, and ensuring the highest quality, performance, and cost...SeniorHourly payTemporary workWork experience placementRandstad
Malvern, PA2 days ago- ...Role Name - Senior Data Engineer ROLE_DESCRIPTION - Build and maintain event-driven data pipelines using AWS services such as Kinesis, MSK/Kafka, Lambda, Step Functions, SQS/SNS, and Glue/EMR. Develop ETL/ELT workflows using Python and PySpark...Senior
Diverse Lynx
Malvern, PA4 days ago - ...years of experience. Ideal candidates should be proficient in programming languages like Python and Java, and have experience with big data technologies and cloud platforms. The role demands strong problem-solving skills and the ability to work independently as well as...Senior
$82.1k - $172.4k
...Job Title: Senior Data Engineer Job Category: Science Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Local Anticipated Posting End: 12/2/2026 The Opportunity...SeniorFull timeContract workWork experience placementLocal areaFlexible hoursCACI International
King of Prussia, PA4 days ago- Join a rapidly growing tech company as a Support Engineer III, where you'll handle technical escalations related to data migrations and system support. Your role includes troubleshooting, client support, and collaborating with Product and Development teams. If you have...Senior
- ...leading educational technology company is looking for a Sr. Support Engineer (Tier IV) to join their Client Support Organization. This role... ...handling complex escalations and supporting clients with data migrations and system issues. The ideal candidate will have extensive...Senior
- A rapidly growing tech company in Pennsylvania seeks a Sr. Support Engineer specializing in systems support and data integrations. This role demands significant expertise in SQL Server and IIS troubleshooting, alongside strong problem-solving and customer service skills...Senior
- A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...Senior
- ...Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including...
Randstad
Malvern, PA4 days ago - ...Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and...
Samprasoft
Malvern, PA5 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA5 days ago - ...Job Title We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Role Responsibilities Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it...
Syntricate Technologies
Malvern, PA2 days ago - ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA4 days ago $146.08k - $200.2k
...Newtown Square, PA to design and develop systems that optimize SAP’s business processes. You will engage with stakeholders, perform data and system development, and manage cloud infrastructure. A Bachelor's degree in Computer Science or related field and significant experience...Senior- Job Title Required Skills: Technological requirements include 3+ years' development experience and familiarity with the following tools AWS Core Services: Cloud formation, DynamoDB, S3, Glue, Athena, Kinesis, Firehose AWS Serverless Infrastructure: Lambda...
Syntricate Technologies
Malvern, PA5 days ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA2 days ago - ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA3 days ago - ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA4 days ago - ...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data...Full timeRemote work
MHK TECH INC
Malvern, PA15 hours ago - ...Data engineer Malvern pa hybrid Assessment required Minimum 8-10 years of exp n * Location - Preferred Charlotte (but can be in Malvern) * pprox desired start - asap * Role - Level 4 Big Data Engineer, Python developer * required skillset - Python...Immediate start
RIT Solutions, Inc.
Malvern, PA15 hours ago - ...Request ID: 86258-1 Title: Lead Data Engineer Locations : Malvern, PA Duration: 6 Months Pay Range: $60 - $65/Hour on W2/C2C (All inclusive) Role Descriptions: Technical skill sets: Python, AWS- S3, Lambdas, Glue, Gen-Ai , LLMs , SQL, DynamoDB , Kafka...
Artech
Malvern, PA1 day ago - ...We are seeking an experienced AWS Developer Lead to join our team. The ideal candidate will have strong expertise in AWS data engineering, including designing and maintaining AWS data ingestion and transformation pipelines. This role offers an exciting opportunity...
Prophecy Technologies
Malvern, PA4 days ago - ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days in office) The Senior Data Scientist plays... ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable....SeniorWork at office
CubeSmart Self Storage
Malvern, PA1 day ago - ...experience in IT industry. Core Skill Set Proficiency in programming languages such as Python, Java, and SQL. Experience with big data technologies such as Hadoop, Spark, and Hive. Knowledge of data warehousing and data lakes. Experience with cloud computing...
$122.43k - $183.64k
...S. Visa sponsorship/sponsorship assumption and other immigration support are not available for this position. The Senior Data Infrastructure Engineer designs, builds, and scales reliable data platforms that power online transaction processing, analytics, machine learning...SeniorFull timeVisa sponsorshipLyric
Newtown Square, PA4 days ago- ...that push the boundaries of AI technology. Work closely with engineering teams to transition research findings into scalable, production... ...(Post Doctorate or PhD or Master's in Computer Science, AI, Data Science or related field) At 5+ years of relevant work experience...SeniorWork experience placementVisa sponsorship
Vanguard Group, Inc.
Malvern, PA2 days ago - CACI International Inc is seeking a Senior Systems Engineer in King of Prussia, PA. This position is crucial for translating user needs into technical... ...with customer analysts and cross-functional teams to define data pipelines and develop system architectures. The ideal...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior vice president of operations Malvern, PA
- senior performance engineer Malvern, PA
- senior manager legal Malvern, PA
- senior manager m&a tax Malvern, PA
- senior level Malvern, PA
- senior application administrator Malvern, PA
- senior application security Malvern, PA
- senior leadership Malvern, PA
- senior manager diversity & inclusion Malvern, PA
- senior implementation project manager Malvern, PA