Senior Data Engineer

Kaav Inc.

Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.

Required Skills : Data Analysis,Data Warehouse

Basic Qualification :

Additional Skills : Data Engineer

Background Check : No

Drug Screen : No

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy

Senior Data Engineer
...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Senior
Kaav Inc.
Malvern, PA
13 hours ago
Senior Data Engineer
...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation...
Senior
RIT Solutions, Inc.
Malvern, PA
5 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...
Senior
Full time
For contractors
Work at office
Vanguard
Malvern, PA
7 hours ago
Senior Data Engineer
...The Senior Database Developer will be responsible for designing, developing, configuring, and maintaining enterprise database solutions... ...Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based...
Senior
BCBS Global Solutions
King of Prussia, PA
5 days ago
Senior Staff Information Security Engineer
$191k - $286k
General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province Pennsylvania Date... ...supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize...
Senior
Remote work
ANSYS
Exton, PA
3 days ago
Senior Data Engineer: Agentic Memory & Retrieval
Coforge is seeking a Senior Data Engineer (Agentic Retrieval & Memory) in Oaks, PA for a full-time role. You will design agent memory interfaces across session state, short-term history, and long-term memory, and select optimal stores for each tier. You will integrate...
Senior
Full time
Temporary work
Coforge
Oaks, PA
1 day ago
Senior Data Engineer: Oracle & SQL Server AI Data Solutions
BCBS Global Solutions is seeking a Senior Database Developer to design, develop, and maintain enterprise Oracle and SQL Server databases. You will implement ETL with SSIS, design data warehouses, and lead data initiatives within SDLC frameworks. The role requires expert...
Senior
BCBS Global Solutions
King of Prussia, PA
4 days ago
Senior Data Engineer (Agentic Retrieval & Memory)
Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term...
Senior
Full time
Temporary work
Coforge
Oaks, PA
1 day ago
Senior Full Stack Data Engineer
...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...
Senior
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
3 days ago
Senior Data Operations & Database Engineer
A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...
Senior
The Hartford
Wayne, PA
12 hours ago
Data Engineer
$120k - $130k
...Attunity, Pyspark, AWS (S3, IAM, Lambda, Cloud Formation) Roles & Responsibilities • Design, develop, and maintain scalable ETL/data integration pipelines using AWS Glue, PySpark, and Python. • Develop and optimize data transformation workflows to process large...
Tata Consultancy Services
Malvern, PA
5 days ago
AWS Data Engineer
...AWS Data EngineerLocation: Malvern, PA, 19355Job Type: FulltimeSalary: $120,000-$130,000 a year+ benefitsKey Technical SkillsPythonAWS Glue (Glue ETL)PySparkAttunity / Qlik ReplicateAWS Services: Amazon S3, IAM, Lambda, CloudFormationRoles & ResponsibilitiesDesign, develop...
Diverse Lynx
Malvern, PA
1 day ago
ETL Data Engineer
...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA
1 day ago
Big Data Engineer
...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating...
Veracity
Malvern, PA
1 day ago
Data Engineer
...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....
Contract work
Local area
Immediate start
Syntricate Technologies
Malvern, PA
1 day ago
AWS Data Engineer
...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement...
Syntricate Technologies
Malvern, PA
12 hours ago
Data Engineer
...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Kaav Inc.
Malvern, PA
6 days ago
Data Engineer
...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA
12 hours ago
Data Engineer
...Data EngineerData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using Azure Data Factory... ...operationalize ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML...
MHK TECH INC
Malvern, PA
12 hours ago
Big Data Engineer
Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA
12 hours ago
Data Engineer
...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA
1 day ago
Data engineer
...Data engineer Malvern pa hybrid Assessment required Minimum 8-10 years of exp n * Location - Preferred Charlotte (but can be in Malvern) * pprox desired start - asap * Role - Level 4 Big Data Engineer, Python developer * required skillset - Python...
Immediate start
RIT Solutions, Inc.
Malvern, PA
1 day ago
Data Engineer
...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in...
RIT Solutions
Malvern, PA
12 hours ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
5 days ago
Data Engineer
...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA
4 days ago
Senior AWS Data Scientist
...ROLE_DESCRIPTION - Senior AWS Data Scientist with 8+ years of experience in Machine Learning, MLOps, and GenAI, specializing in Amazon... ..., Redshift, Lambda, and CloudWatch. Expertise in feature engineering, predictive modeling, and statistical analysis....
Senior
Diverse Lynx
Malvern, PA
1 day ago
Senior AWS Data Scientist
...Senior AWS Data ScientistSpecializing in Amazon SageMaker, Bedrock, Python, and AWS analytics services to build, deploy, and optimize scalable... ..., Redshift, Lambda, and CloudWatch.Expertise in feature engineering, predictive modeling, and statistical analysis.Experience...
Senior
Diverse Lynx
Malvern, PA
12 hours ago
Data Analytical Engineer
...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA
5 days ago
Senior Data Scientist
...Senior Data ScientistThis is a hybrid role based in the Malvern, PA office. (3 days in office)The Senior Data Scientist plays a critical... ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable....
Senior
Work at office
CubeSmart Self Storage
Malvern, PA
1 day ago
Senior Scientist/Principal Scientist- Biotransformation/Met ID
Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...
Senior
Frontage Laboratories
Exton, PA
12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!