Senior Data Engineer

Kaav Inc.

Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.

Required Skills : Data Analysis,Data Warehouse

Basic Qualification :

Additional Skills : Data Engineer

Background Check : No

Drug Screen : No

Apply

Vacancy posted 6 hours ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy

Senior Data Engineer
...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
Senior
V-Soft Consulting Group
Malvern, PA
4 days ago
Senior Data Engineer (Hybrid)
...Senior Data Engineer (Hybrid) Location: Wilmington, DE / Berwyn, PA Duration: 18 Months, quarterly increments Job Description: Senior Data Engineer to support a large-scale enterprise data modernization initiative focused on migrating critical banking and...
Senior
Serigor Inc
Berwyn, PA
3 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...
Senior
Full time
For contractors
Work at office
Vanguard
Malvern, PA
4 days ago
Data Senior Engineer
Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...
Senior
NTT DATA
King of Prussia, PA
3 days ago
Senior Data Engineer: Agentic Retrieval & Memory (Hybrid)
Vish Consulting Services (VISHUSA) seeks a Senior Data Engineer to design and implement Agentic Retrieval architectures and memory systems for enterprise AI platforms in a hybrid Oaks, PA setting. Lead data pipelines, vector search, and RAG solutions using PostgreSQL with...
Senior
Vish Consulting Services Inc
Oaks, PA
4 days ago
Senior Data Engineer - BI Pipelines & AI Dashboards
Eigen X in King of Prussia, PA seeks a Senior Data Engineer to design and implement scalable data pipelines for BI and reporting. You will drive data products, automated dashboards, and analytics self-service, while mentoring teams and documenting architectures. Responsibilities...
Senior
Eigen X
King of Prussia, PA
1 day ago
Senior Data Operations & Database Engineer
A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...
Senior
The Hartford
Wayne, PA
3 days ago
Data Engineer
...Data Engineer Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates...
Software Technology Inc
Malvern, PA
2 days ago
Data engineer
...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...
RIT Solutions
Malvern, PA
2 days ago
data engineer
...Data engineer 5-8 years of exp hybird - malvern, pa or plano, tx, or charlotte, nc assessment required Description Details Client is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized...
RIT Solutions, Inc.
Malvern, PA
2 days ago
Data Engineer
...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA
6 hours ago
Data Engineer
...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA
2 days ago
Big Data Engineer
...Big Data Engineer - Malvern, PA Duration - 12+ months Interview Process - Video interview Must Have - Expert in Python Strong expertise in SQL, Presto, HIVE, and Spark Must have hands-on experience working with Trading/Investment data Strong...
Veracity
Malvern, PA
2 days ago
Data Engineer
...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA
4 days ago
Big Data Engineer
Job Title Required Skills: Python, Spark, AWS services, Glue, IAC Responsibilities ~ Work with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA
2 days ago
Data Engineer
...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....
Contract work
Local area
Immediate start
Syntricate Technologies
Malvern, PA
5 days ago
Data Engineer
...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data...
Full time
Remote work
MHK TECH INC
Malvern, PA
4 days ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
3 days ago
Data Engineer
...Cloud Data Engineer This role requires an understanding of mapping legacy or home-grown data platforms and modernization or migration to a cloud-native data platform. Understanding of AWS cloud systems is critical. A minimum of 10 years of hands-on expertise in AWS,...
Diverse Lynx
Malvern, PA
3 days ago
Sr. DATA Engineer
...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate...
Senior
ClifyX
Conshohocken, PA
4 days ago
Data Analytical Engineer
...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...
RIT Solutions
Malvern, PA
3 days ago
Senior Data Scientist
...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days in office) The Senior Data Scientist plays... ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable....
Senior
Work at office
CubeSmart Self Storage
Malvern, PA
4 days ago
AWS Data Engineer
Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark, Attunity...
Purple Drive
Malvern, PA
4 days ago
AWS Data Engineer
Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting...
Syntricate Technologies
Malvern, PA
4 days ago
ETL Data Engineer
Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. • Deep technical knowledge - including...
Trinity Technology Solutions
Malvern, PA
4 days ago
Data Engineer
...Data Engineer - Assessment required Hybird Malvern, pa Job Description Duties: Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills...
Akaasa Technologies
Malvern, PA
3 days ago
Big Data Engineer
...Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services Qualifications Expert knowledge of Python, SQL, PySpark...
Zuven technologies Inc
Malvern, PA
3 days ago
Lead / Senior AI/ML Data Scientist
Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...
Senior
Full time
Vanguard
Malvern, PA
5 days ago
AWS Data Engineer
Overview: We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale...
Programmers.io
Malvern, PA
3 days ago
Data Engineer, Specialist
Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset...
Full time
Work experience placement
Vanguard
Malvern, PA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!