Senior Data Engineer
Kaav Inc.
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows. Required Skills : Data Analysis,Data Warehouse Basic Qualification : Additional Skills : Data Engineer Background Check : No
Drug Screen : No
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows. Required Skills : Data Analysis,Data Warehouse Basic Qualification : Additional Skills : Data Engineer Background Check : No
Drug Screen : No
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation...Senior
RIT Solutions, Inc.
Malvern, PA4 days ago - ...The Senior Database Developer will be responsible for designing, developing, configuring, and maintaining enterprise database solutions... ...Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based...Senior
BCBS Global Solutions
King of Prussia, PA4 days ago $191k - $286k
General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province Pennsylvania Date... ...supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize...SeniorRemote work- Coforge is seeking a Senior Data Engineer (Agentic Retrieval & Memory) in Oaks, PA for a full-time role. You will design agent memory interfaces across session state, short-term history, and long-term memory, and select optimal stores for each tier. You will integrate...SeniorFull timeTemporary work
- BCBS Global Solutions is seeking a Senior Database Developer to design, develop, and maintain enterprise Oracle and SQL Server databases. You will implement ETL with SSIS, design data warehouses, and lead data initiatives within SDLC frameworks. The role requires expert...Senior
- Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term...SeniorFull timeTemporary work
- ...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...SeniorFull timeWork at officeRemote workWorldwide
- A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...Senior
- ...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity...Permanent employmentFull timeLocal area
Q1 Technologies
Malvern, PA12 hours ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA1 day ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA4 days ago - ...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data...Full timeRemote work
MHK TECH INC
Malvern, PA10 hours ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA11 hours ago - ...Data Engineer Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates...
Software Technology Inc
Malvern, PA3 days ago - ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...
RIT Solutions
Malvern, PA3 days ago - ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA2 days ago - ...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA10 hours ago - ...Big Data Engineer - Malvern, PA Duration - 12+ months Interview Process - Video interview Must Have - Expert in Python Strong expertise in SQL, Presto, HIVE, and Spark Must have hands-on experience working with Trading/Investment data Strong...
Veracity
Malvern, PA3 days ago - Job Title Required Skills: Python, Spark, AWS services, Glue, IAC Responsibilities ~ Work with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA3 days ago - ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA3 days ago $55 - $58 per hour
...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate...Artech
Malvern, PA23 hours ago- ...ROLE_DESCRIPTION - Senior AWS Data Scientist with 8+ years of experience in Machine Learning, MLOps, and GenAI, specializing in Amazon... ..., Redshift, Lambda, and CloudWatch. Expertise in feature engineering, predictive modeling, and statistical analysis....Senior
Diverse Lynx
Malvern, PA12 hours ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA4 days ago - ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days in office) The Senior Data Scientist plays... ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable....SeniorWork at office
CubeSmart Self Storage
Malvern, PA12 hours ago - Build Data Products That MatterDesign and build scalable data platforms, pipelines, and services that power analytics, business decisions... ..., scalability, reliability, observability, and security.Engineer Smarter with AILeverage AI-assisted development tools to accelerate...Full timeTemporary work
- Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...Senior
- ...agents.Contribute to the development and testing of robust, scalable agentic architectures and infrastructure.Collaborate with senior engineers and data scientists in feature development, experiments, and integration of research findings.Participate in code reviews, testing,...SeniorFull time
- ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- ...office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design,... ...strategy, operational performance, risks, and key initiatives to senior leadership and executive stakeholders.Required Skills5+ years...SeniorFull timeWork at officeRemote workWorldwide
- ...research and insights across Investment Management. This role partners closely with quantitative researchers, data scientists, and investment teams to engineer, deploy, and operate production-grade machine learning models that drive research, analytics, and business insights...SeniorWork experience placement
Vanguard
Malvern, PA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data center engineer Malvern, PA
- etl data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data engineer machine learning Malvern, PA
- finance data engineer Malvern, PA
- data engineer Malvern, PA
- data developer Malvern, PA
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- aws data engineer Malvern, PA