Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Kaav Inc.

Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.

Required Skills : Data Analysis,Data Warehouse

Basic Qualification :

Additional Skills : Data Engineer

Background Check : No


Drug Screen : No
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
  •  ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading... 
    Senior

    Kaav Inc.

    Malvern, PA
    13 hours ago
  •  ...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation... 
    Senior

    RIT Solutions, Inc.

    Malvern, PA
    5 days ago
  • The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard... 
    Senior
    Full time
    For contractors
    Work at office

    Vanguard

    Malvern, PA
    7 hours ago
  •  ...The Senior Database Developer will be responsible for designing, developing, configuring, and maintaining enterprise database solutions...  ...Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based... 
    Senior

    BCBS Global Solutions

    King of Prussia, PA
    5 days ago
  • $191k - $286k

    General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province Pennsylvania Date...  ...supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize... 
    Senior
    Remote work

    ANSYS

    Exton, PA
    3 days ago
  • Coforge is seeking a Senior Data Engineer (Agentic Retrieval & Memory) in Oaks, PA for a full-time role. You will design agent memory interfaces across session state, short-term history, and long-term memory, and select optimal stores for each tier. You will integrate... 
    Senior
    Full time
    Temporary work

    Coforge

    Oaks, PA
    1 day ago
  • BCBS Global Solutions is seeking a Senior Database Developer to design, develop, and maintain enterprise Oracle and SQL Server databases. You will implement ETL with SSIS, design data warehouses, and lead data initiatives within SDLC frameworks. The role requires expert... 
    Senior

    BCBS Global Solutions

    King of Prussia, PA
    4 days ago
  • Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term... 
    Senior
    Full time
    Temporary work

    Coforge

    Oaks, PA
    1 day ago
  •  ...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will... 
    Senior
    Full time
    Work at office
    Remote work
    Worldwide

    Comcast

    West Chester, PA
    3 days ago
  • A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL... 
    Senior

    The Hartford

    Wayne, PA
    12 hours ago
  • $120k - $130k

     ...Attunity, Pyspark, AWS (S3, IAM, Lambda, Cloud Formation) Roles & Responsibilities • Design, develop, and maintain scalable ETL/data integration pipelines using AWS Glue, PySpark, and Python. • Develop and optimize data transformation workflows to process large... 

    Tata Consultancy Services

    Malvern, PA
    5 days ago
  •  ...AWS Data EngineerLocation: Malvern, PA, 19355Job Type: FulltimeSalary: $120,000-$130,000 a year+ benefitsKey Technical SkillsPythonAWS Glue (Glue ETL)PySparkAttunity / Qlik ReplicateAWS Services: Amazon S3, IAM, Lambda, CloudFormationRoles & ResponsibilitiesDesign, develop... 

    Diverse Lynx

    Malvern, PA
    1 day ago
  •  ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.... 

    Trinity Technology Solutions

    Malvern, PA
    1 day ago
  •  ...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating... 

    Veracity

    Malvern, PA
    1 day ago
  •  ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr.... 
    Contract work
    Local area
    Immediate start

    Syntricate Technologies

    Malvern, PA
    1 day ago
  •  ...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement... 

    Syntricate Technologies

    Malvern, PA
    12 hours ago
  •  ...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real...  ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops... 

    Kaav Inc.

    Malvern, PA
    6 days ago
  •  ...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands... 

    InterSources

    Malvern, PA
    12 hours ago
  •  ...Data EngineerData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using Azure Data Factory...  ...operationalize ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML... 

    MHK TECH INC

    Malvern, PA
    12 hours ago
  • Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data

    Syntricate Technologies

    Malvern, PA
    12 hours ago
  •  ...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional... 

    I-Flow

    Malvern, PA
    1 day ago
  •  ...Data engineer Malvern pa hybrid Assessment required Minimum 8-10 years of exp n * Location - Preferred Charlotte (but can be in Malvern) * pprox desired start - asap * Role - Level 4 Big Data Engineer, Python developer * required skillset - Python... 
    Immediate start

    RIT Solutions, Inc.

    Malvern, PA
    1 day ago
  •  ...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in... 

    RIT Solutions

    Malvern, PA
    12 hours ago
  •  ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize...  ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy... 

    Samprasoft

    Malvern, PA
    5 days ago
  •  ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources... 

    RIT Solutions

    Malvern, PA
    4 days ago
  •  ...ROLE_DESCRIPTION - Senior AWS Data Scientist with 8+ years of experience in Machine Learning, MLOps, and GenAI, specializing in Amazon...  ..., Redshift, Lambda, and CloudWatch. Expertise in feature engineering, predictive modeling, and statistical analysis.... 
    Senior

    Diverse Lynx

    Malvern, PA
    1 day ago
  •  ...Senior AWS Data ScientistSpecializing in Amazon SageMaker, Bedrock, Python, and AWS analytics services to build, deploy, and optimize scalable...  ..., Redshift, Lambda, and CloudWatch.Expertise in feature engineering, predictive modeling, and statistical analysis.Experience... 
    Senior

    Diverse Lynx

    Malvern, PA
    12 hours ago
  •  ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of... 

    Samprasoft

    Malvern, PA
    5 days ago
  •  ...Senior Data ScientistThis is a hybrid role based in the Malvern, PA office. (3 days in office)The Senior Data Scientist plays a critical...  ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable.... 
    Senior
    Work at office

    CubeSmart Self Storage

    Malvern, PA
    1 day ago
  • Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time...  ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and... 
    Senior

    Frontage Laboratories

    Exton, PA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!