Data Engineer
Zuven technologies Inc
Technical Stack & Requirements:
Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
Qualifications:
Bachelor's degree in Computer Science or related field.
Strong hands-on experience with Apache Spark and Glue.
Proven ability to work with Python-based data pipelines.
Experience with Git and GitHub Actions is mandatory.
Required
Qualifications
Bachelor's degree in Computer Science, Engineering, Information
Systems, or related discipline.
5-7+ years of enterprise Data Engineering experience.
Strong Python development experience.
Advanced SQL programming skills.
Extensive experience with Apache Spark and PySpark.
Strong experience with Databricks application.
Hands-on experience with AWS data services including:
o S3
o AWS Glue
o Athena
o Lambda
o Step
Functions
o EventBridge
Experience building enterprise ETL and ELT pipelines.
Experience in EMR-based Query Cluster workloads, that includes Jupyter notebooks, Park Application and ETL Pipelines.
Strong understanding of distributed data processing.
Experience working with large-scale cloud data platforms.
Strong knowledge of dimensional data modeling.
Experience implementing CI/CD pipelines.
Familiarity with Agile/Scrum methodologies.
Excellent communication and stakeholder management skills.
Preferred
Qualifications
Financial Services or Asset Management industry experience.
Knowledge of Apache Iceberg, Delta Lake, or Hudi.
Experience with Airflow.
Knowledge of Kafka or Kinesis streaming.
Experience supporting AI/ML and advanced analytics platforms.
AWS Professional or Specialty Certifications.
Required Skills :
Basic Qualification :
Additional Skills :
Background Check : No
Drug Screen : No
- ...Data Engineer Assessment required Hybird Malvern, pa Responsibilities ~ Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications ~ Python, SQL, AWS Services Job...Suggested
Akaasa Technologies
Malvern, PA2 days ago - ...Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services Qualifications Expert knowledge of Python, SQL, PySpark...Suggested
Zuven technologies Inc
Malvern, PA2 days ago - Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability...Suggested
- ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale data... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work. Develops...Suggested
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...Suggested
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...
RIT Solutions, Inc.
Malvern, PA1 day ago - Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...
- Job Title: Senior Data Engineer Location : Malvern, PA Duration:6 Months Experience Required: 8-10 Request ID:82529-1 Description : Please prioritize candidates with Vanguard experience. ROLE_DESCRIPTION - Build and maintain event-driven data pipelines using AWS services...
- NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1...Contract workImmediate startRemote work
- Senior Data Engineer - 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services, API...
- Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including...Work experience placement
$190k
Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy...- Job Summary: The Data Engineer will design and build an extensive transaction stitching application that tracks the journey of money flowing through a client's account over the lifetime of funds. The role requires advanced Python and SQL expertise along with strong hands...
- Data Engineer/Python Senior Data Engineer Malvern, PA (Hybrid) Level 4 (8+ years) Role Summary We are seeking a highly motivated Senior Data Engineer to join the Cost Basis Accounting and Method team. This role is primarily focused on a critical, multi-year Batch Modernization...
- Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work with large datasets...Contract work
- Job Title: AWS Senior Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 6-8 ROLE_DESCRIPTION - Strong experience in AWS Data Engineering services: Redshift, EMR, AWS Glue, S3, IAM, Lambda, CloudWatch. • Expertise in designing and developing ETL...
- Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
- Data Engineer - AWS/Python/AngularHybrid - Malvern PAAbout The Team:Working in this team will require a developer who is robust in both WebApp and DevOps principles to help create a modernized platform that will be in use by Analysts and Data Engineers. The deliverables...
- ...Head Of Data Engineering & Analytics Vishay manufactures one of the world's largest portfolios of discrete semiconductors and passive electronic components that are essential to innovative designs in the automotive, industrial, computing, consumer, telecommunications...
Vishay Intertechnology Inc
Malvern, PA3 days ago - Principal Data Platform & Machine Learning Engineer We are assisting our client in hiring for a Principal Data Platform & Machine Learning Engineer. Our client is an established SaaS company serving banks, credit unions, and fintechs. Their cloud-based platform helps financial...Local area
- The Vanguard Group is seeking a Data Engineer, Specialist to design, develop, and maintain scalable data pipelines and infrastructure that support analytics and business intelligence. This role involves building robust ETL processes, managing databases and optimizing cloud...
- 7N is seeking a Data Engineer to design, build, and govern enterprise data platforms using Microsoft Fabric, SQL Server, Dataverse, and Azure services. You will create scalable data architectures and reusable data products to support operational apps, analytics, and AI...
- Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset...Full timeWork experience placement
Vanguard
Malvern, PA5 days ago - ...teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable... ..., and operational excellence. The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed...For contractorsWork at officeMalvern, PA9 days ago
- ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentH1b
SonSoft
Valley Forge, Montgomery County, PA1 day ago - Role Overview The Data Engineer, Specialist is responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load)...
- Data Engineer Advice and Wealth Management Technology (AWMT) is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized financial advice through data infrastructure, machine learning, and engineering excellence. The...
- Data Platform And Security Engineer Hybrid Malvern, PA No assessment Focuses on hardening Client's Data Platforms and code environment against AI-driven attacks (like Mythos) by preventing vulnerabilities early and accelerating remediation using AI. Objectives: 1. Preventing...Shift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- data science developer Malvern, PA
- finance data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data center engineer Malvern, PA
- data engineer Malvern, PA
- sr information security engineer Malvern, PA
- senior cloud data engineer Malvern, PA
- senior data center engineer Malvern, PA