Data Engineer
Zuven technologies Inc
Technical Stack & Requirements:
- Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture).
- Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
- Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
Qualifications:
- Bachelor's degree in Computer Science or related field.
- Strong hands-on experience with Apache Spark and Glue.
- Proven ability to work with Python-based data pipelines.
- Experience with Git and GitHub Actions is mandatory.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
- 7+ years of enterprise Data Engineering experience.
- Strong Python development experience.
- Advanced SQL programming skills.
- Extensive experience with Apache Spark and PySpark.
- Hands-on experience with AWS data services including:
- S3
- AWS Glue
- Athena
- Lambda
- Step Functions
- EventBridge
- Experience building enterprise ETL and ELT pipelines.
- Strong understanding of distributed data processing.
- Experience working with large-scale cloud data platforms.
- Strong knowledge of dimensional data modeling.
- Experience implementing CI/CD pipelines.
- Familiarity with Agile/Scrum methodologies.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Financial Services or Asset Management industry experience.
- Experience with Snowflake or Databricks.
- Knowledge of Apache Iceberg, Delta Lake, or Hudi.
- Experience with Airflow.
- Knowledge of Kafka or Kinesis streaming.
- Experience supporting AI/ML and advanced analytics platforms.
- AWS Professional or Specialty Certifications.
Required Skills :
Basic Qualification :
Additional Skills :
Background Check : No
Drug Screen : No
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Malvern, PA vacancy
$49.46 - $54.46 per hour
...Data EngineerResponsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services. Location: Malvern, Pennsylvania. Job type: Contract...SuggestedHourly payContract workRandstad
Malvern, PA2 days ago- ...Job TitleResponsibilitiesAbility to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data filesQualificationsExpert in SQLAWS S3 and Glue experienceAdvanced Data Modeling principlesRequired Skills : Data WarehouseBasic Qualification...Suggested
Kaav Inc.
Malvern, PA2 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems,... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and Jira...Suggested
RIT Solutions
Malvern, PA2 days ago - Data Engineer Assessment required Hybird Malvern, pa Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications Python, SQL, AWS ServicesSuggested
Akaasa Technologies
Malvern, PA3 days ago - ...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement...Suggested
Syntricate Technologies
Malvern, PA2 days ago - Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...
- ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale data... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
- Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability...
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA1 day ago - Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...
- NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...
- Job Title: Senior Data Engineer Location : Malvern, PA Duration:6 Months Experience Required: 8-10 Request ID:82529-1 Description : Please prioritize candidates with Vanguard experience. ROLE_DESCRIPTION - Build and maintain event-driven data pipelines using AWS services...
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1...Contract workImmediate startRemote work
- Senior Data Engineer - 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services, API...
- Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including...Work experience placement
$190k
Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy...- Job Summary: The Data Engineer will design and build an extensive transaction stitching application that tracks the journey of money flowing through a client's account over the lifetime of funds. The role requires advanced Python and SQL expertise along with strong hands...
- Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
- Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work with large datasets...Contract work
- Data Engineer/Python Senior Data Engineer Malvern, PA (Hybrid) Level 4 (8+ years) Role Summary We are seeking a highly motivated Senior Data Engineer to join the Cost Basis Accounting and Method team. This role is primarily focused on a critical, multi-year Batch Modernization...
- Job Title: AWS Senior Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 6-8 ROLE_DESCRIPTION - Strong experience in AWS Data Engineering services: Redshift, EMR, AWS Glue, S3, IAM, Lambda, CloudWatch. • Expertise in designing and developing ETL...
- ...Head Of Data Engineering & Analytics Vishay manufactures one of the world's largest portfolios of discrete semiconductors and passive electronic components that are essential to innovative designs in the automotive, industrial, computing, consumer, telecommunications...
Vishay Intertechnology Inc
Malvern, PA1 day ago - ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Permanent employmentFull timeH1b
SonSoft
King of Prussia, PA2 days ago - Principal Data Platform & Machine Learning Engineer We are assisting our client in hiring for a Principal Data Platform & Machine Learning Engineer. Our client is an established SaaS company serving banks, credit unions, and fintechs. Their cloud-based platform helps financial...Local area
- The Vanguard Group is seeking a Data Engineer, Specialist to design, develop, and maintain scalable data pipelines and infrastructure that support analytics and business intelligence. This role involves building robust ETL processes, managing databases and optimizing cloud...
- 7N is seeking a Data Engineer to design, build, and govern enterprise data platforms using Microsoft Fabric, SQL Server, Dataverse, and Azure services. You will create scalable data architectures and reusable data products to support operational apps, analytics, and AI...
- Role Overview The Data Engineer, Specialist is responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics and business intelligence initiatives. This role involves building robust ETL (Extract, Transform, Load)...
- Data Engineer Advice and Wealth Management Technology (AWMT) is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized financial advice through data infrastructure, machine learning, and engineering excellence. The...
- ...Retirement Savings Plan Join us and be a part of something bigger. Apply today. Responsibilities Elwyn seeks a Data Engineer to play a key role in designing, building, and maintaining the organization’s cloud-based data platform on Microsoft Azure. This...Flexible hours
Elwyn
Glenolden, PA9 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- data science developer Malvern, PA
- finance data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data center engineer Malvern, PA
- data engineer Malvern, PA
- sr information security engineer Malvern, PA
- senior cloud data engineer Malvern, PA
- senior data center engineer Malvern, PA