Data Engineer
V-Soft Consulting Group
Technical Stack & Requirements:
- Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
- Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
- Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
- Bachelor's degree in Computer Science or related field.
- Strong hands-on experience with Apache Spark and Glue.
- Proven ability to work with Python-based data pipelines.
- Experience with Git and GitHub Actions is mandatory.
- 5-7+ years of enterprise Data Engineering experience.
- Strong Python development experience.
- Advanced SQL programming skills.
- Extensive experience with Apache Spark and PySpark.
- Strong experience with Databricks application.
- Hands-on experience with AWS data services including:
- Experience building enterprise ETL and ELT pipelines.
- Experience in EMR-based Query Cluster workloads, that includes Jupyter notebooks, Park Application and ETL Pipelines.
- Strong understanding of distributed data processing.
- Experience working with large-scale cloud data platforms.
- Strong knowledge of dimensional data modeling.
- Experience implementing CI/CD pipelines.
- Familiarity with Agile/Scrum methodologies.
- Excellent communication and stakeholder management skills.
- Financial Services or Asset Management industry experience.
- Knowledge of Apache Iceberg, Delta Lake, or Hudi.
- Experience with Airflow.
- Knowledge of Kafka or Kinesis streaming.
- Experience supporting AI/ML and advanced analytics platforms.
- AWS Professional or Specialty Certifications. V-Soft Consulting Group
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Malvern, PA vacancy
- ...Lead Data Engineer / Data Architect - Innovation & POC Lead Location: Exton, PA | Onsite Experience: 10+ Years Role Summary Lead enterprise data engineering and architecture initiatives, focusing on technology innovation, POCs, platform evaluation, and...Suggested
Georgia IT Inc
Exton, PA15 hours ago - ...Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team. In this hands-on role, you will design, build, and operate scalable data pipelines and data products that support analytics, AI, and critical business functions. You will provide...Suggested
Vanguard Group, Inc.
Malvern, PA3 days ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....Suggested
Trinity Technology Solutions
Malvern, PA17 hours ago - ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work....Suggested
Kaav Inc.
Malvern, PA3 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...Suggested
Samprasoft
Malvern, PA5 days ago - ...Senior Data Engineer Assessment required Hybrid - Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation...
RIT Solutions
Malvern, PA3 days ago - ...Request ID: 111240-1 Title: Senior Data Engineer Locations: Malvern, PA Interview Mode: Onsite Duration: 06+ Months with Possible Extension. Pay Range: $60-$65/Hour on W2/C2C (All inclusive) We are seeking an experienced AWS Data Engineer with expertise...Local area
Artech
Malvern, PA5 days ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...Contract workImmediate startRemote work
3B Staffing LLC
Malvern, PA4 days ago - ...Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment....
3B Staffing LLC
Malvern, PA2 days ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...
Samprasoft
Malvern, PA5 days ago - ...designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions....
Brains Technology Solutions, Inc.
Malvern, PA2 days ago - Responsibilities: Leads and develops a team of managers, technical leads, and engineers, building a strong leadership bench and high-performing... ...development. Owns the end-to-end lifecycle of enterprise data products and platforms, including definition, development,...Full time
Vanguard
Malvern, PA1 day ago - ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
Vishay
Malvern, PA2 days ago - ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
Sonsoft
Valley Forge, Montgomery County, PA5 days ago - ...Data Analyst Video Interview is okay Project name - Platform Transitions Program Level 3 (5-8 Years) Senior Responsibilities: Direct integration with internal partners to develop business strategies and achieve organizational goals...
RIT Solutions, Inc.
Wayne, PA16 hours ago - ...internationally awarded videos. We're committed to Never Stop Driving. Ready to get in the driver's seat? Join us! As a Data Engineer II , you will be joining a fast-paced, high functioning team to build and maintain data pipelines and services that support...Work experience placementWork at officeRemote work3 days per week
The Hagerty Group, LLC
Folsom, PA4 days ago - ...Role Overview: This role is for a Data Engineer focused on designing, implementing, and optimizing robust ETL/ELT pipelines and complex data models primarily using PySpark and Snowflake. The engineer will be responsible for ensuring high data quality, integrity, and...
Prophecy Technologies
West Chester, PA19 hours ago - ...Requisition #: 76678The Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building the capabilities... ...trust the result. We deliver with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built...For contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA2 days ago - ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...
ClifyX
Conshohocken, PA4 days ago $120.38k - $192.6k
...officeRelocation assistance: is not available for this opportunity.Requisition #: 76603The Role at a GlanceAs a Senior Lead Risk Data Engineer and Architect, you will architect and lead the design and implementation of new technology solutions for the Risk Investments...Work experience placementWork at office3 days per weekLincoln Financial Group
Villanova, PA2 days ago$113.1k - $185k
...optimism and focus. We don’t settle until we give our best and know that we’re making a difference. We're looking for a Voice Data Security Engineer in Conshohocken, PA/Cincinnati, OH/Indianapolis, IN/Cary, NC/Texas or Virginia area who is excited about working on...Full timeRemote workJacobs
Conshohocken, PA3 days ago- ...opportunity.Requisition #: 76677The Role at a GlanceAbout AIDA Data Strategy and GovernanceLincoln Financial's AI, Data and Analytics... ...the result. We deliver with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built into...For contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA2 days ago - ...provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and implement...Contract workWork at officeImmediate startFlexible hours
Artech
Collegeville, PA1 day ago - ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Permanent employmentFull timeH1b
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud Services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation/SNS/EventBridge Knowledge ...Work experience placement
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...
- Job ID: 26183408Reference Number: 25-00948Title: AWS Python ML DeveloperPosted Date: 2025-08-21Contact: Ekta ChaudharyContact Email: ****@*****.*** Phone: (***) ***-****Company: HAN Staffing Job Title: AWS Python ML Developer - Lead LevelJob Location...
HAN Staffing
Malvern, PA1 day ago - ARKA Group L.P. is seeking a Staff Data Engineer/Scientist to lead the development of ETL pipelines for AI/ML and LLM solutions. You will mentor an interdisciplinary team of developers and researchers while building scalable data infrastructure to support a broad set of...
- Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Malvern, PA
- senior cloud data engineer Malvern, PA
- data science developer Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- sr information security engineer Malvern, PA