Data Engineer
V-Soft Consulting Group
Technical Stack & Requirements:
- Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
- Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
- Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
- Bachelor's degree in Computer Science or related field.
- Strong hands-on experience with Apache Spark and Glue.
- Proven ability to work with Python-based data pipelines.
- Experience with Git and GitHub Actions is mandatory.
- 5-7+ years of enterprise Data Engineering experience.
- Strong Python development experience.
- Advanced SQL programming skills.
- Extensive experience with Apache Spark and PySpark.
- Strong experience with Databricks application.
- Hands-on experience with AWS data services including:
- Experience building enterprise ETL and ELT pipelines.
- Experience in EMR-based Query Cluster workloads, that includes Jupyter notebooks, Park Application and ETL Pipelines.
- Strong understanding of distributed data processing.
- Experience working with large-scale cloud data platforms.
- Strong knowledge of dimensional data modeling.
- Experience implementing CI/CD pipelines.
- Familiarity with Agile/Scrum methodologies.
- Excellent communication and stakeholder management skills.
- Financial Services or Asset Management industry experience.
- Knowledge of Apache Iceberg, Delta Lake, or Hudi.
- Experience with Airflow.
- Knowledge of Kafka or Kinesis streaming.
- Experience supporting AI/ML and advanced analytics platforms.
- AWS Professional or Specialty Certifications. V-Soft Consulting Group
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Malvern, PA vacancy
- Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality dataSuggested
Syntricate Technologies
Malvern, PA3 days ago - Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and code....Suggested
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...Suggested
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...Suggested
- Job Title Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills : Data Warehouse Basic...Suggested
- NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...
- Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1...Contract workImmediate startRemote work
- ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA2 days ago $190k
Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy...- Data Engineer - AWS/Python/Angular Hybrid - Malvern PA About the team: Working in this team will require a developer who is robust in both WebApp and DevOps principles to help create a modernized platform that will be in use by Analysts and Data Engineers. The deliverables...
- 7N is seeking a Data Engineer to design, build, and govern enterprise data platforms using Microsoft Fabric, SQL Server, Dataverse, and Azure services. You will create scalable data architectures and reusable data products to support operational apps, analytics, and AI...
- Data Platform And Security Engineer Hybrid Malvern, PA No assessment Focuses on hardening Client's Data Platforms and code environment against AI-driven attacks (like Mythos) by preventing vulnerabilities early and accelerating remediation using AI. Objectives: 1. Preventing...Shift work
- Data Engineer, Specialist Apply ( locations Malvern, PA time type Full time posted on Posted 26 Days Ago job requisition id 181665 Core Responsibilities Provides advanced data solutions by using software to process, store, and serve data to others. Tests data...Full timeWork experience placement
- ...environment where creativity and continuous learning are encouraged, enabling our employees to thrive and grow. Position: Lead-Data Engineering Location: King of Prussia, PA (Hybrid) Responsibilities Own end-to-end data strategy, data governance and data policies.ac...
- Hexaware Technologies in King of Prussia, PA, is seeking a Lead-Data Engineering to drive data strategy, governance, and policy implementation in a hybrid work environment. You will partner with client leadership to define standards, assess data estates, and recommend...
- Data Engineer Location - West Chester, PA Onsite. Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python Job Summary: The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure...
- Data Engineer Expert level with T-SQL. Partitioning and distribution strategies Partition swapping Recursive joins String parsing 1,2,3 normal forms Azure technologies: Azure SQL DW, BLOB Storage, Logic Apps, Azure Data Factory, Azure service Bus. Proven experience with...
- Data Analyst Video Interview is okay Project name - Platform Transitions Program Level 3 (5-8 Years) Senior Responsibilities: Direct integration with internal partners to develop business strategies and achieve organizational goals. Brings structure to business requests...
- Role Overview: This role is for a Data Engineer focused on designing, implementing, and optimizing robust ETL/ELT pipelines and complex data models primarily using PySpark and Snowflake. The engineer will be responsible for ensuring high data quality, integrity, and efficient...
- Data Engineer (TS/SCI with Full Scope Polygraph) {S} Job Category : ENG Requisition Number : DATAE003244 Apply now Posted : February 23, 2026 Full-Time Locations Showing 1 location King Of Prussia, PA 19406, USA Description ARKA Group L.P. (“ARKA”) is an advanced...Full timeTemporary workWork experience placementWork at officeVisa sponsorshipRelocation packageFlexible hours
- ...managers across various asset classes and mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full Stack Engineer, you will design, implement, and maintain a modern, robust, and scalable platform to...
- ...software company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills...Permanent employmentFull time
- Job Title: Data Engineering Lead Location: Malvern, PA Contract Job Description: Skills: Java| AWS | Python | PySpark | Event-Driven Pipelines | Data Architecture Summary We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in...Contract work
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Permanent employmentFull timeH1b
- Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate...
- Vish Consulting Services (VISHUSA) seeks a Senior Data Engineer to design and implement Agentic Retrieval architectures and memory systems for enterprise AI platforms in a hybrid Oaks, PA setting. Lead data pipelines, vector search, and RAG solutions using PostgreSQL with...
- We are seeking a passionate and skilled Senior Data Engineer to join our dynamic team in King of Prussia, PA. In this role, you will lead the design and implementation of advanced data pipelines for Business Intelligence (BI) and reporting. Your expertise will transform...
- A leading technology company in King of Prussia is looking for a skilled Data Engineer/Scientist to support AI/ML algorithm development. You will work on complex data sets, improve data processes, and collaborate with a team of experts. Ideal candidates have a bachelor'...Relocation packageFlexible hours
- Eigen X in King of Prussia, PA seeks a Senior Data Engineer to design and implement scalable data pipelines for BI and reporting. You will drive data products, automated dashboards, and analytics self-service, while mentoring teams and documenting architectures. Responsibilities...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches