Senior Data Engineer
eTeam Inc
REQUIREMENT_CITY - Malvern, PA
Role Name - Senior Data Engineer
Develop ETL/ELT workflows using Python and PySpark, ensuring performance, scalability, and cost efficiency.
Implement and optimize Spark-based data transformations, partitioning strategies, and data processing frameworks.
Design and manage data lake and warehouse structures using S3, Glue Catalog, Athena, and/or Redshift.
Build streaming solutions with checkpointing, stateful transformations, idempotency, and schema evolution.
Ensure high standards of data quality, observability, monitoring, and alerting (CloudWatch, Datadog, etc.).
Implement data security best practices including IAM, encryption (KMS), networking, and governance.
Create reusable frameworks, internal libraries, and CI/CD pipelines for automated deployments.
Collaborate with data scientists, analysts, and business teams to deliver well-modeled, reliable datasets.
Lead design reviews, mentor junior engineers, and contribute to engineering best practices.
Required Qualifications Overall 8 yrs of experience
5 years of professional experience in Data Engineering
Must have an experience on Gule jobs and Lambda,
Experience of working on Java is an advantage
Strong expertise in Python and PySpark for large-scale data processing.
Advanced hands-on experience with AWS (S3, Glue, EMR, Lambda, Step Functions, Kinesis/MSK, DynamoDB, Athena, Redshift).
Deep experience building event-driven and streaming data pipelines.
Strong SQL experience for analytical and ETL workloads.
Hands-on experience with workflow orchestration tools such as Airflow or Step Functions.
Experience with CI/CD, Git, and Infrastructure-as-Code (Terraform or CloudFormation).
Strong understanding of distributed systems, Spark performance tuning, data modeling, and cloud cost optimization.
Knowledge of data security, encryption, networking, and compliance best practices in cloud environments Skills: Digital : Spring Boot
Experience Required: 8-10
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
$50 - $65 per hour
...Job Title: Senior Data Engineer (PySpark & AWS & Agentic AI ) Location: Malvern, PA ( Onsite ) Position : ( C2C Role ) Duration : ( 6+ Months) Pay Range : $50 - 65/Hr Skills: Amazon Web Service(AWS), Cloud Computing, Python, Agentic AI, PySpark....SeniorDiverse Lynx
Malvern, PA1 day ago- ...Role Summary: The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...Senior
Kaav Inc.
Malvern, PA8 hours ago - ...Role Name - Senior Data Engineer ROLE_DESCRIPTION - Build and maintain event-driven data pipelines using AWS services such as Kinesis, MSK/Kafka, Lambda, Step Functions, SQS/SNS, and Glue/EMR. Develop ETL/ELT workflows using Python and PySpark...Senior
Diverse Lynx
Malvern, PA1 day ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...Senior
Samprasoft
Malvern, PA2 days ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...SeniorContract workImmediate startRemote work
3B Staffing LLC
Malvern, PA1 day ago - ...disrupt securities investing across all asset classes. We focus on data strategies including new sources of data and advanced analytics... ...scientists on implementation of AI/ML models Mentor junior engineers to develop production quality code, data pipelines and...SeniorVisa sponsorship
Vanguard Group, Inc.
Malvern, PA3 days ago $51 - $56 per hour
...Akkodis is seeking a Senior Data Engineer for a Contract with a client in Malvern, PA. The candidate will build scalable streaming data pipelines while optimizing ETL workflows and ensuring data quality, security, and performance. Rate Range: $51/hour to $56...SeniorHourly payContract workTemporary workLocal areaAkkodis
Malvern, PA1 day ago- ...Job Title: Senior Data Engineer - AWS & Python Location: Malvern, PA (Onsite/Hybrid likely) Duration: 6 months (extendable) Pay Range: $54-58/Hour on W2 only Note: Applicant must be willing to work on W2. Request-ID: 79469-1 Role Overview: This...Senior
Artech
Malvern, PA4 days ago $82.1k - $172.4k
...Job Title: Senior Data Engineer Job Category: Science Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee Type: Regular Percentage of Travel Required: Up to 10% Type of Travel: Local Anticipated Posting End: 12/31/2026 The Opportunity...SeniorFull timeContract workWork experience placementLocal areaFlexible hoursCACI International
King of Prussia, PA1 day ago- ...Senior Data Engineer We are seeking a highly skilled Senior Data Engineer (or Lead Data Engineer) to design, build, and optimize scalable data pipelines and ETL solutions across enterprise environments. The ideal candidate will bring deep expertise in Big Data technologies...Senior
Argyle Infotech
King of Prussia, PA1 day ago $154.1k - $267.15k
...Description: This position is for an experienced engineer to lead frontend development for the ADDER team and its’ federated data layer products. This role would be the primary leader and point of contact for ADDER’s customer-facing designs and UI platform. This individual...SeniorFull timeTemporary workWork experience placementWork at officeRemote workRelocationFlexible hoursShift work3 days per weekLockheed Martin Corporation
King of Prussia, PA2 days ago- ...Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including...Work experience placement
Samprasoft
Malvern, PA2 days ago - ...Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
Samprasoft
Malvern, PA2 days ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA4 days ago - ...Data Engineer Data Engineer Address: 301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data pipelines...Full timeRemote work
MHK TECH INC
Malvern, PA3 days ago - ...Role Name - Data Engineer with AI Experience ROLE_DESCRIPTION - Data Engineer with AWS cloud + AI experience, explicitly including Redshift, Dremio, Athena, Tableau and Databricks Experience Required: 6-8 Diverse Lynx LLC is an Equal Employment...
Diverse Lynx
Malvern, PA4 days ago - ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work....
Kaav Inc.
Malvern, PA8 hours ago - ...DATA ENGINEER- PHILADELPHIA, PA (REMOTE) The Select Group is hiring a Data Engineer to support the design, implementation, and operation of a large-scale AWS-hosted data infrastructure platform supporting critical building automation and industrial telemetry...Remote work
The Select Group
Exton, PA4 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA2 days ago - ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA1 day ago - ...Overview: Hi All, Client:TCS ob Title: Senior Data Engineer Experience 8-12 years of experience in Data Engineering, Cloud Data Platforms, and large-scale data processing. Key Skills & Technologies Programming: Python (strong), Java (basic...
Purple Drive
Malvern, PA2 days ago - ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA8 hours ago - ...Job Title We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Role Responsibilities Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it...
Syntricate Technologies
Malvern, PA4 days ago - ...Skills: Java| AWS | Python | PySpark | Event-Driven Pipelines | Data Architecture We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in Java, AWS, Python, PySpark, and event-driven architectures. You will design and build...
Diverse Lynx
Malvern, PA2 days ago - ...Security Group of Maryland, and Gallaher & Associates of Tennessee. For more information, please visit ** ** Role Overview The Data Engineer occupies a pivotal position within our organization, responsible for extracting actionable insights from our data resources....Local area
Zeus Fire and Security
Paoli, PA4 days ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Texas State Library and Archives Commision
Malvern, PA3 days ago $85.25k - $125.75k
...which means you can make a difference with your career, while learning, growing and having fun! OPPORTUNITY SUMMARY The Data Engineer works with our IT and Software Development teams, playing a key role in administering, maintaining, optimizing, analyzing, and architecting...Contract workTemporary workWork experience placementH1bWork at officeLocal areaImmediate startRemote workWork visaFlexible hoursCenero
Malvern, PA4 days ago- Job Title Required Skills: Technological requirements include 3+ years' development experience and familiarity with the following tools AWS Core Services: Cloud formation, DynamoDB, S3, Glue, Athena, Kinesis, Firehose AWS Serverless Infrastructure: Lambda...
Syntricate Technologies
Malvern, PA2 days ago - ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA1 day ago - ...Senior Data Scientist - Investment Management Fintech Strategies (IMFS) Investment Management Fintech Strategies (IMFS) is a global... ...in real-world market environments. Raise the bar on engineering quality by mentoring quant strategists and data scientists on...Senior
Vanguard Group, Inc.
Malvern, PA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data developer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior data center engineer Malvern, PA
- finance data engineer Malvern, PA
- data center engineer Malvern, PA
- data science developer Malvern, PA
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- senior cloud data engineer Malvern, PA