Senior Data Engineer

Artech Information Systems LLC

Request ID: 111240-1
Title: Senior Data Engineer
Locations: Malvern, PA
Interview Mode: Onsite
Duration: 06+ Months with Possible Extension.
Pay Range: $60-$65/Hour on W2/C2C (All inclusive)

We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale data processing systems. The ideal candidate will play a critical role in building and maintaining scalable, efficient, and secure ETL pipelines within the AWS ecosystem.

Key Responsibilities:
• Design, develop, and maintain robust ETL workflows to extract, transform, and load data from various sources to AWS Redshift and other cloud-based systems.
• Leverage AWS Lambda to build serverless computing solutions for real-time data processing and automation.
• Work with AWS data storage and processing services, including S3, Redshift, Athena, and Glue, to support data processing pipelines.
• Utilize Python and PySpark to create and optimize data transformation logic and analytical queries.
• Collaborate with cross-functional teams to understand data requirements and provide efficient data solutions.
• Monitor and optimize cloud-based infrastructure for performance, reliability, and cost efficiency.
• Troubleshoot and resolve data pipeline issues, ensuring minimal downtime and high data accuracy.
• Implement automation and monitoring tools to enhance reliability.

Required Skills and Qualifications:
• Proven experience working with AWS services, including Lambda, Redshift, S3, Athena, Glue, and CloudWatch.
• Strong knowledge and hands-on experience with Python and PySpark for data transformation and processing.
• Expertise in building and optimizing ETL pipelines in a cloud environment.
• In-depth understanding of relational databases, data warehousing, and performance tuning in Redshift.
• Strong problem-solving and troubleshooting skills.
• Familiarity with infrastructure as code tools like AWS CloudFormation.
• Experience with version control (e.g., Git) and CI/CD pipelines.
• Solid understanding of data security, data privacy, and compliance frameworks.
• Ability to work in an agile, fast-paced environment.

Ex-Client and local Candidates preferred

Skills: Digital: Python~ Digital : Amazon Web Service (AWS) Cloud Computing~ Digital: PySpark~ Core Java
Experience Required: 10 & Above

Apply

Vacancy posted 22 hours ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy

Senior Data Engineer
...Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment....
Senior
3B Staffing LLC
Malvern, PA
3 days ago
Senior Data Engineer
...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...
Senior
Samprasoft
Malvern, PA
23 hours ago
Senior Data Engineer
...Senior Data Engineer Assessment required Hybrid - Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation...
Senior
RIT Solutions
Malvern, PA
4 days ago
SENIOR DATA ENGINEER
...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...
Senior
Contract work
Immediate start
Remote work
3B Staffing LLC
Malvern, PA
5 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...
Senior
Full time
For contractors
Work at office
Vanguard
Malvern, PA
2 days ago
Data Senior Engineer
Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...
Senior
NTT DATA
King of Prussia, PA
1 day ago
Senior Data Engineer, AI Data Products
...Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built into the product.As a Senior Data Engineer, you wil lead the end-to-end...
Senior
For contractors
Work experience placement
3 days per week
Lincoln Financial Group
Villanova, PA
2 days ago
Big Data Engineer
...Big Data Engineer Hybrid - Malvern, PA Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency...
RIT Solutions
Malvern, PA
5 days ago
Data Engineer
...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA
5 days ago
Big Data Engineer
...Responsibilities ~ Pulling data from GitHub and Jira transforming it for input into our data warehouse. Qualifications Familiarity with AWS including lambda, event bridge, s3. Proficient in typescript Datalake / Data warehouse experience is a big...
Brains Technology Solutions, Inc.
Malvern, PA
3 days ago
AWS Data Engineer
...AWS Data Engineer We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics...
Syntricate Technologies
Malvern, PA
3 days ago
Big Data Engineer
...Responsibilities ~ Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required...
Procyon TS
Malvern, PA
4 days ago
Data Engineer
Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud Services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation/SNS/...
Work experience placement
Brains Technology Solutions, Inc.
Malvern, PA
3 days ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
1 day ago
Data Engineer
...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work....
Kaav Inc.
Malvern, PA
4 days ago
Data Engineer
...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA
23 hours ago
Sr. DATA Engineer
...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...
Senior
ClifyX
Conshohocken, PA
5 days ago
Senior Data Scientist
...Direct experience working with LLMs and GenAI. Familiarity with prominent GenAI based solution patterns. Deep knowledge in data science principles, techniques, and development life cycle. Extensive hands-on experience developing AI/ML solutions to solve business...
Senior
Samprasoft
Malvern, PA
7 hours ago
Data Analytical Engineer
...Data Analytical Engineer Seeking a senior candidate for a hybrid position in Malvern, PA. Job Description: Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...
RIT Solutions
Malvern, PA
1 day ago
Senior Data Scientist
...assessment of the model, methodologies, outputs, and processes for major data science projects. Leads and executes deep dive diagnostic,... ...assumptions, and forages to fill data gaps. Engages with senior leadership to understand and probe business processes in order...
Senior
Work experience placement
Vanguard
Malvern, PA
7 hours ago
Senior Data Scientist
...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days in office) The Senior Data Scientist plays... ...Infrastructure and Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable and scalable....
Senior
Work at office
CubeSmart Self Storage
Malvern, PA
2 days ago
Sr. Associate Data Engineer, AI Data Products
...Requisition #: 76677The Role at a GlanceAbout AIDA Data Strategy and GovernanceLincoln Financial'... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,... ...part of the build. You will learn from senior engineers and business experts while...
Senior
For contractors
Work experience placement
3 days per week
Lincoln Financial Group
Villanova, PA
2 days ago
Data Engineer
...Data Engineer ASSESSMENT REQUIRED Job Description Duties: Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills: Advanced Python, SQL...
Akaasa Technologies
Malvern, PA
4 days ago
AWS Data Engineer
...limited to: expanding usage of current tool to additional data stores working with existing de-identification program tech... ...Expertise in ETL development and data pipeline engineering Experience with data privacy and de-identification methods...
Akaasa Technologies
Malvern, PA
4 days ago
Lead / Senior AI/ML Data Scientist
Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...
Senior
Full time
Vanguard
Malvern, PA
3 days ago
Head of Data Engineering & Analytics
...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...
Full time
Vishay
Malvern, PA
3 days ago
Senior Scientist/Principal Scientist- Biotransformation/Met ID
Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...
Senior
Frontage Laboratories
Lionville, PA
1 day ago
Lead Data Engineer / Data Architect
...Lead Data Engineer / Data Architect - Innovation & POC Lead Location: Exton, PA | Onsite Experience: 10+ Years Role Summary Lead enterprise data engineering and architecture initiatives, focusing on technology innovation, POCs, platform evaluation, and...
Georgia IT Inc
Exton, PA
2 days ago
AWS Developer (Data Engineering and De identification)
...AWS Developer Data Engineering & De-identification Location: Malvern, PA - Hybrid, 3 days onsite per week Rate: .0-.5/hour on W2 Relocation: Non-local candidates willing to relocate will be considered. Position Overview We are seeking an AWS...
Local area
Relocation
3 days per week
Interon IT Solutions
Malvern, PA
3 days ago
Data Analyst Engineer (Dillon)
Data AnalystAnalyzes data, assesses trends and develops actionable insights and recommendations in support of business objectives.Core Responsibilities1. Engages with internal partners to understand business strategy, questions and goals. Brings structure to business requests...
Work experience placement
Samprasoft
Malvern, PA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!