Senior Data Engineer
Artech Information Systems LLC
Request ID: 111240-1 Title: Senior Data Engineer Locations: Malvern, PA Interview Mode: Onsite Duration: 06+ Months with Possible Extension. Pay Range: $60-$65/Hour on W2/C2C (All inclusive) We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale data processing systems. The ideal candidate will play a critical role in building and maintaining scalable, efficient, and secure ETL pipelines within the AWS ecosystem. Key Responsibilities:
- Design, develop, and maintain robust ETL workflows to extract, transform, and load data from various sources to AWS Redshift and other cloud-based systems.
- Leverage AWS Lambda to build serverless computing solutions for real-time data processing and automation.
- Work with AWS data storage and processing services, including S3, Redshift, Athena, and Glue, to support data processing pipelines.
- Utilize Python and PySpark to create and optimize data transformation logic and analytical queries.
- Collaborate with cross-functional teams to understand data requirements and provide efficient data solutions.
- Monitor and optimize cloud-based infrastructure for performance, reliability, and cost efficiency.
- Troubleshoot and resolve data pipeline issues, ensuring minimal downtime and high data accuracy.
- Implement automation and monitoring tools to enhance reliability.
- Proven experience working with AWS services, including Lambda, Redshift, S3, Athena, Glue, and CloudWatch.
- Strong knowledge and hands-on experience with Python and PySpark for data transformation and processing.
- Expertise in building and optimizing ETL pipelines in a cloud environment.
- In-depth understanding of relational databases, data warehousing, and performance tuning in Redshift.
- Strong problem-solving and troubleshooting skills.
- Familiarity with infrastructure as code tools like AWS CloudFormation.
- Experience with version control (e.g., Git) and CI/CD pipelines.
- Solid understanding of data security, data privacy, and compliance frameworks.
- Ability to work in an agile, fast-paced environment.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment....Senior
3B Staffing LLC
Malvern, PA1 day ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...Senior
Samprasoft
Malvern, PA4 days ago - ...Request ID: 111240-1 Title: Senior Data Engineer Locations: Malvern, PA Interview Mode: Onsite Duration: 06+ Months with Possible Extension. Pay Range: $60-$65/Hour on W2/C2C (All inclusive) We are seeking an experienced AWS Data Engineer with expertise...SeniorLocal area
Artech
Malvern, PA4 days ago - ...Senior Data Engineer Assessment required Hybrid - Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation...Senior
RIT Solutions
Malvern, PA2 days ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...SeniorContract workImmediate startRemote work
3B Staffing LLC
Malvern, PA3 days ago - ...a team of managers, technical leads, and engineers, building a strong leadership bench and high... ...the end-to-end lifecycle of enterprise data products and platforms, including... ...across the data ecosystem. Partners with senior leaders and cross-functional teams to shape...SeniorFull time
Vanguard
Malvern, PA12 hours ago - ...Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built into the product.As a Senior Data Engineer, you wil lead the end-to-end...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA1 day ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA4 days ago - ...Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and...
Samprasoft
Malvern, PA4 days ago - Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud Services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation/SNS/...Work experience placement
Brains Technology Solutions, Inc.
Malvern, PA1 day ago - ...Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing...
RIT Solutions, Inc.
Malvern, PA2 days ago - ...Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics...
Syntricate Technologies
Malvern, PA1 day ago - ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA3 days ago - ...Responsibilities ~ Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required...
Procyon TS
Malvern, PA1 day ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA4 days ago - ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA3 days ago - ...Direct experience working with LLMs and GenAI. Familiarity with prominent GenAI based solution patterns. Deep knowledge in data science principles, techniques, and development life cycle. Extensive hands-on experience developing AI/ML solutions to solve business...Senior
Samprasoft
Malvern, PA4 days ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA4 days ago - ...assessment of the model, methodologies, outputs, and processes for major data science projects.Leads and executes deep dive diagnostic,... ...data assumptions, and forages to fill data gaps.Engages with senior leadership to understand and probe business processes in order to...SeniorFull timeWork experience placement
Vanguard
Malvern, PA2 days ago - ...Requisition #: 76677The Role at a GlanceAbout AIDA Data Strategy and GovernanceLincoln Financial'... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,... ...part of the build. You will learn from senior engineers and business experts while...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA1 day ago - Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...SeniorFull time
Vanguard
Malvern, PA1 day ago - Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...Senior
Frontage Laboratories
Lionville, PA4 days ago - ...Services and AWS Qualified candidates will be responsible for API design, implementation, testing and prod support. They will work on a data modernization project which will utilize multiple AWS Services Tech needs: Java AWS Services - GlueEMR API development SpringBoot...
- ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
Vishay
Malvern, PA1 day ago - Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark, Attunity...
- ...Lead Data Engineer / Data Architect - Innovation & POC Lead Location: Exton, PA | Onsite Experience: 10+ Years Role Summary Lead enterprise data engineering and architecture initiatives, focusing on technology innovation, POCs, platform evaluation, and...
Georgia IT Inc
Exton, PA5 days ago - ...Job Title: Lead Data Engineer / Data Architect (Innovation & POC Lead) Location: Exton, PA Role Purpose Serve as the onsite Data Engineering and Architecture lead, driving technology innovation, evaluation, and adoption across the enterprise data landscape...
My3Tech
Exton, PA4 days ago - We are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In this role, you will build and enhance modern data pipelines and warehouse structures that support reporting, analytics, and business decision...
Robert Half
Conshohocken, PA1 hour ago - We are looking for a Snowflake Data Engineer to build modern data solutions that support analytics, AI, and enterprise decision-making. This role will focus on creating reliable pipelines, scalable data models, and secure data products within a Snowflake environment. The...
Robert Half
Villanova, PA3 days ago - ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
Sonsoft
Valley Forge, Montgomery County, PA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- finance data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- senior cloud data engineer Malvern, PA
- aws data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data engineer Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- senior living Malvern, PA
- senior devops Malvern, PA