Data Engineer with AWS
Purple Drive
Overview: Hi All, Client:TCS ob Title: Senior Data Engineer Experience 8-12 years of experience in Data Engineering, Cloud Data Platforms, and large-scale data processing. Key Skills & Technologies
- Programming: Python (strong), Java (basic knowledge)
- Cloud: AWS (Glue, S3, Lambda, Athena, Redshift)
- ETL / Data Processing: AWS Glue, PySpark, batch & streaming pipelines
- Databases: SQL, NoSQL, data warehouses
- Data Formats: Parquet, Avro, JSON, CSV
- Version Control & CI/CD: Git, basic DevOps pipelines
- Monitoring & Security: Logging, IAM, data security best practices
- Design, build, and maintain scalable data pipelines using Python and AWS Glue .
- Develop ETL/ELT workflows to ingest, transform, and load data from multiple sources into cloud data platforms.
- Optimize Glue jobs for performance, cost, and scalability.
- Work extensively on AWS cloud services including S3, Glue, Lambda, Athena, and Redshift.
- Ensure high availability, reliability, and fault tolerance of data solutions.
- Implement data partitioning, compression, and lifecycle management strategies.
- Design and implement data models for analytics and reporting.
- Support dimensional and normalized data models for downstream BI and analytics tools.
- Ensure data quality, consistency, and governance across platforms.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer with AWS in Malvern, PA vacancy
- ...Role Name - Data Engineer with AI Experience ROLE_DESCRIPTION - Data Engineer with AWS cloud + AI experience, explicitly including Redshift, Dremio, Athena, Tableau and Databricks Experience Required: 6-8 Diverse Lynx LLC is an Equal Employment...Amazon Web Service
- ...Job Title Required Skills: Technological requirements include 3+ years' development experience and familiarity with the following tools AWS Core Services: Cloud formation, DynamoDB, S3, Glue, Athena, Kinesis, Firehose AWS Serverless Infrastructure: Lambda,...Amazon Web Service
$50 - $65 per hour
...Job Title: Senior Data Engineer (PySpark & AWS & Agentic AI ) Location: Malvern, PA ( Onsite ) Position : ( C2C Role ) Duration : ( 6+ Months) Pay Range : $50 - 65/Hr Skills: Amazon Web Service(AWS), Cloud Computing, Python, Agentic AI, PySpark....Amazon Web Service- ...Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product... ...candidate will be a hands-on developer with deep expertise in the AWS data stack, focusing primarily on data engineering and...Amazon Web Service
- ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Amazon Web ServiceContract workLocal areaImmediate start
- ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal... ...Building necessary infrastructure using AWS and SQL technologies. This will enable effective... ..., design, product, and executive teams, with technical data difficulties. Working...Amazon Web Service
- ...Role Summary: The Sr. Data Engineering will manage the data pipeline development from data... ...the development of data pipelines using AWS Glue and PySpark, transforming data from... ...analytics-ready stages. Collaborate with the Data Architect to implement data models...Amazon Web Service
- ...Troubleshoots software and processes for data consistency and integrity.... ...and reuse. Partners with internal clients to gain an expert... ...and develops junior data engineers on the team while applying quality... .... Data Engineer: Python, AWS (S3, Redshift, Aurora, Athena,...Amazon Web Service
- ...Machine Learning Engineer We are seeking an experienced Machine Learning... ...and optimizing complex data pipelines, integrating model pipelines... ..., and significant experience with large datasets and cloud-based... ...designing ETL pipelines using AWS services (e.g., Glue,...Amazon Web ServiceWork experience placement
- ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data... ...must possess top-tier skills in Python, AWS services, API development, and TypeScript...Amazon Web Service
- ...Role Name - Senior Data Engineer ROLE_DESCRIPTION - Build and maintain event-driven data pipelines using AWS services such as Kinesis, MSK/Kafka, Lambda, Step Functions... .... Build streaming solutions with checkpointing, stateful transformations...Amazon Web Service
- ...Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program... ...be in use by Analysts and Data Engineers. The deliverables will help data... ...role you will: Work with serverless cloud services to create... ...existing Vanguard tools, AWS components, and vendor products...Amazon Web Service
- Job Title Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation...Amazon Web ServiceWork experience placement
- ...all asset classes. We focus on data strategies including new... ...historical data Work closely with data scientists on implementation... ...AI/ML models Mentor junior engineers to develop production quality... ...delivering data platforms on AWS, using managed services for ingestion...Amazon Web ServiceVisa sponsorship
- ...Job Details DATA ENGINEER- PHILADELPHIA, PA (REMOTE) The Select Group is hiring a Data... ...implementation, and operation of a large-scale AWS-hosted data infrastructure platform... ...of the overall platform. Working closely with cross-functional engineering teams and AWS...Amazon Web ServiceRemote work
$58.33 - $63.33 per hour
...hands-on development work within the existing data pipeline environment. The individual will... ...will also be responsible for configuring AWS services, including Lambda functions and... ...they will also need to communicate directly with Product Owners and business stakeholders,...Amazon Web ServiceHourly payContract workTemporary workWork experience placementWork at office$51 - $56 per hour
...Akkodis is seeking a Senior Data Engineer for a Contract with a client in Malvern, PA. The candidate will build scalable streaming data pipelines... ...and maintain scalable event-driven data pipelines using AWS services such as Kinesis, Kafka/MSK, Lambda, and Glue....Amazon Web ServiceHourly payContract workTemporary workLocal area- ...applications using Java EE, Python, Web Services and AWS Qualified candidates will be... ...and prod support. They will work on a data modernization project which will utilize multiple... ...other related services Work closely with Data and Analytics team to build Data Lake...Amazon Web Service
- ...Senior Data Engineer Location: Malvern, PA (Hybrid) Experience Level: Level 4 (8+ years)... ...mainframe batch processes to a modernized AWS cloud-based architecture. The ideal candidate... ...and initial DB2 tables. Collaborate with internal mainframe experts to understand...Amazon Web Service
- ...Role Description: We are seeking a Senior Data Engineer with strong hands-on experience in building AWS-based data pipelines. The ideal candidate will have deep expertise in Python, AWS Glue, PySpark, and cloud-native data engineering solutions. This role involves...Amazon Web Service
$85.25k - $125.75k
...agile, which means you can make a difference with your career, while learning, growing and... ...fun! OPPORTUNITY SUMMARY The Data Engineer works with our IT and Software Development... ...Hands-on experience with cloud platforms (AWS, Azure, GCP) and their data services....Amazon Web ServiceContract workTemporary workWork experience placementH1bWork at officeLocal areaImmediate startRemote workWork visaFlexible hours- ...Job Title: Senior Data Engineer - AWS & Python Location: Malvern, PA (Onsite/Hybrid likely) Duration: 6 months (extendable) Pay Range... ..., Athena, and/or Redshift. Build streaming solutions with checkpointing, stateful transformations, idempotency, and schema...Amazon Web Service
- ...Troubleshoot and optimize new and existing ETL packages. Experience with AWS EMR, AWS Glue, AWS Athena, AWS Cloudformation, AWS IAM & S3, AWS... .../Linux configuration preferred. Experience building Spark data processing applications (Python, Pyspark) Experience with SQL...Amazon Web ServiceContract work
- ...Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data... ...data modeling. Familiarity with cloud platforms such as AWS, Azure, or GCP. Experience with version control tools like...Amazon Web ServiceContract work
- ...Data Engineer - AWS/Python/Angular Hybrid - Malvern PA About the team: Working in this team will require a developer who is robust... ..., and maintainability In this role you will: Work with serverless cloud services to create integrations, APIs endpoints...Amazon Web Service
- ...Role Summary The Data Engineer, Specialist is responsible for designing, developing and maintaining... ...and reporting. 4. Collaborate with data scientists, analysts and business stakeholders... ...in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure...Amazon Web Service
- ...Data Engineer Client: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration... ...S3 Qualifications SQL, Python, Pyspark, S3, AWS, environment creation Preferable for both - retail...Amazon Web Service
- ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....Amazon Web Service
$82.1k - $172.4k
...Job Title: Senior Data Engineer Job Category: Science Time Type: Full time Minimum Clearance... ...data pipelines and normalizing data with canonical Python packages (e.g. NumPy, Pandas... ..., Docker Compose), cloud services (e.g. AWS), tools for distributed computing (e.g....Amazon Web ServiceFull timeContract workWork experience placementLocal areaFlexible hours- ...Position Overview: We are looking for a Data Engineer/Scientist looking for new challenging... ...data pipelines and normalizing data with canonical Python packages (e.g. NumPy, Pandas... ..., Docker Compose), cloud services (e.g. AWS), tools for distributed computing (e.g. Spark...Amazon Web ServiceTemporary workWork experience placementWork at officeVisa sponsorshipRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with AWS. Be the first to apply!
Related searches
- data developer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior data center engineer Malvern, PA
- finance data engineer Malvern, PA
- data center engineer Malvern, PA
- data science developer Malvern, PA
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- senior cloud data engineer Malvern, PA

