Data Engineer/Python
RIT Solutions
Senior Data Engineer
Location: Malvern, PA (Hybrid)
Experience Level: Level 4 (8+ years)
Role Summary
We are seeking a highly motivated Senior Data Engineer to join the Cost Basis Accounting and Method team. This role is primarily focused on a critical, multi-year Batch Modernization effort, moving legacy mainframe batch processes to a modernized AWS cloud-based architecture. The ideal candidate will be an independent contributor and a rockstar developer who is passionate about building scalable data pipelines.
Key Responsibilities
- Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python.
- Develop custom code and potentially AWS Lambda functions for handling complex logic within the batch processes.
- Utilize PySpark and SQL for data querying, filtering, and manipulation against various data stores, including modernized data sources and initial DB2 tables.
- Collaborate with internal mainframe experts to understand legacy system logic and implement requirements for the modernized batch processes.
- Engage with the build and deployment pipeline, demonstrating a strong understanding of DevOps concepts and proficiency with Git/GitHub.
- Handle data ingestion from multiple sources, including various vendors, flat files, CSVs, and APIs.
- Work closely with a dedicated Tech Lead, but be prepared to operate with a high degree of independence.
Required Skills and Qualifications
- AWS database experience, e.g. Aurora, Redshift.
- Proven experience as a Data Engineer with a strong focus on data pipelines and ETL/ELT processes.
- Expertise in Python (estimated 80–90% of development work).
- Experience with AWS services, particularly Glue and Lambda.
- Proficiency in PySpark and SQL for data handling and querying.
- Familiarity with DevOps practices and the Git/GitHub development workflow.
- Some experience with Java batch processes (estimated 10–20% of development work) is a plus.
- Experience in dealing with varied data formats and sources (vendors, files, APIs).
- Prior experience with or understanding of mainframe concepts is a good-to-have but not a requirement.
Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Data Engineer/Python in Malvern, PA vacancy
- ...Role - Senior Data Engineer - AWS & Python Location - Malvern, PA - Onsite Exp need - 8+ years Job Description ROLE_DESCRIPTION Build and maintain event-driven data pipelines using AWS services such as...Suggested
Diverse Lynx
Malvern, PA1 day ago - ...Role Description: We are seeking a Senior Data Engineer with strong hands-on experience in building AWS-based data pipelines. The ideal candidate will have deep expertise in Python, AWS Glue, PySpark, and cloud-native data engineering solutions. This role involves...Suggested
Prophecy Technologies
Malvern, PA1 day ago - ...Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal...SuggestedContract work
AceStack LLC
Malvern, PA2 days ago - ...Job Title: Senior Data Engineer - AWS & Python Location: Malvern, PA (Onsite/Hybrid likely) Duration: 6 months (extendable) Pay Range: $54-58/Hour on W2 only Note: Applicant must be willing to work on W2. Request-ID: 79469-1 Role Overview: This...Suggested
Artech
Malvern, PA4 days ago - ...Data Engineer - AWS/Python/Angular Hybrid - Malvern PA About the team: Working in this team will require a developer who is robust in both WebApp and DevOps principles to help create a modernized platform that will be in use by Analysts and Data Engineers...Suggested
RIT Solutions, Inc.
Malvern, PA4 days ago - ...Job Title Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation...Work experience placement
Samprasoft
Malvern, PA2 days ago - ...Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join... ...for developing and optimizing complex data pipelines, integrating model pipelines, and... ...Proficiency in programming languages, particularly Python (including PySpark, PySQL) and...Work experience placement
Samprasoft
Malvern, PA2 days ago $50 - $65 per hour
...Job Title: Senior Data Engineer (PySpark & AWS & Agentic AI ) Location: Malvern, PA ( Onsite ) Position : ( C2C Role ) Duration... ...- 65/Hr Skills: Amazon Web Service(AWS), Cloud Computing, Python, Agentic AI, PySpark. Job Description: Min 8+ yrs...Diverse Lynx
Malvern, PA1 day ago- ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract... ...knowledge - including proficiency in at least two of Python, SQL, Hive, Spark, Amazon Web Services / cloud computing (e.g....
Texas State Library and Archives Commision
Malvern, PA3 days ago - ...Athena, Kinesis, Firehose AWS Serverless Infrastructure: Lambda, SQS, SNS, EventBridge, API Gateway Scripting & Programming: Python, React, TypeScript, Java MUST have a background in Oracle. someone who has a strong background with Oracle or has some experience...
Syntricate Technologies
Malvern, PA2 days ago - ...Data Engineer ASSESSMENT REQUIRED MALVERN, PA - HYBRID 1. Writes ETL (Extract / Transform / Load) processes, designs database... ..., Lambda, S3), GitHub, Jira, Confluence. Programming Skills: Python, SQL, PySpark, Data Modelling skills. 2....
RIT Solutions Inc/ Tech Dev IT/ Texperts Inc/ConceptsIT, Inc...
Malvern, PA1 day ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA4 days ago - ...Skills: Java| AWS | Python | PySpark | Event-Driven Pipelines | Data Architecture We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in Java, AWS, Python, PySpark, and event-driven architectures. You will design and build...
Diverse Lynx
Malvern, PA2 days ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing... .... The ideal candidate must possess top-tier skills in Python, AWS services, API development, and TypeScript, and have significant...
Samprasoft
Malvern, PA2 days ago - ...Overview: Hi All, Client:TCS ob Title: Senior Data Engineer Experience 8-12 years of experience in Data Engineering, Cloud... ...processing. Key Skills & Technologies Programming: Python (strong), Java (basic knowledge) Cloud: AWS (Glue, S3,...
Purple Drive
Malvern, PA2 days ago - ...Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing... ...that will be in use by Analysts and Data Engineers. The deliverables will help data consumers... ...API Gateway Scripting & Programming: Python, React, TypeScript, Java MUST have a background...
Samprasoft
Malvern, PA2 days ago - ...investing across all asset classes. We focus on data strategies including new sources of data... ...of AI/ML models Mentor junior engineers to develop production quality code, data... ...~7+ years of strong coding experience in Python, Java, or Scala ~ Demonstrated hands-on...Visa sponsorship
Vanguard Group, Inc.
Malvern, PA3 days ago $51 - $56 per hour
...Akkodis is seeking a Senior Data Engineer for a Contract with a client in Malvern, PA. The candidate will build scalable streaming... ...Lambda, and Glue. Develop and optimize ETL/ELT workflows using Python and PySpark for large-scale data processing. Implement...Hourly payContract workTemporary workLocal areaAkkodis
Malvern, PA1 day ago- ...DATA ENGINEER- PHILADELPHIA, PA (REMOTE) The Select Group is hiring a Data Engineer to support the design, implementation, and... ...engineering with production pipeline experience ~ Strong Python and SQL; experience with Spark or Pandas for large-scale data...Remote work
The Select Group
Exton, PA4 days ago $85.25k - $125.75k
...learning, growing and having fun! OPPORTUNITY SUMMARY The Data Engineer works with our IT and Software Development teams, playing a... ...fields. ~ Strong expertise in SQL, SSIS, PowerShell, Python, and data modeling. ~ Proficiency in SQL Server and MySQL database...Contract workTemporary workWork experience placementH1bWork at officeLocal areaImmediate startRemote workWork visaFlexible hoursCenero
Malvern, PA4 days ago- ...Data Engineer Data Engineer Address: 301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data pipelines...Full timeRemote work
MHK TECH INC
Malvern, PA3 days ago - ...Role Name - Data Engineer with AI Experience ROLE_DESCRIPTION - Data Engineer with AWS cloud + AI experience, explicitly including Redshift, Dremio, Athena, Tableau and Databricks Experience Required: 6-8 Diverse Lynx LLC is an Equal Employment...
Diverse Lynx
Malvern, PA4 days ago - ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA18 hours ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...Contract workImmediate startRemote work
3B Staffing LLC
Malvern, PA1 day ago - ...Job Title We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Role Responsibilities Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it...
Syntricate Technologies
Malvern, PA4 days ago - ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA1 day ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA2 days ago - ...Role Summary: The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA18 hours ago - ...Security Group of Maryland, and Gallaher & Associates of Tennessee. For more information, please visit ** ** Role Overview The Data Engineer occupies a pivotal position within our organization, responsible for extracting actionable insights from our data resources....Local area
Zeus Fire and Security
Paoli, PA4 days ago - ...architecture framework in AWS. Experience with Unix scripting/Linux configuration preferred. Experience building Spark data processing applications (Python, Pyspark) Experience with SQL development. Qualifications ~ Pyspark, SQL, AWS EMR, AWS Glue, AWS Athena...Contract work
Samprasoft
Malvern, PA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer/Python. Be the first to apply!
Related searches
- data developer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior data center engineer Malvern, PA
- finance data engineer Malvern, PA
- data center engineer Malvern, PA
- data science developer Malvern, PA
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- senior cloud data engineer Malvern, PA