AWS Developer

job summary:
Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python.

Develop custom code and potentially AWS Lambda functions for handling complex logic within the batch processes.

Utilize PySpark and SQL for data querying, filtering, and manipulation against various data stores, including modernized data sources and initial DB2 tables.

Collaborate with internal mainframe experts to understand legacy system logic and implement requirements for the modernized batch processes.

Engage with the build and deployment pipeline, demonstrating a robust understanding of DevOps concepts and proficiency with Git/GitHub.

Handle data ingestion from multiple sources, including various vendors, flat files, CSVs, and APIs.

Work closely with a dedicated Tech Lead, but be prepared to operate with a high degree of independence.

 
location: Malvern, Pennsylvania
job type: Contract
salary: $58.33 - 63.33 per hour
work hours: 8am to 5pm
education: Bachelors


responsibilities:

• Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python .
• Develop custom code and potentially AWS Lambda functions for handling complex logic within the batch processes.
• Utilize PySpark and SQL for data querying, filtering, and manipulation against various data stores, including modernized data sources and initial DB2 tables.
• Collaborate with internal mainframe experts to understand legacy system logic and implement requirements for the modernized batch processes.
• Engage with the build and deployment pipeline, demonstrating a robust understanding of DevOps concepts and proficiency with Git/GitHub .
• Handle data ingestion from multiple sources, including various vendors, flat files, CSVs, and APIs.
• Work closely with a dedicated Tech Lead, but be prepared to operate with a high degree of independence.

qualifications:
AWS database experience, e.g. Aurora, Redshift.

Proven experience as a Data Engineer with a robust focus on data pipelines and ETL/ELT processes.

Expertise in Python (estimated 80-90% of development work).

Experience with AWS services, particularly Glue and Lambda.

Proficiency in PySpark and SQL for data handling and querying.

Familiarity with DevOps practices and the Git/GitHub development workflow.

Some experience with Java batch processes (estimated 10-20% of development work) is a plus.

Experience in dealing with varied data formats and sources (vendors, files, APIs).

Prior experience with or understanding of mainframe concepts is a good-to-have but not a requirement.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on jobs.institutedata.com.


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.

Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.