Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big data engineer

$39.38 - $44.38 per hour

Randstad

job summary:
Responsibilities

Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native services.

Build, optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant data solutions that meet business requirements.

Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues, implement enhancements, and follow engineering best practices.

location: Malvern, Pennsylvania
job type: Solutions
salary: $39.38 - 44.38 per hour
work hours: 8am to 5pm
education: Bachelors


responsibilities:

Responsibilities

  • Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native services.
  • Build, optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant data solutions that meet business requirements.
  • Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues, implement enhancements, and follow engineering best practices.

qualifications:
Responsibilities

Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native services.

Build, optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant data solutions that meet business requirements.

Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues, implement enhancements, and follow engineering best practices.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on click.appcast.io.


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).


This posting is open for thirty (30) days.

Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big data engineer in Malvern, PA vacancy
  •  ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue...  ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : No
    Big data

    Procyon TS

    Malvern, PA
    13 hours ago
  •  ...Big Data Engineer Hybrid - Malvern, P Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data... 
    Big data

    RIT Solutions, Inc.

    Malvern, PA
    19 hours ago
  •  ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team...  ...passive as well as active mandates, to conduct data-driven analyses and build tools to help...  ...and investment data Experience in big data technologies such as Spark and developing... 
    Big data

    Samprasoft

    Malvern, PA
    2 days ago
  •  ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS... 
    Big data

    RIT Solutions

    Malvern, PA
    20 hours ago
  •  ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to... 
    Big data
    Permanent employment
    Full time
    H1b

    Sonsoft

    King of Prussia, PA
    2 days ago
  •  ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building...  ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data... 
    Big data

    ClifyX

    Conshohocken, PA
    19 hours ago
  •  ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,...  ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization... 
    Big data
    Full time

    Vanguard

    Malvern, PA
    2 days ago
  •  ...predictive, and prescriptive analytics to support data-driven business decision making. Role...  ...on defined problems such as feature engineering, model fitting, calibration, and validation...  ...and version control. Exposure to big-data frameworks (Spark, etc.). Special Factors... 
    Big data

    Vanguard

    Malvern, PA
    13 hours ago
  •  ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.... 

    Texas State Library and Archives Commision

    Malvern, PA
    3 days ago
  •  ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale...  ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work.... 

    Kaav Inc.

    Malvern, PA
    13 hours ago
  •  ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr.... 
    Contract work
    Local area
    Immediate start

    Syntricate Technologies

    Malvern, PA
    4 days ago
  • $49.46 - $54.46 per hour

     ...job summary: At least 5 years of Data Engineering experience with AWS platform using robust technical skills in Python, SQL, PySpark, Glue ETL, AWS Lambda, S3, Redshift, AWS Airflow Robust problem-solving skills, communication skills, and ability to learn quickly... 
    Hourly pay
    Contract work
    Temporary work
    Work experience placement

    Randstad

    Malvern, PA
    3 days ago
  •  ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal... 

    InterSources

    Malvern, PA
    13 hours ago
  • $55 - $58 per hour

     ...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate... 

    Artech

    Malvern, PA
    3 days ago
  •  ...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS... 

    Purple Drive

    Malvern, PA
    20 hours ago
  •  ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources... 

    RIT Solutions

    Malvern, PA
    19 hours ago
  •  ...Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation/Terraform,...  ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level... 

    Saxon Global

    Malvern, PA
    3 days ago
  •  ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data... 

    Samprasoft

    Malvern, PA
    2 days ago
  •  ...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity... 
    Permanent employment
    Full time
    Local area

    Q1 Technologies

    Malvern, PA
    3 days ago
  •  ...AXA XL, a global leader in insurance, seeks a data-driven Pricing Analytics & Models professional to enable pricing actuaries and underwriters with robust data flows and insightful BI dashboards. The role focuses on building scalable data models, dashboards, and reporting... 

    AXA Group

    Exton, PA
    1 day ago
  •  ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture... 
    Full time

    Vishay

    Malvern, PA
    4 days ago
  •  ...Title: Data Engineering Director Location: Kings of Prussia, PA (Hybrid role) Type: Fulltime Salary – (Best possible) Requirements...  ...related discipline. Preferred Skills: Experience with big data technologies such as Hadoop, Spark, or Kafka.... 
    Big data
    Full time

    TWO95 International, Inc

    King of Prussia, PA
    more than 2 months ago
  • Application Engineer III - AWS Data EngineerAbout the RoleJoin Vanguard's mission to deliver investment success for all investors. We're seeking an AWS Data Engineer to help shape and evolve an enterprise data platform that manages assets and cash flow data across our lines... 
    Full time

    Vanguard

    Malvern, PA
    10 hours ago
  •  ...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We are... 

    Vanguard

    Malvern, PA
    4 days ago
  •  ...with six leading retail brands - QVC, HSN, Ballard Designs, Frontgate, Garnet Hill and Grandin Road.Your Opportunity, Your TeamThe Data Engineer supports QVC and will collaborate with an Agile team to build data pipelines and models, exposing analytics through APIs and... 
    Full time
    Local area
    Remote work
    Relocation package

    QVC

    West Chester, PA
    10 hours ago
  • Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented... 

    NTT DATA

    King of Prussia, PA
    2 days ago
  • DescriptionWe are looking for a Data Engineer to drive the design and delivery of scalable data solutions that support critical business objectives within the oil and gas sector. This position is based in King of Prussia, Pennsylvania, and combines technical execution with... 

    Robert Half

    King of Prussia, PA
    4 days ago
  •  ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate...  ...algorithms and modeling using big data cloud platforms· Understanding of A/...  ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsSpecial FactorsSponsorshipVanguard... 
    Big data
    Full time
    Work experience placement

    Vanguard

    Malvern, PA
    2 days ago
  •  ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate...  ...algorithms and modeling using big data cloud platforms· Understanding of A/...  ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsThe ideal candidate... 
    Big data
    Full time
    Work experience placement

    Vanguard

    Malvern, PA
    2 days ago
  •  ...409 When you work for AmeriGas, you become a part of something BIG! Founded in 1959, AmeriGas is the nation’s premier propane company...  ...points across the United States.Position SummaryThe Lead Data Engineer is a hands-on technical leader responsible for leading data engineering... 
    For contractors

    UGI Corporation

    King of Prussia, PA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big data engineer. Be the first to apply!