Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Artech

Senior Data Engineer We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale data processing systems. The ideal candidate will play a critical role in building and maintaining scalable, efficient, and secure ETL pipelines within the AWS ecosystem. Key Responsibilities: Design, develop, and maintain robust ETL workflows to extract, transform, and load data from various sources to AWS Redshift and other cloud-based systems. Leverage AWS Lambda to build serverless computing solutions for real-time data processing and automation. Work with AWS data storage and processing services, including S3, Redshift, Athena, and Glue, to support data processing pipelines. Utilize Python and PySpark to create and optimize data transformation logic and analytical queries. Collaborate with cross-functional teams to understand data requirements and provide efficient data solutions. Monitor and optimize cloud-based infrastructure for performance, reliability, and cost efficiency. Troubleshoot and resolve data pipeline issues, ensuring minimal downtime and high data accuracy. Implement automation and monitoring tools to enhance reliability. Required Skills and Qualifications: Proven experience working with AWS services, including Lambda, Redshift, S3, Athena, Glue, and CloudWatch. Strong knowledge and hands-on experience with Python and PySpark for data transformation and processing. Expertise in building and optimizing ETL pipelines in a cloud environment. In-depth understanding of relational databases, data warehousing, and performance tuning in Redshift. Strong problem-solving and troubleshooting skills. Familiarity with infrastructure as code tools like AWS CloudFormation. Experience with version control (e.g., Git) and CI/CD pipelines. Solid understanding of data security, data privacy, and compliance frameworks. Ability to work in an agile, fast-paced environment. Experience Required: 10 & Above Required Skills: Python, AWS- S3, AWS Lambdas, AWS Glue, SQL, DynamoDB, Kafka/ Kinesis, pySpark Ex-Vanguard and local Candidates preferred Artech

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
  • Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking... 
    Senior

    3B Staffing LLC

    Malvern, PA
    5 days ago
  • Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation/Terraform,... 
    Senior

    RIT Solutions

    Malvern, PA
    5 days ago
  • ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around... 
    Senior
    Contract work
    Immediate start
    Remote work

    3B Staffing LLC

    Malvern, PA
    5 days ago
  • NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop... 
    Senior

    7N

    Berwyn, PA
    1 day ago
  • $190k

    Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy... 
    Senior

    Hackajob

    Malvern, PA
    5 days ago
  • We are seeking a passionate and skilled Senior Data Engineer to join our dynamic team in King of Prussia, PA. In this role, you will lead the design and implementation of advanced data pipelines for Business Intelligence (BI) and reporting. Your expertise will transform... 
    Senior

    Eigen X

    King of Prussia, PA
    1 day ago
  • A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL... 
    Senior

    The Hartford

    Wayne, PA
    2 days ago
  • Role Summary We are seeking a highly skilled Senior Data Engineer (or Lead Data Engineer ) to design, build, and optimize scalable data pipelines and ETL solutions across enterprise environments. The ideal candidate will bring deep expertise in Big Data technologies ,... 
    Senior

    Argyll Infotech, Inc.

    King of Prussia, PA
    5 days ago
  •  ...data engineer 5-8 years of exp hybird - malvern, pa or plano, tx, or charlotte, nc assessment required Description Details Advice and Wealth Management Technology ( AWMT ) is seeking a data engineer for the Data & Analytics engineering... 

    Akaasa Technologies

    Malvern, PA
    1 day ago
  •  ...ROPES AI - TORC TEST ! About the Role We are seeking a Senior Data Engineer specializing in Data Quality and Data Governance to design, build, and scale our next-generation data platform. In this role, you will lead the transition from ad-hoc data processing to... 
    Contract work

    VSG Business Solutions LLC

    Malvern, PA
    1 day ago
  •  ...AWS Data EngineerWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.Your work will be to:Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting... 

    Syntricate Technologies

    Malvern, PA
    3 days ago
  •  ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of... 

    Samprasoft

    Malvern, PA
    2 days ago
  • Job Title Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills : Data Warehouse Basic... 

    Kaav Inc.

    Malvern, PA
    3 days ago
  • Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability... 

    Samprasoft

    Malvern, PA
    5 days ago
  •  ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale data...  ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work. Develops... 

    Kaav Inc.

    Malvern, PA
    5 days ago
  • Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our... 

    RIT Solutions, Inc.

    Malvern, PA
    5 days ago
  • Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate... 

    3B Staffing LLC

    Malvern, PA
    5 days ago
  • Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate... 
    Senior

    ClifyX

    Conshohocken, PA
    5 days ago
  • Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work with large datasets... 
    Contract work

    AceStack LLC

    Malvern, PA
    2 days ago
  • Senior Data Engineer Location: Malvern, PA (Hybrid) Experience Level: Level 4 (8+ years) Role Summary We are seeking a highly motivated Senior Data Engineer to join the Cost Basis Accounting and Method team. This role is primarily focused on a critical, multi-year Batch... 

    RIT Solutions

    Malvern, PA
    2 days ago
  • Risus Talent Partners LLC is seeking a Senior Business Intelligence Engineer in Newtown Square, PA to join a growing Data & Analytics team. This hands-on role requires turning complex business needs into scalable data and reporting solutions, with expert SQL, dbt, and... 
    Senior

    Risus Talent Partners LLC

    Newtown Square, PA
    3 days ago
  •  ...SmartRecruiters, Inc. is seeking a Senior Backend Engineer to own backend features that process real time outage data for enterprise customers. You will write Python, build scalable services, and operate in a hybrid King of Prussia, PA setting. The role emphasizes... 
    Senior

    Jobleads-US

    King of Prussia, PA
    1 day ago
  • Sr. Manager, Data Engineer A global biopharmaceutical company on a mission to Solve On, Incyte follows science to find solutions for patients...  ...to grow into an architectural mindset. You'll be supported by senior leaders across the MDM/Data Engineering team while taking real... 
    Senior

    Incyte

    Chadds Ford, PA
    3 days ago
  • Data Engineer, Specialist Apply ( locations Malvern, PA time type Full time posted on Posted 27 Days Ago job requisition id 181665 Core Responsibilities Provides advanced data solutions by using software to process, store, and serve data to others. Tests data... 
    Full time
    Work experience placement

    Vanguard

    Malvern, PA
    5 days ago
  •  ...Job Description Our firm has been engaged by a growing, data-centric healthcare technology and services organization that...  ...its enterprise data environment and is looking to add a Senior Director of Data Engineering & Architecture to define technical direction, strengthen... 
    Senior
    Full time
    Remote work

    Spinnaker Search

    Wayne, PA
    11 days ago
  •  ...Job Description Job Description Job Title : Senior Scientist / Principal Scientist – Biotransformation/Metabolite Identification...  ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports. Excellent communication skills... 
    Senior
    Full time

    Frontage Laboratories

    Exton, PA
    a month ago
  •  ...Job Description Job Description We are looking for a Snowflake Data Engineer to build modern data solutions that support analytics, AI, and enterprise decision-making. This role will focus on creating reliable pipelines, scalable data models, and secure data products... 

    Robert Half

    Wayne, PA
    10 days ago
  •  ...reading this posting as you may have found a great home for your career. About the profile RCH Solutions is looking for a Data Engineer specialised in knowledge graphs and semantic technologies to join our growing Data and AI Engineering team of professionals who... 
    Full time
    Remote work

    RCH Solutions

    Wayne, PA
    2 days ago
  •  ...Bentley Systems is building an AI Code Modernization team to transform large-scale engineering software into modern cloud-native architectures. You will design AI-driven pipelines, improve agentic workflows, and modernize complex codebases across Bentley’s products.... 
    Senior

    Jobleads-US

    Exton, PA
    1 day ago
  • $50k - $85k

     ...partners to scale safely across lending, card services, and embedded finance. The Role We are seeking a solution-oriented  Data Engineer with deep expertise in  Azure Synapse, SQL Server, and Power BI . In this role, you will design and deliver end-to-end data... 

    Bing Recruitment

    Conshohocken, PA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!