Senior Data Engineer
RIT Solutions
Senior Data EngineerAssessment requiredHybrid - Malvern, PATechnical Stack & Requirements:Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.Qualifications:Bachelor's degree in Computer Science or related field.Strong hands-on experience with Apache Spark and Glue.Proven ability to work with Python-based data pipelines.Experience with Git and GitHub Actions is mandatory.Required Qualifications:Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.5-7+ years of enterprise Data Engineering experience.Strong Python development experience.Advanced SQL programming skills.Extensive experience with Apache Spark and PySpark.Strong experience with Databricks application.Hands-on experience with AWS data services including:S3AWS GlueAthenaLambdaStep FunctionsEventBridgeExperience building enterprise ETL and ELT pipelines.Strong understanding of distributed data processing.Experience working with large-scale cloud data platforms.Strong knowledge of dimensional data modeling.Experience implementing CI/CD pipelines.Familiarity with Agile/Scrum methodologies.Excellent communication and stakeholder management skills.Preferred Qualifications:Financial Services or Asset Management industry experience.Knowledge of Apache Iceberg, Delta Lake, or Hudi.Experience with Airflow.Knowledge of Kafka or Kinesis streaming.Experience supporting AI/ML and advanced analytics platforms.AWS Professional or Specialty Certifications.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...Senior
Kaav Inc.
Malvern, PA2 days ago - ...Senior Data EngineerWe are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large...SeniorLocal areaWorldwide
Avance Consulting
Malvern, PA7 hours ago - ...Senior Data EngineerWe are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large...SeniorLocal area
Artech
Malvern, PA1 day ago - ...We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...Senior
Techvilla Solutions
Devon, PA5 days ago - The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...SeniorFull timeFor contractorsWork at office
Vanguard
Malvern, PA2 days ago - Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...Senior
NTT DATA
King of Prussia, PA1 day ago - ...Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built into the product.As a Senior Data Engineer, you wil lead the end-to-end...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Radnor, PA2 days ago - ...We are seeking a passionate and skilled Senior Data Engineer to join our dynamic team in King of Prussia, PA. In this role, you will lead the design and implementation of advanced data pipelines for Business Intelligence (BI) and reporting. Your expertise will transform...Senior
Eigen X
King of Prussia, PA4 days ago - Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.Local area
Syntricate Technologies
Malvern, PA2 days ago - Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA2 days ago - ...Big Data Engineer - Malvern, PADuration - 12+ monthsInterview Process - Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkMust have hands-on experience working with Trading/Investment dataStrong experience in building and orchestrating...
Veracity
Malvern, PA1 day ago - ...Data EngineerKEY RESPONSIBILITIESData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using... ...ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML tools...
MHK TECH INC
Malvern, PA2 days ago - ...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA2 days ago - ...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Software Technology Inc
Malvern, PA2 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems,... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and Jira...
RIT Solutions
Malvern, PA2 days ago - ...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate...Senior
ClifyX
Conshohocken, PA2 days ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA1 day ago - ...Requisition #: 76677The Role at a GlanceAbout AIDA Data Strategy and GovernanceLincoln Financial'... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,... ...part of the build. You will learn from senior engineers and business experts while...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA2 days ago - Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...SeniorFull time
Vanguard
Malvern, PA3 days ago - Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...Senior
Frontage Laboratories
Lionville, PA1 day ago - ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
Vishay
Malvern, PA3 days ago - ...AWS Developer Data Engineering & De-identification Location: Malvern, PA - Hybrid, 3 days onsite per week Rate: .0-.5/hour on W2 Relocation: Non-local candidates willing to relocate will be considered. Position Overview We are seeking an AWS...Local areaRelocation3 days per week
Interon IT Solutions
Malvern, PA1 day ago - Data AnalystAnalyzes data, assesses trends and develops actionable insights and recommendations in support of business objectives.Core Responsibilities1. Engages with internal partners to understand business strategy, questions and goals. Brings structure to business requests...Work experience placement
- ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
Sonsoft
King of Prussia, PA1 day ago - We are looking for a Snowflake Data Engineer to build modern data solutions that support analytics, AI, and enterprise decision-making. This role will focus on creating reliable pipelines, scalable data models, and secure data products within a Snowflake environment. The...
Robert Half
Villanova, PA4 days ago - ...Job Description Our firm has been engaged by a growing, data-centric healthcare technology and services organization that... ...its enterprise data environment and is looking to add a Senior Director of Data Engineering & Architecture to define technical direction, strengthen...SeniorFull timeRemote work
Spinnaker Search
Wayne, PA1 day ago - ...assessment of the model, methodologies, outputs, and processes for major data science projects.Leads and executes deep dive diagnostic,... ...data assumptions, and forages to fill data gaps.Engages with senior leadership to understand and probe business processes in order to...Full timeWork experience placement
Vanguard
Malvern, PA3 days ago - ...development as required. Participate in technical design discussions, code reviews, and architecture decisions. Improve AI-assisted engineering workflows and development standards. Collaborate with architects, engineers, product teams, and adjacent teams to deliver...Senior
2T Consulting
Berwyn, PA5 days ago - ...managers across various asset classes and mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full Stack Engineer, you will design, implement, and maintain a modern, robust, and scalable platform to...
RIT Solutions
Wayne, PA1 day ago - ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentH1b
SonSoft
Valley Forge, Montgomery County, PA1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- finance data engineer Malvern, PA
- sr information security engineer Malvern, PA
- data center engineer Malvern, PA
- senior cloud data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior data center engineer Malvern, PA
- data science developer Malvern, PA