Senior Data Engineer
RIT Solutions
Senior Data EngineerAssessment requiredHybrid - Malvern, PATechnical Stack & Requirements:Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.Qualifications:Bachelor's degree in Computer Science or related field.Strong hands-on experience with Apache Spark and Glue.Proven ability to work with Python-based data pipelines.Experience with Git and GitHub Actions is mandatory.Required Qualifications:Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.5-7+ years of enterprise Data Engineering experience.Strong Python development experience.Advanced SQL programming skills.Extensive experience with Apache Spark and PySpark.Strong experience with Databricks application.Hands-on experience with AWS data services including:S3AWS GlueAthenaLambdaStep FunctionsEventBridgeExperience building enterprise ETL and ELT pipelines.Strong understanding of distributed data processing.Experience working with large-scale cloud data platforms.Strong knowledge of dimensional data modeling.Experience implementing CI/CD pipelines.Familiarity with Agile/Scrum methodologies.Excellent communication and stakeholder management skills.Preferred Qualifications:Financial Services or Asset Management industry experience.Knowledge of Apache Iceberg, Delta Lake, or Hudi.Experience with Airflow.Knowledge of Kafka or Kinesis streaming.Experience supporting AI/ML and advanced analytics platforms.AWS Professional or Specialty Certifications.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Job TitleResponsibilitiesProvides expert level data solutions by using software to process, store, and serve data to others.Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure.QualificationsProvides expert...Senior
Samprasoft
Malvern, PA5 days ago - ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...Senior
Kaav Inc.
Malvern, PA5 days ago - ...Senior Data EngineerWe are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large...SeniorLocal area
Artech
Malvern, PA4 days ago - ...Senior Data Engineer – 7+ Years of ExperienceWe are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services, API...Senior
Samprasoft
Malvern, PA5 days ago - ...Senior Data EngineerWe are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large...SeniorLocal areaWorldwide
Avance Consulting
Malvern, PA3 days ago - Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...Senior
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around...SeniorContract workImmediate startRemote work
- NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...Senior
- The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...SeniorFull timeFor contractorsWork at office
Vanguard
Malvern, PA5 days ago - Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...Senior
NTT DATA
King of Prussia, PA4 days ago - ...Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built into the product.As a Senior Data Engineer, you wil lead the end-to-end...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Villanova, PA5 days ago - ...We are seeking a passionate and skilled Senior Data Engineer to join our dynamic team in King of Prussia, PA. In this role, you will lead the design and implementation of advanced data pipelines for Business Intelligence (BI) and reporting. Your expertise will transform...Senior
Eigen X
King of Prussia, PA2 days ago - Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.Local area
Syntricate Technologies
Malvern, PA5 days ago - Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA5 days ago - ...Data EngineerTroubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources... ...guidance and serves as a technical consultant.Adhere to data engineering standards and contribute expertise to other data expert teams...
Samprasoft
Malvern, PA5 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems,... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and Jira...
RIT Solutions
Malvern, PA5 days ago - ...Data EngineerKEY RESPONSIBILITIESData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using... ...ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML tools...
MHK TECH INC
Malvern, PA5 days ago - ...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA5 days ago - Role Summary We are seeking a highly skilled Senior Data Engineer (or Lead Data Engineer ) to design, build, and optimize scalable data pipelines and ETL solutions across enterprise environments. The ideal candidate will bring deep expertise in Big Data technologies ,...Senior
- ...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate...Senior
ClifyX
Conshohocken, PA5 days ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA4 days ago - ...Requisition #: 76677The Role at a GlanceAbout AIDA Data Strategy and GovernanceLincoln Financial'... ...with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,... ...part of the build. You will learn from senior engineers and business experts while...SeniorFor contractorsWork experience placement3 days per week
Lincoln Financial Group
Radnor, PA5 days ago - ASSESSMENT REQUIRED HYBIRD Job Description Duties: Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills: Advanced Python, SQL skills...
Akaasa Technologies
Malvern, PA2 days ago - ...data engineer 5-8 years of exp hybird - malvern, pa or plano, tx, or charlotte, nc assessment required Description Details Advice and Wealth Management Technology ( AWMT ) is seeking a data engineer for the Data & Analytics engineering...
Akaasa Technologies
Malvern, PA2 days ago - Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...SeniorFull time
Vanguard
Malvern, PA1 day ago - Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability...
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills : Data Warehouse Basic Qualification...
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...
- Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...Senior
Frontage Laboratories
Lionville, PA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- finance data engineer Malvern, PA
- data center engineer Malvern, PA
- senior cloud data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- data developer Malvern, PA