Senior Data Engineer
RIT Solutions
Senior Data EngineerAssessment requiredhybrid - Malvern, PATechnical Stack & Requirements:Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.Qualifications:Bachelor's degree in Computer Science or related field.Strong hands-on experience with Apache Spark and Glue.Proven ability to work with Python-based data pipelines.Experience with Git and GitHub Actions is mandatory.Required Qualifications:Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.5-7+ years of enterprise Data Engineering experience.Strong Python development experience.Advanced SQL programming skills.Extensive experience with Apache Spark and PySpark.Strong experience with Databricks application.Hands-on experience with AWS data services including:S3AWS GlueAthenaLambdaStep FunctionsEventBridgeExperience building enterprise ETL and ELT pipelines.Strong understanding of distributed data processing.Experience working with large-scale cloud data platforms.Strong knowledge of dimensional data modeling.Experience implementing CI/CD pipelines.Familiarity with Agile/Scrum methodologies.Excellent communication and stakeholder management skills.Preferred Qualifications:Financial Services or Asset Management industry experience.Knowledge of Apache Iceberg, Delta Lake, or Hudi.Experience with Airflow.Knowledge of Kafka or Kinesis streaming.Experience supporting AI/ML and advanced analytics platforms.AWS Professional or Specialty Certifications.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- ...Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment....Senior
3B Staffing LLC
Malvern, PA4 days ago - ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...Senior
Kaav Inc.
Malvern, PA3 days ago - ...We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...Senior
Techvilla Solutions
Berwyn, PA1 day ago - The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across Vanguard...SeniorFull timeFor contractorsWork at office
- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...Senior
- Coforge is seeking a Senior Data Engineer (Agentic Retrieval & Memory) in Oaks, PA for a full-time role. You will design agent memory interfaces across session state, short-term history, and long-term memory, and select optimal stores for each tier. You will integrate...SeniorFull timeTemporary work
- Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term...SeniorFull timeTemporary work
- Job Title: Senior Data Engineer (Agentic Retrieval & Memory Systems) | Vish Consulting Services (VISHUSA) | Oaks, Pennsylvania, USA Recruiting Company: Vish Consulting Services (VISHUSA) Job Location: Oaks, Pennsylvania, USA (Hybrid) Job Type: Contract (C2C) Application...SeniorContract workH1bImmediate start
- A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...Senior
- Senior Data Scientist — Investment Management Fintech Strategies (IMFS)Investment Management Fintech Strategies (IMFS) is a global team... ...scalable in real-world market environments.Raise the bar on engineering quality by mentoring quant strategists and data scientists on...SeniorFull time
$84.38k - $135k
Alternate Locations: Greensboro, NC (North Carolina); Charlotte, NC (North Carolina); Fort Wayne, IN (Indiana); Radnor, PA (Pennsylvania) Work Arrangement:Hybrid : Employee will work 3 days a week in a Lincoln officeRelocation assistance: is not available for this opportunity...SeniorWork experience placement3 days per week- ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA2 days ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA4 days ago - Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.Local area
Syntricate Technologies
Malvern, PA3 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems,... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and Jira...
RIT Solutions
Malvern, PA3 days ago - ...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning. Candidate...Senior
ClifyX
Conshohocken, PA3 days ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA2 days ago - ...Opening ! Hybrid onsite ROPES TEST / BROWN- I will send. Description- Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python . Develop custom code and potentially AWS Lambda...Relocation
VSG Business Solutions LLC
Malvern, PA3 days ago - ...Data Engineer Assessment required Hybird Malvern, pa Responsibilities ~ Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications ~ Python, SQL, AWS Services Job...
Akaasa Technologies
Malvern, PA3 days ago - Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset...Full timeWork experience placement
- Job Title: Senior Scientist / Principal Scientist - Biotransformation/Metabolite Identification.Location: Exton, PennsylvaniaFull-time... ...Demonstrated ability to analyze and interpret complex mass spectrometry data and provide detailed reports.Excellent communication skills and...Senior
- ...agents.Contribute to the development and testing of robust, scalable agentic architectures and infrastructure.Collaborate with senior engineers and data scientists in feature development, experiments, and integration of research findings.Participate in code reviews, testing,...SeniorFull time
- ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- ...learning pipelines from research through production deployment. Engineer scalable training, inference, and retraining workflows using AWS... ...Develop and maintain feature engineering, feature storage, and data preparation pipelines. Automate model deployment, testing, validation...SeniorFull timeWork experience placement
- ...Data Engineer Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset...
Hackajob
Malvern, PA3 days ago - ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
- ...development as required. Participate in technical design discussions, code reviews, and architecture decisions. Improve AI-assisted engineering workflows and development standards. Collaborate with architects, engineers, product teams, and adjacent teams to deliver...Senior
2T Consulting
Berwyn, PA1 day ago - 3 days onsiter (Tues-Thurs) - Malvern, PA relo okay Job Title: Senior Developer (AWS/Python/) Experience Level: Senior / Level 4 (8+ years) Contract Duration: 12 months initially (potential to extend up to 36 months) Role Overview: We are seeking a...SeniorContract work
Akaasa Technologies
Malvern, PA3 days ago $124.4k - $207.4k
...SUMMARYBuild and operate the production data pipelines that power the Innovation, Data... ...& Continuous ImprovementPartner with the Senior Data Analyst to validate data model and mapping... ...with the Senior Data Scientist and AI/ML Engineer to ensure pipelines meet the data needs...Permanent employmentFull timeH1bLocal areaVisa sponsorshipWork visaRelocation packageFlexible hours2 days per week3 days per week- ...Data Engineer - Contract to Hire (Hybrid, No Sponsorship) Location: Wayne, PA | Plano, TX | Charlotte, NC | Scottsdale, AZ Job Type: Contract to Hire (Hybrid, 3 days on-site/week) Eligibility: US Citizens/Green Card Holders only (no sponsorship provided) About...Permanent employmentContract workLocal area3 days per week
Indotronix International Corporation
Wayne, PA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- aws data engineer Malvern, PA
- data science developer Malvern, PA
- data engineer machine learning Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- senior data center engineer Malvern, PA
- finance data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- senior developer Malvern, PA