Data Engineer - 429020

Full-time

Siri InfoSolutions Inc

West Chester, PA

Data Engineer

Must Have Technical/Functional Skills

Snowflake: Deep expertise in Snowflake

PySpark: Strong hands-on experience using Apache Spark with Python for distributed data processing and transformation.

Database & SQL Knowledge: Advanced proficiency in Teradata

Roles & Responsibilities

Pipeline Development: Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs, flat files, and relational databases

Data Modeling: Develop and manage complex data models (e.g., Star/Snowflake schemas) and maintain Fact and Dimension tables within Snowflake

Performance Optimization: Monitor and tune Snowflake queries and Spark jobs to optimize performance, reduce latency, and manage computational costs

Data Quality & Integrity: Implement automated data validation frameworks and testing procedures to ensure a "single source of truth" and high data reliability

Operations: Troubleshoot production pipeline issues, manage version control via Git

Education

Engineering

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Data Engineer - 429020 in West Chester, PA vacancy

Data Engineer
...willing to consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryWe are seeking a Data Engineer to join our Data Product Engineering team responsible for managing and evolving the enterprise Data Lake that supports critical...
Suggested
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
4 days ago
Data Engineer
...Duration: 6 months Requisition ID: 10934365 Note: PLEASE SUBMIT ONLY QUALITY PROFILES MATCHING TO THE JOB DESCRIPTION Role: Data Engineer Skills: Digital : BigData and Hadoop Ecosystem - MapR~Digital : Databricks~Digital : PySpark Experience Required: 6- 8 Years...
Suggested
Q1 Technologies
West Chester, PA
13 hours ago
Data Engineer
...Title: Data Engineer Location - West Chester, PA Onsite. Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks, SQL, Oracle PL/SQL,Python Job Summary The Senior Technical Lead will be responsible for leading the technical...
Suggested
United IT Solutions
West Chester, PA
2 days ago
Data Engineer
...Azure Data Lead Location: West Chester, PA (Onsite) Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks,... ...mentoring, and support to junior team members. Stay uptodate with the latest trends and technologies in data engineering and analytics....
Suggested
InterSources
West Chester, PA
3 days ago
Data Engineer
...retail brands - QVC®, HSN®, Ballard Designs®, Frontgate®, Garnet Hill® and Grandin Road. Your Opportunity, Your Team The Data Engineer supports QVC and will collaborate with an Agile team to build data pipelines and models, exposing analytics through APIs and...
Suggested
Local area
Remote work
Relocation package
QVC Group, Inc
West Chester, PA
4 days ago
Senior Full Stack Data Engineer
...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
2 days ago
Sr. Manager, Data Center Engineering
...consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design, reliability, and lifecycle management of critical data center infrastructure...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
1 day ago
Data Engineer
...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity...
Permanent employment
Full time
Local area
Q1 Technologies
Malvern, PA
12 hours ago
Data Engineer
...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA
2 days ago
Data engineer
...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...
RIT Solutions
Malvern, PA
3 days ago
Data Engineer
...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....
Contract work
Local area
Immediate start
Syntricate Technologies
Malvern, PA
1 day ago
ETL Data Engineer
...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA
11 hours ago
Data Engineer
...Data Engineer Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates...
Software Technology Inc
Malvern, PA
3 days ago
Data Engineer
...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data...
Full time
Remote work
MHK TECH INC
Malvern, PA
11 hours ago
Data Engineer
...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA
11 hours ago
Data Engineer
...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA
3 days ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
4 days ago
Big Data Engineer
...Big Data Engineer - Malvern, PA Duration - 12+ months Interview Process - Video interview Must Have - Expert in Python Strong expertise in SQL, Presto, HIVE, and Spark Must have hands-on experience working with Trading/Investment data Strong...
Veracity
Malvern, PA
3 days ago
Big Data Engineer
Job Title Required Skills: Python, Spark, AWS services, Glue, IAC Responsibilities ~ Work with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA
3 days ago
Senior Data Engineer
...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation...
RIT Solutions, Inc.
Malvern, PA
4 days ago
Senior Data Engineer
...Role Summary: The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA
2 days ago
AWS Data Engineer
$55 - $58 per hour
...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate...
Artech
Malvern, PA
23 hours ago
Senior Staff Information Security Engineer
$191k - $286k
General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province... ...directly supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize advanced security...
Remote work
ANSYS
Exton, PA
2 days ago
Data Analytical Engineer
...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA
4 days ago
Data Engineer, Specialist - DADES3001
Build Data Products That MatterDesign and build scalable data platforms, pipelines, and services that power analytics, business decisions... ..., scalability, reliability, observability, and security.Engineer Smarter with AILeverage AI-assisted development tools to accelerate...
Full time
Temporary work
Vanguard
Malvern, PA
2 days ago
Head of Data Engineering & Analytics
...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...
Full time
Vishay
Malvern, PA
1 day ago
Data Scientist
$131k - $155k
...various unanticipated locations in the US: Job Title-Data Scientist Write well documented code that can be shared... ...in job offered, Data Analyst, Software Consultant, IT Engineer, or related occupation. Requires travel/relocation to various...
Relocation
Surya Systems
Exton, PA
3 days ago
Oracle Fusion Cloud Engineer
...office for the remote option.)Job SummaryComcast is seeking an Engineer 2 - Oracle Fusion Cloud Engineer to join our Enterprise Technology... ...in support of ERP workloads.Help document integration designs, data flows, and configuration decisions to support platform knowledge...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
3 days ago
Software Quality Analyst - Civil Engineering Tools
...Hybrid - Exton or Philadelphia PAPosition Summary:*Must have Civil Engineering Degree or Experience*A Quality Analyst will be responsible for... ...we help infrastructure professionals unlock the value of their data to transform project delivery and asset performance. Equal...
Worldwide
Bentley Systems
Exton, PA
2 days ago
Business Technical Analyst
...Experience with Symitar, Jack Henry product suite, Terafina, or job automation software. Technical experience with Symitar core data processing system, CR Microsoft Windows and Office Suite, SQL proficiency. Education Two Year Associate's degree in business...
Work at office
Shift work
Citadel
Exton, PA
11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - 429020. Be the first to apply!