Data Engineer - 429020

Full-time

Siri Info Solutions Inc

West Chester, PA

Data Engineer

Must Have Technical/Functional Skills

Snowflake: Deep expertise in Snowflake

PySpark: Strong hands-on experience using Apache Spark with Python for distributed data processing and transformation.

Database & SQL Knowledge: Advanced proficiency in Teradata

Roles & Responsibilities

Pipeline Development: Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs, flat files, and relational databases

Data Modeling: Develop and manage complex data models (e.g., Star/Snowflake schemas) and maintain Fact and Dimension tables within Snowflake

Performance Optimization: Monitor and tune Snowflake queries and Spark jobs to optimize performance, reduce latency, and manage computational costs

Data Quality & Integrity: Implement automated data validation frameworks and testing procedures to ensure a "single source of truth" and high data reliability

Operations: Troubleshoot production pipeline issues, manage version control via Git

Education

Engineering

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer - 429020 in West Chester, PA vacancy

Data Engineer
...willing to consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryWe are seeking a Data Engineer to join our Data Product Engineering team responsible for managing and evolving the enterprise Data Lake that supports critical...
Suggested
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
2 days ago
Data Engineer
...Duration: 6 months Requisition ID: 10934365 Note: PLEASE SUBMIT ONLY QUALITY PROFILES MATCHING TO THE JOB DESCRIPTION Role: Data Engineer Skills: Digital : BigData and Hadoop Ecosystem - MapR~Digital : Databricks~Digital : PySpark Experience Required: 6- 8 Years...
Suggested
Q1 Technologies
West Chester, PA
2 days ago
Data Engineer
...Azure Data LeadLocation: West Chester, PA (Onsite)Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle... ...mentoring, and support to junior team members.Stay uptodate with the latest trends and technologies in data engineering and analytics....
Suggested
InterSources
West Chester, PA
2 days ago
Data Engineer
...Title: Data Engineer Location - West Chester, PA Onsite. Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks, SQL, Oracle PL/SQL,Python Job Summary The Senior Technical Lead will be responsible for leading the technical...
Suggested
United IT Solutions
West Chester, PA
5 days ago
Senior Full Stack Data Engineer
...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...
Suggested
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
9 hours ago
Sr. Manager, Data Center Engineering
...consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design, reliability, and lifecycle management of critical data center infrastructure...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
4 days ago
Data Engineer
...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....
Contract work
Local area
Immediate start
Syntricate Technologies
Malvern, PA
3 days ago
Data Engineer
...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Software Technology Inc
Malvern, PA
3 days ago
Data Engineer
...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA
2 days ago
Data Engineer
...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity...
Permanent employment
Full time
Local area
Q1 Technologies
Malvern, PA
2 days ago
Data Engineer
Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.
Local area
Syntricate Technologies
Malvern, PA
3 days ago
ETL Data Engineer
...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA
2 days ago
Data engineer
...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...
RIT Solutions
Malvern, PA
1 day ago
Data Engineer
...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data...
Full time
Remote work
MHK TECH INC
Malvern, PA
2 days ago
Data Engineer
...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA
2 days ago
Data Engineer
...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in...
RIT Solutions
Malvern, PA
2 days ago
Data Engineer
...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA
1 day ago
Big Data Engineer
Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA
2 days ago
Big Data Engineer
...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating...
Veracity
Malvern, PA
3 days ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
2 days ago
Sr Data Engineer
...Data EngineerPython, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation... ...data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production...
Saxon Global
Malvern, PA
2 days ago
Senior Data Engineer
...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA
2 days ago
AWS Data Engineer
...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement...
Syntricate Technologies
Malvern, PA
2 days ago
AWS Data Engineer
...AWS Data EngineerLocation: Malvern, PA, 19355Job Type: FulltimeSalary: $120,000-$130,000 a year+ benefitsKey Technical SkillsPythonAWS Glue (Glue ETL)PySparkAttunity / Qlik ReplicateAWS Services: Amazon S3, IAM, Lambda, CloudFormationRoles & ResponsibilitiesDesign, develop...
Diverse Lynx
Malvern, PA
3 days ago
Senior Staff Information Security Engineer
$191k - $286k
General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province... ...directly supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize advanced security...
Remote work
ANSYS
Exton, PA
9 hours ago
Data Analytical Engineer
...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA
2 days ago
Data Engineer for Commercial Data Architecture
Incyte Corporation seeks a Data Engineer / Associate Commercial Data Architect to join the MDM/Data Engineering team in the U.S. Business Analytics group. You will translate commercial goals into scalable, well-governed data solutions on our modern cloud stack. This early...
Incyte Corporation
Chadds Ford, PA
3 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across...
Full time
For contractors
Work at office
Vanguard
Malvern, PA
2 days ago
Data Engineer/Assoc. Commercial Data Architect
...Headquartered in Wilmington, Delaware, Incyte has operations in North America, Europe, and Asia. Job Summary We're looking for a Data Engineer / Associate Commercial Data Architect —someone who thinks architecturally but isn't afraid to get into the weeds. This role will...
Incyte Corporation
Chadds Ford, PA
3 days ago
Head of Data Engineering & Analytics
...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...
Full time
Vishay
Malvern, PA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - 429020. Be the first to apply!