Data Engineer

United IT Solutions

Title: Data Engineer
Location - West Chester, PA

Onsite.

Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks, SQL, Oracle PL/SQL,Python

Job Summary
The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions.

Key Responsibilities
1. Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Design and develop efficient and reliable etl processes for large datasets.
3. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
4. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity.
5. Implement best practices for data security, governance, and compliance.
6. Provide technical guidance, mentoring, and support to junior team members.
7. Stay UpToDate with the latest trends and technologies in data engineering and analytics.

Skill Requirements
1. Proficiency in azure data factory (adf) and azure databricks for data integration and processing.
2. Strong skills in writing complex sql queries for data manipulation and analysis.
3. Experience with oracle pl/sql for database development and management.
4. Proficient in python programming language for automation and scripting tasks.
5. Solid understanding of data warehousing concepts, etl processes, and data modeling.
6. Ability to work in a fast paced environment and manage multiple priorities effectively.
7. Excellent problem-solving skills and attention to detail.
8. Strong communication and interpersonal skills for effective collaboration with team members and stakeholders

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in West Chester, PA vacancy

Data Engineer
...willing to consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryWe are seeking a Data Engineer to join our Data Product Engineering team responsible for managing and evolving the enterprise Data Lake that supports critical...
Suggested
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
14 hours ago
Data Engineer
...Duration: 6 months Requisition ID: 10934365 Note: PLEASE SUBMIT ONLY QUALITY PROFILES MATCHING TO THE JOB DESCRIPTION Role: Data Engineer Skills: Digital : BigData and Hadoop Ecosystem - MapR~Digital : Databricks~Digital : PySpark Experience Required: 6- 8 Years...
Suggested
Q1 Technologies
West Chester, PA
1 day ago
Data Engineer
...Azure Data LeadLocation: West Chester, PA (Onsite)Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle... ...mentoring, and support to junior team members.Stay uptodate with the latest trends and technologies in data engineering and analytics....
Suggested
InterSources
West Chester, PA
14 hours ago
Data Engineer
...retail brands - QVC®, HSN®, Ballard Designs®, Frontgate®, Garnet Hill® and Grandin Road. Your Opportunity, Your Team The Data Engineer supports QVC and will collaborate with an Agile team to build data pipelines and models, exposing analytics through APIs and...
Suggested
Local area
Remote work
Relocation package
QVC Group, Inc
West Chester, PA
5 days ago
Data Engineer - 429020
...Data Engineer Must Have Technical/Functional Skills Snowflake: Deep expertise in Snowflake PySpark: Strong hands-on experience using Apache Spark with Python for distributed data processing and transformation. Database & SQL Knowledge: Advanced proficiency...
Suggested
Full time
Siri InfoSolutions Inc
West Chester, PA
4 days ago
Senior Full Stack Data Engineer
...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
3 days ago
Sr. Manager, Data Center Engineering
...consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design, reliability, and lifecycle management of critical data center infrastructure...
Full time
Work at office
Remote work
Worldwide
Comcast
West Chester, PA
2 days ago
Data Engineer
$120k - $130k
...Attunity, Pyspark, AWS (S3, IAM, Lambda, Cloud Formation) Roles & Responsibilities • Design, develop, and maintain scalable ETL/data integration pipelines using AWS Glue, PySpark, and Python. • Develop and optimize data transformation workflows to process large...
Tata Consultancy Services
Malvern, PA
5 days ago
ETL Data Engineer
...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA
1 day ago
Data Engineer
...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional...
I-Flow
Malvern, PA
1 day ago
Data engineer
...Data engineer Malvern pa hybrid Assessment required Minimum 8-10 years of exp n * Location - Preferred Charlotte (but can be in Malvern) * pprox desired start - asap * Role - Level 4 Big Data Engineer, Python developer * required skillset - Python...
Immediate start
RIT Solutions, Inc.
Malvern, PA
1 day ago
Data Engineer
...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in...
RIT Solutions
Malvern, PA
14 hours ago
Data Engineer
Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.
Local area
Syntricate Technologies
Malvern, PA
1 day ago
Data Engineer
...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....
Contract work
Local area
Immediate start
Syntricate Technologies
Malvern, PA
2 days ago
Data Engineer
...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Kaav Inc.
Malvern, PA
6 days ago
Data Engineer
...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA
14 hours ago
Data Engineer
...Data EngineerData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using Azure Data Factory... ...operationalize ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML...
MHK TECH INC
Malvern, PA
14 hours ago
Data Engineer
...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA
4 days ago
Big Data Engineer
...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating...
Veracity
Malvern, PA
1 day ago
Big Data Engineer
Job Title Required Skills: Python, Spark, AWS services, Glue, IAC Responsibilities ~ Work with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Syntricate Technologies
Malvern, PA
4 days ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA
5 days ago
Senior Data Engineer
...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation...
RIT Solutions, Inc.
Malvern, PA
5 days ago
Senior Data Engineer
...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA
14 hours ago
AWS Data Engineer
...AWS Data EngineerLocation: Malvern, PA, 19355Job Type: FulltimeSalary: $120,000-$130,000 a year+ benefitsKey Technical SkillsPythonAWS Glue (Glue ETL)PySparkAttunity / Qlik ReplicateAWS Services: Amazon S3, IAM, Lambda, CloudFormationRoles & ResponsibilitiesDesign, develop...
Diverse Lynx
Malvern, PA
1 day ago
AWS Data Engineer
...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement...
Syntricate Technologies
Malvern, PA
14 hours ago
Senior Staff Information Security Engineer
$191k - $286k
General Information Job Title Senior Staff Information Security Engineer Job ID 17214 City Exton State/Province... ...directly supports the security of mission-critical systems and data.What You'll Be DoingConfigure, maintain, and optimize advanced security...
Remote work
ANSYS
Exton, PA
3 days ago
Data Analytical Engineer
...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA
5 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across...
Full time
For contractors
Work at office
Vanguard
Malvern, PA
9 hours ago
Data Engineer for Commercial Data Architecture
Incyte Corporation seeks a Data Engineer / Associate Commercial Data Architect to join the MDM/Data Engineering team in the U.S. Business Analytics group. You will translate commercial goals into scalable, well-governed data solutions on our modern cloud stack. This early...
Incyte Corporation
Chadds Ford, PA
1 day ago
Data Engineer/Assoc. Commercial Data Architect
...Headquartered in Wilmington, Delaware, Incyte has operations in North America, Europe, and Asia. Job Summary We're looking for a Data Engineer / Associate Commercial Data Architect —someone who thinks architecturally but isn't afraid to get into the weeds. This role will...
Incyte Corporation
Chadds Ford, PA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!