Azure Data Engineer
Omni Inclusive
Azure Senior Data Lead
The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions.
Key Responsibilities
- Lead the end-to-end technical implementation of data projects using Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python.
- Design and develop efficient and reliable ETL processes for large datasets.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize data workflows, troubleshoot issues, and ensure data quality and integrity.
- Implement best practices for data security, governance, and compliance.
- Provide technical guidance, mentoring, and support to junior team members.
- Stay up-to-date with the latest trends and technologies in data engineering and analytics.
Skill Requirements
- Proficiency in Azure Data Factory (ADF) and Azure Databricks for data integration and processing.
- Strong skills in writing complex SQL queries for data manipulation and analysis.
- Experience with Oracle PL/SQL for database development and management.
- Proficient in Python programming language for automation and scripting tasks.
- Solid understanding of data warehousing concepts, ETL processes, and data modeling.
- Ability to work in a fast-paced environment and manage multiple priorities effectively.
- Excellent problem-solving skills and attention to detail.
- Strong communication and interpersonal skills for effective collaboration with team members and stakeholders.
Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python would be a plus.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in West Chester, PA vacancy
- ...Azure Data Lead Location: West Chester, PA (Onsite) Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL... ..., and support to junior team members. Stay uptodate with the latest trends and technologies in data engineering and analytics....Suggested
InterSources
West Chester, PA4 days ago - ...Pipeline Development Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs, flat files, and relational databases. Data Modeling Develop and manage complex data models (e.g., Star/Snowflake schemas...Suggested
Diverse Lynx
West Chester, PA2 days ago - ...Role Overview: This role is for a Data Engineer focused on designing, implementing, and optimizing robust ETL/ELT pipelines and complex data models primarily using PySpark and Snowflake. The engineer will be responsible for ensuring high data quality, integrity, and...Suggested
Prophecy Technologies
West Chester, PA1 day ago - ...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...SuggestedFull timeWork at officeRemote workWorldwide
- ...consider candidates who live greater than 100 miles from the office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design, reliability, and lifecycle management of critical data center infrastructure...SuggestedFull timeWork at officeRemote workWorldwide
- ...Job Description Insight Global is seeking an Azure Infrastructure Engineer that will join one of our software engineering clients. The Azure Cloud Infrastructure Engineer to support and enhance enterprise cloud environments with a strong focus on Azure services, automation...
Insight Global
Exton, PA4 days ago - ...Description THE OPPORTUNITY AKUVO is seeking a hands-on Senior Data & Machine Learning Engineer to build and own the production lifecycle of our... ..., and performance analysis. ~ Experience with Azure Machine Learning, Databricks, MLflow, or comparable cloud...Local areaRemote work
AKUVO LLC
Malvern, PA22 days ago - ...Job Title: Senior Data Engineer Location : Malvern, PA Duration:6 Months Experience Required: 8-10 Request ID:82529-1 Description : Please prioritize candidates with Vanguard experience. ROLE_DESCRIPTION - Build and maintain event-driven...
I-Flow
Malvern, PA4 days ago - ...Responsibilities ~ Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required...
Procyon TS
Malvern, PA3 days ago $39.38 - $44.38 per hour
...Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark... ...business requirements. Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues...Hourly payTemporary workWork experience placementMalvern, PA20 days ago- ...Data Engineer Duration: Contract Location: Malvern PA (Day 1 onsite) Local Only Job Description: AWS Redshift is mandatory With SQL, Python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr. Technical Recruiter...Contract workLocal area
Syntricate Technologies
Malvern, PA2 days ago $120k - $130k
...Data Engineer Job Location: Malvern, PA, 19355 / Charlotte, NC, 28262 Job Type: Full Time Salary Range: $120000 to $130000/Annum + Full Time Benefits Note: This role is hybrid, requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday). Must Have...Full timeDiverse Lynx
Malvern, PA5 days ago- ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...
RIT Solutions
Malvern, PA4 days ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...
Samprasoft
Malvern, PA5 days ago - ...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
V-Soft Consulting Group
Malvern, PA1 day ago - ...Data Engineer Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native services. Build, optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant...
Randstad
Malvern, PA3 days ago - ...Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and...
Samprasoft
Malvern, PA5 days ago - ...Data Engineer hybird - malvern p 2 openings ssessment required Job Description Technical Stack & Requirements: Core Competencies: WS, Glue, S3, IAM, Redshift, Python, Spark. Development Environment: Experience with Amazon...
RIT Solutions, Inc.
Malvern, PA3 days ago - ...Big Data Engineer Hybrid - Malvern, P Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data...
RIT Solutions, Inc.
Malvern, PA4 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA5 days ago $60 - $67 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in Malvern, PA. The ideal candidate is responsible for designing, building, and optimizing scalable data platforms, real-time streaming pipelines, and cloud-native data solutions . Rate Range: $6...Hourly payContract workTemporary workLocal areaAkkodis
Malvern, PA1 day ago- Job Title Required Skills: Technological requirements include 3+ years' development experience and familiarity with the following tools AWS Core Services: Cloud formation, DynamoDB, S3, Glue, Athena, Kinesis, Firehose AWS Serverless Infrastructure: Lambda...
Syntricate Technologies
Malvern, PA5 days ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Texas State Library and Archives Commision
Malvern, PA1 day ago - ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA4 days ago - ...Data Engineer We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Python, AWS Glue, ETL processes, and Attunity. This role is crucial for driving data initiatives...Work experience placementWork at officeFlexible hours
Artech
Malvern, PA5 days ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...
Samprasoft
Malvern, PA5 days ago - ...Job Description : Data Engineer for a financial client of ours based in Malvern PA.This is a Hybrid role 3days/week from Malvern. We are looking for consultants who can make it for an In-person interview. There is no scope of virtual interviews. At least...
VSG Business Solutions LLC
Malvern, PA2 days ago - ...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME... ...Design, construct, and maintain robust data pipelines using Azure Data Factory, Azure Synapse, and Azure Databricks. Develop...Full timeRemote work
MHK TECH INC
Malvern, PA1 day ago - ...Senior AWS Data Engineer We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate) to design, develop, and maintain scalable cloud-based data integration solutions. The ideal candidate will have...
Artech
Malvern, PA1 day ago - ...Sr. Data Engineering The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves...
Kaav Inc.
Malvern, PA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- data intern West Chester, PA
- data collection researcher West Chester, PA
- clinical data West Chester, PA
- data visualization West Chester, PA
- data loss prevention engineer West Chester, PA
- clinical data coordinator remote West Chester, PA
- data internship West Chester, PA
- ai data West Chester, PA
- data labeling West Chester, PA
- data technician West Chester, PA