Azure Data Engineer
Programmers.io
Job Description:
Role Overview
We are looking for a Data Engineer with strong experience in Azure and Apache Spark to design and build scalable high-performance data solutions. The ideal candidate will work on modern cloud data platforms ensuring reliable data pipelines and supporting analytics and business intelligence needs. Familiarity with Databricks and Collibra will be an added advantage.
Key Responsibilities
Design develop and maintain scalable data pipelines using Azure services
Build and optimize Spark-based data processing applications
Implement ETL/ELT workflows for batch and real-time data processing
Work with Azure Data Factory (ADF) or similar tools for orchestration
Store and manage data in Azure Data Lake (ADLS) or cloud storage systems
Perform data transformation cleansing and validation
Ensure data quality governance and security compliance
Collaborate with analysts data scientists and business stakeholders
Monitor debug and optimize data workflows
Required Skills & Qualifications
Technical Skills
Strong hands-on experience with Microsoft Azure (ADF ADLS Synapse or similar)
Solid experience in Apache Spark (PySpark preferred)
Proficiency in Python and SQL
Experience in designing data pipelines and data models
Good understanding of data warehousing concepts
Experience with version control and CI/CD pipelines (e.g. Azure DevOps)
Nice-to-Have Skills
Experience with Azure Databricks for distributed data processing
Exposure to Collibra or similar data governance/catalog tools
Knowledge of Delta Lake architecture
Familiarity with streaming technologies (Kafka Event Hub)
Experience with BI tools such as Power BI
- ...Job Title : Salesforce Adaptive Analytics Engineer Job Type : W2/C2C Experience :... ...experience with Salesforce and enterprise data platforms. ~ Hands-on experience with... ...modeling Cloud & Integration Azure or AWS REST APIs JSON/XML...SuggestedFull time
- ...Bachelors degree in Computer Science Computer Engineering Technology Information Systems (CIS/MIS)... ...production grade services APIs or data platforms) Cloud native development (Docker Kubernetes or equivalent; AWS/Azure preferred) Strong experience with software...SuggestedFull time
- ...Sofware Engineer - AI Engineer Strong back in Software engineering with Rest API s Comfortable with CI/CD the unit tests Agentic AI and... ...action of product the customer should be purchasing from debt of data and mostly accessible by backend The pilot is being built Lot of...SuggestedFull time
- ...Senior Cloud Network Engineer (AWS & OCI) 10 Years Experience Job Summary The purpose of this position is to manage and architect... ...operates in high-volume enterprise environments across multiple data centers and cloud platforms including AWS and Oracle Cloud...SuggestedFull time
$93.7k - $154.5k
...GCS) is looking to hire a Senior Software Engineer-Cloud. The ideal candidate should have... ...expertise in Microsoft 365 SharePoint Online and Azure cloud services. The candidate must have... ...REST APIs and PnP JS enabling seamless data access and interaction across Microsoft 3...SuggestedFull timeTemporary workWork experience placementWork at officeRemote workWorldwideFlexible hours- ...Love your job. Overview We are seeking a Manager Cloud Engineering to lead the design development and operation of scalable cloud... ...operation of multicloud and hybrid platforms (e.g. AWS Google Cloud Azure with onprem/private cloud integration). Design solutions...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
