Senior Cloud Data Engineer - IPaaS & Event-Driven Platform Engineering

This is a remote position.

We are seeking a highly skilled and experienced Senior Cloud Data Engineer to design, develop, and support enterprise-scale iPaaS and event-driven data integration platforms on Microsoft Azure.


This role will focus on building scalable, metadata-driven, and cloud-native integration frameworks supporting enterprise data movement, API orchestration, event processing, and operational workflows across distributed systems.


The ideal candidate will have strong hands-on experience implementing Azure-based iPaaS architectures, event-driven integration patterns, containerized applications, and modern orchestration frameworks involving AKS, messaging platforms, Snowflake, and Astronomer Airflow.

Job Duties

• Design and develop cloud-native iPaaS integration frameworks on Azure

• Implement reusable inbound, outbound, and feedback-driven integration services

• Build scalable API orchestration and event-processing frameworks

• Develop canonical integration patterns and standardized payload models

• Implement event-driven architectures using Logic Apps, Azure Service Bus, Event Grid, or Kafka

• Develop retry, replay, dead-letter, and idempotency frameworks

• Build containerized microservices using Python and Kubernetes-based deployment patterns

• Develop scalable AKS-hosted integration applications

• Build REST APIs and integration services

• Build and support workflow orchestration frameworks using Astronomer Airflow / Apache Airflow

• Develop metadata-driven pipeline orchestration frameworks

• Develop Snowflake integration workflows and operational frameworks

• Develop Cosmos DB integration services and operational frameworks

• Implement centralized logging, audit, and operational monitoring frameworks

Must Have Qualifications

•5–8+ years of experience in Cloud Data Engineering, Integration Engineering, or Distributed Systems development

• Strong hands-on expertise with Microsoft Azure cloud services

• Strong experience implementing enterprise integration platforms and event-driven workflows

• Hands-on experience with Azure Service Bus, Event Grid, messaging, and asynchronous processing

• Strong understanding of retry frameworks, replay mechanisms, dead-letter handling, and idempotency

• Strong experience with Kubernetes and Azure Kubernetes Service (AKS)

• Hands-on expertise with Docker containerization

• Strong Python development experience

• Experience building REST APIs and event-processing applications

• Strong hands-on experience with Astronomer Airflow / Apache Airflow

• Hands-on experience integrating enterprise data platforms with Snowflake

• Familiarity with deploying applications using Helm Charts and Kubernetes manifests

• Familiarity with CI/CD pipelines and cloud-native deployment practices

Good to Have Qualifications

• Familiarity with Terraform or Infrastructure as Code concepts

• Exposure to Azure Key Vault and secure secret consumption patterns

• Familiarity with Kafka and real-time streaming architectures

• Exposure to metadata-driven orchestration or integration frameworks

• Experience with monitoring platforms such as Azure Monitor, App Insights, Grafana, or Prometheus

• Familiarity with AI-assisted workflow orchestration or agentic execution frameworks

• Experience with GitOps, Ansible, ARM Templates, or Bicep

• Azure, Kubernetes, or Snowflake certifications

Preferred Technical Stack

  Azure

  AKS, Docker

  Logic Apps, Azure Service Bus, Event Grid, Kafka

  Astronomer Airflow, Apache Airflow

  Snowflake, CosmosDB

  Helm Charts, Kubernetes YAML

  Azure DevOps, GitHub Actions

  Python, Bash

  Azure Monitor, App Insights, Grafana