Data Platform Engineer - AI Experience

Data Platform Engineer AI Experience

Position: Full-Time



Location: Redmond, WA



Experience: Senior/Technical Lead level Job Summary

We are seeking a hands-on Technical Lead Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture.

The successful candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure. The role requires strong experience across data ingestion, processing, lakehouse architecture, APIs, backend services, cloud infrastructure, monitoring, and production operations.

Experience with AI/ML or AI-enabled analytics is highly desirable.

Key Responsibilities Data Platform & Engineering

• Design and build scalable Azure data platforms and ETL/ELT pipelines.

• Develop large-scale data processing solutions using Azure Databricks and Spark/PySpark.

• Build analytical solutions using Azure Synapse Analytics and Azure Data Factory.

• Design and implement Lakehouse and Medallion architectures.

• Work with ADLS Gen2 and Delta Lake across Bronze, Silver, and Gold data layers.

• Develop data models and scalable data processing workflows.

• Implement data quality, reconciliation, governance, and validation processes.

Backend Services & Integration

• Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.

• Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.

• Develop microservices and event-driven processing solutions.

• Implement secure authentication and authorization mechanisms.

• Integrate enterprise data platforms with internal and external systems.

Modernization & Reliability

• Modernize legacy data pipelines, APIs, services, storage platforms, and application components.

• Support platform and data migration initiatives while maintaining functional and data parity.

• Implement logging, telemetry, dashboards, and proactive alerting.

• Use Azure Monitor and Application Insights for production monitoring and troubleshooting.

• Participate in production support and incident resolution.

Cloud, DevOps & Technical Leadership

• Build and maintain CI/CD pipelines using Azure DevOps and Git.

• Implement secure Azure cloud practices using Azure Key Vault, identity, authentication, and access controls.

• Support Docker and Kubernetes/AKS-based workloads.

• Provide technical leadership across data engineering, backend services, and cloud architecture.

• Collaborate with engineering, product, operations, and architecture teams.

Mandatory Skills Data Engineering

• Azure Databricks

• Apache Spark / PySpark

• Azure Synapse Analytics

• Azure Data Factory

• ADLS Gen2

• Delta Lake

• SQL Server / Azure SQL

• Cosmos DB

• Kusto / Azure Data Explorer

• ETL/ELT

• Data Warehousing and Data Modeling

• Lakehouse / Medallion Architecture

• Data Quality, Reconciliation, and Governance

Backend & Services

• C#

• .NET / ASP.NET Core

• REST APIs

• Microservices

• Azure Functions

• Event Hubs

• Service Bus

• Entity Framework Core

• Authentication and Authorization

Cloud & DevOps

• Microsoft Azure

• Azure DevOps

• Git and CI/CD

• Azure Monitor

• Application Insights

• Azure Key Vault

• Docker

• Kubernetes / AKS

Good to Have

• React or Angular

• TypeScript

• GraphQL

• Power BI

• Infrastructure as Code

• SRE / Production Support experience

• AI/ML experience

• AI-enabled analytics

• Experience implementing intelligent or AI-driven data solutions

Preferred Profile

A hands-on Data and Services Technical Lead capable of owning enterprise Azure solutions across:

Data Ingestion Data Processing Lakehouse/Analytics APIs & Services Monitoring Production Operations