Azure Data Engineer

Request ID: 110123-1
Title: Azure Data Engineer
Locations: Cary, NC (Local)
Duration: 6 Months
Pay Range: $45 - $52/Hour on W2/C2C (All inclusive)

Introduction

We are seeking a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing and building data pipelines, developing ETL/ELT solutions, and implementing data architectures using Azure technologies. This role requires collaboration with cross-functional teams to optimize data processes and ensure data quality and governance.

Required Skills & Qualifications

• 8 years of experience in data engineering with Azure, specifically using Azure Databricks.
• Strong experience with Azure Data Lake, Databricks, ADF, and Postgres.
• Hands-on expertise in SQL, Python, PySpark, or Scala.
• Proven experience with batch and real-time data ingestion.
• Experience with Kafka and big data processing.
• Prior work experience at client or in client's industry.

Applicants must be able to work directly for Artech on W2.

Preferred Skills & Qualifications

• Experience with Informatica PowerCenter and IDMC or equivalent cloud data integration tools.
• Knowledge of SQL Server, Oracle, Azure SQL, Cosmos DB, Unix/Linux.
• Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data).
• Experience with Azure DevOps (AzDO) and GitHub-based CI/CD.
• Exposure to Generative AI / GenAI use cases in data platforms and analytics.

Day-to-Day Responsibilities

• Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
• Develop ETL/ELT solutions using Spark, SQL, Python/PySpark, or Scala.
• Implement and support Data Lake / Lakehouse architectures.
• Integrate data from legacy and modern platforms, with a preference for Postgres DB migration to Azure Cloud.
• Apply data quality checks and support data governance basics (metadata, lineage, access controls).
• Optimize Spark jobs for performance, reliability, and cost.
• Collaborate with cross-functional teams, product owners, admin teams, BSAs, Scrum, and project managers.

Company Benefits & Culture

• Comprehensive health, dental, and vision insurance.
• 401(k) plan with company match.
• Opportunities for professional development and career growth.

For immediate consideration please click APPLY to begin the screening process with Alex.