Data Engineer

Job Description

Data Engineer + Data Quality

Role Overview

We are seeking an experienced Azure Architect with strong expertise in Data Engineering and Data Quality (DQ) frameworks to design, implement, and govern scalable enterprise data platforms on Microsoft Azure. The ideal candidate will have deep experience in cloud-native data architectures, modern ETL/ELT pipelines, data governance, and enterprise-grade data quality practices.

The role involves working closely with business stakeholders, data engineers, architects, analytics teams, and leadership to build reliable, secure, and high-performing data ecosystems.

Key Responsibilities

Azure Data Architecture

• Design scalable and secure enterprise data platforms on Microsoft Azure.
• Define end-to-end cloud data architecture using Azure-native services.
• Develop reference architectures, reusable frameworks, and best practices.
• Lead migration of on-premise data platforms to Azure cloud.
• Ensure architecture aligns with business, security, governance, and compliance requirements.

Data Engineering

• Build and optimize large-scale batch and real-time data pipelines.
• Design ETL/ELT frameworks using modern Azure data services.
• Implement lakehouse/data warehouse architectures.
• Enable data integration from structured, semi-structured, and unstructured sources.
• Optimize performance, scalability, and cost of Azure data solutions.

Data Quality & Governance

• Define enterprise data quality standards, controls, and monitoring frameworks.
• Implement DQ checks including completeness, accuracy, consistency, uniqueness, and timeliness.
• Design automated DQ validation and reconciliation frameworks.
• Collaborate with governance teams on metadata management, lineage, and master data initiatives.
• Establish data observability and monitoring mechanisms.

Stakeholder Management

• Work with business users to understand analytical and operational data requirements.
• Collaborate with cross-functional teams including BI, AI/ML, governance, and infrastructure teams.
• Mentor junior engineers and provide technical leadership.
• Participate in architecture reviews, design discussions, and client presentations.

Required Skills & Experience

Technical Skills

Azure Services

Strong hands-on expertise in:

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure Data Lake Storage (ADLS)
• Azure SQL Database
• Azure Purview / Microsoft Purview
• Azure Event Hub / Stream Analytics
• Azure Functions
• Azure DevOps

Data Engineering

• Expertise in SQL and Python/PySpark.
• Strong understanding of data modeling techniques.
• Experience building distributed data processing systems.
• Knowledge of batch and streaming architectures.
• Experience with Delta Lake/Lakehouse concepts.

Data Quality

• Experience implementing enterprise Data Quality frameworks.
• Data Governance
• Knowledge of DQ tools/frameworks such as Great Expectations, Deequ, Monte Carlo, Informatica DQ, or custom validation frameworks.
• Experience in data profiling, validation, reconciliation, and anomaly detection.
• Understanding of data governance and metadata management.

Cloud & DevOps

• CI/CD implementation for data pipelines.
• Infrastructure as Code (IaC) exposure using Terraform/Bicep/ARM templates.
• Experience with monitoring and logging frameworks.
• Understanding of cloud security best practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.
• 8+ years of experience in Data Engineering and Cloud Architecture.
• 4+ years of hands-on experience with Azure Data Platform.
• Experience working in enterprise-scale cloud transformation programs.
• Azure certifications preferred:
• Azure Solutions Architect Expert
• Azure Data Engineer Associate
• Azure AI Engineer (preferred)

Preferred Experience

• Experience in BFSI, Healthcare, Retail, Manufacturing, or CPG domains.
• Exposure to AI/ML data platforms.
• Experience with multi-cloud or hybrid-cloud environments.
• Familiarity with Agile delivery models.
• Client-facing consulting experience.

Soft Skills

• Strong communication and stakeholder management skills.
• Excellent problem-solving and analytical thinking.
• Ability to lead technical discussions and architecture reviews.
• Strong collaboration and mentoring capabilities.
• Ability to work in fast-paced and cross-functional environments.

Note: The job description may be subject to modification based on business requirements and evolving project needs.

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $120,000 - $140,000 . In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws