Data & AI Engineer
Purple Drive
Overview: Must Have Technical / Functional Skills
- Strong core data engineering competencies with expertise in data concepts and data modelling
- Experience with Big Data platforms and scalable data pipeline design
- Hands-on experience with Microsoft Fabric Data Agents and Azure AI Services
- Knowledge of AI/ML integration within enterprise data platforms
- Strong analytical and problem-solving capabilities
- Expertise in performance tuning, monitoring, and optimization
- Proficiency in PySpark for large-scale data processing
- Ecommerce domain knowledge with customer behavior analytics experience
- Experience with Adobe Analytics, Adobe Customer Journey Analytics (CJA), and clickstream data analysis
- Design, build, and maintain curated Silver-layer datasets in Microsoft Fabric for experimentation reporting and analytics
- Collaborate with BI/Data Reporting teams to define dimensions, metrics, and joins such as visitor/session, variant, campaign, geo, device, channel, funnel steps, and conversion events
- Develop reusable and standardized data products including tables and views for dashboards, scorecards, and ad hoc reporting
- Ensure Silver-layer datasets are clean, conformed, deduplicated, and aligned with agreed business definitions
- Conduct regular gap assessments across experimentation requirements, existing Silver-layer data, and upstream telemetry/source systems
- Identify missing fields, inconsistent definitions, data latency issues, and join-key mismatches
- Document business impact, severity, remediation plans, timelines, and dependencies for identified issues
- Recommend improvements in data models, including facts/dimensions, surrogate keys, grain definition, and conformance rules
- Lead workshops with experimentation, BI, measurement, and engineering teams to define Gold-layer reporting requirements
- Define KPI calculations, attribution rules, scorecard structures, segmentation requirements, governance standards, and refresh SLAs
- Prepare functional and technical documentation including source-to-target mappings, data dictionaries, validation rules, and acceptance criteria
- Ensure alignment on single-source-of-truth definitions across CJA, Power BI, and scorecards
- Build and maintain robust pipelines using Microsoft Fabric Pipelines and Azure Data Factory (ADF)
- Work with 1DS telemetry pipelines or equivalent systems to ensure accurate event and attribute flow into Fabric
- Implement orchestration, incremental loads, monitoring, and error-handling mechanisms to meet reporting timelines
- Perform reconciliation between Silver/Gold datasets and Customer Journey Analytics (CJA)
- Validate event counts, session/user logic, experiment attribution, conversions, and time-window consistency
- Build automated checks for missing data, duplicate events, schema drift, and metric anomalies
- Coordinate issue resolution with telemetry, tagging, product engineering, and reporting teams
- Ensure datasets are ready for pre-launch checks, measurement, scorecard generation, health checks, and post-test analysis
- Curate experiment metadata including test IDs, allocation details, start/end dates, KPI metrics, and slicing dimensions
- Support consistent and reliable experimentation scorecard generation
- Design and develop AI-powered agents using Fabric Data Agents, Copilot, and Azure OpenAI
- Enable automation for scorecard creation, narrative summaries, self-service analytics, anomaly investigation, and metric definition assistance
- Define agent scope, personas, grounding datasets, RBAC/security models, and evaluation metrics
- Partner with experimentation and reporting teams for pilot implementation, feedback gathering, and production rollout
- Maintain detailed documentation for datasets, transformation logic, metric definitions, pipelines, validation rules, and operational runbooks
- Establish standards for naming conventions, semantic consistency, versioning, backward compatibility, and performance optimization
- Provide operational support including monitoring, troubleshooting, incident management, and continuous improvement initiatives
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data & AI Engineer in Bellevue, WA vacancy
- ...Overview: Job Title: Data & AI Engineer - Microsoft Fabric, Experimentation Data & Agent Development Location: Bellevue, WA/Remote Experience: 6-8 Years Job Summary We are seeking a highly skilled Data & AI Engineer with strong expertise in Microsoft...SuggestedRemote work
$64k - $100k
...Must Have Technical/Functional Skills: Core Data Engineering Competencies; Data Concepts & Data Modelling; Digital : Big Data Platforms... ...; data pipelines design; Microsoft fabric data agents; Azure AI Services; AI and ML Integration; Analytical and problem...Suggested$60 - $85 per hour
...A fast-growing AI company''s Finance organization is looking for a Data Engineer to develop and maintain the data infrastructure that supports its CFO team. This role offers the opportunity to join a small, dynamic team with a wide-ranging mandate: build data pipelines...SuggestedHourly payFull timeContract work- ...Responsibilities and essential job functions include but are not limited to the following: # Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and...SuggestedPermanent employmentRemote work
- ...Position : Principal - Data Engineer Location: Bellevue WA ( Hybrid) Rate - DOE Job descriptions : We operate in an Azure + Databricks Lakehouse. We'll need a person with: • Azure experience - ADF for orchestration, ADLS for storage, AzureDevOps...Suggested
- ...Benefits: Competitive salary Opportunity for advancement Training & development Role: Data Visualization Engineer

