Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Microsoft Azure Data Engineer - Azure Data Platform and Reporting Remediation

CoSourcing Partners

Position: Microsoft Azure Data Engineer - Azure Data Platform and Reporting Remediation Location: Remote - United States only Employment Type: Full-time contract Estimated Duration: Approximately two months Reports To: Managing Director of Technical Services Experience Level: Senior Overview Our client, an intelligent automation and AI consultancy, is seeking an experienced Microsoft Azure Data Engineer to stabilize, remediate, and extend its internal Azure data platform supporting executive and Client Principal reporting. The environment integrates data from Upland PSA and HubSpot CRM into Azure SQL Database using Azure Data Factory pipelines and T-SQL stored procedures. Power BI provides executive reporting on revenue, backlog, utilization, forecast, and margin. Additional integrations currently operate through Workato, and QuickBooks financial data has not yet been integrated into the reporting platform. The Data Engineer will independently diagnose existing SQL logic defects, correct historical data modeling issues, improve client master data alignment, repair reporting calculations, and migrate legacy integrations into Azure Data Factory. This is a tactical, delivery-focused engagement requiring an individual capable of understanding existing production systems, translating complex business rules into reliable data logic, and delivering tested, documented solutions with minimal supervision. Objectives 1. Restore Accuracy to Executive Financial and Operational Reporting Within the first three to four weeks, diagnose and remediate defects affecting forecasted hours, utilization, staffing capacity, project costs, margin, and week-over-week backlog reporting. Analyze existing Azure SQL stored procedures, MERGE/upsert logic, Azure Data Factory pipelines, and Power BI semantic models to isolate root causes. Develop reconciliation queries and validation procedures that demonstrate alignment with Upland PSA source data within agreed tolerances. Success will be measured by validated reporting accuracy across representative active projects and the ability of Client Principals to identify project-level backlog and forecast changes between consecutive weeks. 2. Establish Historically Accurate Revenue Attribution and Client Master Data Within the first four to six weeks, design and implement data model enhancements that preserve historical revenue attribution, establish consistent client identifiers, and differentiate end clients from billing partners. Implement appropriate effective-dated employee assignment dimensions, historical snapshots, client crosswalks, and reporting relationships within the existing Azure SQL environment. Coordinate business-rule validation with Finance and other stakeholders, including the treatment of late time entries and post-close adjustments. Success will be measured by preservation of closed-period revenue following employee team changes, consistent active-client identification across HubSpot and Upland, and accurate end-client reporting for partner-billed engagements. 3. Migrate Legacy Workato Integrations into Azure Data Factory By the end of the estimated two-month engagement, rebuild the remaining in-scope Workato integrations, estimated at four or fewer recipes, as production-ready Azure Data Factory pipelines. Document existing integration logic, dependencies, authentication mechanisms, scheduling, transformation requirements, and error-handling processes. Conduct parallel validation runs and implement appropriate monitoring, failure handling, and operational controls before supporting cutover. Success will be measured by equivalent or improved functionality, consistent output between Workato and Azure Data Factory, and readiness to retire the legacy integrations. 4. Evaluate and Recommend a Sustainable QuickBooks Integration Architecture Within the first four to six weeks, evaluate the technical and commercial options for integrating QuickBooks financial information into *** Azure and Power BI reporting environment. Compare a native Azure Data Factory implementation using the QuickBooks API against appropriate third-party connector alternatives. Assess costs, technical complexity, security, SOC 2 implications, maintainability, and alignment with the planned retirement of Workato. Deliver a documented recommendation reviewed with the Managing Director of Technical Services, with implementation dependent on separate scope confirmation. 5. Deliver Secure, Documented, and Maintainable Production Solutions Throughout the engagement, ensure all SQL, pipeline, and Power BI semantic model changes follow *** Azure DevOps source control, peer-review, change management, and SOC 2 requirements. Develop clear technical documentation covering data lineage, transformation logic, business rules, validation results, operational dependencies, and maintenance considerations. Coordinate knowledge transfer with internal technical resources and provide specifications for any Power BI report or visual changes to be completed by *** personnel. Success will be measured by documented acceptance of each workstream, reviewed production changes, completed knowledge transfer, and the ability of internal teams to maintain the delivered solutions. Subtasks 1. Assess the Existing Azure Data Platform and Prioritize Remediation Develop a prioritized remediation plan covering workstream dependencies, technical risks, validation procedures, and delivery milestones. Measure success through completion of an agreed-upon assessment and delivery plan. 2. Remediate Forecast, Utilization, Cost, Margin, and Backlog Calculations Validate corrections using reconciliation queries that demonstrate source-system alignment within agreed tolerances and accurate project-level comparisons between consecutive weeks. 3. Implement Point-in-Time Historical Revenue Attribution Redesign the applicable data model and upsert logic to prevent employee role or team changes from rewriting historical revenue attribution. Implement appropriate Type 2 slowly changing dimensions, effective-dated employee assignments, and/or monthly period-close snapshot tables that cannot be overwritten by routine daily ingestion. 4. Resolve Client Master Data and Partner-Billed Revenue Reporting Design and implement a consistent unique client identifier across HubSpot and Upland PSA, including the necessary HubSpot custom property and Azure SQL historical crosswalk. Backfill historical client records and produce an exception report identifying any unmatched records requiring resolution. Modify the reporting data model to distinguish end clients from billing partners such as UiPath and Celonis. Validate that every active client carries a consistent identifier across both systems and that partner-billed revenue reports under the end client by default, with billing partner available as a reporting dimension. 5. Evaluate QuickBooks Integration Options investigate supported approaches for bringing QuickBooks financial data into the Azure SQL and Power BI reporting environment. Assess native API integration using Azure Data Factory and compare relevant third-party connectors, including authentication, extraction limitations, operating costs, security controls, and ongoing maintenance requirements. Evaluate each option against *** SOC 2 obligations and strategy to retire Workato. Deliver a written recommendation reviewed by the Managing Director of Technical Services; production implementation will require confirmation that it is within the engagement scope. 6. Complete Workato Migration, Production Validation, and Knowledge Transfer During the engagement and no later than its agreed completion date, inventory, document, and rebuild the remaining in-scope Workato integrations using Azure Data Factory. Implement equivalent or improved scheduling, parameterization, authentication, monitoring, failure handling, and incremental data processing where applicable. Conduct parallel runs, reconcile outputs, obtain appropriate change approvals, and support cutover readiness for retiring Workato. Complete technical documentation and knowledge transfer across all seven original workstreams, with success measured against their respective acceptance criteria. Requirements Professional Experience: Minimum five years of hands-on professional data engineering experience, including at least three years working with the Microsoft Azure data stack. Azure Data Factory: Demonstrated production experience building and maintaining Azure Data Factory pipelines, including REST APIs, parameterization, incremental loads, scheduling, monitoring, and failure handling. Advanced T-SQL and Azure SQL: Strong hands-on experience with stored procedures, MERGE/upsert logic, window functions, complex SQL debugging, performance tuning, and remediation of legacy code written by other engineers. Historical Data Modeling: Proven implementation of Type 2 slowly changing dimensions, effective-dated dimensions, and periodic snapshot tables that preserve historical reporting accuracy. Dimensional Modeling: Demonstrated experience developing star schemas, conformed dimensions, master data crosswalks, and reporting-oriented data models. Power BI and DAX: Ability to trace reported metrics to underlying source data, modify semantic model relationships and measures, develop DAX calculations, and validate reporting outputs. SaaS API Integration: Hands-on experience integrating SaaS platforms through REST APIs, including OAuth authentication and pagination. Professional Services Reporting: Working knowledge of billable utilization, staffing capacity, backlog, forecast versus actuals, revenue attribution, and project margin. Independent Delivery: Demonstrated ability to independently diagnose technical problems, work with Finance and executive stakeholders, translate business requirements into data logic, and deliver documented solutions. Source Control: Experience using Git-based source control for database and pipeline code, preferably Azure DevOps. Preferred Qualifications Experience with Upland PSA or comparable professional services automation platforms such as Kantata, Certinia, or Planview. Experience working with HubSpot CRM APIs, data models, and custom properties. Experience extracting financial data from the QuickBooks Online API or evaluating financial data integration connectors. Experience migrating integrations from Workato or another iPaaS platform into Azure Data Factory. Experience implementing CI/CD for Azure Data Factory and SQL database deployments through Azure DevOps. Prior experience supporting consulting or professional services organizations, particularly revenue attribution, financial reporting, resource planning, and utilization analytics. Experience operating within SOC 2, ISO 27001, or comparable security and compliance frameworks. Current Microsoft data engineering or Power BI certification. CoSourcing Partners

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Microsoft Azure Data Engineer - Azure Data Platform and Reporting Remediation in Chicago, IL vacancy
  • Role : Data Engineer| Chicago, IL (Onsite) JD : Data Engineering and...  ...sources into Enterprise Data Platform (EDP). • Designing and...  ...prepare data for analytics and reporting. • Identifying and resolving...  ...variety of data sources using Microsoft Fabric. • Understands how... 
    Platform
    Microsoft

    Prophecy Technologies

    Chicago, IL
    3 days ago
  •  ...helpful, but not required Job Title: Azure Data Engineer Job Summary: We are seeking a highly skilled...  ...our next-generation cloud data platform. You will build scalable data pipelines...  ...Required Technical Skills: • Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL,... 
    Platform
    Microsoft

    3B Staffing LLC

    Chicago, IL
    3 days ago
  • $27 - $42 per hour

     ...challenges with confidence. As a Data Analytics Developer in...  ...data visualization and reporting solutions that empower stakeholders...  ...tools, while leveraging platforms like Power BI, Tableau, and...  ...environment within the Microsoft Azure Cloud Solutions. Participate... 
    Platform
    Microsoft
    Hourly pay
    Internship
    Local area
    Immediate start
    Worldwide

    Crowe

    Chicago, IL
    4 days ago
  • $70k - $90k

     ...meaningful way. Tempus' proprietary platform connects an entire...  ...and product development. Our data and reporting infrastructure – using...  ...Responsibilities As a Data Visualization Engineer on the Tempus Next team ,...  ...Web Services (AWS), or Microsoft Azure Experience with... 
    Platform
    Microsoft

    Tempus AI

    Chicago, IL
    5 days ago
  • $110k - $156k

     ...The Senior Developer, Data Engineering will lead the design, development...  ...'s enterprise data platform, built primarily on Microsoft Fabric. You will set...  ...solutions that support reporting, BI, and downstream product...  ...integration. Build .NET-based Azure Function Apps and... 
    Platform
    Microsoft

    Evention

    Chicago, IL
    29 days ago
  • $90k - $200k

     ...that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain...  ...other data products using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) Advising clients on specific technologies and... 
    Platform
    Microsoft
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Chicago, IL
    4 days ago
  • $130k - $180k

     ...experienced Enterprise Data Engineer to join our...  ...that power firm-wide reporting and analytics. Working primarily within the Microsoft Fabric ecosystem, you...  ...as a Microsoft Fabric platform engineer, assisting with...  ...Real-Time Intelligence); Azure (Data Factory, Blob Storage... 
    Platform
    Microsoft
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Jenner & Block

    Chicago, IL
    2 days ago
  • $137.4k - $161.7k

     ...Monroe is seeking a Senior Data Engineer to join our Data & AI...  ...modern cloud data platforms that enable advanced analytics...  ..., Snowflake, and Microsoft Fabric, you will help...  ...that power reporting, machine learning, and...  ...solutions using AWS, Azure, and GCP, integrating... 
    Platform
    Microsoft
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Chicago, IL
    2 days ago
  • Position: Data Engineer IIILocation: Chicago, IllinoisDuration: ContractJob...  ...analytics and operational reporting.Enable, configure, and...  ...automation across the data platform.Utilize Python, Bash scripting...  ...presentation skills.Proficiency with Microsoft Excel and PowerPoint for... 
    Platform
    Microsoft
    Full time
    Temporary work
    Work at office
    3 days per week

    Pinnacle Group

    Chicago, IL
    2 days ago
  • $91.1k - $179.5k

     ...0/2026. Work you'll do The Data Engineer Consultant will support data...  ...You will build dashboards, reports, and reusable analytics...  ...production-ready pipelines and platforms with strong data governance...  ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (... 
    Platform
    Microsoft
    Local area

    Deloitte

    Chicago, IL
    2 days ago
  •  ...firm is looking for BI Data Modeler Engineer. This role will be focused on data modeling, Microsoft tech Stack, SQL Server, Azure, Azure Synapse Analytics...  ...models that support reporting and analytics across enterprise...  ...Intelligence (BI) platforms and warehouses.... 
    Platform
    Microsoft
    Permanent employment
    Full time
    Remote work

    Request Technology, LLC

    Chicago, IL
    5 days ago
  • $200k - $250k

     ...THE OPPORTUNITY Our Principal Data Engineer owns the architecture and technical direction of the data platform that powers trading analysis, reporting, and decision-making across Group...  ...platform to support it. Our existing Microsoft-based environment gives us a... 
    Platform
    Microsoft
    Flexible hours

    Group One Trading

    Chicago, IL
    a month ago
  • $215.2k - $244.7k

     ...clients developing Big Data strategy and...  ...Provide guidance and platform selection advice...  ...Snowflake, and/or Microsoft FabricDesign data...  ...for ingestion and reporting, specific to use case...  ...services such as Azure OpenAI, OpenAI...  ...Models (LLMs), prompt engineering, embeddings,... 
    Platform
    Microsoft
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Chicago, IL
    2 days ago
  • $140k - $175k

    Position SummaryThe Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and...  ...processes for real-time data synchronization in Azure data platforms.• Implement data cataloging, classification, and... 
    Platform
    Full time
    Work experience placement
    Work visa

    Ryan Specialty Group

    Chicago, IL
    4 days ago
  • $190k - $225k

     ...Computer Science, Engineering, MIS, or related field...  ...of experience in data engineering or...  ...architecting data platforms and pipelines at scale...  ...without direct reporting authority.Preferred...  ...., Unity Catalog, Microsoft Purview, Collibra,...  ...environment (Azure, AWS, or GCP).Architect... 
    Platform
    Microsoft
    Temporary work
    Local area
    Flexible hours

    Newmark

    Chicago, IL
    2 days ago
  •  ...Job Title Staff Engineer II, TSG Data Engineering Job ID...  ...solutions built using Microsoft technologies, with integrations...  ...troubleshooting, reporting, and database...  ...tools such as Jira or Azure DevOpsExperience architecting...  ...conceptsRPA platforms such as Automation Anywhere... 
    Platform
    Microsoft
    Permanent employment
    Full time
    Work at office
    Local area
    1 day per week

    Bain & Company

    Chicago, IL
    4 days ago
  • $133.06k - $139.5k

     ...MULTIPLE POSITIONS] Avanade Inc. seeks Azure Data Engineers in Chicago, IL to deliver analytics...  ...Interfaces (APIs); and create and maintain report forms and formats, information...  ...analytics solutions built on MS or Azure platforms; 4 years of experience working with Azure... 
    Platform
    Work at office
    Local area

    Avanade

    Chicago, IL
    3 days ago
  • Sr Data Engineering & Data Governance Architect  Our talented Data & AI...  ...strategic direction using data platforms, reporting, self-service analytics,...  ...and Integrate Purview with Azure, Databricks, Postgres and...  ...solutions using  Python, SQL,  Microsoft Azure Data Services, Fabric... 
    Platform
    Microsoft

    Avanade

    Chicago, IL
    5 days ago
  •  ...About This Role The Data & Integration Engineer is a hands-on...  ...Health Centers data platform integrations pipelines...  ...accessible to support reporting analytics and AI-enabled...  ...solutions using Microsoft Fabric and related technologies...  ...with Microsoft Azure and Microsoft 365... 
    Platform
    Microsoft
    Full time

    Compass Health Center

    Chicago, IL
    6 days ago
  • $160k - $200k

     ...provide differentiated, data-driven perspectives...  ...Accounting and Financial Reporting (TAS/AFR) practice is...  ...an investment banking platform, gaining exposure to...  ...controls frameworks and remediation of control...  ...skillsStrong command of Microsoft Excel, PowerPoint and... 
    Platform
    Microsoft
    Full time
    Apprenticeship
    Work at office
    Worldwide

    Houlihan Lokey

    Chicago, IL
    1 day ago
  • $190k - $220k

     ...Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD...  ...build, and migrate to the Microsoft Azure platform, and increasingly...  ...which platform fits, what data and governance boundaries apply...  ...and showback or chargeback reporting.AI agent platform engineering... 
    Platform
    Microsoft
    Full time
    Work at office
    Shift work

    AHEAD

    Chicago, IL
    1 day ago
  • $110k

     ...Compliance Officer, Compliance Data and Reporting to support Hightower's...  ...preparation, findings review, and remediation tracking. Build and perform...  ...recurring work with Microsoft Power Automate and Power Apps...  ...Power BI, or a comparable platform. Foundational knowledge of... 
    Platform
    Microsoft
    Permanent employment
    Work at office
    Local area
    Work from home
    Monday to Thursday
    Flexible hours

    Hightower Advisors

    Chicago, IL
    2 days ago
  • $112.8k - $153.7k

     ...ideas. This is a senior engineering role. You will architect...  ...continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake,...  ...jobs, semantic models, reports), including branching strategy...  ...certifications (Azure, Snowflake, Databricks,... 
    Platform
    Microsoft
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    Chicago, IL
    3 days ago
  • $67k - $101k

     ...Summary The Regulatory Reporting Specialist is...  ...both product complaint remediation and processing new complaints...  ...complaints to verify data completeness and ensure...  ...timelines. Proficiency with Microsoft Office (Word, Excel,...  ...TrackWise, or similar platforms. Benefits Our benefit... 
    Platform
    Microsoft
    Minimum wage
    Work at office
    Local area
    Worldwide

    Medline

    Chicago, IL
    1 day ago
  •  ...in daily coverage that lead to in-depth reporting, scoops, exclusives and breaking news....  ...experience. Foundational proficiency with Microsoft Office suite, such as Excel. Proficiency with social media, AI and other platforms a plus. Photography skills a plus.... 
    Platform
    Microsoft
    Work at office

    American City Business Journals

    Chicago, IL
    3 days ago
  •  ...beginning of a new Data & AI decade that...  ...seeking a Data Engineering, Management & Governance...  ...AI insights platforms that translate...  ...Snowflake, Databricks, Azure Synapse, BigQuery...  ...monitoring, and remediation practices that...  ...Databricks, AWS, Microsoft Azure, or Google... 
    Platform
    Microsoft
    Live in
    Work at office
    Local area

    Accenture

    Chicago, IL
    1 day ago
  • $124k - $335k

     ...OpportunityAs a Tax Innovation - Data Engineer - Senior Manager, you...  ...of data pipelines in Azure Data Factory and Microsoft Azure Databricks to collect...  ...tax data accessible for reporting and analysis-...  ...administration and data engineering platforms, including monitoring processing... 
    Platform
    Microsoft
    Full time
    H1b

    PwC

    Chicago, IL
    1 day ago
  • $70 - $80 per hour

     ...Sr. Data Engineer Location: Chicago Hybrid role- candidates must be willing to go onsite...  ...Qualifications Experience with Microsoft Azure data services, particularly Azure Data...  ...Power BI and how data pipelines support reporting and analytics. Exposure to infrastructure... 
    Microsoft
    H1b
    3 days per week

    The Planet Group

    Chicago, IL
    18 days ago
  • $120k - $140k

     ...enterprise, and our cloud platforms are central to how our...  ...& Site Reliability Engineer, you will be hands-on...  ...pipelines and Terraform-based Azure platform behind our ....  ..., and self-hosted and Microsoft-hosted agents.Create...  ...incidents, recommend remediation, and automate low-risk... 
    Platform
    Microsoft
    Permanent employment
    Temporary work
    Work experience placement
    H1b
    Local area
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Berlin Packaging

    Chicago, IL
    5 days ago
  • $100.79k - $160.26k

     ...Together.SummaryThe Data Engineer, Solutions & Data role...  ...datasets for analytics, reporting, and downstream...  ...downstream consumption.Data Platform & StorageDesign and...  ...data pipelines using Azure data technologies (e....  ...monitoring/remediation approaches.Collaboration... 
    Platform
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    Chicago, IL
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Microsoft Azure Data Engineer - Azure Data Platform and Reporting Remediation. Be the first to apply!