When working with Microsoft Fabric, one common challenge is keeping the SQL endpoint in sync with the Lakehouse endpoint after a pipeline run. Fabric provides two endpoints for every Lakehouse: Why does the SQL endpoint sometimes lag? The SQL endpoint doesn’t automatically refresh its metadata the moment new data lands in the Lakehouse. Instead, a … Read more
SharePoint list → cleaned, flat, ISO-dated table A reusable Power Query (M) snippet for Dataflows Gen2 that: When to use: Landing SharePoint list data into a Bronze/Silver layer (Fabric/Synapse/SQL) where flat, predictable schemas, text-formatted dates, and stable column names are preferred. Full code (drop-in) Step-by-step Customisation points Validation checklist Troubleshooting Notes
Weekly Release Note – Week Ending 03 November 2025 New Views project_meta_codes_pmn A new DataMart view based on data sourced from the SharePoint List PMN, processed via a GEN2 Dataflow to the Bronze layer.🔗 View Documentation This view enables portfolio and project management insights by transforming Project Manager Narratives (PMNs) into a structured, analysable format. … Read more
Category: Utility Functions → String & EncodingAuthor: Data EngineeringLanguage: Power Query (M)Purpose: Converts a text string into a URL-safe format by encoding non-alphanumeric characters as percent-encoded hexadecimal values (%XX).Compatibility: Power BI, Excel Power Query, and Fabric Dataflows (Gen2) 📝 Description UrlEncode transforms text into a format suitable for inclusion in URLs or API query strings.All … Read more
Purpose This view supports financial control and transparency by standardising balance-level data for consistent reporting and reconciliation. It helps finance and business leaders understand balance movements, inter-company positions, and the relationship between projects, programmes, and cost centres. Use Case Suggested dashboard insights: Source Integration with Dimension / Reference Tables Joins used (per SQL): (none in … Read more
Purpose This view provides a clear and consistent way to analyse individual General Ledger transactions across the organisation. It breaks each posting down into structured attributes — such as journal, project, programme, or inter-company activity — so that financial movements can be explored, reconciled, and connected to operational detail. Use Case Suggested dashboard insights: Source … Read more
Purpose This view provides a consistent and detailed picture of General Ledger activity across the organisation. By standardising ledger attributes and dimensional codes, it enables reliable analysis of financial movements, balances, and reconciliations — all within a single, governed structure. This view supports finance and audit teams in maintaining clarity and confidence in financial data. … Read more
DataMart views changed since 01-Oct-2025. Executive summary New views Renamed / globalised Downstream dependencies: Corrections Improvements to source identification & aliasing Purpose: Ensure tables are identified using their non-dollar names for lineage and metadata consistency. Change pattern:'{“Source”:”ifs.[QFACT_BMT_DWH_INVOICE_TAB_IAS$]”}’ as SOURCE_SYSTEM→'{“Source”:”ifs.[QFACT_BMT_DWH_INVOICE_TAB_IAS]”}’ as SOURCE_SYSTEM Views updated: Global query structure change (Beta & 202409 queries) Adopted a consistent CTE … Read more
Purpose:To run the stored procedure get.myArchive from Power BI for a series of previous Sundays (for example, the last six Sundays), and optionally combine or parameterise the results. 🧭 Background The get.myArchive procedure is designed to retrieve snapshot data for a specified date.By default, Power BI passes a single date parameter such as: However, when … Read more
Issued by: Data & Analytics TeamApplies to: All data integrations, pipelines, and views entering or leaving the Data WarehouseStatus: Approved DraftDate: [Insert Date]Version: 1.0 1. Purpose This standard defines the structure and principles for integrating data from source systems—including ERP (IFS), Dynamics 365, Power Apps, and SharePoint—into the enterprise Data Warehouse. It ensures that data … Read more