Overview The myosh_Archive notebook is designed to maintain a complete and accurate archive of records from the MyOSH API. It ensures that no data is lost by identifying gaps in the current API response and backfilling missing records, then merging everything into a single, consolidated archive stored in the Azure Data Lake container. Why Do … Read more
Overview The cdm__Archive_upsert notebook is designed to help keep accurate historical records of data. It implements a technique called Slowly Changing Dimension Type 2 (SCD2), which means instead of overwriting old information, it creates a timeline of changes so you can see what was true at any point in time. This method ensures that previous … Read more
When working with Microsoft Fabric, one common challenge is keeping the SQL endpoint in sync with the Lakehouse endpoint after a pipeline run. Fabric provides two endpoints for every Lakehouse: Why does the SQL endpoint sometimes lag? The SQL endpoint doesn’t automatically refresh its metadata the moment new data lands in the Lakehouse. Instead, a … Read more
Purpose:To run the stored procedure get.myArchive from Power BI for a series of previous Sundays (for example, the last six Sundays), and optionally combine or parameterise the results. 🧭 Background The get.myArchive procedure is designed to retrieve snapshot data for a specified date.By default, Power BI passes a single date parameter such as: However, when … Read more
This note explains how to turn the current views (wide–from–tall) into a report‑friendly table using Power Query (recommended) or DAX. It covers two common layouts: It also shows how to extract a human‑readable Description from the JSON in VALUE_METADATA. Source schema (tall, meta-driven) Expected columns: Assumption: Each (OBJECT_SEQ, [META_TYPE], ATTRIBUTE) appears at most once for … Read more
Should We Reuse Standard Dynamics 365 / Dataverse Tables for Our In‑House Apps? 1) Why We’re Talking About This We’re starting an important conversation: when we build apps internally, should we lean on the standard tables already in Dynamics 365 / Dataverse (like Account, Contact, Opportunity, Project), or should we keep spinning up new SharePoint … Read more
Hey everyone 👋 We’ve been working hard behind the scenes on something that we think will really help you. 🔍 What’s New? We’ve significantly expanded the Attribute Lineage and Data Dictionary tooling in myBMT. This means: It’s a fully transparent journey from requirement ➡ mapping ➡ code — all in one place. 😅 One Small … Read more
Today I stumbled upon a neat little trick in Power BI’s Power Query Editor, and it’s too good not to share! If you’ve ever loaded data into Power BI and ended up manually renaming columns one by one to clean them up, there’s a much faster way. 💡 You can rename all columns at once … Read more
📘 Context The CODESSTRING field returned from Oracle contains serialised key-value pairs using non-printing ASCII characters: Example value: ✅ Goal Convert this encoded string into structured columns in Power BI, e.g.: ACCOUNT CODE_B CODE_C CODE_D CODE_E 10201 200 2011072 🛠️ Solution: Power Query Function Step 1: Create the Parsing Function Step 2: Apply the Function … Read more
✅ What You’ll Need 🛠️ Step-by-Step Power Query Approach Step 1: Load both tables into Power Query Step 2: Create a Cross Join (Employee × Month) Step 3: Add FTE Logic (Human Version in M) Now, for each row (i.e. employee × month), add a custom column to calculate the monthly FTE: 🧾 Final Step: … Read more