Modern data platforms are not built on single scripts or ad‑hoc notebooks. They rely on reusable, well‑designed utility functions that handle extraction, transformation, auditing, and historical tracking in a consistent way. This article walks through a real‑world Python utility module used in Microsoft Fabric, explaining every major function, what problem it solves, and how it … Read more
The meta_codes, meta_dates (and any derived meta_values) views are intentionally long and thin. This structure: That said, long thin tables aren’t always the easiest shape to work with directly in a reporting tool. Shaping meta data into a report-friendly form Once you’ve applied some basic filtering (for example, keeping only the code or date types … Read more
Bulk‑generate and (optionally) execute DROP VIEW statements for a subset of views in a given schema When to use this Safety checklist
When working with Git repositories in Azure DevOps, you might need to move a file from one folder to another without losing its history. The best way to do this is by using the git mv command. This ensures Git recognizes the move as a rename and keeps the file’s commit history intact. Why Not … Read more
SharePoint list → cleaned, flat, ISO-dated table A reusable Power Query (M) snippet for Dataflows Gen2 that: When to use: Landing SharePoint list data into a Bronze/Silver layer (Fabric/Synapse/SQL) where flat, predictable schemas, text-formatted dates, and stable column names are preferred. Full code (drop-in) Step-by-step Customisation points Validation checklist Troubleshooting Notes
Category: Utility Functions → String & EncodingAuthor: Data EngineeringLanguage: Power Query (M)Purpose: Converts a text string into a URL-safe format by encoding non-alphanumeric characters as percent-encoded hexadecimal values (%XX).Compatibility: Power BI, Excel Power Query, and Fabric Dataflows (Gen2) 📝 Description UrlEncode transforms text into a format suitable for inclusion in URLs or API query strings.All … Read more
List all Error and Comment logging processes, that will be removed if we do not have an SQL server The current logging processes include transaction and error logs. These logs are stored in tables within the staging (stg) and Global Org (GL) databases. GL: Stg:
📘 Context The CODESSTRING field returned from Oracle contains serialised key-value pairs using non-printing ASCII characters: Example value: ✅ Goal Convert this encoded string into structured columns in Power BI, e.g.: ACCOUNT CODE_B CODE_C CODE_D CODE_E 10201 200 2011072 🛠️ Solution: Power Query Function Step 1: Create the Parsing Function Step 2: Apply the Function … Read more
✅ What You’ll Need 🛠️ Step-by-Step Power Query Approach Step 1: Load both tables into Power Query Step 2: Create a Cross Join (Employee × Month) Step 3: Add FTE Logic (Human Version in M) Now, for each row (i.e. employee × month), add a custom column to calculate the monthly FTE: 🧾 Final Step: … Read more