Julian.Kellett & Common Data Standards – MVP Development Project Description The Data Dictionary & Common Data Standards initiative aims to create a structured, standardised approach for defining and managing the key DataMarts, including: This initiative will form the Minimum Viable Product (MVP) for describing the data landscape, improving data discoverability, governance, and quality assessment across the … Read more
Project Description The PinPoint Application Tracking System Integration project aims to integrate the PinPoint recruitment platform with internal systems, specifically by: The goal is to streamline recruitment data flow, ensuring that job postings are automatically synchronised, consistently formatted, and securely integrated into internal systems. Risks & Issues Key Risks Key Issues Main Tasks & Deliverables … Read more
Project Description The Regional Project Data Integration aims to integrate legacy project data from Deltek Vision systems in the APAC, NA, and CAN regions into the Data Warehouse. This integration will enable automated business reporting before the GMIS ERP system is implemented in these regions. The main objective is to ensure that historical and active … Read more
1️⃣ Overview The Data Warehouse (DWH) enforces role-based access control (RBAC) and Multi-Factor Authentication (MFA) to secure access across: All users must authenticate using MFA when accessing database resources and storage accounts. Access Governance and Security 2️⃣ User Access and Membership Groups Volumes – Users and Type 3️⃣ SQL Server Access Control SQL Server permissions … Read more
Additions Customer Details & Project Details APC Alterations General Ledger Transaction Customer Details (CAD & USD) Business Opportunity Dates (Busopp Dates) Notes The following SQL scripts have been modified and differ from previous versions: There were additional alterations to cdm to support transaction error logging 1. ⚠️ DIFFERENT: create_table_comment.sql2. ⚠️ DIFFERENT: create_table_log.sqlSource ID altered to … Read more
When importing rich text data into a Data Warehouse (DWH), it’s often necessary to remove unwanted HTML tags while preserving essential formatting. This guide outlines a method using Python’s BeautifulSoup library to clean and structure the data efficiently. Why Strip HTML Tags? Rich text from sources like web applications, CMS platforms, and APIs often includes … Read more
The following Power Query (M) script demonstrates how to extract a list of dates from a table, convert them into a formatted string, and use them dynamically in an API request: Step-by-Step Guide Explanation: Application in get.myhistory This approach can be used within get.myhistory to dynamically retrieve historical records by supplying a list of relevant … Read more
Additions Customer Details USD ✅ New Addition customer_details_USD – Part of the CAD/USD series of changes.⚠️ Contains Created (Hash) Customer IDs – This will be corrected in the next release. Considerations & Next Steps 🔹 Customer ID Fix Pending – Plan for a smooth transition when correcting the Customer ID field.🔹 UNION-based “mega” list for … Read more
SFIA-8 Aligned Overview As a Senior Data Engineer (Grade 4) you design, build, and optimise scalable data platforms, pipelines, and architectures. In this role, you lead data engineering best practices, DevOps, automation, and real-time processing, working closely with Data Architects, Analysts, and Data Scientists to drive business value from data. You play a key role … Read more
(Revised for SFIA-8 Alignment) Overview As a Data Analyst / Report Writer (Grade 3) you play a pivotal role in developing insightful reports, dashboards, and data models to support data-driven decision-making. This role involves working closely with the Data Warehouse team, Finance, and Commercial teams, ensuring data integrity, governance, and automation across reporting processes. You … Read more