Changes busopp_dates_202409 Updated to source Wanted Delivery Date from the refactored QFACT_BUSINESS_OPP_OL (formerly FACT_BUSINESS_OPP_OL$). project_value_202410 Now filtered to exclude rows where CONTROL_CATEGORY is NULL. OCNS / CEFAS DataViews These views provide an overview of the product-related DataViews derived from OCNS (Offshore Chemical Notification Scheme) and CEFAS (Centre for Environment, Fisheries and Aquaculture Science) regulatory sources. … Read more
📘 Purpose This page provides an overview of the product-related data views based on OCNS and CEFAS environmental regulatory sources. These views support reporting, environmental compliance, and substitution warning analysis across various product categories. 🔍 Use Cases 🗂️ DataViews Summary The following views are published within the cefas schema: DataView Name Category Description Notes / … Read more
View: project_forecast_202409 Enhancements: Spark-SQL Compatibility and Safe-Code Updates Changes Implemented To improve compatibility with Spark SQL and prepare views for future transition into Fabric or Lakehouse environments, the following adjustments have been made: Outstanding Compatibility Issues 1. IIF() in object CODE should be CASE 2. Square brackets on reserved words (e.g. [identifier]) 3. CF$ field … Read more
This proposal outlines a phased approach to broaden the scope of our Data Engineering capability, incorporating Microsoft Fabric as a unified analytics platform and evolving our approach to include foundational elements of AI Engineering. The goal is to create an agile, scalable, and intelligent data platform that supports operational analytics, predictive insights, and innovation. 1. … Read more
A novel about IT, DevOps and Helping your Business Win
Today I stumbled upon a neat little trick in Power BI’s Power Query Editor, and it’s too good not to share! If you’ve ever loaded data into Power BI and ended up manually renaming columns one by one to clean them up, there’s a much faster way. 💡 You can rename all columns at once … Read more
Staging: Gl: Logging:
List all Error and Comment logging processes, that will be removed if we do not have an SQL server The current logging processes include transaction and error logs. These logs are stored in tables within the staging (stg) and Global Org (GL) databases. GL: Stg:
Role Purpose The Head of Data Engineering & Analytics provides strategic and operational leadership for the organisation’s data platforms, data engineering capability, and analytical services. The role exists to ensure that: The role balances: in order to maximise the value of data across the organisation. Scope and Impact The role: The Head of Data Engineering … Read more
🔧 Summary of Changes This week’s release includes updates to four DataMart view SQL files, all related to a recent data unification issue affecting the CAD domain. The issue arose due to conflicting records across two client lists. This has now been resolved by aligning with the authoritative CL extracted from the Vision database (last … Read more