📘 Purpose This page provides an overview of the product-related data views based on OCNS and CEFAS environmental regulatory sources. These views support reporting, environmental compliance, and substitution warning analysis across various product categories. 🔍 Use Cases 🗂️ DataViews Summary The following views are published within the cefas schema: DataView Name Category Description Notes / … Read more
View: project_forecast_202409 Enhancements: Spark-SQL Compatibility and Safe-Code Updates Changes Implemented To improve compatibility with Spark SQL and prepare views for future transition into Fabric or Lakehouse environments, the following adjustments have been made: Outstanding Compatibility Issues 1. IIF() in object CODE should be CASE 2. Square brackets on reserved words (e.g. [identifier]) 3. CF$ field … Read more
This proposal outlines a phased approach to broaden the scope of our Data Engineering capability, incorporating Microsoft Fabric as a unified analytics platform and evolving our approach to include foundational elements of AI Engineering. The goal is to create an agile, scalable, and intelligent data platform that supports operational analytics, predictive insights, and innovation. 1. … Read more
A novel about IT, DevOps and Helping your Business Win
Today I stumbled upon a neat little trick in Power BI’s Power Query Editor, and it’s too good not to share! If you’ve ever loaded data into Power BI and ended up manually renaming columns one by one to clean them up, there’s a much faster way. 💡 You can rename all columns at once … Read more
Staging: Gl: Logging:
List all Error and Comment logging processes, that will be removed if we do not have an SQL server The current logging processes include transaction and error logs. These logs are stored in tables within the staging (stg) and Global Org (GL) databases. GL: Stg:
Role Purpose The Head of Data Engineering & Analytics provides strategic and operational leadership for the organisation’s data platforms, data engineering capability, and analytical services. The role exists to ensure that: The role balances: in order to maximise the value of data across the organisation. Scope and Impact The role: The Head of Data Engineering … Read more