Purpose: Transfer SharePoint List data through azure blob storage and into the DataWarehouse Requires: Prerequisites: Process Steps: 4. Data Pipeline 5. Create pipeline parameters. Create two pipeline parameters. 5. Activities Tab 6. Look up Activity Click on the Lookup activity and go to settings, from there if not already set up create a new connection … Read more
Purpose: Transfer SharePoint list the Database environment for DataWarehouse Requires: Process Steps: 4. DataFlow Gen2 5. Power Query Window 6. Get Data 7. More… 8. SharepPoint Online List (NOT Sharepoint List) 9. Enter URL 10. Set Implementation to [2.0] 11. [Next] 12. Choose your list 13. [Create] 14 . Rename Dataflow 15. Select [Cog] on … Read more
1. Create a blank query in Power Query Editor like so: 2. Keep “Include in report refresh” unselected. 3. Create a Card visual to show “LastPublishedDate”. 4. Before publishing the report, you need to refresh the data of the “LastPublishedDate” table, not refresh the report.
DataView Exec get.myView analytics for Prod DataMarts
Create Parameters Create two parameters… Use a Token on myBMT The token allows the Datawarehouse to identify with the source of the report, as PowerBI cannot send environment details. (answers on a postcard please, if you know how) So the token is used to give the report a unique identifier <token_finder> Navigate to the Workspace … Read more
Strive to make data accessible to everyone in the organisation, regardless of technical expertise. Implement self-service analytics tools, intuitive dashboards, and comprehensive data documentation to empower all stakeholders to make data-driven decisions.
Set a goal to build a data processing pipeline that can effortlessly handle massive volumes of data without any performance degradation. This could involve leveraging technologies like Apache Spark, Apache Flink, or Google Dataflow to achieve seamless scalability.
Aim to enable real-time analytics capabilities for the organisation, allowing stakeholders to make decisions based on the most up-to-date information. This could involve building streaming data pipelines, implementing complex event processing systems, and developing real-time dashboards.
Make it a goal to ensure the highest standards of data security and compliance within the organisation. This could involve implementing robust encryption, access controls, and auditing mechanisms to protect sensitive data and ensure compliance with regulations like GDPR.