Data Quality Monitoring Dashboard Guide

This Data Quality Monitoring Dashboard is designed to ensure the integrity, accuracy, and usability of data within our organization. This dashboard allows for meticulous
monitoring, management, and enhancement of data quality, empowering stakeholders to trust their data-driven strategies.

Overview
Track and visualize data quality trends: Understand how data quality changes over time and identify patterns or irregularities.
Detect and address data issues: Quickly spot areas where data does not comply with predefined rules and standards, allowing for prompt rectification.
Maintain data standards: Ensure that all data across the organization meets the set quality criteria, preserving the integrity of business insights and operations.

Key Features
Comprehensive Data Rules: The dashboard lays out specific rules that the data must adhere to, helping to prevent errors and inconsistencies.
Data Quality Scores: A scoring system that quantifies the quality of data, giving you a measurable way to assess performance.
Alerts System: Proactively notifies you of any deviations from expected data patterns, allowing for immediate action.
Data Dictionary: A detailed reference that defines each data element, ensuring that all stakeholders have a common understanding of data terms and structures.

Sections
Main Dashboard
The Main Dashboard is the heart of the tool, presenting a snapshot of overall data quality. Here, you'll find visual representations of scores, and alerts that provide a
quick yet comprehensive view of the current state of the data.

Alert
The Alert Section is a critical component of the Data Quality Monitoring Dashboard, specifically designed to showcase how many alterts are above the treshold. The
Alerts are organized by category allowing users to quickly understand the nature of the data issues.

Profiling
Profiling gives a detailed analysis of the data, offering insights into patterns, anomalies, and statistical summaries. This section aids in understanding the data's structure,
content, and inherent relationships.

Rules Deep Dive

The Rules Deep Dive offers an in-depth exploration of the specific rules that govern data quality. It allows users to examine and compare the impact of each rule and to
scrutinize the data that falls under each rule's purview.

Data Dictionary
The Data Dictionary is a detailed inventory of all data elements in the system. It provides metadata about data tables, columns, and relationships, serving as a
comprehensive reference for understanding data structures.

Relevant Links
Adding new rules excel file: data_monitoring_rules.xlsx (sharepoint.com)
 Processed Date
DATA QUALITY MONITORING DASHBOARD 3/12/2024 to 3/12/2024

Data Refresh Cadence: Daily Brand

All
Data Source: GDF (NGCv12, NGCv14,Infor)
Datamart
Displays the total number of rules currently being monitored to ensure data quality and integrity All

Src Sys
Rules Alerts Latest Score All

29 26 95
Acurracy Uniqueness Validity

99.9% 99.6% 93.8%

Rules in total: 8 Rules in total: 1 Rules in total: 3
Rules alerted : 6 Rules alerted : 1 Rules alerted : 3

Completeness Consistency Timeliness

Alerts

Profiling
93.6% 99.4% 38.3%
Rules in total: 15 Rules in total: 1 Rules in total: 1 Data Dictionary
Rules alerted : 15 Rules alerted : 1 Rules alerted : 1

Rules Deep Dive

Total Rules Monitored: Represents the distinct count of rules under surveillance for data quality and integrity.
Alert Threshold: Currently set at 0.20%, this metric indicates the frequency of alerts triggered when data deviates from established norms or expectations.
Latest Data Quality Score: This score reflects the ongoing health and accuracy of our data, serving as a barometer for overall data quality.
For in-depth insights, including time series analysis, rule descriptions, category breakdowns, and more, please click on the 'Details' button. And for comprehensive understanding and definitions of data elements, refer to the 'Data
Dictionary' button, which provides detailed explanations and context for our data structure and standards.
 DATA DICTIONARY

Table Name Table Description Schema Name Column Name Data Type Column Description Column Logic Table Name
data_profiling Table for PSA Data qma_datamart brand character varying (200) All
Profiling category character varying (20) Data Category From other table
description character varying (2000) Schema Name
invalid numeric (10, 2) All

pct_invalid numeric (10, 2)

Table Owner
processed_date date
z_rs_sso
project character varying (200) Project Name
reason_to_review character varying (2000) why need to review Formula to calculate
Column Name
remark character varying (2000)
All
rule character varying (200)
src_sys character varying (200)
valid numeric (10, 2)
weightage numeric (10, 2)
dc_port qma air_ocean character varying (2000) NA NA
brand character varying (2000) NA NA
dc_code character varying (2000) NA NA
dc_name character varying (2000) NA NA
order_type character varying (2000) NA NA
pod character varying (2000) NA NA
pol character varying (2000) NA NA
region character varying (2000) NA NA
std_pol_code character varying (2000) NA NA
DC Port Information qma coalitions character varying (2000) NA NA
NA qma std_pod_code character varying (2000) NA NA
dtm_cs_bom_val Costing BOM costing_data_mart bom_or_add character varying (200) NA
Datamart Table brand character varying (200) Product brand name NA
costing_marker_effici.. character varying (200) NA NA
costing_marker_effici.. character varying (200) NA NA
costsheet_material_c.. character varying (200) NA
count_of_material_co.. integer (32, 0) NA
create_date timestamp without time zone Row created timestamp NA
currency character varying (200) Currency Type From other table
 Category
Overview All

Datamart
Accuracy reflects data's correctness in representing real-world entities or events. Accurate data aligns closely with the true state of its subject. All
Completeness measures if all required data fields are filled. It's vital for ensuring no critical information is missing from the dataset.
Consistency ensures data compatibility across systems, maintaining uniform formats and values. It prevents contradictions in data storage and use. Brand
All

Details Source
All
Rule Description Reason To Review Source Datamart Remark
Actual CRD If the date is missing or NULL, if the date is not in date format, if the date range exceeds 36 Missing or NULL, INFOR PO&S NaN Processed Date
months from today's date, PL Quantity or Shipped QTY present but not populated Format, Date Ra.. 3/12/2024 to 3/12/2024
NGC PO&S NaN
Brand If brand is blank or NULL, exception report is built to review SBU detail and map in MDS. If the Missing or NULL, INFOR PO&S NaN
brand name is not in proper casing, need to work with the INFOR team to correct. All Proper Case f.. NGC PO&S NaN Score
BRAND2 If brand is blank or NULL, exception report is built to review SBU detail and map in MDS. Missing or NULL INFOR PO&S NaN

Business
Unit
If brand is blank or NULL, exception report is built to review SBU detail and map in MDS. Missing or NULL
NGC
INFOR
NGC
PO&S
PO&S
PO&S
NaN
NaN
NaN
95
Buy Month If buy month is blank or NULL work back with the planners to update the PO with correct details. Missing or NULL INFOR
NGC
PO&S
PO&S
NaN
NaN
Rules Alerts Count

29 26
Currency The currency should be written the same way Inconsistency INFOR PO&S NaN
with the currency
DQ Score Trend

98
Alerts
DQ Score

96
94 Actual CRD
Brand
3/12/2024 BRAND2
Business Unit
Buy Month
DQ Score by Src Currency
100 Factory FFC
Inspected sample qty
DQ Score

Major Product Category Name

50
Managing Office
MARKET
0 Missing CRC
3/12/2024 Po Create Date

Source INFOR NGC PO Cut

PO Volume
 Datamart
Data Rules General
PCD
Processed Date
PO&S
10 11 12 13
QMA
Datamart Rule Volumen Invalid (Data Profiling) Volumen Invalid (Data Profiling) Volumen Invalid (Data Profiling) Volumen Invalid (Data Profiling)
General PO Volume 7,838 3,284 4,828 3,187 9,782 3,181 13,894 3,209
PCD Missing CRC 225,716 78,714 225,750 78,709 226,033 78,666 226,688 78,536
Rule
Negative Change Value 225,716 270 225,750 270 226,033 270 226,688 272
Description Reason To Review Remark All
Any duplication at PO Cut level Duplicated Values NaN
Change reason code either missing or unable to map Missing CRC may caused to misleading information NaN Processed Date
Check whether the insp_sample is null or not The data soming the P88 is missing the insp_sample NaN 3/10/2024 to 3/16/2024

Trend of the Data Quality Data Volumen Src Sys

Rule / Processed Date All
Vans The North Face
A.. Br.. B.. B.. B.. C.. F.. In.. M.. M.. M.. M.. N.. P.. P.. P.. P.. Pr.. Pr.. P.. R.. S.. S.. S.. S.. S.. T.. V.. V..
2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2.. 2..
Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1

40.00%

INFOR
30.00%

OD OD Timberland Tree Kipling

percentage invallid

INFOR
20.00% INFOR
INFOR

10.00%
WD WD
P88 SW
INFOR INFOR Dickies Icebreaker No brand
SW WD INFOR
INFOR
SW OD INFOR WD
INFOR INFOR
INFOR
OD OD INFOR
INFOR WD INFOR SW OD WD OD
0.00%
OD INFOR
OD OD INFOR
WD INFOR ODWD INFOR OD WD INFOR INFOR
WD OD INFOR
WD SW OD WD INFOR
SW INFOR

Smartwool Jansport
-10.00%

Napapijri
12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12 12
 Category
All
Rules deep dive
Datamart
All

Rule Rule
Processed Date
Scenario 1 Currency
3/10/2024 to 3/16/2024

259,715 89,762

4,604,972 21,785,468