Professional Documents
Culture Documents
Road Map For Data MGT
Road Map For Data MGT
Data Management
Comment
Business Questions
Roles, Responsibilities
and Compliance with
Doing Things Right
A Generic Design to
provide totals for Reports
To provide a Single
View of the Truth, with
Data Quality and MDM
Maintain a Repository
of all Databases, People
and Applications
Page 1 of 34
3. The Stages
For each Stage, blank and partially completed Templates are provided and a series of What,
Why and How Questions are answered.
AREA
NAME
DESCRIPTION
APPROVED
AREA
NAME
DESCRIPTION
People
Policies
Data Models
Data Integrity
John Small
A Single
View
Procedures
Data Models
Roles
Data Models
Data Analyst
We will aim to provide a Single View of every
major item of data, such as Customers.
Models are created in Power Designer and
stored in Dimensions after approval.
Responsible for coordinating changes
John Small
APPROVED
Page 2 of 34
What validation and transformations are applied to the data in its life cycle
Page 3 of 34
Page 4 of 34
Page 5 of 34
Weekly Totals
Traffic Lights
Dashboards
KPIs
Other
Dashboards
In use
Unaware
Unaware
KPIs
In use
Aware
Unaware
Other
Mashups
Page 6 of 34
Data Marts
Movements
NCTS
Products
Customer
Warehouses
Data Marts
N/A
N/A
N/A
Movements
NCTS
Products
Customer
Warehouses
N/A
Available
SEED
DTR but needs work
DTR but needs work
N/A
N/A
N/A
N/A
N/A
Page 7 of 34
Weekly Totals
Grand Total
Week 1 Date
Week 2 Date
Week 3 Date
Week 4 Date
Total
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
<Value in s>
Weekly Totals
Grand Total
205,000
425,000
361,000
396,000
Total
160,000
160,000
118,000
366,000
490,000
1,300,000
Page 8 of 34
http://www.databaseanswers.org/bi_plus_performance_reports.htm
This Stage delivers Performance Reports that meet the requirements of all levels of
management.
Step 1. Assess the level of Maturity of the Users concerning KPIs, Dashboards,etc..
Page 9 of 34
Step 3. Check availability of Report Specifications and SQL Views for Reports
If you have a Question that is not addressed here, please feel free to email us your Question at
barryw@databaseanswers.org.
Microsofts SQL Server Integrated Services also lets Excel be defined as a Source.
On-demand reports
Page 10 of 34
Page 11 of 34
DIMENSION 1
Dimension 1 ID (PK)
Dimension Details 1
DIMENSIONS 2
Dimension 2 ID (PK)
Dimension Details 2
DIMENSIONS 3
Dimension 3 ID (PK)
Dimension Details 3
DATA_MART_FACTS
Fact ID (PK)
Dimension 1 ID
Dimension 2 ID
Dimension 3 ID
Dimension 4 ID
Dimension 5 ID
Dimension 6 ID
Averages
Counts
Totals
KPIs
Other Derived Figures
DIMENSIONS 4
Dimension 4 ID (PK)
Dimension Details 4
DATA_MART_FACTS
Fact ID (PK)
Date
Movement ID
Product ID
Product Type Code
Customer ID
Customer Type Code
Total Movements
Total Movements by Value
Total Movements by Month
KPIs
Other Derived Figures
MOVEMENTS
Movement ID
Movement Details
DIMENSIONS 5
Dimension 5 ID (PK)
Dimension Details 5
DIMENSIONS 6
Dimension 6 ID (PK)
Dimension Details 6
CALENDAR
Day Number (PK)
Day Date
PRODUCT TYPES
Product Type Code
Product Type Details
CUSTOMER TYPES
Customer Type Code
Customer Type Details
Page 12 of 34
PRODUCTS
Product ID
Product Details
CUSTOMERS
Customer ID
Customer Details
http://www.databaseanswers.org/data_marts_questions.htm
Page 13 of 34
Page 14 of 34
Templates are defined for important activities within Data Integration, including : Data Profiling
Data Validation
Mapping Specifications
DESCRIPTION
MIN
VALUE
MAX
VALUE
MOST COMMON
VALUE
COMMENTS
MAX
VALUE
Jan-12010
MOST COMMON
VALUE
Jun-15-2008
COMMENTS
DESCRIPTION
Withdrawn Date
Date Customers
Approval withdrawn
MIN
VALUE
Dec-311998
Page 15 of 34
DESCRIPTION
Nullable
RULES
DATE
% QUALITY
Nullable
Yes
RULES
>Start Date
DATE
% QUALITY
DESCRIPTION
Date Customers
Approval
is withdrawn
Data Type
Target
(eg XML File)
Page 16 of 34
Data Item
Data
Type
Job
Schedule
Rule
Specification
Mapping Specifications
Project Title: Creation of a Data Extract for Customers
Date: April 1st. 2010
Additional Comments:
Trigger
Source
Table
CUSTOMERS
CUSTOMERS
CUSTOMERS
CUSTOMERS
CUSTOMERS
CUSTOMERS
ID
DAT_VALID
PHON_NUMBER
FAX_NUMBER
TELEX_NUMBER
E_MAIL_ADDRESS
NVARCHAR2(8)
DATE
NVARCHAR2(35)
NVARCHAR2(35)
NVARCHAR2(35)
NVARCHAR2(70)
OFFICE
Office
Unique ID
CHAR(8)
CUSTOMERS
CUSTOMERS
CUSTOMERS
CUSTOMERS
CUSTOMERS
COUNTRY_ID
TRADING_ROLE
POST_CODE
REG_CODE
GEO_INF_CODE
NVARCHAR2(2)
NVARCHAR2(1)
NVARCHAR2(9)
NVARCHAR2(3)
NVARCHAR2(8)
OFFICE
Country
Code
CHAR(2)
Page 17 of 34
Field Name
Data Type
Transf
Rule
Column
Copy
As is
Some key points : Data Integration is concerned with combining data from various Sources into one
consistent stream.
It provides an essential Single View of Data, for example, a Single View of a Customer.
It also provides a natural point at which Data Quality can be addressed.
At this Stage, Data Quality can be assessed and a Single View of a Customer can be
achieved.
When Data Quality is of a uniform good quality, it can be integrated and made available as
a consistent View.
This will be supported using a Glossary, as described in the Information Catalog Stage.
The current incarnation of Data Integration is Master Data Management,(MDM).
Data Integration provides a Single View of the Truth for the things of importance to the
organisation, such as Traders, Products and Movements.
It provides a natural point at which data quality can be addressed.
When Data is of uniform good quality it can be integrated and made available as a consistent
View.
This leads naturally to Master Data Management,(MDM).
Page 18 of 34
Page 19 of 34
What validation and transformations are applied to the data in its life cycle
In 3 months, confirm GDM with sample data and Facilitated Workshops and
choose MDM product.
In 6 months, implement MDM and publish GDM and CMI on the Intranet.
Data Integration covers a number of Steps, each of which can have its own Templates.
Examples are included here for Data Profiling and Mapping Specifications.
Page 20 of 34
Step 1. Define the Target which is usually a Single View Data Model.
Step 3. Define the Mapping Specifications from the Sources to the Target.
Page 21 of 34
In 3 months, confirm GDM with sample data and Facilitated Workshops and
choose MDM product.
In 6 months, implement MDM and publish GDM and CMI on the Intranet.
Step 1. Define the Target which is usually a Single View Data Model.
Step 3. Define the Mapping Specifications from the Sources to the Target.
Page 22 of 34
Page 23 of 34
Page 24 of 34
CONTACT
TYPE
DATA ITEMS
COMMENTS
DATA ITEMS
Customers
Offices
COMMENTS
Golden Source
Official Source
CONTACT
Joe Bloggs
Joe Bloggs
TYPE
SQL Server DB
Oracle DB
Applications
Databases
Spreadsheets
It also includes Information related to each Stage in the Best Practice Road Map on People,
Roles and Responsibilities.
This Information is stored within an Information Catalog.
Page 25 of 34
Page 26 of 34
AREA
NAME
DESCRIPTION
Weekly Totals
Grand Total
Total
<Value in s>
<Value in s>
Page 27 of 34
DIMENSION 1
Dimension 1 ID (PK)
Dimension Details 1
DIMENSIONS 2
Dimension 2 ID (PK)
Dimension Details 2
DIMENSIONS 3
Dimension 3 ID (PK)
Dimension Details 3
DATA_MART_FACTS
Fact ID (PK)
Dimension 1 ID
Dimension 2 ID
Dimension 3 ID
Dimension 4 ID
Dimension 5 ID
Dimension 6 ID
Averages
Counts
Totals
KPIs
Other Derived Figures
DIMENSIONS 4
Dimension 4 ID (PK)
Dimension Details 4
DIMENSIONS 5
Dimension 5 ID (PK)
Dimension Details 5
DIMENSIONS 6
Dimension 6 ID (PK)
Dimension Details 6
Mapping Specifications
Project Title
Project :
Date:
Additional Comments:
Trigger
Source
Data Item
(eg Table)
Data Type
Target
(eg XML
File)
Data
Item
Data
Type
Job
Schedule
CONTACT
TYPE
Page 28 of 34
DATA ITEMS
COMMENTS
Rule
Specification
Applications
Databases
And so on
It will be published over the corporate Intranet with clearly-defined privileges for who can create,
update, access and provide feedback on the content.
Page 29 of 34
Paper-based documents
A Database-supported version
Page 30 of 34
Appendix
Key Performance
Indicators (KPIs)
DATA MART
Data Layer of Totals
Page 31 of 34
Page 32 of 34
Web Services are used to implement data movements between these three Layers.
The Top Layer included :o Traffic Light displays
o Reports
o Enquiries
o Feedback
The Data Services Layer included :o Web Services for Data Integration and Consolidation
Data Sources included :o Inspections from the Monitoring Team using Smartphones
o Rectifications from the third-party Environmental Clean-up Contractor
o Monthly Schedules input from Spreadsheets
Page 33 of 34