Data Warehousing

By
Rajasekhar Reddy
i Logic Technologies

Overview

Types Of Systems
Overview of Data Warehousing
Types of Tools
Basic Functionalities of Tools

Types of Systems
OLTP

DSS

Complex Data Structures

Multidimensional Data
Structures

Few
Many

INDEXES

Many

JOINS

Some

Normalized DBMS

DUPLICATED DATA

De-Normalized DBMS

Rare

DERIVED DATA AND

AGGREGATES

Common

Many

NUMBER OF USERS

Few

Predefined operations
Volatile
Small Volumes
Availability Must be high

WORKLOAD

AD-HOC queries
not known -

DATA MODIFICATIONS

Update on a regular basis

DATA

Large Volume (Historical

Data)
Response time must be
good

Data Warehousing Overview

What is Data Warehousing
A data warehouse is a subject-oriented,
integrated, time-varying, non-volatile collection
of data in support of the managements
decision-making process.

Data Warehouse Architecture

Source

Staging
Area

Data Mart

Data
Warehouse

Analysis

Metadata
Raw
Data

Summary
Data

Reporting

Data Mining

ETL
OLAP

Data Warehouse Tools

ETL Tools
OLAP Tools
Reporting Tools
Metadata Tools

ETL Tools
ETL Extract Transform Load
Functional capabilities

Read directly from the data source (different sources)

Transform data
Cleansing data
Load data
Metadata support

Popular ETL tools

Data junction
Data stage
Informatica

OLAP Tools
OLAP Tools

MOLAP
ROLAP
DOLAP
HOLAP

Most Widely in use

OLAP
MOLAP:MOLAP The cube is aggregated from the
relational data source (data warehouse).
ROLAP:ROLAP ROLAP engine essentially acts
as a smart SQL generator. The cube is
specified by the relationship between the
relational tables.

OLAP Tools
Functional capabilities
Ability to leverage parallelism.
Performance
Loading data into the cube
Reading the data from the cube

Metadata Support

Popular OLAP tools

Business Objects
Cognos
MicroStrategy

Reporting Tools
Basic Functionality
Data source connection capabilities
Scheduling and distribution capabilities
Customization

Popular tools in use

Crystal Reports
Actuate
Business objects

Metadata Tools
No clear standards
Difficult to extract information out of such data
modeling tools
Many OLAP and ETL tools have their own
methods of maintaining the metadata.

Data Warehousing
Rajasekhar Reddy
i Logic Technologies