Data Warehousing & Mining

B. Tech and MBA. Tech. (Information Technology)

Semester-V

Chapter 4: Introduction to Data Mining

By. Prof. Bhushan Inje

 Outline
• Basics of data mining
• Related concepts
• Data mining techniques,
• Classification,
• Clustering,
• Association rules,
• KDD Process.

By. Prof. Bhushan Inje

What Motivated Data Mining? Why Is It Important?
So, What Is Data Mining?
• Knowledge discovery as a process
is depicted in Figure 1.4 and consists of an iterative sequence of the following steps:
1. Data cleaning (to remove noise and inconsistent data)
2. Data integration (where multiple data sources may be combined)1
3. Data selection (where data relevant to the analysis task are retrieved from the database)
4. Data transformation (where data are transformed or consolidated into forms
appropriate for mining by performing summary or aggregation operations, for instance)2
5. Data mining (an essential process where intelligent methods are applied in order to
extract data patterns)
6. Pattern evaluation (to identify the truly interesting patterns representing knowledge
based on some interestingness measures; Section 1.5)
7. Knowledge presentation (where visualization and knowledge representation techniques
are used to present the mined knowledge to the user)
• Based on this view, the architecture of a typical data mining
system may have the following major components (Figure
1.5):
– Database, data warehouse, World Wide Web, or other information
repository:
– Database or data warehouse server:
– Knowledge base:
– Data mining engine:
– Pattern evaluation module:
– User interface:
 Data Mining—On What Kind of Data?
• Relational Databases
 Data Mining—On What Kind of Data?

• Data Warehouses
Data Mining—On What Kind of Data?
• Transactional Databases
 Advanced Data and Information Systems and
Advanced Applications

• Object-Relational Databases
• Temporal Databases, Sequence Databases, and Time-Series Databases
• Spatial Databases and Spatiotemporal Databases
• Text Databases and Multimedia Databases
• Data Streams
• The World Wide Web
 Data Mining Functionalities—
What Kinds of Patterns Can Be Mined?
• Concept/Class Description: Data can be associated with
classes or concepts
– Characterization
– Discrimination
Mining Frequent Patterns, Associations, and Correlations
Association Analysis Cont..
Data Mining Tasks (Analysis)
Classification and Prediction
 Cluster Analysis
• What is cluster analysis?
Cluster analysis or clustering is the task of grouping a set of objects in such a way that
objects in the same group (called a cluster) are more similar (in some sense) to each other
than to those in other groups (clusters).
Outlier Analysis
Evolution Analysis
 Are All of the Patterns Interesting?
• What makes a pattern interesting?
• Can a data mining system generate all of the interesting
patterns?
• Cana data mining system generate only interesting patterns?
Classification of Data Mining Systems
 Cont..
• Data mining systems can be categorized according to various criteria, as
follows:
– Classification according to the kinds of databases mined
– Classification according to the kinds of knowledge mined
– Classification according to the kinds of techniques utilized
– Classification according to the applications adapted
 Data Mining Task Primitives
• The data mining primitives specify the following, as
illustrated in Figure 1.13.
– The set of task-relevant data to be mined
– The kind of knowledge to be mined
– The background knowledge to be used in the discovery process
– The interestingness measures and thresholds for pattern evaluation
– The expected representation for visualizing the discovered patterns
 Integration of a Data Mining System with
a Database or Data Warehouse System
• A critical question in the design of a data mining (DM) system is how to integrate
or couple the DM system with a database (DB) system and/or a data warehouse
(DW) system.
– No coupling:
– Loose coupling:
– Semitight coupling:
– Tight coupling:
 Major Issues in Data Mining
• Mining methodology and user interaction issues:
– Mining different kinds of knowledge in databases
– Interactive mining of knowledge at multiple levels of abstraction
– Incorporation of background knowledge
– Data mining query languages and ad hoc data mining
– Presentation and visualization of data mining results
– Handling noisy or incomplete data
– Pattern evaluation—the interestingness problem
 Cont…
• Performance issues:
– Efficiency and scalability of data mining
algorithms
– Parallel, distributed, and incremental mining
algorithms:
 Cont…
• Issues relating to the diversity of database
types:
– Handling of relational and complex types of data
– Mining information from heterogeneous
databases and global information systems:
Thank You