TABLE OF CONTENTS

CHAPTER NO.

PAGE NO.

ABSTRACT
LIST OF TABLES
LIST OF FIGURES
LIST OF ABBREVIATIONS

iv
xii
xiv
xvii

INTRODUCTION
1.1 GENERAL
1.2 DATA MINING
1.3 ASSOCIATION RULE MINING
1.4 POPULATION BASED STOCHASTIC SEARCH

1
1
1
4
5

1.5
1.6
1.7
1.8
2

TITLE

METHODS
PROBLEM IDENTIFICATION
OBJECTIVE OF THE RESEARCH
RESEARCH APPROACH
ORGANIZATION OF THE THESIS

LITERTURE REVIEW
2.1 GENERAL
2.2 TRADITIONAL METHODS FOR MINING
ASSOCIATION RULES
2.2.1 AIS Algorithm
2.2.2 Apriori and Apriori-Based Algorithms
2.2.3 FP-Tree and FP-Growth/FP-Tree Based

7
8
9
10
12
12
12
12
13
14

Algorithms
2.2.4 Other Association Rule Mining Methods
2.3 STOCHASTIC SEARCH METHODS FOR MINING

15
16

ASSOCIATION RULES
2.3.1 Genetic Algorithms for ARM
2.3.2 Particle Swarm Optimization for ARM
2.4 HYBRID APPROACHES OF GA AND PSO
2.5 MEMETIC PARTICLE SWARM OPTIMIZATION
2.6 SUMMARY

17
21
23
25
27

CONCEPTS AND PROBLEM SETTINGS

28

3.1 GENERAL
3.2 STOCHASTIC SEARCH METHODS
3.3 OVERVIEW OF EVOLUTIONARY COMPUTING
3.3.1 Genetic Algorithm
3.3.2 Particle Swarm Optimization
3.4 DATASETS USED IN THIS STUDY
3.5 PERFORMANCE EVALUATION
3.6 SUMMARY

28
28
30
34
37
39
40
43

ASSOCIATION RULE MINING USING

44

GENETIC ALGORITHM
4.1 GENERAL
4.2 NEED AND MOTIVATION
4.3 MINING ARM USING GA
4.3.1 Experimental Setup
4.3.2 Results and Discussion
4.4 EFFECTIVE PARAMETER SETTING OF GA FOR

44
44
45
45
48
51

ARM
4.4.1 Methodology
4.4.2 Experimental Results and Discussion
4.5 GA WITH ELITISM FOR ARM
4.5.1 Elitism in GA
4.5.2 Experimental Results and Discussion
4.6 ADAPTIVE GA FOR ARM
4.6.1 Need for Adaption
4.6.2 Experimental Results and Discussion
4.7 SUMMARY

52
52
57
58
61
65
66
68
72

PARTICLE SWARM OPTIMIZATION FOR MINING

74

ASSOCIATION RULES
5.1 GENERAL
5.2 PSO FOR ARM
5.2.1 Methodology
5.2.2 Experimental Results and Discussion
5.3 CHAOTIC PSO FOR ARM
5.3.1 Chaotism in PSO
5.3.2 Experimental Results and Discussion
5.4 DYNAMIC NEIGHBORHOOD SELECTION IN PSO

74
74
75
78
82
83
84
87

FOR ARM
5.4.1 Dynamic Neighborhood Selection in PSO

88

5.5
5.6
5.7
5.8
6

5.4.2 Experimental Results and Discussion

MOTIVATION FOR ADAPTIVE TECHNIQUES
DATA INEPENDENT ADAPTION IN PSO
5.6.1 Methodology
5.6.2 Experimental Results and Discussion
DATA DEPENDENT ADAPTION IN PSO
5.7.1 Methodology
5.7.2 Experimental Results and Discussion
SUMMARY

90
94
95
96
98
102
103
113
123

HYBRID AND MEMETIC METHOS FOR MINING 124

ASSOCIATION RULES
6.1 GENERAL
6.2 NEED FOR HYBRIDIZATION
6.3 HYBRID OF GA AND PSO FOR ARM
6.3.1 GA-PSO Hybrid for ARM
6.3.2 Experimental Results and Discussion
6.4 PSO WITH LOCAL SEARCH
6.5 PSO WITH SFLA FOR MINING ASSOCIATION

124
124
124
126
129
136
137

RULES
6.5.1 Methodology
6.5.2 Experimental Results and Discussion
6.6 SUMMARY

138
140
146

CONCLUSIONS
7.1 GENERAL
7.2 SALIENT CONCLUSIONS
7.3 SCOPE FOR FUTURE WORK

147
147
147
149

REFERENCES
LIST OF PUBLICATIONS
CURRICULUM VITAE
ANNEXURE I

150
172
168
171

LIST OF TABLES
TABLE
NO.
3.1

TITLE

Description of the Datasets Used

PAGE
NO.
41

4.1
4.2
4.3
4.4
4.5
4.6
4.7
4.8
4.9
4.10
4.11
4.12
4.13
5.1
5.2
5.3
5.4
5.5
5.6
5.7
5.8

GA Parameters for ARM

Predictive Accuracy for ARM with GA
Number of Rules Generated by GA
Qualitative Measures of AR mined by GA
Role of GA Parameters in Problem Solving
Default GA Parameters
Comparison based on variation in Crossover Probability for
ARM using GA
Default Parameters for ARM with Elitist GA
Predictive Accuracy for AR mined with Elitist GA
Qualitative Measures of ARM with Elitist GA
Default GA Parameters for ARM
Qualitative Measures of ARM by AGA
Comparison of PA achieved by the GA based Methods
Initial Parameter Setting of PSO for ARM
Predictive Accuracy Comparison of PSO and GA for ARM
Qualitative Measures of ARM with PSO
Default Parameter Setting of NPSO for ARM
Measure of Interestingness for Dynamic Neighborhood
selection PSO
Comparison of Convergence rate of NPSO with PSO for
ARM
Parameters of PSO and their roles
Default Parameter Setting of Adaptive methodologies for

48
49
49
50
52
54
55
61
62
64
69
71
72
78
79
80
91
92
93
95
99

ARM
TABLE
NO.

TITLE

PAGE
NO.

5.9
5.10
5.11
5.12
5.13

Classification into States by Evolutionary Factor

Control Strategies for c1 and c2
Parameter Setting for APSO
Multiobjective Measures of APSO
Predictive Accuracy Comparison of APSO with AGA and

106
109
113
114
120

5.14
6.1
6.2
6.3

ACO
Predictive Accuracy Comparison of PSO based Methods
Parameter values of GPSO for ARM
Comparison of Predictive Accuracy
Comparison of the No. of Rules Generated in ARM

122
130
145
145

LIST OF FIGURES
FIGUR

TITLE

PAGE

E NO.
3.1
3.2
3.3
3.4
3.5
4.1
4.2
4.3
4.4

Block Diagram of Genetic Algorithm

Pseudo-code for simple GA
Crossover Operators
Pseudo-code for simple PSO
Displacement of a PSO particle
Roulette Wheel Selection Methodology
Flowchart of simple GA
Population Size vs Accuracy for ARM with GA
Minimum Support and Minimum Confidence vs Accuracy

NO.
35
35
37
38
40
47
53
54
57

4.5
4.6

for ARM with GA

Elitism in Multiobjective Optimization
Block Diagram of Elitist GA for Association

58
59

4.7
4.8

Rule Mining
Flow chart of ARM with Elitist GA
Predictive Accuracy for Mining AR based on GA

60
62

4.9
4.10

with Elitism
Comparison of Elites for ARM with and without Elitism
Comparison of No. of Rules Generated with Elitist GA

63
65

4.11

and Simple GA
Comparison of the Accuracy between GA and AGA when

69

4.12
5.1
5.2
5.3

Parameters are Ideal for Traditional GA

Comparison of AGA , GA and GA with AGA Mutation Rate
Particles Movement towards the target
Flowchart of PSO for ARM
Execution Time comparison of PSO and GA for ARM

70
75
76
80

TITLE

PAGE

FIGUR
E NO.
5.4
5.5

Impact of Inertia Weight on Predictive Accuracy for ARM

Comparison of PSO with and without Inertia Weight

NO.
81
82

5.6

for ARM
Comparison of Predictive Accuracy of CPSO and PSO

85

5.7
5.8

for ARM
Convergence rate of CPSO for ARM
Flowchart for association rule mining with Dynamic

85
89

5.9

Neighborhood Selection in PSO

Predictive Accuracy Comparison for Dynamic

91

5.10
5.11

Neighborhood selection in PSO

Execution Time Comparison of NPSO with PSO
Predictive Accuracy Comparison of three Adaptive

93
100

5.12

Methodologies with PSO for ARM

Evolutionary state information robustly revealed

106

5.13

by e at run time for Zoo dataset

Population Distribution in PSO based on Evolutionary

108

5.14

factor e
Adaptation of Acceleration Coefficients through EES

111

5.15
5.16

for Zoo Dataset

Inertia Weight Adaptation for Zoo dataset
Predictive Accuracy of Adaptive PSO over hundred

112
115

5.17
5.18

Generations
Predictive Accuracy comparison of APSO with PSO
Comparison of No. of Rules Generated by APSO and

116
117

PSO

FIGUR
E NO.
5.19
5.20
5.21
6.1
6.2

TITLE

PAGE

Comparison of Execution Time of APSO and PSO

Comparison of Convergence of APSO and PSO
Comparison of Convergence of APSO and SAPSO
Hybrid GA/ PSO (GPSO) Model

NO.
117
118
119
127

Predictive accuracy vs. No. of Generations for

132

6.3

ARM with GPSO

Comparison of Predictive Accuracy GPSO, GA and

134

6.4

PSO
Comparison of Execution Time of GPSO with GA and

135

6.5
6.6
6.7
6.8

PSO
Flowchart for PSO with SFLA for ARM
Formation of Memeplexes
Predictive Accuracy Comparison for ARM
Fitness Value for PSO with SFLA for ARM

138
139
141
142

LIST OF ABBREVIATIONS

ACO

Ant Colony Optimization

AGA

Adaptive Genetic Algorithm

AIS

Agrawal, Imielinski and Swami Algorithm

APSO

Adaptive Particle Swarm Optimization

APSO+SFLA -

Adaptive Particle Swarm Optimization with Shuffled Frog Leaping

Algorithm

AR

Association Rules

ARM

Association Rule Mining

BPSO

Binary Particle Swarm Optimization

CARMA

Continuous Association Rule Mining Algorithm

CPSO

Chaotic Particle Swarm Optimization

DIC

Dynamic Itemset Counting

EA

Evolutionary Algorithms

EC

Evolutionary Computing

EMOGA

Elitist Multi-Objective Genetic Algorithm

FP

Frequent Pattern

GA

Genetic Algorithm

GCPSO

Guaranteed Convergence Particle Swarm Optimization

GPSO

GA/PSO

ITL Mine

Item Trans Link Miner

KDD

Knowledge Discovery in Databases

LS

Local Search

MA

Memetic Algorithm

MPSO

Memetic Particle Swarm Optimization

NPSO

Neighborhood Selection in Particle Swarm Optimization

PA

Predictive Accuracy

PSO

Particle Swarm Optimization

PSO + SFLA -

Hybrid

Particle Swarm Optimization with Shuffled Frog Leaping

Algorithm

Q-QPSO

Quantum behaved Particle Swarm Optimization

RARM

Rapid Association Rule Mining

RWDE

Random Walk with Direction Exploitation

SAPSO1

Self Adaptive Particle Swarm Optimization 1

SAPSO2

Self Adaptive Particle Swarm Optimization 2

SACPSO

Self Adaptive Chaotic Particle Swarm Optimization

SFLA

Shuffled Frog Leaping Algorithm

SI

Swarm Intelligence

UCI

University of California, Irvine

VIPER

Vertical Itemset Partitioning for Efficient Rule

WPSO

Weighted Particle Swarm Optimization