Professional Documents
Culture Documents
Data Mining
Data Mining
Text Mining
Course Web Page
http://www.cs.uic.edu/~liub/teach/cs583-fall06/cs583.html
CS 583
General Information
Email: liub@cs.uic.edu
Tel: (312) 355 1318
Office: SEO 931
Room: A3 LC
Office hours: 2:00pm-3:30pm, Tuesday &
Thursday (or by appointment)
CS 583
Course structure
Two projects
1 programming project.
1 research project.
Programming projects
Two projects
To be done in groups
You will demonstrate your programs
to me
You will be given sample datasets
The data to be used in the demo will
be different from the sample data
CS 583
Grading
1 midterm
1 programming (10%).
1 research assignment (25%)
CS 583
Prerequisites
Knowledge of
CS 583
Teaching materials
Text
Reading materials will be provided before the class
based on the forthcoming book:
References:
CS 583
Topics
Introduction
Data pre-processing
Association rule mining
Classification (supervised learning)
Clustering (unsupervised learning)
Post-processing of data mining results
Text mining
Partial/Semi-supervised learning
Opinion mining and summarization
Introduction to Web mining
Link analysis
Information integration
CS 583
CS 583
CS 583
10
Introduction
CS 583
11
12
Example of discovered
patterns
Association rules:
80% of customers who buy cheese
and milk also buy bread, and 5% of
customers buy all of them together
Cheese, Milk Bread [sup =5%,
confid=80%]
CS 583
13
Classification:
mining patterns that can classify future data
into known classes.
Clustering
identifying a set of similarity groups in the
data
CS 583
14
Deviation detection:
discovering the most significant changes
in data
15
CS 583
16
17
18
Related fields
19
CS 583
20
Fraud detection
identifying credit card fraud, intrusion
detection
21
Text mining
Main topics
Text classification
Text clustering
Information retrieval
Topic detection (topic maps)
Opinion mining and summarization
CS 583
22
CS 583
23
24
An example
GREAT Camera., Jun 3, 2004
Reviewer: jprice174 from
Atlanta, Ga.
I did a lot of research last
year before I bought this
camera... It kinda hurt to
leave behind my beloved
nikon 35mm SLR, but I was
going to Italy, and I needed
something
smaller,
and
digital.
The pictures coming out of
this camera are amazing.
The 'auto' feature takes
great pictures most of the
time. And with digital, you're
not wasting film if the
picture doesn't come out.
.
CS 583
Summary:
Feature1: picture
Positive: 12
Negative: 2
25
Visual Comparison
Summary of
reviews of
Digital camera 1
_
Picture
Comparison of
reviews of
Battery
Zoom
Size
Weight
Digital camera 1
Digital camera 2
_
CS 583
26
Web mining
Link analysis
CS 583
27
A data
record
Data
region2
CS 583
28
EN7410
17-inch
LCD
Monitor
Black/Dark
charcoal
$299.9
9
Add
to
Cart
(Delivery
/ Pick-Up
)
Penny
Shoppin
g
Compar
e
image
2
17-inch
LCD
Monitor
$249.9
9
Add
to
Cart
(Delivery
/ Pick-Up
)
Penny
Shoppin
g
Compar
e
image
3
AL1714
17-inch
LCD
Monitor,
Black
$269.9
9
Add
to
Cart
(Delivery
/ Pick-Up
)
Penny
Shoppin
g
Compar
e
image
4
SyncMaste
r 712n 17inch LCD
Monitor,
Black
Add
to
Cart
(Delivery
/ Pick-Up
)
Penny
Shoppin
g
Compar
e
Was:
$369.9
9
CS 583
$299.9
9
Save
$70
After:
$70
mail-inrebate(s
)
29