Hoc May

Chng 11
Hc my
GV: Nguyn Th Trc Vin Email: nttvien@dit.hcmut.edu.vn
Ni dung
Gii thiu Hc khi nim (Concept learning) Cy quyt nh (Decision Tree)
Khoa Cng Ngh Thng Tin - i Hc Bch Khoa Tp. HCM Bi Ging Mn: Tr tu nhn to
Side 2
Hc khi nim
Hc khi nim:
Cho trc cc v d hun luyn (training examples)

Cc v d hun luyn:

Gm nhiu phn t (c th) Mi c th cho bit c thuc khi nim hay khng (thuc: positive, khng: negative)
a ra khi nim tng qut phn loi tp hun luyn.

Khi nim tng qut = hm boolean c nh ngha trn tp c th (example)
V d:

(Input) Cc VD hun luyn:

Tp cc animal, cng thuc tnh ca n.
(Output) Khi nim c trch ra:

Bird Cat
Side 3
Hc khi nim (tt.)

V d:
(Input) Tp VD hun luyn gm 4 c th sau.

Tp ny ni v nhng ngy (ngy ntn) m Aldo thch mn th thao di nc ca anh ta.
Example 1 2 3 4
Sky Sunny Sunny Rainy Sunny
AirTemp Warm Warm Cold Warm
Humidity Normal High High High
Wind Strong Strong Strong Strong
Water Warm Warm Warm Cool
ForeCast Same Same Change Change
EnjoySport Yes Yes No Yes
(Output) Khi nim c hc: Thch th thao - enjoySport

Side 4
Hc khi nim (tt.)

Gi thit:

Cng c hiu l khi nim (concept). L hi ca cc rng buc trn thuc tnh ca c th, dng biu din c th l:
<Attr1=Value1, Attr2=Value2, , AttrN=ValueN > <Value1, Value2, , ValueN >, trng hp ny th t thuc tnh c quy nh trc.

AttrK : Thuc tnh th K no . ValueK: Tr cho thuc tnh th K. C th nhn: ? : Mt tr bt k. : Khng tr no c th chp nhn c. Mt tr c th.
Side 5
Hc khi nim (tt.)

Gi thit:

X l c th, v X tho tt c cc rng buc trn gi thit h th h phn loi X l positive (h(X) =1) V d: Gi thit l Aldo thch mn th thao di vo ngy cold days with high humidity, gi thit c ghi l:
<?, Cold, High, ?, ?, ?>
Gi thit tng qut nht:

<?, ?, ?, ?, ?, ?>
Gi thit c th nht:
< ,,,,,>
Side 6
Hc khi nim (tt.)

Cc k hiu:
Tp c th (set of instances)
Tp c dng trch khi nim t . K hiu: X VD trn: tp c th = tp ngy, mi ngy c 6 thuc tnh.
Khi nim ch (target concept):

Khi nim (hm) c hc. K hiu: c
c: X {0,1} V d trn: c(X) =1 nu EnjoySport = Yes. c(X) =0 nu EnjoySport = No.
Cc v d hun luyn (training examples), gm:

Mt c th thuc X. Khi nim ch c(X). Vit l: <X, c(X)>
Side 7
Hc khi nim (tt.)

Cc k hiu:

Tp cc gi thit (H): cc gi thit v s phn loi tp c th. CT hc:

Cho trc tp VD hun luyn. a ra gi thit v s phn loi tp c th: h(X) = c(X)
Hc khi nim ~ Tm kim:
Hc khi nim ~:
Tm trn khng gian gi thit c th. Tr v gi thit tt nht tho mn tp VD hun luyn.
S gi thit c th:
N thuc tnh trong mi gi thit. M tr c th cho mi c th, cng thm hai tr na:

? : bt k tr no. : khng c tr no tho. Mt hay nhiu u nh nhau m t tp

Side 8
Hc khi nim (tt.)

Hc khi nim ~ Tm kim:
S gi thit c th:
1 + (M+1)N.
Th t cc gi thit:

Cc gi thit trong khng gian u c th t C th sp xp theo dng: Tng qut c th. Th t:

hj v hk l hai gi thit. hj c n l tng qut hn hay bng hk nu v ch nu: (x X)[(hk(x) = 1) (hj(x) =1)] K hiu: hj g hk
V d: h2 g h1 vi h1 v h2 sau:
h1 = <Sunny, ?,? , Strong, ?, ?> h2 = <Sunny, ?,? , ?, ?, ?>
Side 9
Hc khi nim (tt.)

Gii thut FIND-S:
1. 2.
3.
h = gi thit c th nht trong H. Vi mi x tp VD hun luyn, m c(X) =1 Vi mi rng buc ai trong h IF ai tho bi x THEN do nothing. ELSE thay ai bi RB tng qut hn k tip m n c tho bi x Xut ra h.
Side 10
Hc khi nim (tt.)

Gii thut FIND-S: (VD)

h < , , , , , > C th 1 (positive):

<Sunny, Warm, Normal, Strong , Warm , Same >
h <Sunny, Warm, Normal, Strong , Warm , Same >
C th 2 (positive):
<Sunny, Warm, High, Strong , Warm , Same >
h <Sunny, Warm, ?, Strong , Warm , Same >

C th 3 (negative): h khng i. C th 4 (positive):

<Sunny, Warm, High, Strong , Cold , Change >
h <Sunny, Warm, ?, Strong , ? , ? >
OUTPUT: <Sunny, Warm, ?, Strong , ? , ? >

Side 11
Hc khi nim (tt.)

Gii thut FIND-S: (VD)

Vi training examples l correct th FIND-S tr v gi thit c th nht trong H tng thch vi cc c th positive. 1 s bi ton cha gii:
Khi c nhiu gi thit tho th sao ? Khi training set is not correct th sao ? Gii thut c hi t?
Side 12
Hc khi nim (tt.)

Gii thut Candidate-Elimination (CE):
Consistent tng thch:

h: gi thit D: training set. H l consistent vi D nu v ch nu:
h(x) = c(x) cho mi phn t <x, c(x)> thuc D.
Satisfy - tho mn.

x tho h ngha l h(x) = 1, bt k x l positive hay negative
Version Space (VS):

h: gi thit D: training set. VSH,D : tp con cc gi thit t H tng thch vi D.
VSH,D = {h H| Consistent(h,D)}
Side 13
Hc khi nim (tt.)

List-Then-Eliminate(LTE):
1. 2. 3.
VersionSpace danh sch cha mi gi thit trong H. For each <x, c(x)>: Remove h t VS nu h(x) <> c(x) Output: danh sch cc h trong VS.
(dng c khi |H| hu hn)
Biu din thu gn VS:
Gii hn tng qut G:

Tp cc phn t tng qut nht ca H tng thch vi D. G={gH| Consistent(g,D) ^ (gH) [(g >g g) ^ Consistent(g, D)]}
Gii hn c th nht S:
Tp cc phn t c th nht ca H tng thch vi D. S={sH| Consistent(s,D) ^ (sH) [(s >g s) ^ Consistent(s, D)]}
Side 14
Hc khi nim (tt.)

Biu din thu gn VS:
nh l biu din VS: VSH,D = {hH | (s S) (g G) (g g h g s)} G = tp gi thit tng qut nht. S = tp gi thit c th nht. For each d thuc training set:
IF d is positive:

Candidate-Elimination:

Remove t G bt k gi thit no ko tng thch vi d. For each s S m ko tng thch vi d. Remove s t S. Thm vo S tt c cc tng qut nh nht h ca s sao cho: > h l tng thch vi d, > Vi phn t ca G tng qut hn h. Remove t S bt k gi thit no tng qut hn 1 ci khc trong S.
Side 15
Hc khi nim (tt.)

Candidate-Elimination:
IF d is negative:

Remove t S bt k gi thit no ko tng thch vi d. For each g G m ko tng thch vi d. Remove g t G. Thm vo G tt c cc c th nh nht h ca g sao cho: > h l tng thch vi d, > Vi phn t ca S c th hn h. Remove t G bt k gi thit no t tng qut hn 1 ci khc trong G.
Side 16
Hc khi nim (tt.)

Candidate-Elimination: (VD)
Khi ng:
S0: {< , , , , , >}
G0: {<? ,? ,? ,? ,? ,? >}
C th 1 (positive): <Sunny, Warm, Normal, Strong, Warm, Same>

S0: {< , , , , , >}
S1: <Sunny, Warm, Normal, Strong, Warm, Same>}
G0, G1: {<? ,? ,? ,? ,? ,? >}
Side 17
Hc khi nim (tt.)

C th 2 (positive): <Sunny, Warm, High, Strong, Warm, Same>

S0: {< , , , , , >}
S2: <Sunny, Warm, ?, Strong, Warm, Same>}
G0, G1, G2: {<? ,? ,? ,? ,? ,? >}
Side 18
Hc khi nim (tt.)

C th 3 (negative): <Rainy, Cold, High, Strong, Warm, Change>

S0: {< , , , , , >}
S2,S3: <Sunny, Warm, ?, Strong, Warm, Same>}
G3: {<Sunny ,? ,? ,? ,? ,? >}
{<? ,Warm ,? ,? ,? ,? >} {<? ,? ,? ,? ,? ,Same >}
G0, G1, G2: {<? ,? ,? ,? ,? ,? >}
Side 19
Hc khi nim (tt.)

C th 4 (positive): <Sunny, Warm, High, Strong, Cool, Change>

S3: <Sunny, Warm, ?, Strong, Warm, Same>}
S4: <Sunny, Warm, ?, Strong, ?, ?>}
G4: {<Sunny ,? ,? ,? ,? ,? >}
{<? ,Warm ,? ,? ,? ,? >}
G3: {<Sunny ,? ,? ,? ,? ,? >}
{<? ,Warm ,? ,? ,? ,? >} {<? ,? ,? ,? ,? ,Same >}

Khoa Cng Ngh Thng Tin - i Hc Bch Khoa Tp. HCM Bi Ging Mn: Tr tu nhn to Side 20
10
Hc khi nim (tt.)

VersionSpace:
S4: {<Sunny, Warm, ?, Strong, ?, ?>}
<Sunny ,? ,? , Strong ,? ,? > <Sunny ,Warm ,? ,? ,? ,? > <? ,Warm ,? ,Strong ,? ,? >
G4: {<Sunny ,? ,? ,? ,? ,? > <? ,Warm ,? ,? ,? ,? >}
Side 21
Hc cy quyt nh
Gii thiu

L phng php xp x hm ri rc gi tr. Hm c biu di dng cy quyt nh, cng c th dng lut if-then. Thuc lp gii thut suy din quy np (inductive) Node thuc tnh ca c th. Nhnh t node X cc tr c th ca thuc tnh ti X. Phn loi trn cy cho 1 c th:
Bt u t node gc, kim tra thuc tnh tng ng vi node ny v di duyn xung theo nhnh c tr l tr ca thuc tnh. Lp li vi cy con.
Biu din cy quyt nh

Mt cy quyt nh mu: trang sau

Side 22
11
Hc cy quyt nh (tt.)
Outlook
Sunny Humidity
Overcast YES
Rain Wind
High NO
Normal YES
Strong NO
Weak YES
Mt cy quyt nh biu din khi nim PlayTennis. Cy ny c kh nng phn loi mt bui sng ch nht no c thch hp cho vic chi tennis khng da vo cc thuc tnh <Outlook, Humidity, Wind, ..> ca sng .
Hc cy quyt nh (tt.)
Vi cy trn:
Mt bui sng c thuc tnh:

<Outlook=Sunny, Temperature=hot, Humidity=High, Wind=Strong> Phn loi: No, khng thch hp
Cy quyt nh:
Biu din mt tuyn(v) ca cc hi(^) cc rng buc trn thuc tnh.

Mi nhnh trn cy t root n l c phn loi l YES Ton b cy tuyn ca cc hi.
mt hi
Cy trn: (Outlook=Sunny ^ Humidity=Normal) v (Outlook=Overcast) v (Outlook=rain ^ Wind=Weak)
Side 24
12
Hc cy quyt nh (tt.)
Cc bi ton thch hp vi cy quyt nh:

C th c biu din dng cc cp <thuc tnh, gi tr> Hm c gi tr output ri rc. V d trn hm c hai tr YES|NO. Bi ton c dng biu din tuyn ca cc hi. Training set c th cha error. Error trong vic phn loi c th, cng nh error trong vic gn tr ca thuc tnh. Training set c th c c th thiu i mt s thuc tnh. Cc lnh vc p dng:
Phn loi bnh nhn bi bnh. S trc trc thit b theo nguyn nhn. Ti chnh
Side 25
Hc cy quyt nh (tt.)
Gii thut hc c bn - ID3.
tng:
Xy dng cy t root n l, bng cch tr li:

Thuc tnh no l tt nht c kim tra ti root ? Mi cy con c to ra tng ng mi nhnh l tr ca thuc tnh ny.
Qu trnh lp li vi cc cy con.
Thuc tnh no l b phn loi tt nht ?

Da vo khi nim : li thng tin - information gain Information gian: o lng mc c li m thuc tnh no phn chia tp c th da theo khi nim ch.
ENTROPY:
o lng tnh ng nht ca tp hun luyn. Tp hun luyn:S ENTROPY: Entropy(S) = -p+log2p+ - p-log2p-
Side 26
13
Hc cy quyt nh (tt.)
ENTROPY:
P+: T l gia s cc th positive trn tng s c th. P- : T l gia s cc th negative trn tng s c th. V d:

Tng s c th: 14 Trong c: 9 c th positive (thuc vo phn loi ca khi nim ch). 5 c th negative (khng thuc vo phn loi ca khi nim ch). Hay ghi rt gn: [9+,5-] Entropy([9+,5-]) = -((9/14)log2(9/14)) ((5/14)log2(5/14)) = 0.94
Side 27
Hc cy quyt nh (tt.)
ENTROPY:
Lu :

0log20 = 0 Khi P+ hay P- =0 th Entropy =0 Entropy =1 khi P+ =P0<= Entropy <=1 C = 2: trng hp trn. Entropy(S)= - SUM(Pilog2P i), i=1 c
Entropy cho hm phn loi nhiu nhm, s nhm c:
Side 28
14
Hc cy quyt nh (tt.)
Info Gain:
o lng s gim Entropy mong mun. Cng thc: Gian(S,A) = Entropy(S) SUM([|Sv|/|S|]Entropy(Sv)), v values(A)

S: Tp hun luyn. A: thuc tnh. Values(A): tp cc gi tr c th ca A. Sv: tp con ca S m thuc tnh A c tr l v. |Sv|/|S| : t s c th c thuc tnh A c tr v trn tng s c th.
VD:
Xem Bng c th hun luyn trang sau.
Side 29
Hc cy quyt nh (tt.)
Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 Outlook Sunny Sunny Overcast Rain Rain Rain Overcast Sunny Sunny Rain Sunny Overcast Overcast Rain Temperature Hot Hot Hot Mild Cool Cool Cool Mild Cool Mild Mild Mild Hot Mild Humidity High High High High Normal Normal Normal High Normal Normal Normal High Normal High Wind Weak Strong Weak Weak Weak Strong Strong Weak Weak Weak Strong Strong Weak Strong Playtennis No No Yes Yes Yes No Yes No Yes Yes Yes Yes Yes No
Side 30
15
Hc cy quyt nh (tt.)
Info Gain:

Vi d liu cho bng trn. Tnh cho thuc tnh Wind.
Values(Wind) = {Weak, Strong} S =[9+,5-] Sweak = [6+,2-] Sstrong = [3+,3-]

Gian(S, Wind) = Entropy(S) (8/14) Entropy(Sweak) - (6/14) Entropy(Sstrong) = 0.94 (8/14) 0.811 (6/14) 1.0 = 0.048
Trang sau tnh Info Gain cho hai thuc tnh: Humidity v Wind
Side 31
Hc cy quyt nh (tt.)
S: [9+,5-] E=0.94 Humidity S: [9+,5-] E=0.94 Wind
High [3+,4-] E=0.985
Normal [6+,1-] E=0.592
Weak [6+,2-] E=0.811
Strong [3+,3-] E=1.0
Gian(S, Humidity) = 0.94 (7/14) 0.985 (7/14)0.592 = 0.151
Gian(S, Wind) = 0.94 (8/14) 0.811 (6/14)1.0 = 0.048
Side 32
16
Hc cy quyt nh (tt.)
Tng bc gii thut:
Bi ton:
Bng d liu cho trn. Khi nim ch: PlayTennis.
Bc 1: cy cho S
Gian(S, Outlook) = 0.246 Gian(S, Humidity) = 0.151 Gian(S, Wind) = 0.048 Gian(S, Temperature) = 0.029 Outlook : thuc tnh phn loi tt nht ti bc ny. Outlook: root node. Cy nh sau:
Side 33
Hc cy quyt nh (tt.)
[D1,D2, ..,D14] [9+,5-]
Outlook
Sunny
[D1,D2,D8,D9,D11] [2+,3-]
Overcast
Rain
[D3,D7,D12,D13] [4+,0-]
[D4,D5,D6,D10,D14] [3+,2-]
YES Entropy=0 Nn c phn loi l YES/NO. YES, v [4+,0-]
Side 34
17
Hc cy quyt nh (tt.)
Tng bc gii thut:
Bc 2: Cy cho SSunny
Ssunny={D1,D2,D8,D9,D11} Gian(Ssunny, Humidity) = 0.97- (3/5)0.0 (2/5)0.0 = 0.97 Gian(Ssunny, Wind) = 0.97 (2/5)1.0 (3/5)0.918 = 0.019 Gian(Ssunny, Temperature) = 0.97-(2/5)0.0-(2/5)1.0-(1/5)0.0=0.57 Humidity : thuc tnh phn loi tt nht ti bc ny. Humidity: root ca Ssunny. Cy nh sau:
Side 35
Hc cy quyt nh (tt.)
[D1,D2, ..,D14] [9+,5-]
Outlook
Sunny
[D1,D2,D8,D9,D11] [2+,3-]
Overcast
Rain
[D3,D7,D12,D13] [4+,0-]
[D4,D5,D6,D10,D14] [3+,2-]
Humidity
YES
High
[D1,D2,D8] [0+,3-]
Normal
[D9,D11] [2+,0-]
NO
YES
Side 36
18
Hc cy quyt nh (tt.)
Tng bc gii thut:
Bc 3: Cy cho SRain
SRain={D4,D5,D6,D10,D14} Tng t nh trn.
Kt qu:
Cy cui cng nh cy u tin ca phn Hc cy quyt nh
iu kin dng:
Mi nt l u nm vo 1 trong hai trng hp: 1. Tt c cc thuc tnh u nm trn node thuc con ng t root n l . 2. Node l c entropy = 0.

Entropy=0, Tt c c th u + Entropy=0, Tt c c th u -
Phn loi YES. Phn loi NO.

Side 37
Hc cy quyt nh (tt.)
Gii thut ID3:

To node gc cho cy. IF tt c cc c th l positive THEN tr v cy ch c node, nhn l + IF tt c cc c th l negative THEN tr v cy ch c node, nhn l IF Attributes trng THEN tr v cy ch c 1 node, nhn l gi tr chung nht ca Target_Attribute trong tp c th. ElSE: BEGIN
A Thuc tnh t Attributes tt nht phn loi tp c th. Thuc tnh cho root l A. (root A) For each tr Vi ca A:
Side 38
19
Hc cy quyt nh (tt.)
Gii thut ID3:
For each tr Vi ca A:

Thm 1 nhnh mi di root, tng ng A = Vi. ExamplesVi = tp con cc c th thuc Examples c A=Vi. Nu ExamplesVi trng : Th: di nhnh mi ny, thm 1 node l c nhn = tr chung nht ca Target_Attribute trong Examples. Ngc li: di nhnh mi ny thm 1 cy con, tr v t li gi: ID3(ExamplesVi, Target_Attribute, Attributes {A})
End. /*Begin*/ Return Root.
Side 39
Bi tp 1
Cho bng d liu dng hun luyn cho khi nim hc Ru gi nh sau: STT 1 2 3 4 5 Tem Khng C Khng C Khng Mu Trong Trong c Trong Trong Mi Khng Khng Khng Nng Khng V Cay Cay Cay Cht Chua Ru gi C Khng C Khng C
Yu cu: Thc hin tng bc gii thut hc Candidate-Elimination cho khi nim Ru gi
Side 40
20
Bi tp 2
Cho bng d liu dng hun luyn cho khi nim hc Vim xoang nh sau: STT 1 2 3 4 5 6 7 Nhc u thng xuyn Khng C C C C Khng Khng Hi th Bnh thng Bnh thng Nng mi Bnh thng Nng mi Bnh thng Nng mi Hc mi Bnh thng Bnh thng Bnh thng Vim xoang Khng C Khng C C Khng C
Yu cu: Bng gii thut hc Candidate-Elimination hy a ra cc gi thit cho khi nim cn hc. Xy dng cy quyt nh cho khi nim cn hc.
n tp
Cc dng ton cn n tp:
Biu din tri thc:

Cu/on biu din trong lc yu cu. Cho lc ny cu/on vn. chuyn sang lc khc tng ng.
Tr chi:
Cho bi ton (???):

Chy tng bc gii thut. Gii thut: Minimax, alpha-beta, IDS, IDA*
Cho gii thut: phc tp b nh, thi gian.
Tri thc khng chc chn:

Cho on vn mng Bayes. Cho mng Bayes tnh xc sut : 3 cch suy ln trn mng Bayes. Cho on vn
Biu din cc s kin, bin. Dng lut Bayes chun on mt s kin.
Tnh h s khng chc chn.

21
n tp (tt.)
Cc dng ton cn n tp:
Lp k hoch:
Cho bi ton.

Chy tng bc gii thut Planning. Gii thut: Stack of Goal Non-linear.
Hc my:
(Hc khi nim & Cy quyt nh) Cho bng d liu.

Chy tng bc gii thut. Gii thut: FIND-S, CANDIDATE_ELIMINATION, ID3
Side 43
n tp (tt.)
thi:

Thi gian: 120 pht. Ti liu: c s dng. % im: 60%

30%: im gia k. 10% : Thi thc hnh.
Side 44
22

Hoc May

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Hoc May

Uploaded by

Copyright:

Available Formats

Chng 11

GV: Nguyn Th Trc Vin Email: nttvien@dit.hcmut.edu.vn

Cho trc cc v d hun luyn (training examples)

a ra khi nim tng qut phn loi tp hun luyn.

(Input) Cc VD hun luyn:

(Output) Khi nim c trch ra:

Hc khi nim (tt.)

(Input) Tp VD hun luyn gm 4 c th sau.

Sky Sunny Sunny Rainy Sunny

AirTemp Warm Warm Cold Warm

Humidity Normal High High High

Wind Strong Strong Strong Strong

Water Warm Warm Warm Cool

ForeCast Same Same Change Change

EnjoySport Yes Yes No Yes

(Output) Khi nim c hc: Thch th thao - enjoySport

Hc khi nim (tt.)

Hc khi nim (tt.)

Gi thit tng qut nht:

Hc khi nim (tt.)

Khi nim ch (target concept):

Cc v d hun luyn (training examples), gm:

Hc khi nim (tt.)

Tp cc gi thit (H): cc gi thit v s phn loi tp c th. CT hc:

Hc khi nim ~ Tm kim:

? : bt k tr no. : khng c tr no tho. Mt hay nhiu u nh nhau m t tp

Hc khi nim (tt.)

Cc gi thit trong khng gian u c th t C th sp xp theo dng: Tng qut c th. Th t:

Hc khi nim (tt.)

Hc khi nim (tt.)

h < , , , , , > C th 1 (positive):

h <Sunny, Warm, Normal, Strong , Warm , Same >

h <Sunny, Warm, ?, Strong , Warm , Same >

C th 3 (negative): h khng i. C th 4 (positive):

h <Sunny, Warm, ?, Strong , ? , ? >

OUTPUT: <Sunny, Warm, ?, Strong , ? , ? >

Hc khi nim (tt.)

Hc khi nim (tt.)

Consistent tng thch:

h(x) = c(x) cho mi phn t <x, c(x)> thuc D.

Satisfy - tho mn.

Version Space (VS):

Hc khi nim (tt.)

(dng c khi |H| hu hn)

Biu din thu gn VS:

Gii hn tng qut G:

Hc khi nim (tt.)

Hc khi nim (tt.)

Hc khi nim (tt.)

G0: {<? ,? ,? ,? ,? ,? >}

C th 1 (positive): <Sunny, Warm, Normal, Strong, Warm, Same>

S1: <Sunny, Warm, Normal, Strong, Warm, Same>}

G0, G1: {<? ,? ,? ,? ,? ,? >}

Hc khi nim (tt.)

C th 2 (positive): <Sunny, Warm, High, Strong, Warm, Same>

S1: <Sunny, Warm, Normal, Strong, Warm, Same>}

S2: <Sunny, Warm, ?, Strong, Warm, Same>}

G0, G1, G2: {<? ,? ,? ,? ,? ,? >}

Hc khi nim (tt.)

C th 3 (negative): <Rainy, Cold, High, Strong, Warm, Change>

S1: <Sunny, Warm, Normal, Strong, Warm, Same>}

S2,S3: <Sunny, Warm, ?, Strong, Warm, Same>}

G3: {<Sunny ,? ,? ,? ,? ,? >}

End. /Begin/ Return Root.