TM HIU V MNG N-RN LGIC M TSK

Nguyn Thanh H v L Quc Hng

KT&THCN 1 K50
TM TT
Trong bi tm hiu ny chng em s gii thiu v mng n-rn logic m Takagi-Sugeno-Kang
(TSK) c tm ra t nm 1985 v t n nay c nghin c v ng dng trong nhiu
lnh vc thc t c bit l trong cc bi ton nhn dng , d bo ,tnh ton cc ch sBi
vit ny nhm mc ch gii thiu chung v cu trc nguyn l hot ng cc thut ton hc
ca mng TSK v mt s hng ng dng ca n trong thc t.
1. Gii thiu:
Chng ta s tm hiu h thng nhiu u
vo 1 u ra. Biu din vect u vo l
1 2
[ , , , ]
N
X x x x K
T
v tn hiu u ra l y.
Mt dng suy lun logic thng thng ca
mng TSK c a ra nh sau:

R
p
: if
1
x
l F
l1
v
2
x
l F
l2
vv
N
x
l F
lN
, then y l ( )
1 2
, ,...,
p N
f x x x
(1)
y
j
x
l F
pj
, p=1,2,,m ; j=1,2,,N
trong m l l s quy tc cho trc . x
j
,
j=1,2,,N l gi tr cho trc xc nh trn
tp X
j
, j=1,2,N , v F
pj
p=1,2,,m ;
j=1,2,,N l tp m xc nh bi khi m
ha ( )
( ) p
j j
x
= F
pj
: X
j

[0,1] , p=1,2,
,m ; j=1,2,,N. Trong thnh phn kt
qu ca cc quy tc suy lun y l kt qu
thay i do hm g
p
c s dng.
Nu ( )
1 2
, ,...,
p N
f x x x = C , C = hng s th
mng TSK l bc 0. Mng c gi l bc 1 nu
( )
1 2
, ,...,
p N
f x x x
l hm tuyn tnh. Nu hm
l phi tuyn mng c gi l TSK bc cao.
Cho 1 vect u vo
i
x = [
1 2
, ,...,
i i i
N
x x x ]
T
kt qu
i
y hoc u ra ca h thng l:
( )
1 2
1
1
, ,...,
m
i i i
p p N
p i
m
p
p
w f x x x
y
w

(2)
Vi ( )
( )
1
w
N
p
p j j
j
x

(3)
p=1,2,,m ; j=1,2,,N.
2. Cu trc ca mng TSK:
Hnh 1: M hnh cu trc mng TSK cho mt
u ra
Mng TSK l mt cu trc gm 5 lp. Lp
th nht bao gm cc khi ( )
( ) p
j j
x cn c
gi l khi m ho cho thnh phn th j ca vc-
t u vo x (lp iu chnh thng s). Lp th 2
tnh trng s: ( )
( )
1
w
N
p
p j j
j
x

(lp khng
iu chnh thng s). Lp 3 tnh hm
( )
1 2
, ,...,
p N
f x x x
(lp iu chnh thng s).
Lp 4 tnh tng ( )
1 2
1
, ,...,
m
p p N
p
w f x x x

(lp
khng iu chnh thng s) . V lp 5 thc
hin tnh y(X)=
( )
1
2
f
f X
f

(lp khng iu
chnh thng s).
3.Thut ton hc vi ( )
1 2
, ,...,
p N
f x x x
l
hm tuyn tnh:
Vi ( )
1 2
, ,...,
p N
f x x x
l hm tuyn tnh ta
xt trng hp: ( )
1 2
, ,...,
p N
f x x x
=
0 1 1 p p pN N
a a x a x + + + K
y chng em gii thiu thut ton hc lai
(hybrid algorithm) s dng trong qu trnh hc
ca mng.
Mc ch ca qu trnh hc thch nghi l tm
cc tham s ca mng sao cho sai s sau l b
nht:
( )
2
( ) ( )
1
1
2
n
i i
i
E y d

(4)
Vi n s cp s liu hc (x,d) v d l gi tr
mong mun. Cc thng s iu chnh c chia
thnh 2 nhm: nhm thng s tuyn tnh
pj
a
ca
hm TSK v nhm thng s phi tuyn ca khi
m ha. y ta chn khi m ha l hm Gauss
m rng gm 3 thng s
( ) ( ) ( )
, ,
p p p
j j j
c b
( ) ( )
( )
2
( )
( )
1
1
p
j
p
j j
b
p
j j
p
j
x
x c

+

,
(5)
Thut ton hc lai bao gm 2 bc:
- Bc 1: iu chnh thng s tuyn tnh
pj
a
bng cch c nh gi tri ca thng
s phi tuyn.
- Bc 2: iu chnh thng s phi tuyn
bng cch c nh gi tri ca thng s
tuyn tnh.
Bc 1 v 2 c thc hin li nhiu ln cho n
khi t n s n nh cc thng s ca mng.
Trong bc 1 chng ta s dng

'
0
1 1
( ) w .
m N
p p pj j
p j
y X a a x

1
+
1
]

(6)
Vi
' ( )
( ) 1 1
1 1
1
w [ ( )]
[ ( )]
N m
p
p F j N m
r r j
F j
r j
x
x

(7)
Vi gi tr trng s
'
w
p
c nh vi p=1,2,,m
n cp s liu hc
( ) ( )
( , )
i i
x d (i=1,2,,n).
Chng ta c c h thng cc phng trnh
tuyn tnh ca a c vit nh sau:
Fa=d (8)
vi
10 1 20 2 0
[ ]
T
N N m mN
a a a a a a a K K K K
vc-t cc tham s tuyn tnh
( ) i
j
a ,
(1) ( )
[ ]
n
d d d K
T
vc-t cc u ra ca mng ;
F ma trn cc trng s tng ng trong khai
trin hm tn hiu u ra ca mng theo cc tham
s tuyn tnh.
Ma trn F c xc nh theo cu trc sau:
' ' (1) ' (1) ' (1)
11 11 1 11 1
' ' (2) ' (2) ' (2)
12 12 1 12 2
' ' ( ) ' ( ) ' ( )
1 1 1 1
N m N
N m N
n n n
p n n N nm N
F F x F x F x
F F x F x F x
F
F F x F x F x
1
1
1

1
1
1
]
K K K
K K K
K K K
K K K
Dng phng trnh ma trn (8) c th gii n
gin bng vic s dng ma trn F
+
a=F
+
d (9)
Trong bc 2 sao khi c nh cc thng s
tuyn tnh a
pj
cc tn hiu u ra y
(i)
c
tnh vi i=1,2,,n.

(1) ( )
[ ]
n
y y y K =Fa
Sai s y d
Vic iu chnh thng s phi tuyn c th thc
hin bng phng php bc gim cc i v
thut ton lan truyn ngc ca sai s.
( ) ( )
( )
( )
( 1) ( )
p p
j j c p
j
E k
c k c k
c

( ) ( )
( )
( )
( 1) ( )
p p
j j p
j
E k
k k

( ) ( )
( )
( )
( 1) ( )
p p
j j b p
j
E k
b k b k
b

Vi k l s bc hc.
4.Thut ton hc vi ( )
1 2
, ,...,
p N
f x x x
l
hm phi tuyn :
V cc h thng suy lun logic m c
xem nh 1 s kt hp ca cc h thng con
ni lin nhau c m t di dng n
gin nn m hnh TSK bc 1 thng c
nhiu cho n nay. Tuy nhin trong 1 s
trng hp vic s dng hm phi tuyn s
hp l v mang li nhiu hiu qu hn.
Trong bi ny chng em s tm hiu hm:

1 2
0 1 2
...
N
b b b
N
y b x x x
phn nhm d liu vo cho vic to cc
quy tc suy lun logic m v khi to cc
gi tr thng s ca quy tc chng ta s
dng phng php C-means clustering.
Tm ca cc nhm l gi tr khi to ca
tm ca cc hm Gauss v trong mi nhm
khong cch ln nht gia tm ca nhm v
mu l gi tr khi to ca rng ca hm
Gauss tng ng.
p dng php bin i logarit cho phng
trnh

0 1 1 2 2
ln( ) ln( ) ln( ) ln( )
... ln( )
N N
y b b x b x
b x
+ + +
+
Sau chng ta s dng phng php c
lng bnh phng b nht (LSE) trn cc
mu trong cc nhm c c cc gi tr
khi to ca cc thng s b
j
j=0,1,,N l
s cc u vo.
y ta s dng khi m ha l hm
Gauss:
( )
2
( )
2
( )
*exp
2
j j p
j j
j
x c
x

1

1
1
]
Khi h thng c c 1 cp s liu (x
i
,d
i
) n
s tnh gi tr u ra nh sau:
2
2
1 1
( )
2
2
1 1
( )
exp
2
( )
( )
exp
2
i
N m
j pj
p
p j pj
i i
i
N m
j pj
p j pj
x c
y
y f x
x c

1
1
]

1

1
1
]

Mc ch ca qu trnh hc thch nghi l tm

cc tham s ca mng sao cho sai s sau l b
nht:
( )
2
( ) ( )
1
1
2
n
i i
i
E y d

Thut ton bc gim cc i c s dng
ti u cc thng s b
pj
, c
pj
,
pj

v
pj

trong
khi m ha.
( 1) ( )
( ) ln( )[ ( ) ] ( )
pj pj
i i i i
b p j p
b k b k
y k x f x d x
+

( 1) ( )
[ ( ) ][y ( ) ( )] ( )
( )
pj pj
i i i i
p p
lj
k k
f x d k f x x
k

+


2
( 1) ( )
[ ( )]
[ ( ) ][y ( ) ( )] ( )
( )
pj pj
pj pj i i i i
c p p
pj
c k c k
x c k
f x d k f x x
k

2
3
( 1) ( )
[ ( )]
[ ( ) ][y ( ) ( )] ( )
( )
pj pj
pj pj i i i i
p p
pj
k k
x c k
f x d k f x x
k

Vi
2
2
1 1
2
2
1 1
[ ( ) ( )]
exp
2 ( )
( )
[ ( ) ( )]
exp
2 ( )
N m
ij pj
pj
p j pj
i
p
N m
ij pj
pj
p j pj
x k c k
k
x
x k c k
k

' ;

' ;

b
,
c
,

v

l tc hc cho vic cp nht

cc thng s tng ng.