Tng quan v Mng Neuron (Neural Network)

Nguyn Vn Chc chucnv@ud.edu.vn

Mng Neuron nhn to (Artificial Neural Network- ANN) l m hnh x l thng tin c m phng da trn hot
ng ca h thng thn kinh ca sinh vt, bao gm s lng ln cc Neuron c gn kt x l thng tin. ANN
ging nh b no con ngi, c hc bi kinh nghim (thng qua hun luyn), c kh nng lu gi nhng kinh
nghim hiu bit (tri thc) v s dng nhng tri thc trong vic d on cc d liu cha bit (unseen data).
Cc ng dng ca mng Neuron c s dng trong rt nhiu lnh vc nh in, in t, kinh t, qun s, gii
quyt cc bi ton c phc tp v i hi c chnh xc cao nh iu khin t ng, khai ph d liu, nhn
dng,
1. Kin trc tng qut ca mt ANN nh sau

Processing Elements (PE): Cc PE ca ANN gi l Neuron, mi Nueron nhn cc d liu vo (Inputs) x l chng
v cho ra mt kt qu (output) duy nht. Kt qu x l ca mt Neuron c th lm Input cho cc Neuron khc
Kin trc chung ca mt ANN gm 3 thnh phn l Input Layer, Hidden Layer v Output Layer (Xem hnh
trn)
Trong , lp n (Hidden Layer) gm cc Neuron, nhn d liu input t cc Nueron lp (Layer) trc v
chuyn i cc input ny cho cc lp x l tip theo. Trong mt ANN c th c nhiu Hidden Layer.
Qu trnh x l thng tin ca mt ANN

Inputs: Mi Input tng ng vi 1 thuc tnh (attribute) ca d liu (patterns). V d nh trong ng dng ca ngn
hng xem xt c chp nhn cho khch hng vay tin hay khng th mi Input l mt thuc tnh ca khch hng nh
thu nhp, ngh nghip, tui, s con,
Output: Kt qu ca mt ANN l mt gii php cho mt vn , v d nh vi bi ton xem xt chp nhn cho
khch hng vay tin hay khng th output l yes (cho vay) hoc no (khng cho vay).
Connection Weights (Trng s lin kt) : y l thnh phn rt quan trng ca mt ANN, n th hin mc
quan trng ( mnh) ca d liu u vo i vi qu trnh x l thng tin (qu trnh chuyn i d liu t Layer
ny sang layer khc). Qu trnh hc (Learning Processing) ca ANN thc ra l qu trnh iu chnh cc trng s
(Weight) ca cc input data c c kt qu mong mun.
Summation Function (Hm tng): Tnh tng trng s ca tt c cc input c a vo mi Neuron (phn t x l
PE). Hm tng ca mt Neuron i vi n input c tnh theo cng thc sau:

Hm tng i vi nhiu Neurons trong cng mt Layer (Xem hnh b):

Transformation (Transfer) Function (Hm chuyn i)

Hm tng (Summation Function) ca mt Neuron cho bit kh nng kch hot (Activation) ca neuron cn gi l
kch hot bn trong (internal activation). Cc Nueron ny c th sinh ra mt output hoc khng trong ANN (ni cch
khc rng c th output ca 1 Neuron c th c chuyn n layer tip trong mng Neuron theo hoc khng). Mi
quan h gia Internal Activation v kt qu (output) c th hin bng hm chuyn i (Transfer Function).

Vic la chn Transfer Function c tc ng ln n kt qu ca ANN. Hm chuyn i phi tuyn c s dng ph

bin trong ANN l sigmoid (logical activation) function.

Trong :
YT: Hm chuyn i
Y: Hm tng
Kt qu ca Sigmoid Function thuc khong [0,1] nn cn gi l hm chun ha (Normalized Function).
Kt qu x l ti cc Neuron (Output) i khi rt ln, v vy transfer function c s dng x l output ny
trc khi chuyn n layer tip theo. i khi thay v s dng Transfer Function ngi ta s dng gi tr ngng
(Threshold value) kim sot cc output ca cc neuron ti mt layer no trc khi chuyn cc output ny n
cc Layer tip theo. Nu output ca mt neuron no nh hn Threshold th n s khng c chuyn n Layer
tip theo.
Mt s kin trc ca ANN

2. Qu trnh hc (Learning Processing) ca ANN

ANN c hun luyn (Training) hay c hc (Learning) theo 2 k thut c bn l hc c gim st (Supervised
Learning) v hc khng gim st (Unsupervised Learning).
Supervised learning: Qu trnh Training c lp li cho n kt qu (output) ca ANN t c gi tr mong
mun (Desired value) bit. in hnh cho k thut ny l mng Neuron lan truyn ngc (Backpropagation).
Unsupervised learning: Khng s dng tri thc bn ngoi trong qu trnh hc (Learning), nn cn gi l t t
chc (Self Organizing). Mng Neuron in hnh c hun luyn theo kiu Unsupervised l Sefl Organizing
Map (SOM).
Sau y l phn loi cc thut ton Learning v kin trc ca ANN

Nguyn tc hun luyn (Training protocols)

Mng Neuron c 3 cch hun luyn chnh l batch training, stochastic training v on-line
training. i vi on-line training th cc trng s ca mng (weights) c cp nht ngay lp
tc sau khi mt input pattern c a vo mng. Stohastic training cng ging nh on-line

training nhng vic chn cc input patterns a vo mng t training set c thc hin ngu
nhin (random). Batch training th tt c cc input patterns c a vo mng cng lc v sau
cp nht cc trng s mng ng thi. u im ca on-line training l tit kim b nh v
khng cn lu li s lng ln cc input patterns trong b nh.
Trong qu trnh hun luyn mng, thut ng epoch c dng m t qu trnh khi tt c cc
input patterns ca training set c a hun luyn mng. Ni cch khch 1 epoch c hon
thnh khi tt c cc d liu trong training set c a vo hun luyn mng. V vy s lng
epoch xc nh s ln mng c hun luyn (hay s ln a tt c cc d liu trong training
set vo mng).
Bi vit ny ch yu gii thiu v qu trnh hun luyn ANN theo k thut Supervised learning.
Qu trnh hc ca Supervised ANN c m t nh sau:
1.Tnh gi tr output .
2. So snh output vi gi tr mong mun (desired value).
3. Nu cha t c gi tr mong mun th hiu chnh trng s (weights) v tnh li output

Gi s sau khi tnh ton t cc input value cho, ta c output l Y. Gi tr mong mun (Desired) l Z bit trc.
S chnh lch gia Y v kt qu mong mun Z c biu din bi tham s delta (gi l li) = Z-Y. Mc ch ca
vic Learning l lm sao cho delta cng nh cng tt (Nu delta =0 l hon ho nht) bng cch iu chnh trng s
(weights) ca cc d liu vo.

 d hnh dung, sau y minh ha vic hun luyn mt ANN n gin gm 1 Neuron hc thc hin php ton
Logic OR gia 2 input l 2 ton hng X1 v X2. Nu mt trong 2 input l positive (1) th kt qu l Positive. Kin
trc ANN nh sau :

Cc Input patterns v Desired value nh sau:

Neuron phi c hun luyn nhn bit cc d liu vo (input pattern) y l mt b gm 2 gi tr X1 v X2

(trong v d trn c 4 b d liu ) v phn loi chng vo cc kt qu bit (Desired Results)
Qu trnh hc c din ra nh sau:
4 Input patterns c ln lt a vo Neuron, cc trng s ban u c khi to ngu nhin v c iu chnh
sau mi vng lp. Bc ny lp li cho n khi cc trng s hi t n tp cc gi tr cho php ANN phn loi chnh
xc 4 input patterns. Kt qu ca qu trnh Training ANN c minh ha bng Excel nh di y (Download File
Excel ti y):

Trong v d ny gi tr ngng (Threshold) nh gi hm tng ca cc input l 0.5. Sau khi

tnh ton cc output (Y), v s dng Desired Result (Z) tnh ton li delta v delta c s
dng cp nht trng s ca cc input: delta = Zj-Yj
Hiu chnh trng s:

Wi(final) = Wi(initial) + alpha*delta*Xi

Trong alpha l tham s kim sot tc hc ca ANN gi l Learning rate. Vic chn tham s Learning rate
ph hp (lm tng chnh xc) l vn rt quan trng khi trin khai ANN.
Cc cng thc thc hin trong Excel:
Tnh gi tr Output (Y) =IF((B3*E3+C3*F3)>0.5,1,0)
Tnh li (delta) =D3-G3
Cp nht trng s W1 =E3+0.2*H3*B3
Cp nht trng s W2 =F3+0.2*C3*H3
Trong v d ny, qu trnh hun luyn ANN lp li 4 ln th cc trng s hi t v ANN phn loi chnh xc cc
input patterns tng ng vi php ton Logic OR.