6.2. Thut ton backpropagation.

Cc v d ph bin nht v thut ton hun luyn mng nron nhn to l backpropagation. Cc thut ton bc hai hin i nh conjugate gradient descent v Levenberg Marquardt c bn nhanh hn trong nhiu vn , nhng backpropagation vn c mt s u im trong mt vi trng hp khc, v l thut ton d hiu nht. Trong backpropagation, vector gradient ca mt phng sai s c tnh ton. Vector ny ch ra ng gim dc nht v v tr hin ti, v th chng ta bit rng nu chng ta di chuyn dc theo n mt khong ngn, cui cng chng ta s t c gi tr nh nht. Kh khn y l quyt nh ln ca tng bc di chuyn. Bc ln c th hi t nhanh hn, nhng c th vt qu im cn n hay i ra khi vng c cc tiu (nu mt phng sai s b lch tm). Ngc li, bc qu nh c th i n ng hng nhng chng ta cn phi thc hin php lp nhiu ln. Trong thc tin, kch thc bc t l vi dc v hng s c bit: tc hc. Gi tr chnh xc tc hc ph thuc vo tng ng dng c th, v thng c chn qua thc tin. Thut ton thng c thm khi nim momentum. Momentum s thc y di chuyn i theo theo mt hng xc nh nu sau khi qua nhiu bc i cng mt hng, thut ton s di chuyn nhanh hn, a n kh nng thot khi vng gi tr cc tiu cc b v cng c th di chuyn nhanh chng qua vng bng phng. Thut ton do x l lp i lp li, sau mt s epoch. mi epoch, cc trng hp hun luyn s c a ra xem xt trong mng, cc ng ra thc v mong mun c so snh v tnh ton li. Li ny kt hp vi gradent mt phng sai s, s dng iu chnh trng s v sau qu trnh x l lp li. Cu hnh mng ban u l ngu nhin, v hun luyn ch dng li khi s vng lp epoch ti a cho php xy ra hay khi sai s t c mt mc cho php, hoc khi sai s khng tng na.