GRADIENT DESCENT DELTA RULE

Preptron taininq rule morks for only lineavly

6eprabu data
Delta ule hlbksfov nen- lintaTty 6tprablu caBa.

Main idea of dlta ule

nuducton)

ducent nule ind out the

araditnt
bst eight
Zer
poMibu
Cost
94 keep on
Charging the s , u
after in tr then

he eo ill incrLaKe
ttight
minimuM.
eyroY

modity t
AN ve)
MULTILAHER NETulORKS BACKROPAGATIO
neural netork is
Batkpopa gattom a
meltilayerd,
ncural nefok
fced for ravd most generally

CUscd fev Superuided leaYnind

the lineaY rnlaton-

htbrkS
b9 by aPprOximatinq non-

ualu.
shp bto P P by adjusting the hlught
Opratioo BPN Stp
,ftud fornard
2 BaekPropagat"
f the h
BP algosithm Aooks fov min ualue eor

a tubnique called the

to ighf Spate uKing
Olta ule lov Gradient ducent

Backnlayd popagatlon of roY

(ol5)
Hs lo 46) Coo )
h (o:sd/

Wslo-25)
Wslo
20) g (o\ts)
tm7o (OT-0)
Wg los5)

b=(o.35) b o 6 0)
 hle dback a r d dinitivo
lhen e OccuTA g0 n

e bidden lp layr.
Part

Caltulat torward Fropaga tio error

in and ouet)
Catcuilat h
h (in) t» +b
+D 35
2xol
O 1 5 X0 055 + 0

0 377

0 5932
h lout) 1+ o 37)
(1+e huCin))

Calulat h in and out)

h lin)- a t hl t b
0 05 x0 2 5 +0 1o x0 3 + 0 35

0 3125

y ba (out) o 56

sCalulati OCin and Ot)

t ha (out) x 6 tba
, in) h tout)x uls

o53 Xb 4 t o 596 xo 45 +06

tb5

O,lourt) O 7513
lte
-0,in)
 4Caludat O Cin and out
0 Cin) h tout) xula t h, (out) x Wg tba

0'5 51 32 Xo 50 to 568 xo 55 t0:6

22 48

O (out)
t 4 O alin))

,Calulat E Tota

Total 2 fargef -
tE02

283 approx)

eroY
Part :Caleulating Back hard propagation
hiclden layer)
output layr
leights ul5hl6, nla g

Flrst, Let us aduat uls

l ls total
Dhls

Etota DEtotal x Out O met 0

ls D DutD nt O
 total OutOut O target O O 45 136 0-0 -

7Ourt O
3

Out 0,
Out O Out O Ct- Out Df 0 o:sl36(1- 07s t36)

0&68

Out h, 05q 32 Stmply b,lout).

'.DEtota 0 0 8 2 167
0 ul3 x0 8 6 8 K0 513 2
uls

hs dt total
uls
0 35 d69

Pavt 6) Caltulating back ad propagaft0 ef emor

(hidden pp laya)
lts , y

irst leta adut

, - 7dttotal

Etotal Etotal DOut lhu) net hi

Dut hi Ont (h
 Consider Etotal DE6
Out (h) DOut h, o t hi

DEO net D otO

net 0 Ourt h
dmet O Out hi

Out 0
net b
Out O
20utO

(Out0 -tavget 0)
0 2101
O772q2-0 19

0 7 2 4 lt-o772)
out 0 Out 0 C- OutOa)
ntO2 0 I7 551

-) Dntt01
On O1 from h - ud5 04
Dout h

nt0
0n O
0 from ba u luda 0 So
0ut h
XD y)
0 38 oo 580 7 x 050)

( 0 01To) 0 0363
ttota_ 0 0 5531

out h
Out h Out h, (1 Out h) 02415

neth

th

D 05

D2 l 300 7 0 Do s 38
E tota 0 0 650 D

, dF total
o1497 3
 N

lo