Ae otal Tends nfo’ (een ) ~ — = ao Ope 2 Anttietal Muara! mf ' neprctent a deere oh G f © ak -onaf, Mon + sui fms foctins of Bly of biolyae hea aera! ale Cowivg. af tes ort, avesticat reel nfo are jut meal Afulle ac they are ost ofte atbrewiated having ont of tht mafor bua di wor fw mut go Orpast from agile etecteficacion A coutval the wre been applied on divace fille oF WMrance » etme. bast 5 ban capes ee Son and Twoge proaecing ae $ “hay oe apes at afin CEptaneg 4 o @ UCIT gece of human bham Ww compudtin) | oO o Defi jou 2? — . . 4 Ga sy Caw of mtur ov (gtmple pun aecting dumantr] Fak One tonvu ol ‘ucto an by eet of weigh The meron (or) node (ey) wik as te & walled Go prowssting elomend Rat “ke @ mo of atp\ jougilt 77 gumt thon up and wet the het Melt at arquement-for teevantle, unt taled ade actvatio vantfe, unt caled atdeachvation foncfion ag shorn in the” —figrre below. , * oat) fe o o activate, Be Lop va +... ye th) =@) The hp hough an unk unt, hor an be Ww Leon tole many forms fe cated he tas aie digas fie autication fo" whith aw foelow > — 1 sole 4 Duet ade acthteitiola fun. | $ z te 70\ a)stanh funch ot: tt bt eicl - q ae 1?)athntutory gy ddan 4S Laer [eed tayen) stp AQ\ i ‘ aMeatl a Inyerte ae warral wfiw't norwially have « 1 lurve 4 hav? . , wily lhe dit Vagey 4 anoont having woh hera, dil ber citinble ar (vation ful © 2, “the ime hae WwW O Mayer nuwcyal mo thew figure na we? ° ° a ¢ Wee, and a lagers of mewvont wit (8 Loy an havi ra ; 4 mm’ mcr one * that feed wip che 2 4 lage Maviey Waldin ran) 4 a * npwn at ‘a. amiaenne * ihe 8 layen “UENO Sayer ( widdtn bl w \p Layer & and layer) sto, Abe ond lagen & kaon as olp Laqas tt % wmmpn oO. o mouryon ger atith - Inyo 40 dave ath: “ aural afro! worth anal ay ore wu called aarulh layer, jarceptroue + OAL cotinous jun can be Approxim ald AD ty dutived cera Uf sort a uturol ov 0} 4 fddow loan, of Siqyaoi al Wddiw units £ a faye of Uta, olp unite Zor As aloes neavol nf,” 4 ' o ee(a ete + VD wank +0) a : 4 la Wun sm. AM yn + a?)Get lan. etre mo, 3, 2 o (Way + Maa t-- ~~ + Ranan 4") Fem = (Ray + Wig Inte. + Winn te +0") and of { Ip fol ayer trom rune nfs, free (nar 2% Fate a oe. tM a, sw) Yo = o (Mba AMG 7 + Aan Sn +%2) 47 qa My Bp to Aen ten 1M’)orjvelrers = & A weural aio har 3 nUryow! OAle?! layer + a she nail lo bay th auf too Kiuvong wv the Coltulate Awe Valu, ol, or y, ancl Ya when tht ip ave 4 A) x = 9.3 and % FOS b) oy =0-9 andt, 0-4 she woke Cand Buel Ave 1 ao] of | Q We . wr 3 3 ? -Q al 4 ur [73 -2 | ye] 3 1 2 3 ; _3 . ods. 6 st all activatfon dun’ te waaral ajw are 0,406f oom t tyne ® 6.705teal 7 a N ual Neural M9 WNOAYY debs ee ° The wh of nevvons dibher prom cath othe 4) The gropertiee Qf tke euwrvon (7) cell. C-thrrehold, GAetivation tunekfow) , athe arekitectuve, of alw (ow anpolegy. ye earning mechautenn (4) banning ne wedge calualatior), and ae way they ker a f updated ; Update wule Govste af p | techie 2 3 main topologfer Usted any 4+ Peed forward xt{vole (o) 4 - tayev tad foward [vo (b) mult ~ layer fod -fervaard (00 a. Retort a[w'e4. tered -foww pand nYy 0% —> fad -forvoard mgeuval q's allovo siqnalt +o travel one wary only = from ‘Ip ‘te ol. “thet Seno fudback ot loope, f. £24 dhe lp of any layin clpcenot atpet Hhat game layer — Feed forward wnéiral fils tend to be Arafght Aprvvand mio"! nat ceo 2 BO aceotiate ‘pls with olpls. they ae. catencively wed © Pattiw pctogpnttfon- _4 hue ype 6h niwte te alo ved fered at-loottrm “Pp lo “top downs + Fadhatk a(t nt —> Ferdback n[to's com have &qnalt seni * tn both the dfveckfout by Tuetro ductieg too ps a the nw. > feedback nfo are dy antes t 6, SHAE of cystim eaunnt change ealily Gy) men ay Thetis date chan ging eontinondly —usrtl shay MACH ay equ lt’ acm pewt-ayo thtly seman al equiltb nvet m yl until 4 5 pat ben le 4 \p charger and a ww equilibaucm need t to ht Aruna > Veedhact anclftecturer ave aled vel bend 40 at Cuterattive oY yeuurreut, all though ” J erdbar Ame tata team “ie often uted douste -ferdbal tonnectt fh dale layer, orgautyatton » (tat - toqen) Bh.pelay elumen F iw) Ruwrunt N[weReewsentl nthe! ] & “Ty 42) \| Alepor fj Leaning [Trang of aera! Uv ae vetgh'tS (Wig) are voniablec hey cau be dg ravrar cathy odfurted —b produc a qe olp (4) - The dgramce modipicatPou of the Valualle Weigle te she Wedence of fenrninn, Qe sh © (avel of a stugte fous tay eliment tone £elh — ad fu cto fw very cimple thieg when many. prowcsing cluminte dx if callectiely, we say St vas emblec duteli®gence. «The omen "efor tfow a ty end freA ws. content al a mural alr f tt oO Tut tearing wm te tr and acter she proutt of adja Huy he weg h SS auth a mannus that yer qivew fp 6 the overt: Tet pone Oe Ofpl: aq atht wemm S w Wr Ay ae hs to [0250.4 50-6] (dubud olp) Updation of weighty & called Learntig| Trang Aahing Acdfurting wks duth that the error blu) actual fp and degirecl- ofp ue the Some, BA Bu of Tips and ofpt ax apptied to the dota are uced 40 fr Sai q,, (acter ele) % Neural Alw. true pobics teach | -tvain the nfo, aud a duchy ae retfere ob +0 ot the Hraiuiug set. Knowing —ighat ofp 2 ey pected -from each te, he ni automod cat! 4 alice) ada ptt she etvemphtr of “the comnect¥oug bw prio eating demu. the method used for the adfistty prowss % catted He learning rule-eo as The lecveniug method Can be claesi {fed tuto 3 categories 4 Supowtee| learn ) Rolveloreedrewt- learnivg 3) Unsuperviced teasintvyy 4) supuoteed Leannlog * sthuce aulee comple Whe necessary change tn ~Ihe tonneetion weigatt by pausenting He 2 nfo avn ‘Ip patton, compantey the obtained o 2 responce wrih a destrecl respoute Ldn at a prtonf and Ahew “dhaug ing athe wk. bu Gasetfon of decrening over. | Dy awe gL mode, a neural afi & suprtied wrtn a sequuce of example Cat, gt) 2°47] vee CaO, gP) yo of death tp - ofP pas - Warm zak Vp, a?) & fed Sule tw wural nw he correcponding dust neck op we alto supplted +o the nevral nfo. sham & fy. 45 the dijjoune bho stent yuurato| CP) and 9, Y) OP Ya oy dined of Ye2 if \ f o _- a ut major Gh the evr oY shqqaal quaratyr whith Whey produce ervey diquale for the Meuval fro an commert ite vote tw duc a way at the actual i i) ofp will maoveclpeer to “Ihe elected ofp - t Yo Ciypun) cactual olp) evvor efqual Ya general C ductved v Cyn ol) ° dq! Superviced Learnt (st) Resiefoveencent Learntag © In anpavited Lean ntg, tt anak the correct tanger ofp Noluct Gre 2 is acened vnown -foy eath [p SE peta. But fr come itinaty out (ee avtatled tfo- & nwadlable ltr ait atswiural wv mang only be old chat ite consent atta ‘lp 5 too big bi ha sof cory correcl « Ia Whe extvemu cate, ten ft ouly a dingle bit of feedback tno. {fdteattiney whethor the of tt aight (oy) rou ’ wy pT sg act rors atari bated pr alte Lurcl of ontti font 2 called reinforcement: learning aud he fecdb arte | eo ee a ° 'Wovmation called wrdnfoccement signal. Feedback wetteved bere tt ouly evaluative cence) wacdhey han qu nuclve - ys The Orlanal Aclacrcmut cfqnal & wally proctced by Are it —afqual qensractoveto prodice a wore nfo 40 adjust te wots te property worth af qutng better Otte feedback th the fice, 0,0 of uxformatfive crrtie siqual ov ake nevyal Ane hopece ee © © a ——s - I SRE alto called learning or th a brlyar Otpased to Tearing wah a ctenrlass whet —decvfler ° Mbenvi ted learning. n 1 Py a 4 aclual ofp cr a | | eq [ “wit the | Blerarre | "yuna vy “anal D fige: Retfore cmt Learning (RL) 3. Untuper vieed Leownivng ttle leather to provide oy feadoath. tal orm atfona ¢ chown tw Aq. 2 thee te we feedback fron die covfronment bb oi what athe ofple Shout d be (oy) volt, Why aan neve the whe must df be rust Aksroven few ‘Led, tae pation, 4a » remalant tie . Geabeast pew, news we th *ulatfone, (or) cadeqorvec an the 4 ON data and snide - e LN , de for Atami Ua ha of.| | | j thle Gu toverivg Hase featuvecs the ufo uncles oe 5 9 . clanyee ible fatal le proeee ‘ft called. oe dell organ zing. ah typical) Cromaple ue wan eto aw untupavieedd Aasst{ir aon of aby ec tt vortloud provfrcdiing info. about Whe actual claseec. Peeper clutlat ave . oye efoiard by dtecoverting tha cGnitanttter aud die hnRlanrttire among th. object pT nett Be Lear we “4 44.3: Uncupeary teed ake. 06 one 0 ut Tadtng ang hace eopegetion anes Back Prvpogetion Algovitho (BrA) i 4 leasnutag te one of Whe mock Commer fw mat af wating oO © oO cechurquee We ealled BPA becauce ob bat propoqetee Ahe ormoY bio Ue darted and actual: ofpo) we Konval afro for Ahe pur pote oF adfucting she manval fio wh le aud brace ta order to reduc t the learning error. 1 Aengust 113 — changing the valle [changing “the valuc training of toh, matty 5 crrer te Hee fant + o © wi te gee the do dettred olp de change oh ( Jehan ge vot = . ‘ corer gerade < dir o 4o mint ze the cyst cAnor ent. wblt ! nN BAL + blvo commanel § # a ud,00 i mininl giiag error using BPA; ete called BPA because Th back pror 1 | . LD pogate’ Ww destined § actual ofp: Speci i j Se facally a typical back propo qv qatio algorithm é parcel cons Of -Wwo phases Gon -e 4m Abe forward pace, ip veckore “6 nv and the actual afp's ave pre. cali -lo che neural caleuloted - : Nth sururce pags, the errr gradient «i calculated — osnd ‘ propagated bac twoarcle Hough he neural anf a} . Ong te wrote qrackiut 2 calealacted, tte wt. are ad fustusl ale + apr adieu destent ) Method . aptiwataation 8 oO -~ 7 ervor gratin wre — dag) ay > _-ve = errors decreatiinge (slope) of, te Gradient clescaut fe at or din opr ster Blqov itm “To ay stunt find Abe local teww 7 tg s — 7 opraolid alceteml, bie dates eps o& bo ch -ve 4 tw qraciuak of Abe uut- at sou Lorreut petut- The qvadaut Ww al que Ah (lope of Ame wyve at that x aud tt dissekfou wll a ° pouch te am theveate wy “the fue’. Go we change ty! the opp: divection. tv lower the fn © Valuc- fr) Me Ae The ''® thay to Changed th dtu eve duuctiou. Wygase) = Wy 4 Any Wy Uw) = wl, + Aw, Wyre) = We + AW wo tv) 2 wet Aw of gw:Step dt Spt trp > 0 I actual ofp devived lp Map 2! at ae 1 bg ‘af! a collet leary upelat ed valet imate eryuy coeffietent Shop 3: 1 YF new) = Wy + AW) ! My 3 dy gr wrth Wr 4 Mhg. a, tO + a 4 . 7 ae —Ts eee St wogts) dla) FL (uae)Ee ot > woe PA (Ya- ¥) a OE dno (lat) 0 tens Qs eo oe DB FoF Uae ae = Oy - € ote - ie (ey pe Cae) Berean ‘ e ; Ae we em ow Beet He ig as >— 4 @ 0 any Hoty yt--4t = © awe <4 ae> [awe a (y-4) if) ius) =H a (fF > wp Poa = WP A CYa yg) gly) a? fun durteve silel23 &. -for a tan ‘esp per botie ar the -for updetion “ol drown the $e activation an alqorithon wt te 4 pans fer a f- neuron: at Sol. - . ty toy ty 11S THe @)-- oO) t qe dant 9 af = | “£ yae kb wb We yas) =wW+aul 2 -e 4 (ad) aa’) «fmm) - ME am QE frawte- sep” datice wine) © Wt $98: jae v | awe raphad” 9 a6 2 CH) By can _ ee x? a= fy -y) 2 ans tie 1) St a i: DH xt 0 AL. Gee) We)CE = ieee Ca oy Ca CH esyy at Geer 7 ated ety -t[s-t] 7 © % . aes — -at a 4, i Ay dO) 0 “a (fom 0 § 6) gub.G » O°& qontidty a a pay a ge) 1-4’) ote Avot = (ari) a | wr -w 4 Ww Ww , cous) = WP AL (qa WD 8 -t{p single rods perceptron with tow at attivectfou jun’: wypeote vote update puule fpr 1 (*) dutave He & pat “.° 4a desioud of =a" Yael obtain uv part (a) to up dale sol ofp ° the Unpiating 4 ° Bp vasstable! > ay, 49 Mr. (b) use Aw nul awe paper, ata ds teed Up & dust wile. pattan Oe at follows - a=-[2 -2 ° tov tt crate AL 4 We [1-4 ood . 0d -1y' tar >t pha Suetial wok VerW beveptoon Abanot forsee ay red fet. - 10) witnsw) = wee wv oh oy FE no Tata yy oo: 4 ot aw, (tay) a, Gaver, We Wypes beb't dunt jun thas eane pA lta: ay. - 4 awe ft ~rye sé (2 WYLLAWy ty Hare a tr cm ack (ae tr ~™ os aT 44 rae) tee i at . aa’ ty BA, vty 27 Bt ae and, ; » Hay is 3 ly") ; A a, ( Ay ety, at ff Xe Aya. og q): 4 (l- 4) aes de % Aw) "s | =a ya d) CVE yay (fon and O) Ww (from @) pet eer MEP IIO Oth givens Avi 60.06 (uw rege as) #F trav) = +o.0el4,-y)li-4") aif =: Wy(wio) « ©) 40 oF (4a-4) (eg ys , * | vay (ut) 2 va, bo oe CY) trey te Wi, tuo) Ws, yo 0s” Cyd’) 3 Wg (nus) + voy #0 OF Cu “yyy tya? ® —from part ta), iigqutay < Wie o-06( Yang) Cw AE Q- WP mus) = wp +o.0r(-4 -y) UU “y) ai > @ \ 823 tout - 1D) Hy ED, Hy FW Xa tr” 2 10) Heney) 400) (0) FENG Cein, Se my TN “en S ras = 3 get: 7 01882 leer == : 2, Wiis) = 0) 40. os(-! -0-8482) (I- (e-guas)) » % -4i4 eos (-1auts) (1 -b-susx})] RL = 4 4(-0-0284)*1 = 1-p.0284 Wid) = of 41 Ws(wi) = Wh + 0.08 (-1- 0.8482) ( 1- co.guen)?) only, = ~4 4-0-0384) (-9 nh, un) = Oe -0.4U82 (Hw) oS Wane) = Ws, t 0-06 (1-0 -84g9) (1 - lo-guea)") Wa =p + (-02S4)¥0 Wayuny = °Wig twas) = Oy 40+ oc{-1 -0.8ugr) ('~ (C0-€Uk2)™). ay = 0.5 4 op(-0 0264) (-1) = 0.6 40-0964 bly evo) = 0.5959 ) = HW) (aevo) ot Ug bg Le?) pAyoq uur) + ea ana) Screw) = “ = atoaral) +E f-0-4ue2) oto) +(e) (0.5259)u | ———_ ett) for weno COT, Neural Nifiy wall behave ab a MP dul | he sygtuv as tb will Wave Came Arpra nares.tL Ye Mtural nl reprecente sta enatt Tnveate ¢ dapaawatet of te est, hun ofp of The yet t 4 alee 0 at (k eayh artant wr! be equal We v t ah ° command ip tu) and ih Tngtant