Scribd Logo
Upload

Welcome to Scribd!

  • Học Sâu

    Uploaded by

    AI Warlock
    41 views664 pages

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    Download as pdf
    41 views664 pages

    Học Sâu

    Uploaded by

    AI Warlock

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    Download as pdf
    of 664
    (© IAN GooDFELLow, YosHUA BENGIO va AARON COURVILLE Nh6m bién dich DLBOOKVN, Muc luc KE higa 1 Gist enigu LL Alu dge end ach nay? 12 Leh see sa uring trong nin hg si 121 Ning ofi ten vi vin mnk dang 4 thay eis ming aeuron nbn tao 122 Sting trang ea Kch thade dig 128° Swting tring ea ich thade mo bin 124 Si ting trudng cia 49 phite tap, dB chink sie wi tae dh ting trong th gi tye Ca ban vé todn ting dung va hoc my Dal unt tin ‘Dai lug v6 hung, vector, ma tri vi tensor 22 Nain ma ua ni socor 23° Matrin don v va me trdn nghich dio 24 Phy thude tuyén ta i span 25 Chun 26 Che ma trin vt vector ds bit 27 Phin tic ring 28 Phin tic gid tl euy bid 29 Gib nghlch dio Moore-Pearose 2.10 To 6 6 cin ma trim 241 Dinh thee 212. Vidy: Phan teh thin phn chi LE thuyét xe sudt vA 1 thuyét thong tin 31 Thi ao cin ie ult? 82° Bién nga nhién 83. Phin phil xde suit 33.1 Biba ed rac wh hm Whi wie se 83.2 _ Big Ldn tye va him mt 9 xée sult 84 Xéesuit bien 35. Xieoult 06 dtu kita 86 Quy the elndi ea whe wt of dil kigu 387 Bee lip wh dge lip 06 iba ifn 38. Ki vg, phuong sa, higp phuang sa 8.9 Mot s6 phn phét ade sust thing dng Me ie 310 an a1 a1 34 391 Phin phil Bernoulli 392 Phin phi Multinoal 393. Phin ph6i Gans $9.4 Phin pit mit wa phan phi Laplace 39.5 Phin phi Dirac va phan pa thue nghidu, 39.6 Hin bop ede phn phét (Ce Uk che hi feb ea eb han thong dyn Quy te Bayes (Chit chat v8 bin 5 en tye Li chu thing in 1M inh xe auto ere 4 Tinh todn sb ‘Trin ob teen vi tran sb doi ‘Tin én ia hoa ‘Td tr prion 43,0 Ma trén Jacobi vi ma tein Hesse ‘Te wo ring buge ‘Vid Binh pliwng eve td tuyé tin 5 Hoe méy eg bain 5a 53 Ba 58 56 87 (Cée thut toén hoe tp BLL Téewy,T 512 Bb dohieu nang, P 513 Kinh ng, B Sad Vidy: HO quy tuyén inh Dang bong kop vA Hsp 52. Khiag 6 bim tran no mila phi 522 Coché kfm sot ‘Situ sham ab v8 tap i 531 Kulm dink ego Ue hn, chic va phen sat 541 Ue lung dé 542 Dp hich 543 Phuong sal va sai ehudn 5.44 at digits 9 ehgch vA pong, dE ee 16a nga MSE 545 Tinh oft quan Uae mg pI ce dk 55:1 DQ hop I thang log of dies bln v8 MSIE 5.52 Ceti chis cis phic php hop i eye da ‘Thbng hd Boyes 36.1. de hong hi gh ee dai (MAP) Ce Ont coin pee gi st ST. Hoc gidm sit di trén xe wut nn BRSERREALES 100 101 104 0 42 ne 5 us us 119 12 mi 130 12 14 135 136 1 40 iL 2 us Mt 4s 146 19 10 10 u Mie tue 57.2 May vector bu 57.3 Cée thug ton he 0 glam sit dom gin We 5.8 Che te toga hoe kbng pi ast 58.1 Phin tic thinh phn chin 582 Phin cun Eemeans 59 Trae grint ngiu nhien 5.10. Xiy dime moe thudt tain hoe may SAL Natng théeh thie thie dy su phat tein cn hoe sit S.ULL Him hoo seh lon 5.112 Tinh bit bi cue BO vi ca eh Kin Sot di tom 5113 Hee da tap Céc ign tric hoe su hign dai ‘Mang lan truyén thug da tng G1 Vids: Hoe him XOR 62 He dm iin gradient 621 Him apht 62.1.1 Hoe phn pio ai ig aig nguyen th pI 62.12 Hoe oie thing Uo du hig 622 Cle dom vi dtm 6221 Dam vi tay tinh cho pha ph dra Gis 6222 Dam yj sgmold cho phn pt da ra Beso 6223 a v| sft eho phi phi da a Mulino 8224 Che dag dsm Hie 63 bawin G31 Dex of ayn tinh iu ia (Reb) ve ne ng ita 632 Hi sigmoid vi him tx 833. Ce don vn Ese 4 Tru tn te mg 64.1 Tinh xp x pb quat vi 4 sca mang 6442 Cac ybu ed thie KE Kae ca 65 Lan tran ngwe vee thu on indo im Re aa DO th ah on 652 Quy te ehubt wong pling pip tak 6.53 ban tigin gue big ich 8 guy ay te eh G54 Tan tpn age trong mang MLP Men dy 655 Dro im dang “hiéy tama tape 656 Lan tmpéa neue tng que 657 Vidu: Lan eayén ngage bi yg LP 658 Mou sé vin dB pie tap 659 Phip dao tong link eke 5:10 Ce dga him bi can hon 11 am 176, 216 Me tne 66 Val née Ih st 20 1 Cle ed cht kdden sodt tromg ge sft 223 TA. Phat can cn than co TL Co chl phot cin 2 25 112 Coehé kik sot cot 1.2 Phpt ehuin dui gc nhin tt ao rang bude 20 73. Coch km sot vb baton ving ring bude 22 TA. Ting cutng dita 233 15 Tah King nhiéa 2 754. Thm nhidu vio dia za 2 7.8 Hoe bin gia sit 236 17 Hgo da ahign 23 7 Kile thie sim 28 7.0) ‘Troi ue thamn of vi dng chung than 28 24 79.1 Mang neuron tid ep 245 a0 Bid din eh 245 TAL Bagging vi ee phon phi hop thé Khe 27 TAD Co hi te ng nhieu 209 118 Hn hn Ring 258 TAM Khong ech tgp tuyén, lan coun tgp tuyén vis bo pin lpi tp tnyén dat 259 8 TOI wu trong hin Iuygn cée mo hinh da tng 203 81 TE troug hoe may Ke tl thadn tug nb thé mio? 26 LL Gye edu hia el ro thye nghigm 264 S12 Cle hm anit mit thay hi wh BY the wm 265 3.13 Cie that ton sit dyng 6 vi 1 nh’ 260 8.2 Thich thie sip pid khi tt uu mang neuron a7 S21 Tin kdmm didn oa. 2m 822 Cw tien ene bb an 823 Cao nguyen, diem yin ngua va cde wing phiing Khe m3 824 Veh dimg va bing nd gradient 25 S25 Phy thage dil ban 216 S25 Gradient Khdng eb xe a S27 Sy iin dé yet cf eric cue v8 cl tne ta ee ar 328 Gli om I thayét eda th hoe 270 83 Cie tat coén co bin 280 S31 Trt gradient ng hin 280 832 Dong Ingng 282 83.3 Ding lugug Nestoroy 25 St Che bid luge kt to thas ob 286 85 Cac tht eoim wi tee gee i ein 2 S51 AdaGrad 2 852. RMSProp mm = 853 Adam 85.4 Lya chon ding thudt tad ei 86 Phumg php xip x1 dgo him hfe ba 861 Phung phip Newton S62 Gradient leo bop 863 _BFGS {87 Clie edn thu ct a ee sta chug toda BT1 Chain bia theo 16 8.72 Tru theo tow 879 Trung binh Polyak B74 Hun luyen trae of gin aie 87.5 Tht mo hid hd tro qua tei to 876 Phuong phip min dn va hoe theo so tinh 9 Cac mang tich chap 94 Phép sen chap 82 Diag Ie ph cid 83. Phép sip DA Phép tic chip vi phép gp du ge nin mbt ea nghiéen muah ¥8 han 8.5 Cie bldn th cin him te chip eat bin 868 Diu ra ob ob trie 87 Céckiéu liga 93 Clic thudt tain tick chp hgu suit cao 89° Die trmg ngdu nda hake Khong gin wit ‘9.410 Nén ting Kos hoe thin kink cia mang tich chip 9.11 Mang teh chip v8 ich sco hoe sia SEEGSERRESEE SSSSEseeeeERE 10 M6 hiinb héa chudi: Mang truy hdl vi mang 48 auy 10.1 DA eh ta tog din ta 102 Mang neuron uy hi RN 1021 Day ép huge va eée mang oS da ra truy ht 10.22 ‘Tinh gradient trong mang newon truy hit 10.23 Mang truy hi du dang ma Binh di th 6 hating 102.4 MG bah da hd ph the ng ca blag RN 103 RN song hing 10.4 Kin trie euch dang 105 Mang tray bi da tng 106 Meng neuron 48 uy 107 Thdeh tie én te ph thnge dl bas 108 Mang trang thal voug bit 19 Don vib vi fe cid ge We cho da mie thd gia 10.9.1 BB sung kien shy fe xuyén tha gan 1092 Bon v 18 ri va phd ca we mite thd gan Khe nha 1093 Loal B Hit nbi hoi ma” Me ive 10.10 Be ahd ugin hg hung dai an (LST) wee RN 6 ong ke 0101 LStM 10.102 Che RNN cba ke 410.11 TBi an cho phy hfe dA han 10.111 Sift grant 10.112 Thi dy Iudng thing tn théng que eo ché kim sost 10.12 BS wh ving inh 41 Phuong phép lugn trong thye t& 111 Dh do higu ning 11.2 Céc m6 hin co wb me da 113 Clin abic thu thip thém dieu 114 Ly chon su cham sb 1A Tio cia th cng oe wit than 8 1142 Che that ton 05 ams tham 8 ty ng 1143 Tim kim the lt 144d Tim kde ng abit 115 Th vu iu tham ob bing md hin 115 Chida lage go it 116 Vidus Nhgn dang 8 66 hid chi 12 Ung dung 121 Hoe aa 3 quy mb ln 121.1 Teién Kha tn CPU tbe da 121.2 ‘Trién kha ten GPU 12.1.3 Tridn hat phn tn guy md Yn 1214 Néw mo hah BLS Chin tae ding 121.6. Tyla Khai ofe mang da ting trén phn emg chayén dung 122 Th ge my i 221 Tin xine 122.11 Cha hin tong ph 1221.2, Tang cutmg dig 123 Nou dang tng not a 124 Xir lf ngia ng nhlen W241 gram 124.2 Mo hinh ng ngs dng mang neuton 1243 Dum eb ab hid lon 1243.1 Sirdong dank sich rt gon 1248.2 Softmax phin eip 1243 Ly min theo d quan rong 12434 Ute ugg tung phn ublgn vi him mt mét xp hang 12.44 Kéc hop md hinh ng ng at dng mqng neuron wi mam, 3243. Djeh may nearon 410 412 413 au 46 a7 418 a0 22 a ryt 25 ar 28 20 29 485 41 135, Mee tue 1245.1, Sit dung co ché ch won kt ee man d Ubu 36 1246 Vai né lich st 138 125 Cle tng dng Khe 0 1251 Hoga y 430 125.11 Khai phi va kai thie “0 125.2 Bidu din tei thi, lbp togn val ap aus 1252.1 Th the, quan bf vai dp us I Ngbién eit hoe sau 446 15 M6 bink hin ti tuyén tinh 49 181 PCA hang xée sult vA phi teh bin “450 182 Phan teh think phiin de lip (1CA) 451 133 Phin tie de tring chim 453, 184 Mihéa thu 455, 185 ign git PCA dud ae nh da tap 458 14 BQ ty ma Nd 461 TL BB tr ida dud mie 62 2 BG tr ml hbo 0 kiém sot 63 21 Bp emi a th 53 122 Bo emi hin ei nb 65 1428 Kin sot bing phat dyo ham 66 148 Nang le bu dim, kichthue eb tng vd si 66 144 Céc bf tum héa va gi a nga nbien “6r 145 BG tm ho Ks nhlen 465 145.1 Use hong dim xh 469 1451.1 Bbi cin lich wt an 146 Hoe da tap wi bo ty ma hie an 147 BO tr mk héa co rit a 148 Phu ti chum ey doa 479 149 Ung dying ea ee bgt ma ha a0 15 Hoe biéu dig 482 16.1 Buin luyga trade tham lam the tng khingeiém sit 483 45.1. Khinio ota suo hun luyén tre Khtg gid st mang ial hibu qu 485 152 Hge ehuyéa a0 va thich ag mid 00 153 Boe téch ele yént6 nh qué thing qua ge iin gin sit 95 154 Bidu dia pin tn cy 15.5 Lat ich mang ll tng theo hm mc 9 si 186 Gang cdp nea m6 cho qu ah hie nn ce agua un bin 208 16 Cie m6 hinh xe sudt 6 cd trie trong hoe a 508 Moe tue 16.1 Thich te trong ige m6 hin Hea phi ea te 500) 162 M6 ti chu tre elm md bh Ding hy 512 1621 Mé hinh 0 baing 52 1622 Ma hinh v6 hing ou 1623 Phén him 516 1624 Mi hah ning bag, is 1625 Téeh bet vb téch big 510 16.28 Chun di git dB th v6 tng wi ei ob nang 528 1627 D8 thj nha tt 526 163 Liy miu ttm bink dd thy ser 164 Uu dd cn me bin a 6 obi te 528 165 Hoe efe quan he phy thus co) 1665 Sy dita v8 uy didn xp x3 530 16.7 Sicdung hoe su trong ind hia xe sul oe tie 51 167.4 Vid: mdy Boltzmann oii han sa 17 Phutang phép Monte Carlo 536 ATL Ly min vk phon php Monta Carlo 538 TELL Visewo cin ly miu? 536 17.2 Go bin vé plums phip lay miu Monte Carlo 537 172 Lay mu theo qin trom, 38 173 Phiumg phip chndi Markor Monte Caslo 50 174 Lay miu Gibbs 58 YTS Thich the kh 16m ede mode teh ie Su 175.1 Dida hin 8 trgn mode 6 17.52 Bd ai of hd BS erg ted made 57 118 DSi mit voi bm phn hogch 549 18.1 Gradient cis 48 bgp If thang log, 9 418.2 Hop If ewe dal ng nhién va phn Id tng pia ‘61 183. Do bop i wh sr 184 Khdp dif 8 vi kp 1 580 185. Khop difm 6 kit nif 561 186 oe mg tuaog phn ais sl 187 de ng phn him 64 187.1 U lly miu theo 49 quan trong, 266 1872 Ly miu be cha 568 19 Suy didn théng ké xp xf 570 191 Suy da thing qua tm bos 5m 19.2 Cy dai ia i vous 5m 193. Suy dién MAP va mi a thas 573 194 Suy didn bifn pin vA boc ign phn 575 19:41 Bib cde dn rt r9e sr 195 19:42, Phong php tinh bin phn 19.43 Bin tm dan tye 19.44 Tasag te ga hoe v8 euy dia ge eh suy dita xp xi 1951 Thdengh 1952 Che dang thie Kk cin hoe uy dia 20 Mo hinh sinh da tng a4 m2 203 204 m6 207 20s 209 2010 2 May Boltzmann May Boltamann gt yn 2021 Phin phil xée suit ob diéu Kn 2922 Hus luyén may Boltzmann gid hea Mang ni tn da ting ‘May Boltzmann da tag OAL Che tin cht ding et § 2042 Suy didn trang trong buh trong DEM 2043. Hoc tham a tong DBM 204.4 Hun Iuygn true theo ting 20.4.5 Hun luyen DBM dng this My Boltzmann cho dt i ee ve 30.5.1 RBM dang Gauss Bernoul 20.52 Mo hinh wo hung ela higp phuong sai oda kiéa Méy Boltzmann tch chip (May Boltzmann cho dik ro chu tne ole du tui ti (Che miy Boltzmann ke {Lan tray nguge qua phép vagn gu nin 209.1 Lan truyén aga qs php toa nga ain rl ye ‘Mang sin sa 0 bang 20.101 Mang nibm tin sigmoid 20.102 Meng sinh mo Li vi 20.108 BG tym ha bin hin 20.104 Mang dt Khng sinh mi 20.105 Mang sinh miu kbép moment 20.106 Mang sinh miu tch chap 20.107 Mang ty bd quy 20108 Mang hd gy tun tn 20.109 Mang hii quy neuron 20.10.10NADE Ly mau i bg ta mi hos 20.111 Chit Marko tem ig vO Ht mh Ki nis ek 20.112 Ghi va ly miu 66 dia kita 20.118 This tye hud Baym A ik Manisa mi ng nitn Mye Ine 20.12. GSN bag pa los 20.18 Cin eign lage sinh mike 20.14 Dok 6 mo ba sia mba 2015 KEL haga ‘Thuat mee vide tat (Cha git that ng "TAL igu tham Kho 610 610 oa ou 645 «9 ors Danh sadch hinh vé High 11 Vidy v8 sw ke bed tr ef thie bi ai, Fink 1.2 Minh hos m9¢ m6 hin ges, Hinh 13 Minh hea mée bidu 8 tin todn én xa mbt du vi to da ra Binh 14 Buu dB Voun bidu din méi quan blog gia hoe xia vb pe my Fink 1.5, iw dB eho théy mat én hg gia ede thinh phn Khe hau ea mgt he thing AL ink 16 Téng quan bb eve ndi dang ch ink 1.7 Minh hq ha cong ba lin sng nehien eit mang, neuron mhéa to. Hink 18 Sy ing tring ca keh thude tiga qua that gan ink 19. Mrs vi du da vio eia tp dg MST. ink 110 58 luug bit uf tn mdi neuron theo thd gia, ink 11 Kiehthude mang neuron theo thi gan. inh 112 Chin thing cia boe su trong ee euge thi IISVRC. inh 2.1 Chaya vf cia me ma tr ink 22 Vid vé ma ten do vi Jy ink 2.8 Mot i dy vb én hung i. vector vgn a tren. inh 3.1 Phin phi chun inh 3.2 Mts mi hy itt md inh Gans inh, Vink 33 Hin logt sigmoid. Vinh 34 Him softs Hiah 38 Shannon entropy cia mét bigs nga nhién nb pin inh 8.6 § phn ld KL o6 tinh bit i xing Binh 3.7 Mgt mé hinh 48 hj 6 hag 48 vt ee bi ni ubion, inh 38 Mot md hinh 4b eh 6 hog a ede bn nga nian inh 4.1 ‘Trapt gradint. Miah 42 Cée log dif ti os. Binh 43. Xp agi tr ew td inh 4 Do ham be hal mt 49 cong ca a, inh 45 Me diém yen ng och 49 ong vi dng Hinh 46. ‘Thujt ton trun gradient Khéng kbal thie due thing tn v8 d8 cong te sa tn Hes, inh 5.1. Mot hl toa it quy tus tinh, wi tp ho Jay cn 10 di ds, rnd dim of 1 de tr. ih 5.2 Khép ba mo bah wi tip di tifa in hye Binh 5.3 Mt quan hé dda bi gia dung hug nd inh va sai, inh 5.4 Anh lng ela kih thate tp dt pa bun ayn dd vt si x8 bn Daye ‘sal kim thi, cing ne vol dung hg sea md hin 1 ao wr Dah sich hinh v8 inh 5.5 Khop mgt mo hin dt quy da thie be cuo val ep hun ly, ink 5. Mi quan hi gta dO ees vk phaong sl inh 6.7 Luge dd mt edch bogt dng ci cay quyét din ink 5.8 PCA he mée phép chiéu tuyéa tinh eho phép cin chin trye cba khong sian mei choo hing o phon sa in at ih 5.9 El ob chidu ota dia tg ln (tt quan ph), na es Nid eb x4 in of th tng theo ep 2 unt ‘ink 5.10 Minh hoa vé ich thu ton Ming gag gn nh chin Khdng gian di vo tit oe vig, ‘inh 5.1 Durbigu doe dy miu te mot phi pid trons mot Wg gin ai chia, ink 5.12 Ly miu dn ngu nbn theo phén phi du (bing eéch chon nau aha mi diém dnb theo mit pain phi du) 58 tgo ra ede dni. ‘ink 8.13 Cée ma ad byén 6 tp tis Rann mgt da ge nan QMUL. inh 6.1 Gli quylt bal ton XOR bing och hge mie bia dfn Hinh 62. Vi dy v8 mang lan trayén thud da ting, dug v8 theo hal ku ke nba, Hinh 63 lim kich hoot RELU, inh 64 Cée-mdu duge ly tir moe mang neurone tag ain aT ima mat bn hig, : inh 63 Mot eich gil thidh Minh ge wh teye quan cho fl thé tng tho hm mi ii cic mang ReLU sia hon, inh 6.6 Anh tng ca 48 su, Binh 67 Ci mo hin sy han o6 Kiuyab budng host dong tt om, Hinh 68 Vidy vb ch tinh tsa, lal, 69 DS th) tok tos thu duge Kh ip li ee big Ue com trong qu tak tio ton gradient. ih 6.10. Vi dy v8 phim, phép tn dao nin dang “bid twong bid tans inh 611 DS ¢hy th ton sit dong dé tink hm eh ph eng dé bua luyéa MLP ant tn dn, inh 7.1 Mink hoa dah bung ea es eh Md sot £? i wig te w ti ws inh 72 Me tnvng hep hoe da nhigm ph bién ofc te vn ding eng da vio ‘hung o bin me teu dura Khe naw inh 7.8 Dabng cong ge Uap eo ly qu tua thay a cia gi ey i a do 1 thang log theo tht gan ink 7.4 Minh hea v6 hi dng eta it thie im, inh 7. Mink hea v8 es eh host dng cia phuong phép BAGGING: ink 7.6 Ga eké tie nen mh ban Tuya mt m6 hinh bop thé ink 77 Vidu wé qu feink Ian raven than ain mt mang lan ean thud sit dong os chb tt ng nha. Wink 7" Mink hoa v6 qué ten tao ra mda df King dupe dp dng cho mang GoogLeNettrén tap dit igu InageNe. ink 7 Minh hea fag chinh cia thust tm lan tray ip tupén va bp phn Tea tip tuyén da tap 2. an 155 ast 164 166 168 100 170 176 ww 178 m2 09 2m. a 206 au 216 ar oa Dank sich bin we inh 8.1 Trugt gradiont thug Khong 161 duge bi: mot log dd tag mo, ink 82 Hinh dn wo tf him ch phi cla mt mang neuron Hinh 83 Him mye tfu che ede mang neuron phi tyén ds tog hae cho ode ng try Bal thing thug. inh 84 TSi im ho dy trén phutng php tray de ewe bp eb thé ta ba nba Inaong dBe cuc bg kkGng ev pa dép 4 toan eve ‘inh 85 Bog Tuong ci yéu nin vo ha vn tiki abe ea ma ta Hiss va phuang sai tong gradient ng nbien, inh 8.6 Phumg phip tru theo huing-dée-ahés duge Bp dung cho mgt hm 8 05 Dime dang ie al inh 8.7--Min hoa mt dang bs tay trae tha iam og, ih 9.1 Mt dy 8 phép tich chip 2 chi Khdng ol, inh 9.2 Két nd th, akin theo ug tt dun. inh 9.3 Két ni chm, nin theo hung tt én xing, Hin 0.4 "Trung tiép li en of dom vi tome mang ich ep, ih 9.5. Ding cong tham 3. Hih 9.6 Hi sult abén din canh bin inh 0.7 Cée thinh pha ein mgt ting mong neuron teh chp di Mh, inh 9.8 Phép ip eve dai tgo rath bat hid inh 9.9. Vicdy v8 tinh bit ido 6 thé hoe de. inh 9.10 Phép gp thu nbd miu. inh 0.11 _Vidu v8 of kin trie mang sich chp cho bi tain pis Tol inh 9.22 Phép teh chp si. ink 9.13 Anh budng cis ki thust den thm 0 a wi ich the cia mang. ‘inh 9.14 So sin gita kt 6 eye bo, teh chp vi ht nb diy ‘ink 9.15, Phien bin mang tch chip 6 tinh kt nit gt han I, inh 9.16-So sn gitm ting kt ndi cue b, tic chp xen he va ich chp teu ctu, inh 9.17 Moe vi du vé mang tie egy teuy hd gest cang cho much gin hn ida di. inh 9.8, Him Gabor vi mi tile tgp that ktse abon. inh 9.19. Nhidu ehngt tain ge may let dp dg cho binh dob tt nhiga 46 ge ee trang gp pt him can biém hove mia ake cy thé ela ee eqn bien. Hi 10.1 Mie ding Ive odin inh 102 Mgt mang teuy hb khdng of dw ra. inh 1038 eh inh ton tinh km mat mst eda qu tn hua lay mot RN ih 104 Me NN eb of itm etry tt lira v8 tag dn inn 105 INN dn tii theo thd gian vol ge du ra dy at 6 end chub inh 106 Minh hos i thust day & bude Binh 107 Mo hiah dd th xe suit e6 kit nt dy a cia cad yy}... yi, ‘inh 108 Bua thir bién trang thé vio mi hinh bj ug cla RAN. inh 109. Mt RNN dnh xq me vector di di o5 dink x vm phn phen che chu ¥ ™ mm 26 315 316, a7 as 319 m1 2 Dank sich bin v8 inh 10.10 Mit RIN of dia kg, nh xa mt chub ee git ob lb tien ‘Gi nde phn phbi ei of chub y 06 cing 4) ‘Minh 10-1 Quy tein tinh toga tong mgt RN song hudag dio hin. ‘Moh 1012 Vi dy ve lon trie RN °m hod-gii ma”, hay Ilén tne chubechndi inh 10.13 Tab thé eng 9 au eda. mt RN theo nh eh. ih 10.14 Moe mang d@ quy 08 th sinh ton Kh quat én a th cn Kon ci INN tir dang mpe cb thiah dang mot ety ‘inh 10.15 Lap la php hop km o hit Hn, ‘inh 10.16 89 48 KASi ein mt "28 Blo” (cel) ca mqng truy dl LSM. Hint 10.7 Vi dy x hia tng cn vide sift gradient tong mgt mang try hi wh a ham 35 w vib. Minh 10.18 89 ci mt mang st dung b nh tag min, thé if mot ob yu ‘hit kd quan trong cia my neuron Turing ‘inh 111 Mi qn bh aida inh ga tbe A hoe val 6 sn tye Hi 112 So adn git can Kim too hat v8 tm kin nea nbn. inh 121 GCN dex ci mi tn trén me mst cb. Minh 12.2 So sinh gta chudn bin eve b9 v4 hod ha ton eve inh 123° Minh ago hai eid ee op vector nhing tt thu de ttt mb hin dich ‘ndy sc dng mang neuro. inh 124 ‘Minh boa ange bp thdng pha cp dan gin ce mgt vt dm ti ink 125 Kidn tre “wd bods ns” gp él xa qual gt bid di be ange vi iGu ign ng neh, inh 12.6 MB hinb eo eb ci tien dt inh 13.1-ME hind 8 th 0 hating, m8 mt bo mo inh hn teu ia Miah 13.2 Vidu vb ce miu 4 Hea vl trong str mt mo hinh mi én tha ba ‘hop bt cag dug hao lay trén DO di igu MNIST. Miah 195 Phin phét Gauss pig nim bit oy tp trang xe sult gin mot a tap cb ‘6 cidu tp inh 14 Cha te cng da pt bi tar mb. Hinh 142 Gha trie ofa mgt bd tw md ha ng nbién ‘ Huh 143.8 thi sind ton cin hha eh phi ei mt btm ho Kh hi. ia Mol Moe bo tm ha kh nbidu dupe bun lyn én xa dim cia eat be 3 tr al aim dieu ban inh 143, Teng vector due e bai bt mal ha Kh du xung quan rit da tap cong Ichi nin gn nd fu tp trun trong mt KiOng gan 2 hit. inh 146, Minh liga kh ld vé sda mat phng dp tuyén, inh 14.7 9 tyma hée ge mt him ti eu tie bit bn true nbing nbiéu Toon ‘hd sng gunnh dda dit i s8 nm bt duge edu trie ds tap cba di. 308 a ms 40 2 128 198 am ma a5 a ‘inh M.S Qua tinh hpe da tap phi tham s6 xy ding mot eh King gi i ATS anh sich bin inh 149 Minh hoa efch mot da top e6 thé dupe It dt wang ln ming vé dang Gans yd tia eue bo. "Miah 14.10 Minh liga vector Gp tay Gia da Un dae ti amg bot PCA ee Up aL mg bg ey ao it. inh 15.1 Hulu thj thing que phép chibu phi tuyn cia 2 chién luge hoe cia ce smqng neuron Hae now trong Khfag glan hm sb inh 152" Vidy v6 kifa tie cho hoe da ublém hofe hoe cya lao Hinh 153 Hoe chuyéa giao gia hai mién x vi y cho phép hoc Ou, ih 15-4 MB tinh ha hep, inh 15.5, Mie eg mi nba dupe hun lye vo rung bin bik phere ab cho gt te vy robot thit bl trong vige Kh pie mt qu bong bis, ih 156 Meng sinh miu tién dosn cho tm mde vi cy v8 tm quan trong cn vige Inge ede etm nt bit. Vinh 157 Minh hoa eich mje thuat toga hoe tap dy teén bw dé phn tn chia nb king gin di vio thin ef ving. ‘inh 158 ‘Minh os céch thu toéa ling aiéng gn mht ph v0 Kg sian db vio ‘hhh fe wing ke nau nh 159 Vs dy vé mgt md Anh ln su ge mae tw din phn tin Be ch ‘im i inh ea ng kh kh nlm vb vige deo Kin ay hug inh 16.1 Mo hi hw xe stein in ty mio, inh 162 M6 hah 4th e6 hung md t8 vt dy v8 ee thi chay ip we ink 1633 S thw hung bu didn st tag td Hn nb gia: se Khe cia bin ‘ng ping cia bam fe, st kde ea ban hy hs Wide a ing nahiep ca ‘ban he Hin 16.4 Vida v8 eich doe thing tin die nin tit héa tra dB th v6 huts Hinh 165 Vids v8 ofch doc him nog hum tit mt 4th vO busing. Hinh 166 M6 té tre quan ehe dung di Kf hoat wi it hoat trong, mt md ia 6 hing ‘inh 16.7 Vida v8 ich oe ete the tn tt big tr mg dd th v0 hong. Fink 168 Huong din edch xe diab ete duing di kich boat trong mt m6 hinh © dong inh 169 Vicdy v8 céch ge mgt sb thupe inh tied thy in 16-10 Vid v8 ede dB th dy io thé ma td bt ki phn pixie ult mo. inh 16.11 Cée vf de 8 bin di md hin hung that mf hinh v6 bung bing coh xy dmg ee 8 th lin Ui inh 16.12 Chuyén di mgé mo hin 8 hung think md hin e hua. inh 1613 Vi dy v8 ofch a thy nn et iil quylt abip nhdng trong dn gil che ce mang v0 hug, Hinh 16.14 RBM dupe ve duit dang mqng Markov. ‘inh 16.15 Cée mu ue kh tao bai lay miu Gibbs irom hinh RBM 38 1 04 95 ‘07 408 9 so 510 513 515 525 sor om sa Dank sich bia ve inh 17. Cli ding 4 md hy miu Gib tgo re tn ba phn phi, vi chub Markoy ‘ute it go ta ove tong tt ef ee rng hop. ses inh 17.2 Vip mind ha vin @b tpn etn cong m6 hah le ult da ng 546 ‘Minh 18.1 Dido gi pa dummy ulue not eo eé gm nag amg tp Ida yo ‘i pha dan nluc int eo ci ting ang agg ete mau dupe ly miu timo bn 1 ih 182 Mode gi mao. 64 Binh 19.1 Vin dé suy dién kh ti too trong hye shu on Hinh 10.2 Cu trie B th cia mgt md hinh maha thin nj pin wi bia dom vj dn. 573 ih 20.1 Vide vb ofe mo hn duge xiy dmg cya trén RBM. oo. ink 202 MG Blah dé thea mt my Boltzmann da tng wt mt ving Wl kn vb iting in 00 inh 20.3 Mot may Boltzmann da tng, diye sip xp abu 1 cfu te th ha pia ea 6, 07 inh 20.4 Th tye mn yn my Boltmann da ng af phi Lgl tp dibu MIST. 608 inh 20.5. Mink hoa qué ten hon layin da ay dog eho mt méy Boltzmann da - oo nh 208i dy wii 2 iu ch le ap hb, ne intB tat da bin pi oar ‘inh 207 Cie hah a a bs GAN de hud Teen re tp ia TSUN. © || 620 Tinh 208 Mt FVBN dy doin bin th 1 bm ee oa ich 209 Meng ty Ml uy neuron cb a Mah bh equa! gig ai ang mang th uy log. sat ink 2010 Mish ge mang NAD. 635 inh 20.11 Mink pe mt bade en ht Mask er inh 20.12 ink a ve gm nia bn hc nt chy chad Maro ing ety a ol nd tg be a9 Danh sach bang Bing 4 Vid we ink dng if Ke nnn hl ge ot gw mpg oh aa ms ‘Bang 11.1 Anh hutng cita eéc siéu tham s6 lén dung lugmg and hin, 397 Ki hiéu Ching ti cung cp mt md 18 npn gon vce ki fu 8 dupe ing thdng nh trong euén sch my. Ching tl 58 m6 td hu ht ce Kl nig tain hoe dh dy taong ee ehutmg 2-4 86 va Mang (array) al Ign ¥6 huding (tu nguyén hoe iéu the) a Vector Ma trén A Teor Iq Mo tran don v1 hng n of J Ma tyin don vj vi a8 chidu ty thuge nat ei 8) Veetor eo a8 cin te (,..,0,1,0,..,0] Ol 1 8 vl et iag(a) Ma trinchéo wi of phi ti cn dmg chéo chin Lk 4 Bién ng nbién dgng vo hung 8 Bifsngnnbién dang wertor A Bio gu nhién dang ma tr "Tap hgp va 48 th} A Tipton R Typ hop sb the {0,1} Tap gp bao gbm 0 va 1 {0,1,-..9m} ‘Tap ep bao gbm tt ef oc x nguyen git 0 va (a2) Khhodng 6 thye bao gm ci a v8 8 (0,8) Khodng 56 thye Khong bao gm a nhumg bao gen 6 ANB Tap hop tet, neha I t6p hop beo gbm cée phn ti thube A sm king chufe B 9 ey Pag(xs) iit ch cin x; trong 48 thi G Ke hija Aue at a anh eb xb Phin ti citi ea veetor a, dye én el 8 ir ‘Ti ee pint ea vctor a tri phi ir tht ¢ Pn (9 ing hit tht j ia ma trp A ig thi én mi tin A (Cot the in ma erin A ‘Ph 1 3 v tt (,j,k) ela mot tensor 2D A Lat ft 2-D ein mgt tensor 3-D Phin tt thei ea mgt weetor ng nhign a ‘Tofin tit dai a5 tuyén tah, (Chun iota ma trim A Gil nghjch dio Moore Penrose cin A AGB Th theo ting phn tir (Hadamard) ela A vi B det(A) Bint thite ein A Phuong phép tinh (calculus) 2 eo im ea then & ‘Dao him rigng cia y theo = Ye radiont cay theo 2 Vx Ma tra do nim ea y eho vx “Tensor dia dg hn cin y theo X % sn tr Job J ERT" cin FRO Visl2) afc Hie) Ma rin Hue in fh dd di vo 2 JFle}dee) Tie phi xe toh een ton mi ei 2 FeS(z)d(2) Tih pin xe dah cia = ten tp ep 8 1s thuyét xe suit vt Ki thuyée thong tin nub Hal bin nga hin a vb de Isp alble "ai bién ng nhién a va b de Lp eb dig kim Kh Bt Pos) Phin phi xe sult ela mde bin 18 re 248) Phin phil xe suit cia mgt bit lién tye hoe mgt bin e& du een xe din Bi ngin nh a 6 phn phil P Excl] hoe B/(e) KA voug ela J(2) theo Px) Vax(f(2)) Phang sai ci f(r) theo P(x) Cov(s(2),s12)) ‘Hipp phung ex cba f(2) a g(2) theo P(x) (2) utropy Shannon on bin nga nia x DuL(PIQ) DS phn Ki Kullbede Leiber eta P va. Q Gem) Phy pt Gna ca vt ng i ip ng Ham sé F:ROB Ham sh f vl ibn xe inh A vk mia gl tl B Fog Phip bgp cia hai him f vig 8) lim cin x de snm ob hi bi. (D8 Ki hing vitae) bo gun la ah gn Mia) Togs Loar ty ia cia x ci) i og seme hry (a) am ap, ell, Chuan D? cin x 2] Ciuia eta Phin dang oa et mx(,2) emanating v8 © LAM, ching ts dg hi fo 98 8 ng ang i ip dmg ho nt etn ‘mpt ma tron hoje mot tensor: f(z), F(X) hoge F(X). Dik niy biu thi vige dp dung him f ‘theo img phn ti ia ming. Vidu if C= a(X), then C.y4 = oy) dbl we ace Ar hop 1 ins) & Ki bite Poa Pata 2 hte YO ‘Typ a igu vA phn phbi Phin pi sinh di eu Phin phi tye nghiin, dink nga bai tp bun lay Mla tit (in vio) cba mde tp do Ma ‘Nn twong ing ve 2 trong bi von hoe ob gin sit Ma trin'm cm, wi miu dl vo a nm 8 bing X,, Chuong 1 Gidi thiéu "Ti xa nm, con ng A ob we mo tgo ra ahi eB my 6 Ud wing uy neh. Kho Kh niy dived tir thét Hy Lop of dal. Nhimg hinh tuomg thin theo! hue Pygmalion, Daedalus, Heplinestus I cde uhh pt minh vida, v8 Galatea, Tals, Pandora 05 thé die xem nb eh ‘hg thé sng nhs tg0 ((OMOA}; (Spa; [Tan07), [Ngny 3 kh nim chige may tinh ds tn 06K ning Wp tea ge t40 neta 8 ‘hit xem liga ching ob thé ted én thing minh hay Kbdng, eho dé ki mot ob my thong ‘minh mh 3) vong ra dit sau dé ma thé ki ([Lows2). Ngiy may, tf tap nha ta (atic Inelgence (AD) i tod thinb mot Tinh wwe wt wo van tg dang thue tin vi ted thank chi 28 thu itt nigu 46 ti nghién eis trén ton thé gi. Ching ta st dung phn mim thing minh d6 ty dng ha ede cng vige chan ty, nha dang Binh dn, 4m thank, ein don y hoe ‘ii tag nghén ea Koa he ea bin. ‘Thong ning ney di ci ti tu nh go, nginh nay 4S nhanks cng gt quyé him vin 68 tay phi top Bi vei con ngut, hug ll tung dt dan gi wh dy i - hg vin dé o thé difa tf dye bing mt danh sich ahimg quy Init di dyn ngbn ng ta hoe ‘hud te. Tuy nhido, thc thie chye sed tite nha to Ta pi guy hing the vd hye hig v6 con nab hung Khé diéa ti: mot ch chun tie ~nhimg win d& ma con ngiOh dang ta xi I mt ech rt ey abla bling true ge, ching han nu nn dang téng a hog btu dang Kon mt, [oi dung ead sch ny xoay quant mot gi phip cho ning vin dé fy. Gti phip nay eho ‘hep may tinh ty hoe tr abitng kink ng thu dpe vi hiéu hon w thé gl thong qu moe ‘han cp bh nif hierarchy of concepts), trong 46 mBi kh nm (cont) uge nh nghian ‘theo mdi quan hf ea n6 v6 ning khdl nia don glin hon. Bing ech &€ my tinh ty ng tm ehgp tthe Lr inh nghifm, ech Lp ein nly hip gdm bot nl ning eho com ngueh trong vibe m6 tice tr hie chin tht cho may tinh mt ech tug mh, H phn ep Kh niga ch phép my tin hoe ng Kh nin phe tgp Ui hing KhAl nig dan gin han. Nix ining ta we mot db th mia hb pha ep Khai nim my, th db hj 3 o 06 Sti ng, ‘i rt a Vv, ta gl obs igp any IA po su (deep Isaring), ‘i nbidu tho cong ban db cin AI rad trong pg th ng, mt nt rng Kg, 2 hit méy tin phi e6 nbida biéw biét vb thé gil ben ngodl. Vi du, bP théng chet va DespBiue cia cing tf IBM ds dink bel abi v6 dich thé ges Garey Kasparov vio niin 1997 (sw). Ca vas dain I mgt mdi trng dom gn, chi bao gdm 643 vung v.82 quan c, ‘rong 46 mBi quia & eh cb thé di chuyén thoo nhimg quy tée xe dinh. Di sing tgo ra mit ‘én thug chat cb higu qu la me thnh tyo ln, nnmg teh tite King nim 3 vige day cho ‘ny tinh hi v8 fc qin od vi ech di ehuyéa ela Ching. Lust ch ob vua dupe bg dia ou (Chung 1. it tia diy 4 bing mt 6 quy the vA 6 ehé Ip tinh mot céch dB dng ‘To tu thay, nie te wu tri tama, va chun te Kid con ng gp tr mg a 8 ‘hing te vd wt ws my tinh, May tinh ti Iau 486 Kh ning a bal ngud eae ‘yan gti nh, nbing ial eh theo ip tinh dB eda ngui biah thwng trong viée min dang it thé 8 tng nb trong thal glam gin diy. Cue ing hing ney cia mt con ng dt dt de lg ta the kn Yb v8 thé po. Ph én ning to thie my mang tin eh quan eh Dy the vio tr sige en moi ng, nén rit Wh di o6 thé din dat ching moe oéch tung, Ininb. May tinh en nim bit doe mtu thie nt vy UD wid 06 thé ted en thong, tinh. Bann tr the King tung ac vlo trong mie chibe may inh Ja mgt trong ing the che hah tong ngiab te tu mbin tao. ‘Mito dud Ao ging gin cing tri thie vb th pl thing qua ngin ng cn i, a dy tinh 06 thé te dy wb ce ei ea trong ng ng cha the thong qua ede quy te suy Tuan loge. Phung php nly due gol Bk tp cm thing qua oo 30 tr Unde (knowlege bast). “Tuy nen, king me dy a nho trong 6 46 dat due thiah eOng Wn. Mi érong x aang ee of tig mht Ia Oye (LGSM]). Gye TA mgt ong ey suy luge vi KL mot cab du gdm ee bills duge vide Bing ngou mgt CyeL. Nhing chi leh nly due d&l ng alsin win gig i cin Gye da vio. Mla qu tlh iy gan nan. Nei a pip Hh Kin trong wie tao ‘a mhimg quy tie rhe ¢ mi vi phic top A ob ging miu th thé 6 mt ch ehinh xe nh. Vid, oye Khing hifu duge ctu chayin v8 mot naw tén Fred dang exo riu vio bubl sng {{ling2). Cong ey suy Indu eda Gye 48 gp phd mote tiét miu thud trong chu eye: no tide ring eon nex King ef abimg bo phn din et erén co thé, nung vi lie 46 Pred dang clan mat chide miy eyo ris, cho nn 6 eho ring thye thé mang vn “FredihsteShaving" cb ‘data olug bp phan dign i Cho nn Gye track hdl Fredo cb TA con ng ki an ta dong cao 1 hay Khing? [int Ki. ma ee 9 hn te thie win cing gp phi cho thy moth ting AL edn 6 kd ming thu thip ti thie, Ding vibe tich wut ede-md the (pattern) ted ga thd, Kh ning nly ge go ge may (machine learing)-Su-xode hit ca hge méy cho phép may ‘inh gil quyét ee vin ® chn nti tit vf th gi hye vi tu a quyé nh eb quan. ML ‘thuft tn lige may don gl uw ht quy logit (logistic regression) ob thé ein don vb Khun ‘ng o6 nn tye ign phi thot hb tag sn phiy Kh sin hay ng ([Mor+-0]). Me thus ‘adn Mo, gota gn fun Bayes (naive Bayes), c6 thé phn bit mall théng thidag va email the Hig ning cia ahing thuit toga hge my dom in my phy thuge mbiéu wo bid din (representation) cia at iu dia vio. Vid, kt i dng Wa guy logit can don Mak ing, ‘ln pha thot khi sinh, bg thSng AI khong idm tea béah nha met eich tee tép. Thay vio 44, che beat ngp mgt vi thn tin iba quan vao be thing, v dy nh o6 tn tl mo ti cums, hy ktdng. MGi uu ehong tin Hén quan dén bn nh dige got Ik mbt de tren (Feature) Bi quy logit sé ge mdi tag quan gia mB de tg vO nha bit gud ea. Tuy nis, ‘haat tin ny khong thé quyet duh vie eke de mg diye dah nghin thé no. Nu 3 gy rit age cung ebp mt bin chyp MRK eia bok shia, thay vio edo chi tf ci bes, 6 8 khing the dts ta di don chinh xée- Nhitg di ah (piel) dn 1é trong hin ehup MI Chong 1. Git eigu dog 0 niu twang quan Vl ee bién cing 06 thé xy ra trong kh thye hifa pa thus Sic phu thude vao biéu dién Thin tung ph bi trong hoa hoe my tinh vA ee sing ‘hing ney Trong khos he may tinh, nbing thao te ab tim ke tog mot tap gp ge cb thé didn ra nhenh hom theo eip sb nhin nba thp hgp 46 duge t8 cite od edu tee vb ie 1p chi mue mt ech thong minh. Da phi ching ta o6 thi dB dng tye hi ede php toon ‘6 hoe tlm hf chi?sd A Rap nfumg lal mit nbiéw th gian Kh chye ign tm be La Ma. Vay nn khOog c6 agae nhién Ki vgeIym chon eich bid didn of inh hung Lou dén hi sede ‘ea cc thud ton. ge méy (machine learning). Hah 1.1 minh hos mgt vid tre quan, He toa 69 Descartes He toa 60 ove ‘inh 1.1, Vi dy By Ke bit én tt dc te bi do 8h gta ba ph ol al dang iia bang ech v8 mfe ding thing pin tach cing ek. tn (aateplt). Tony ten te, iu de tu lyn band) Deere vg tng pi th dt en Hang tn "al Tiong Rin bs po bid ch Aria rn b tom exe i ln 6 mt dg hg ho ha Dn ek dpe ale dn Hit de 8 p40 ea David Waode are, [hide tc wy tr tup ain tao od thé dune git gust bing oct eit Kl ng de tring ‘Pit hop, x8 cung ep bp ge trang 8 cho nge thus ea hge mnsy don gin, Vi dy, mt de ‘mg hu ich cho te wu nba dang ngut él tir mt dean dm thank lk oO than qui uc tng in ng 4. Bfe rumg nay eho phép ta akin bide duge nga nt mam gi nt bay ange ine ‘Tuy nhl, trong ubiéu te vy, ri hd bide due ta en tfch at ug de trmg no Vida, cing ta mia vit mgt chumag eink phe hia xe hat trong Anh Ble ig se hat od Dinh, nén ta oho ving seule ign eta bénb xe lA ge die time, Tuy nie, wit sé mse ti chinh xie hinh dqug cla mt cde inh x0 thing un gi tr ea fe din inh. Me chile ‘nh xe ef inh dang nt an gin, nhumg nh chyp clin nS 6 thé eed nén phe tap hon nhibu do bing 46 én bn xe, nh ning chi @ ning bp phn kit lage bin xe, ten chic bin cia xo hoe mot vit thé mio dé ehe Khu vi hd phn ea hin e, vA hid th Ke na (Mie ei phap cho vin dé nly Wit dung hoe my A King hit ve php uh x Ur 3 Chang 1. Gis thie i an ta mi cn im ph pp dh ia ny 8 ti cn ung ip che iy’ ig got Bye ts dn (epesenttion lesing). Nog i if oe htm ia gon inde i i eng, Cig cing cb pe eb si Athi nina i ee te vy at 6 ta ean hitomi. Mot tht ane ‘bia i eth tn a bie tr pi op cho ning te wy dong ng vl pat On ‘ling te pte tp, lg ei ch gi tl hing. Te vie a ME ng ‘ec trang cho me vu ph tep yc tht th lan v8 nb ee con thy {hd kn it eg ag dng io cen nin cu tn hing hip ha hi. Mtv ln dnc that eatin oe tif ia i (tence) Mt tx. ni Bt hap ca dt ma he (eer), hit ng bin ai a 0 Ahh nt bi dda he, hme 89 pt ma (Second) ie ng dim i in ‘dang ban dn ty hi de i ny et nh hing tn nt th ei iy in sod an 6 mas hav giana ching cng de uk hy a fe is ny bl tact Tn al la Lt a he Re a aye 8.8 de de ning de ih ong rn i tit Ke me bay he 8 hat tose hoe Be rm, me ea eng a 1c seb fn (ators of ston) tp ith iif quan it. hae Ci 6" Ay st gm ca unt cto) il ah agua Aah bud ig. Nog nd 2 ‘x tg ee dai mg ta Kg aun te Ching th hal da dang ce tug kg th un st aye eng thé do de rong Eg cy amg te ing ng i op ta quan st thi. Ching cn 0 th tn de dang eth {tot con ng pd va cich gi thc dom gin hon bay say dn ang gyn sin ng satu hu thip de Ta ech col eng nb hg Ma io ay ning dang ti ng iy i hich dn rong iia Vi dy HA ph teh mg don ga fl n,n bo gb tal, i, cht ong v8 ning eu tr ange Kh pin tik tae es dp 3 hn nbn tra se quan it ie ev sng ind ng eh. Mot eh thie i wt abit ing dng Aton thee Be whi bi Gn hug toi meting ma ta qua ste Nhe nh rng ie ney eis eat ‘ni th of mau gn vom den nw ue chop vo ben dt, sh ne ne ia chi hy thufe mo ge guna ait. Hb hi le dng dung lve 8c tc dye oe ‘ia bw log hg nn 0 Hag gun rng Ke Dini, vig ch xe ie trang mae co, rt agg dig 0 of hf ‘Dashing i 2, cng gn chi inna wy ch ht pe x nh Kt A ‘oa do nat tinh, ngage cong. KM vie de dg Buc pi op Hs wag dang gi ye bi ok hd, age gn en nh Hn sp die hi obo cing a o (Chaong 1. Git eh Teotnnes ad, “gta ats ink 1.2: Minh ga td hin pe iu, Tht Ks 4 ny ih a dase § agin cin oe tM ds ‘6 0 dng ching han nbn mg, ae i ena nt sp op ese te i ah nh pee dfn Anh in dn and ident) ca wt th hme hm eye pe ap Tee i Ipc ih hm dha mly ev ae nm yt Hh th Hoe ag qt Ks Kt may "ng ch kin nh hm Goh pie tgp en hn Cai ane chute im Ah don gi ie vo na man a hae rat ttn Khe hau es mb Maks De wo de a tng BAG in (vse layer), age ta dt te ar ys ok in wb hag ky etd quan ke Tp tine ie edt ede tng hidden Inger) sp ech ale ob i tang ob a tity usa tS, (Chin ego 1 "ng dn Dw | 8 ng ng my Ring oh in ton i, hy i mb 1a phi eye doh ng kn ty th cng vig a ml Hn rong iu gunn 4 dye. Nhig nk inh yd th a ee de tr dace i dn 8 md tine Titec dla, Aa eo true, cog th le a hd dng nbn r oe cg in, bg ch no a 4 st gi ce ‘hi dh cf wan. Tee cal i gem 4b tng WE ud, gd at ha {ib ding i ra che ge vk in, th dz nha dito ehp hope ce cla i, be ge ‘vil geo al tng do tba, gd th be 0 tpt ena ton th pha a he ‘thf eu the, lng cich tim ed tip hp dug bao va ge ep tae Cob eng m0 th dt dang ce BO Dh cd we theo edge ding 48 phat ke th rang dn, Névng kkk ten age ie keto pipe P14) 2s. Chucng 1. G4 ei ‘He si (deep earning) lit quySt vin trong ten my cia ge bid din ng ch ‘bia din mtd ta nhing ign die don gin hom, Hie at cho pep ny tn ay de ‘ee Minin phe tap tx6n coo 3h ubimg Kol nin om gl hens Hin 1.2 eho Uy 18 ‘hing hge sw o6 thé bidu dn Hhdl nig vB mage bie nk ehyp con ngs blag fc kt gp ‘ee Kh nigm dan giin hon, abit ede ge wi vi, mht Kh nif my gi dae ade dn ir di aig dam gin Ie ca, ‘Vi du din bin v8 mt. md huh hoe shu mang Ten tray Ud da tng (Gd forward deep setwork), hay thing de gol Ik mang pereptron de tng (multilayer perceptron (MEP). Mat MLP thye cht la mt him ton he dal 2 dt liga dn vio $05 ee gi ty dé ra. Ham, 7 duge bop thiub tt ubiog him don gin hen. Ching ta ef thé col mai lin 6p dung mot ‘nim ton hge Ke nau 8 nut ln ds 2a eh bia din md cho diem db vi ‘¥tudug v8 nn cf ge de bidu din dng cho dau da cho temp enn v hoa Me ge mhin he 8 ge wis d6 Ih ds en 08 cho php muy tinh, fmt emg inh hid eng dogn, MBL tng biéu dime thé dupe nem nb trqng thea ahd my tinh sa {hi the hign mt lgt ‘ef ci Ifa song song. Che mang wt ds slim hon 06th the hig ‘hd of nh nm, Ci chub Kn 0 cOng ning rt Kn, bak nhimg ef Ie sn ht dung igi kt gud cia nhing cfu Ie tude, Du ge mhin nay cis hoe su, hing ne hit ‘rng tc thong tin trong ce tn hifu Kick hot (activation) ela mdt ting du ma hd whit ‘ign ob gil ehich dir ign du vio, Biéu didn eng lw tri ce thing tn trang ta isp thu ‘thi mde chong tinh eth hiéu duge di lu du vio. Thing tin trang that ny 06 th emg using v6 bp dtm hay contr trong mgt chwong triah my tn trun thie. DX. dng lam vige Wi nt dung ey thé ea du ho, nung nb ep mo hinh t eit qu tein xi i ‘Géch thite xe ah sa thin, st dung bo ce mind A je st dang (Ap probabilistic graphical model), dinh nghia su ela mgt m6 hinh king pha ld au ca | i tio ton, ma lb 9 sia cia thy mo wn Bm oe Khai nib OL nha. Trong trang hop may, su cia i mab eh qu rin ti tod bid di ea xk Kh nen co ‘thé fan an hla sow hea chin Kh nif 8, bo ech higa ela He dng v eek nidm dan yin e6 thé dupe tinh ein kh ching ta 06 thésn thong tin w8 oe kA nig pe lap hon. Vi dy, Ki ching AT quan sande bl dn a mage adn mt 0 moe ma 9 tong tying ti, bom dl née wha thy mitt. Sow Ki ph hig em ng tong Sac mgt Kinda init, bp théng AT ed thé uy lain sng mhib ki ng oo com st th hal ni dn tone, ‘inh. Trong trang hop ny, dB th) Khai nigm cht boo gm hai tog, me tng eo mit vi mgt ‘tng cho khan mit, ning dB th inh tn ll ao gn tng bu ching ta tinh chin see Iga w i ht nm n tn Mid bite Wnt ke, (C6 bai eich the hioh 8 dink gid sci mgt m0 Rah. MQ dg ta cut fe fla ci thye hi Kil vit mi thy th toin b kid tre. Ta eb the xem né nh 48 dic dng A Al mht trong hu 8b ech tinh dra cia mbt mo hink tag v9 vai ia vb tung ‘ing, Cing ging nh vige hai chum. teinh may tink ging Mba #88 dai ke haw phy thobe vio agin nat dug st dung dé vit ching, cng mot him web hl oki db wi ee su Ke nhau phy huge vio ian ching t due phép ar dung trong, cfc bute don 18 ei a 4}, Hanh 1.8 minh pa vie ya chon ngén ng o6 thé dn et Gs Make nba cho eg mgt _— lr (Chong 2. Git ei Ii te (cae se | tne te to tae ‘cobain ‘con QO AQ OQ & G3) Ge © OOOO. OO inh 1.2 Mink hoa me Bia tink ton a aq. nt db vio lis, wi mdi nit ye Mn mot hip ton a cb dt in due ht a i i, nem pp the nena to Ub de butts tan Bu ren minh he va sad a in ‘ny log 2), rong ah hn slot Neu tihng ph ou, nv hn sg I, ce Dep toda in tong ngbn ng pth, h hid ny hb, Nut cu BL guy Tei ur re pip tone hin hm Rye ed Tit khé o€ xe dinh ge abn no vl su Uk phd gp to = wu cn. tj tn tin hy dn cin md inh 8 the out» 8 bv mnie ch chon tip efe thal pba ca Thin Hae nau dé xy dg dB thi ch ring, sn, nn taking 08 mgt tl chi sxéeduy abt oho mgt kin tri, tug ty nt vie King thn tl mt gt day ali cho 46 ‘di cin mgt ehueng tein may tin. Vi ching ta cng Mag of guy we v8 vige mot ma inh ‘nh th oth dug sem “stu Tuy’ vs a am a, to thé eo hoe sink we melt cu hing mé hinh che rdtnhida ay it hgp cba cfe im lye diz, bode oe Kl at bo (ge, 30 veh che mb Minh hoe my truyén tng "Tom Il, hoes, hi 8 ci enn sich ni, 1A met hung tikp fa dh eho eke Bil ton ‘AL. Ch thé, n6 mt dang ea ge may, mbt hut cho phép he thbng may tinh ty bye tt ‘rd nghigm va. liga. Ching t8i dm ehde ring hoe may 1 hing tp cin Kh thi day aie 448 xay dmg cic hf thing Al e6 thé vim hi trong thé gi thye phic tap. Hoe san TA mat dang. cy thé cia hge may, shu ste mank vay inh hog tuyst wi ehéng au vibe hye edch bid didn thé gi hu mot he phn ep Kt nif, trong mdi Kh fm dg dink nga it ng ki nlém dan giin hon, vi mi bu digo dage tin ton Gt hig big di kez ins tong on ‘ik 1.4 thé ign mf én wé pam vi oi ee inh we ke nha trong AL Hin 1.5 m6 {it gin dB v8 ech hogt ng ea md log a Chnamg 1. Cid tiga ‘ah 1 Bu 6 Venn eo chy hoe sa Ik me dang ye i do, a bye bu i Bm dng Tipe my, mt dad due tds ro wu (hang dng phi ohn 9) ag tp cfu dah ho [AE MB pda ents ab Venn hang oe dhe tebe gh AL a8 Chang 1. Gee C=) (>) (een) (aus) (sate aoa, | (aes) | (lee) (a aoe, | (oars | [ Sa ome) [oe oe IS, emcee Llama ‘Woe wu oni ink 1.5: Bil cho sy mate gin ee th pn kde nb ea mt Eng AL rng in Tak ye, Hin ug 1 daa eb tht phn 6 thd pe de 11 Ai nén dgc cuén séch nay? (Who Should Read This Book?) ‘Guin sich o6 thé eh wrt hid A ewong Aj si, nung ching 8 ung 161 hat 54 tug hin, Tit nh a sinh vig ef trudag dai hoe (hae sa dat hoe) dang fa Bika v6 hoe miy, beo gém abing nsw dang bét du sw nghiep nghlén clu teang Ish wye tx tae baa tao ¥8 bee su. Thal la ede Ki su phiin mam, nh. ng ca oka tite na ng, ‘E boe may hay dg, nung dn nan eng ip th kia tite rong ha inh ey + biti st dng lige si cong sin phim cia minh. Hoe su ching minh tah gu dung, ‘rong nh nh vye phn mf, bao ghm chi gic méy chy aif tha va ign x TF rigbn ng ti nha, robot, tn alah hoe vi ha ge, tsb cl din tong oy tim kim, ling ‘i tr uy vehi, ‘Gun sch my duge cha think ba phn d8 gi dd cho nhidu abi amg doc gi ke nha st céch tt nt. Phin T i thibu ede eng eu ton hoe ea bin vi ung Kha nin ge my bin. Pin Tm th nag thust Ln hoe ab ph biém vi dase pt tein mt ech on ‘hin nt. Phin TH mt hig $ turing due cho li quan trong Kh nghién et hoe su rong ‘uc 3. Chang 1. Gt ein easter — | inh 1.6: Téng quan 6 cy nl dng ch. Mt cies niy testing Kc 6 nga sng tn pidge chav xt pt clam tn md i deca tl < n, Chong 3. Cie thie Bn c6 thé bo que Bit et phn nto trong sich néu Khang quan thm hake khing pit hap os én thie nn ting ea bom. Vic, Ae 8 quen thuge wt da cua inh, xe lt, vk ii nig hoe may ea bn ob thE b8 qua phn I trong Whi dé ahing new chi mabn dp diag lige my ndo san phen sf khdng en quan tim #86 phin IT DE gicp ban Iya chon chums ce Age, cing th cong efp abt lu a8 tng quan thé hin b6 cue nf dung trong se. Ching #0 gi din ing ttc ee ban. dge du 6 hid bit ca bin v8 Khoa hge may tink he Tp tsb, bid bie oa v8 ee wa dB tn quan dn hu su cn tn, I chuyét 8 46 ‘phe tap ela thu ton, phtng Pak tinh eo bin vd mbt 9 ehust ng tong Use 1.2 Lich sit eée xu hung trong nganh hoc sau (Historical Trends in Deep Learning) CCéch dom gi ut 4d hidu vb ge stu 1 tia hiéw i ch leh atc m6. Thay ve lie sit ta ge sw tcc ei ei, ng, 1s tein ay mut val xu hug chin + Hoc sof leh sit au di vA pong phi, ws nbidu ten gol kde nu, pha dab img, ‘quan dim ei hoc Kc aba, vb di te qu ning i ei, ey + Hige a td fn ht fom Kh Ing if uk Iya ny ed ng + Koh thud ela nhimg md Mod tige iu ngay cing tng do cd 88 he ting my tinh (B40 «Bim pha cing vb pba ma) cho hoe au gy cng dupe ed thin + Hoc si dvi dang git aunt shang win d8 phe tap vt 45 chish xe ngy eng cao 1.2.1 Nhiug efi «én va van ménh dang déi thay ciia mang neuron nhan tao (the Many Names and Changing Rortunes of Neural Networks) ‘Ching tl don rng vit mh Qe gi bit hoe shu nhu mst cng ng mdi thi vi, vi qv rt nga nin Kl thy cobn sich dB chp cai “ie sit” che mot nghnh mi a di ‘Thue t, hoe sau 4a aut hign sng nen. 1940 Hge wo v8 nt mt tA ah, Bd ‘in tt aug bit én trong nhibu nm, cho én kin td néa nb iéng, vi eing Wn qua nbid tn got Make man, ch m6 gn dy ng ta mot sir dung thust ng pe su’ Linh ‘we nly di dive di tan abiéu Hin, pba dah das hung a nbibu ub nghidn eu Kise nan vi ahi gée nhin Khe nao Vige mo diy di, chi tt v8 lich sir cia ge sia nim ngoii pham vi en cub sch nay. ‘Tuy alin, huge qua me vt dw me Heh sit c6 thé 8 fe cho ching ta kh im biguvé hoe ss. Nhin chang, trong Ue si boe sf dtl qua ba Tin sng ph eidn: hoe shu ge bie 1 dui fi tén du Rig hoe (ybernetien} trong nig aim 1040-1960, hoe stu due hid ut abe uhin cia. thuyét két nd conneetionim) trong nhimg nim 1080-1980, vb 6 len gin ‘Midis in he su ti km 2006, Hin 1.7 main pa qu sinh phe tia may mgt ech ink oom, a Cuong 3. Ci tiga igo cyt ‘Tn sutcuttny ‘ah 17: Hinh minh boa hal trong bao sng nein ea mg aearon ain tan, de do Wg, (da sule st ibm cin ti ibe Hin hoe”, "thay Bit ni” hay "agag ere’ i te, Googe Books (ln ag thi ba ct wae in gn iy) Ln wing at it wedi id he oa mg ni 1940-1960, vw pt tia cs thay he tp theo ex sinh bg (olga rag) (9) eb) v4 ee hin A in ge hye th abr preepern (Ras), bo php han ye, ‘nt neuron Lin sng tal tu vt hug lp fa theo gp A ab 8 gs doa 180-195, ‘Sn elie cn tht em raya noe (backenropagtion} (REN) ch gy Be ay ‘tag eto mt hae ha ting din Ln sg tb a cing I Hn ig Ba i, ae 8, dt next no nh 2006 (HOTOG|, [Bens], (Rant Oral} vs bday due vt thiah sch vo nen Hah ing hn ing ye eh i mab ot ng en feng gt ‘Mat vi tong nha a tn ge tp (hoe 06 thé di go Mk th dna") sun nitmi eving ta bie dm pling ee m6 hin tinh ton trong och ig tp sinh Boe, ‘nga lis ang mé hnh 0 wing m6 pag ning xy m ong no bp Rh ching ta hoe Ap ‘Vi vy, mat trong ning, ct Lin ma hoe win 43 tig e6 1 mang veuron nbn to (atl ‘neuron network). Ge akin ny cho ring oe hg thn hoe as due My cua hg hit KE wt Bp no sin hoe (nfo gui hoje no cia ning Fal dng vit ke). Meds ching 6 hn Jogi mang neuron duge sr dung 4 tm hiéu v8 cide ning ofa no bé (HSPN), nkimg mane euro nél chung Kang dune thle KE theo mé hinh che ing sn hoe thye hy. Quan dia ‘if dung neuron thin kh nbut ngan im hing cho hoe sin di teen hal § tng, enh. MG 18 hin thin bi mo hin mink ching cho vide td tal me hé tng o6 inh vi thé tinh, vi mt cich dB nbn thiy d@ xy ding infe be tng thing minh I dich ngwye ed nguyen I tin ton ben trong no bi a ego nn stag minh 6 va suo chép che ning ca nb. Hon it, vigehidu nao bp vb ede nguyen te lam nén ting cho tf théng minh ea on ng di 0 cing hij, vi vy ee mo hinh hoe may ngodl kh ming gi quyét nog win dt tht, cn hi fh trong vie wip Tam sing t8 hi ef ht kom hoe oa, ‘Tut ng “hoe stu” gia dy 44 vag ra. ngod ae nin ein hon ge thin ah wee md hi ge may hign tl. NG thin vé mt nguyen te tdng quit han ea vibe hoe, 6 li hoe nhien aly dé trong cfu think cin mgt wt vt hi tye, vk BgUYeD the nay 66 thé dig sp dyng trong cc me hin lige my king My cim ing tr mang neuron thin Kink, Chuang 1. Gitte ‘Tin than cbs hoe a hig da a cc minh ey ti dom ei My cm ng it koa he thn kin, Nhg mb tah 46 duge thie WB G8 uh Qt Sp ald tl da vo 2... cfg nde gi tr bu ray. Ching a “hye” ram tb ee trong 08 (weeht wy. rng ton dra f(2,0) = 210 +m. Ls dg ghia mang neuron db tia by mang ten dibu Kia boc, oh inh tong hi 2.7 MeCulloch-Pitts Neuron ((MP4S)) 1A mot m6 hinh mo phéng che ming no b§ aut hign it som, MG Luh tuyba tinh ny 06 thé abu Bit hal logh Iu Khe nan bang eh Kiem tra xem f(z.) I im hay dug, Tit ldo, df ma hink o thé xe nh ding lol cha du, troag af w od dige hit lbp mt eich chin ae. Ning trong wb ny dupe ei iy bacon ng. Tong ming nim 1950, gis ehnit perooptron ([Ress[Ree2}) i tc thinh md hin (stn 06th ty hoe trong 8 xe dn loa Kh be dir Mud wo Sing 6 mi og, Gi ‘hast phdn 0 tayén tb tich ng (adaptive liner element (ADALINE}), red eng th vi si thustpereepeoa, tr 8 chi gla tr f(x) 48 du dos mt 26 thse ([ WHO) vi cng cb hd ty hoe 48d don nim con 8 6 tii, ‘Nig si thgt he dom gi tn nh dg tnt i enk chang cage my ‘ta dal Ct hud hyn dng 8 cp uh trong rong gi thule ADALINE ti mt tring hap de Bates meal that ep lh tru gradient nyi nh (stochastic gradient sesent). Ce phi bn bien thé intra radiont nga ub vl ce i eho ie at ‘dung rng i abit tong oe 6 hin hoe a gy nay. (em hn dy tri f(2, 0) nh thst perceptron vb ADALINE de ol can cc mé hin tayén th (line model). Ching vin dupe dng ng al tong ee as Ine ny, iy Hing rw hop, cing dagen fy too ahODg ech Khe naw 0 md ink ee ‘ke mé hinh tay tah of nidu hen ch. Nong dé hen ché nf ing ht cing kg Ai hoe tape him NOR, tong 46 f(s ],0) = 1 8 f(140}) — Laing f(y e0) =O F009, w) = 0. Cae ip bin saw ki thy due didn you ny 4 pan tg man 8 {Béng alee sitet hoe My cm hinge alah he (MP6). Ds Uk kn thd nko en {cong qu inh phi en ea mang neuron, [gly may, Khoa ge thn kinh win I agua edm Ing cho ofe nb ghia ci hoe su, hing n6 Khdng cn Ib ngon hil ing dn ding na. [Nguyéin nhin chish lim suy gm val tr cia hoe pe thn Kinh do con ng chua 6 ‘thong tn vé no bo cé thé xem dlc a,b hi mt ech i se ee that ton ma no gu it dung, to chn quan ait host dong ela (ft nhit) hing ng nowon én kt Wat bau mt ech ding thi - me nim vp bét Kk thi. Do dé, ngay of vie ifn nig thant phi don giia va di due oghién oH tg wht trong no bo cng t0 nn ngodl ten ‘Khon bigest ([OPO8). ‘Khoa hoe thin kinh ds tip len hi vong rng mt Thu tos hye su dom 186 thé i squyde mh tc wy Hlde nbaa, Cée nh Khoa hye thin kinh phat fa ea ng ei 6 the “hin bing ving xt I thinh gide trong no bé nba no ching Gage uf a tn ha th ide di tv kta ve ([MPS00). iy cho thy pha én néo ei ce loi dng witb vi, 43 Chong 3. Git eh 6 thé sit dung moe thuft ton dan 18 git quy6t bin hit nig tée vpn cin thye big “Drwie kh gia tye nly dpe dara, vige nein cia ge may bj phn ha Kh 10 of thant hin ong dng nghlén eu ec ih rye on és a gba ng nin, th ge may tinh, hia dang téng néi. Npiy nay, sy ahitng cng ng ny vn edn tich bigt bao, bmg ee ‘hun mghidn eis hye ad dk 8 thé lin vige wi uhidu hoe thm eh tei ee nh wy 5 tinge. Ching tao thé lt kt ge vig ft Kho he thd Kin. Y tng v8 vigenhiéu don vt ‘ink tos tr nn “thing minh” sn Ki tong tae we nan dupe My cm ving bo no ‘ya tren cu tric vt hi cdg th gle cla dag vét eb ve, Fukushima dua ra neooenitron ((Fuk80), mgt tila tec xl Anh mon me vi sou nly te thin nis mag eho mens teh chip hign dai ([LeC+08), cing ta 9 n6t din diéw niy trong phn 9.10. Higa nay bu hit Ingng neuron nbn tgo dé dy tn mot mo binh neuron tn I dow of tap tinh hia hind {cestifed lnvar unit (ReLU}). Phién bin Cogaltroa bax Alu ([uk7S)) Ik mot phign bin phic ‘ap hon vi gi ar hod ton ly ed hin tt ee ee ang no bd. Phi bn hi dai don sin bon dige pit tin dua trén kit hop nbibu§ tg tt ede go nin Khe nha: [NEO] ‘8 (GBBLID, du cho ring koa hoe thin kinh Ia mse ngudn dob huting vi (Jar) dua ra ‘ce nguba dh biting Khe tc Khia nh Ki thst. Du cho koa hoe thin Kiah Ia mot neuen ‘km big quan trong, nhumg nd King phi thi ta chn mn phing chin xo. Ching ta da pt higm ring neuron thye sy cia con gud thye hign vie tin tom theo ech rt Wie $0 wt ‘ce don vj tuyén tinh big cih higa dg abung ede nd Ive bit chute neuron mit cf enh ‘xe vin cua mang dé sy fi thie hu nag. Mie d Khoa hoe thn kiah a. truyda ebm hing thin cig cho mot b Mn trie mng neuron, cing ta win gad hid bide v8 hoe tp sinh ge Sp dg mo ee hut tai hye Ki la ya ec ibm tre Gi rus thing Ung hn mand a twang ng gm no bp vl hge sin. Me dehy ‘ib oe nbd ngién cits ge silky cdm hing tr D6 no nhiéu hon so vi ang inh vy kh fia ige muy may (kernel machine) hay thing kb Bayes, uhung ta Khdng nea coi oe Ss nbut nf pin bit mx png cb no bp. Cc mo hinh hoc ss ign da dang ép dung § thing tt nhidu inh ye, dc bige Ib akong nguyn the eo bn ea toi tng dng nb da 3 tug tinh, ae tu, thay thong tn va tS ea 6. Mit 6 nbd nghién ew hoe su cho eg hoa Big tk Kin I ngutn cima hing quan tong tong a phe tein cia hoe su, ohung mit 8 ke hodn tain king quan thm dé koa he thin kin ‘Cin a rng, con ng vn dang ob yng hida ech nBo bp Lim vige 8 ep gil thus. Diy lh mt ia vie ngign ef te Bit wk hoes, thug duge bide én vd tén gol “kon ‘ge thin Kinh tn ton” Vige ofc ahi ngbién cit ay tin wae aby aang inh Ye av gre li it hal inh ve nay a nym thing ep. Ned hoes cd vu quan tm tv im th8 no 8 xy dmg due moe bf théng my tinh Kh nding i Cdnh cng ee te vy ‘én quan tte tf, trong Khi ngnk Khos hoe thn kinh tink tos Int ch y€0 quan tm ¢ xy dmg cia xe hom ee mo hinh mi t ech the oat dv thue scab no, ‘Trong hip nin 60, tn tht ballin sing nghin ef mang aeuron nln ci yu thong qua thay het nd (connections), hay 2K phan tén song song (parallel distributed procesing) ((RMPS6); [MREOS), Thayée et nis nd len tang Tinh ye bow hoe nba the. Khon hoe Chung 1. it si bin thie 1b mot hung tfp cba tga nginh iim nghit eta tm eri, Et hap whibu ae 39 Dhan ich Khée nban. Diu thing nin 1960, hi hie céc ahi nabién cow Kho ge nb Unde nghién et oe m6 hin sup fukn bid typng (symbolic reaming). DA xét phd blén 8 thai diém ‘oy, ce und nh big egg eng DS Uke trong ve wil thich céch host dng es no bp sit ‘dung cde neuron. Do 4S, nm ney theo they ke nit da bt in ng es mat md Minh nn thee hye ay xoay quanh ef hoot dng thin kinh ({TMAS)), qu Rai quit nhibu $ tov ef nba tm I hge Donald Hebb dua va trong nhimg ns 1640 (Heb). "Ti tg ct icin thay Ita KK 06 ant Ig, Hn ee dn i toi dm gh ‘dried vl nha tinh mpg I, cing thd eb nda thong mink. King dn my dng St ede 8 ko trong hg thin kinh sinh hoe lin eke dam vn cron ee mad hah ta tog, [hin Ih nen ein sae hn trong nguyen ci ehupée et n5l vn dng va ted trong tam trong hoe sit ny ay. MOE trang ab 6 lk tid dn phn tn (tre representation) (HMRSG). Theo 46, robin vio cin mBe he thing dupe bu din bai niu de trang kde bon, visu je trim of thé thom gin bin di nbs didm Adu vo, Moe vi du don ein Sita cb mth thing jie o6 thd ni bit 6 0, xe ti wh chi. Nhimg we cd dy of thé ‘mang min 48, xanh Iye hofe wan dung, Mét céch 4 biéu difn cde du vio ny list dung snd neuron hoje me don vn rng bit, mii neuron ose dan vi dn ay 88 heh boot mbt fron chin his ning 06th xy noe 0 £06, xe td, chin dS, 6 1 xan, vv. Nhu vy, ea cha thin newron ke nha dé béu din dv vio, va mat neuron pha he ede sr KE gp gta mau se vk vit thé mgt cich Age lip. Mot cich tt han B sit dung mgt bi eifm phn tn, wi ba ‘earon m6 tn se va bu neuron mt i tng. Neh tachi cin tug cing sé neuron thay vi chin, vi neuron mx td rae dd c6 thé hoe age me dd tr nh 6, xe tava inh chim, eit king chi hor ah ein ding met log dfs tng. Kh nig bin dim pln tin ‘inh trong tim ci enn sich ni, 88 dye md teh tb hon trong chao 15. (Mok thin tu bt Khe cd phong trio thuyét Kit nd lA ép dung thn céng vlan ‘rng vest dil thugt lan truyén nguge dé hun lyin efe mang neuron dating wi biéu ‘ida noi tai (IRHWA5]); (L4C7). host ton nay tr 6 da tri qua nen thing tran vi tal ‘hn dim ehing ti dang, wiét end sich ay (nm 2016), m6 dang la phon php ci dao 4 Inn lay ee minh oe si, in nh nim 1990, git nghién ctu d o6 nh ta Is) quan tong trong mi hin 6a dni blng ee myn neu. [Hoo] vi [BSFO4) di chi ra mhng Kd hin mt ton hoe Tl an ink ae chu di, nr nd 14 trang phn 10-7. HSO7] dum ra gn 9 nd npn ‘hn hadng dis han (long short-term memory network - STM notwork) 8 gai guy nit val eho kha trong 6 5, Cho dém nay, LSTM a dige 6p dng rng rl tong nhiéu te vu m0 link how chay bo gt niu ee wy x gba nat nin tf Goode “Lin sing nghiin ot mang neuton blo dil én tn gt ng nm 90. Che de nk go ‘thu rag bid vio mang neuron vi ede ing nght AT Ue bit iu pt big ntag chan wong Hing tadg dé ti kid dint Ki ee nghién elm AT Khong th kha tip ng 8 ‘oni 96 i, ede a dl tu bit din cfm thiy ehit von. Glow that di doe mgd he say Ee Ini bt dao nig ein bw. May Io ([BGV92}; [CVS]; [SB599) vk m0 hin ‘th (lord) bu dt duge et qu 6 etn nbidu te vy. quan trong. Nhs. tb ny Ki 4s. Chuang 1. Git eis ‘co qua triah phé cfp mang neuron dl vo thos tro eho £6 nim 2007, ‘rong khong tht gan fy, mang neuron tifp tye dat dude hig stn emg rong nb tc vy (fLeC+98; [BDVO}. Béng gép rit lon cho sy tn tai vk phét toa ma wt cia ‘mang neuron I dy a mang tén Neural Computation and Adaptive Perception - NCAP, duge Vigu Nghién cit Cao ofp Canada (CIFAR) kbd xu, Chung trinh niy da gp ab cc nhém nghién eit hoe ny eis Geofirey Hinton tei Dei hoe Toronto, Yoskua Bengio tai Dal Inge Montreal vi Yann LeCun tai Dai ge New York. CLEAR, NCAP li mgt df in nghlém cf ‘4a ngdn, quy ty abibu ah Khoo hoe thn lan efing nb ee cbuyén gin hing da trong nh ve th ge my ti, Lie yg, vige hin Iuyfn oc mang hoe stu win ge cho fa qua Kid. Cho dn 8 nin 2006, eng ta ini Bit 16 ring ed thaBe tn v8 4b ir nhing mim 1980 hogt ing ki tt [do dom gn la vie thuft tn niy tiga tn qué abi ti guy in ton sown ing hin eng by Ln sng nghién eit mang neuron li thi ba Kbit nguda bude dt phd vo nm 206, Geofirey Hinton ching mint ring mbt loo! mang neuron ob tin IA mang niin tn da tng (deep Delief network) ob thé duge Inn luyBa mt eich ifm qud ab chia luge Aan typ rae ‘han tam theo tng (greedy layer wise pretraning) ([HOT06) an eng th sé md ti chi ist hhon trong phn 15.1 Sau 6, ec nh nghion eu Khde cia CIBAR aban chéng ching int ‘ing 06 che buhay nb logs mang da tng Ke ab wi cia ge tng (Ben +07), (Rass+07e), gdp ft thign kt ning Kl qust hoa ern tap Km tht mot ech 6 be ching Tan séng niy i. gp phin phd ofp vito sit dung thuft ng “age sa" dé alia mga rag ‘ce nha nghién cin gid diy dao} thé hun luyén ege mang newron xin hom eit nh 0 WA tre diy, v8. tr, chi fo thm qua trong vé mt I thay eto 9 sala al ((BLora}; (DBI; Pas+4) [Mout4)- 6 tha diém 46, mang neuron da thng era wun ti 0 wl be he thing AT dyn tra ofe cing neh hoe my Khe cag ub che he chie ning ue ‘hit thi cing. Lin sng nghin eit mang neuron lin thie ba vin dang tip din cho din ‘tt dima ching (6 vét cnn sich niy, ds trong tém cia nghién ctu hoe su da tay di dng, 4 tong kong tho gan dy. Ln sng tit bo ban dw tp trung vo ede KI hut hoe Khe sim sit moi vi tp trung nghién ci kh ning tng quét ha tn ede tap di ligu nhd cia ede smd hinh da tdog, nhimg ngiy may e561 aghiém ci dang dh whi se quan tim cho ee ‘hfe toi he ed gin sit din va tdin ning eam hinges ki ts dung ede tp dit lig lon da diye gan nn, (Chums 1. Git tit en ube he i re bey te) Huh 18: Sy ting tring ein Meh thie A fu gun ek gan, Thong Au ahi nin 1900, oe ti thing Ae npn cin ohtng tp Ufa si dong hing tek ode hing ugha pep do th cong ((Gero Iso [ANDSS; (ris. Tt thi aie 80 dea a thép nid AO, akg ne in png, teeng Th ype ge my yc ag in ie hing lm vibe vk ee tpt nn ln bon nu ede dk bitmap 5 phn gi thp eu be chit re thie Kd yl ph th os Alp aching minh log cle wang neon of hd oc ee a ene th (WHOM), RAIS). Tome hitg nim 1980 1990, hoe my it cy A tng cn eng Be ni dnc thé tn dene au qu che pd on wt hang ce nn de, cng gn epi cit ob vi ay sr (hin 18) (LeC+-98a) Tong bp a ea eh 2, pla fap hm wh ch he emg ty ip edge tae sn eho hn no CIFAR-10 (HOO). Dia ca hp 49h ‘song ain di ning an 201, ee tp dt He wh ich hte nan ng Wh hg en ig

    You might also like