Course summary Here ave the couse summay 2s gvenon the couse in: you wart bra ito cuting-2dge Al ths course il help youd So. Deep kang ensinees ae high sought afte and maceing deep lining wil give you numerous nav cates opportune. Deep ining tao a ‘supepover tht lle you bu Alsstems that ut werent posible a fow yes 290 Inti course you il nv the foundations of deep karning, When you neh th css, you + Understand the major technology tens ving Das Latin + Beableto bull tainare app fly connected dep neural net-ots| + on how to implement efficent (ectore=d nual netorks + Understand the le prams ina neual neve sauce “This couse ao teaches you ho Dasp Letning aca works, rather than pesnting ona cuso1y of surface kvl ‘desiption So after com plting& you wil beable to apply deep baring to ayou oom appatons. youre hoking ‘ora ob in Al ate this course ou il ako beable to ansve bask imei questions. Introduction to deep learning Be able expinthemapr ends diving the re20f dep karin and undead vheteare hot appl ty. ‘What is 2 (Neural Network) NN? + Seale neo Inst regression vthoutappng acthationpeception + Basal single won willbe weighted sum of input!) are then we canst theshollt pradet ouput ina perception eighted sum of input cross thethvesholl, paception fies andi not then perception coast rede + Ptcepioncan ae alas input or book values. + Acualy when wes the peception ouput. + Désdvanageot paception that # on ouput bray valussand ie wy to giesall change in eight ae ia then peceptioncanflp the output We nexd someon wich an med the ouput sight according wo swall, lange inveight and bi. Hee come igo function in picture + Hive lunge paception ith sigmoid function then wecan male sight change in output + eg.cutputin perception of sigmoid output! = 0. sight ctange in veghtand bas, put youslght changed weight and bias output bzomes = 1 butacu ouput O7.Inease a + tte appl sigmoid actiationfircton then Single won wilactas Logit agiesion + econ understand france benven peceptonand signal! function b boting 2 siquoid function graph. + Spl NN gaphe Hidden Input Output © laagetalentiom turabpointcom + RELU stares fo sect nt unit the most popu 2ctiation function ight now that males deep NN tain fate + Hidden yes predicts conection baticn inputs automatically, hats what deep lng & good at+ esp NN const move hen ets (Dapar bye) 2 laagetatenttom opannnet + Fach pt vill be comecta othe iden bet ae the HN will decide the cometions + Supeisd kaming means e have the 0] ae we nas to get the futon tat maps Xt Supervised learning with neural networks + Dire types neural netvotks for superad ting which includes © ClN or comolitinal neal nets [seul incom pte veo © NI Recut neural nwo (Ustlin Speech recognition HL) © Saeed HM (Useful for Stu ct} © Hybideustom Mora Collection of Mis pas + Succ dota ete ctabases ane tbls. + Unstructured data He ages video auto, arto + Stucted eta ves wore money baatze companies ele on pedicon on ts big, ‘Whi is deep learning taking off? Deep kaning tating of for 3 ane: 1 Date: Using this image we can conchae: Scale drives deep learning progress qomidan Gg T + Forsmalldna Ni can perform 25 Lina egyessiono SM (Support vector machined For bigcataa small Nisbet tat SM + For bigcataa big NN benar hata medium NN is beter that all 1 Hopetuly we favea oto data bec the wording the compara ee = Mobis = (OT tenet of things 1 Compueation + GPUs 1 Powerful PU, + Diibuted computing. + Aske ii Algom 2 Cretve abot tas appeted that changed the vay NN wos = Forecample ing FELU function <0 mich bre thn ing SIGNOD function a taning a NN because ithelps withthe vanshing orc problemNeural Networks Basics Leanto.et wpa machine Karing probe witha neural ntvork wind, Lain to ee vactoation a speed up your model Binary classification + Main hei tating about how to da logistic egression to mates bray casi. OK © laagetalention 2hpbigspotcom + Hetaedabout an ecm ple of towing the cuter age contains act orm. + Hereate ome notations: © Wy Sethe ste oft 2 = ( ¥).- 500) + Wewilse python inthis couse + IntlumPy ve can mate maticasand wale operations on them ina stand eae tine Logistic regression 1+ Ago & wel for chssifaton agora of? cz, + Equations © Simpleequation: y= +8 6 Hheisa verry = weranpoceye +8 © Hve med bein between Qand probabil: y = sprit tran 2 Insome rotations th might be say = sgnis(u transpose) 1 While» io of v andveadd 10 «1. bur vewont ise ths notation inthe couse (Ade sa that the fist notion betel + Inbinaychssieation ¥ haste bebenveen @ and + Inthelast emotion « avert hand » 2 ra number Logistic regression cost function + Fist ss function would be the squneot enor: Ly'.9) = 42." = 2 © Burwevent wethé notation because ads us to optin tion problem which &noncome, means i comains lecloptinum pois + Tiss thefunction hat wevil we: Ly) = (Psty") + Gey MeRKt¥'D) + esphinthe bt function ts 2 Biggest valve to besnaler a possible otty-e because tanonl hast value + ThentheCost function vllbe 304.9) = (4m) * suse {A ¥009 + Thess function computes the er for 2 single taining example the cost function ithe average ofthe ss functions ofthe enti ining set. Gradient Descent + Wewantt predict u are» tht minim ze theces function + Ow cos function comer. + Fist weintaize v and » 12000 intalce then 12 random value inthe comectunctionand then 1 im prove the ales the veach minum ale + Inogis agresion pape aays use 00 rsa at acon + Thegaclnt decent agri peat: =. sighs * hv whotealpha the ening ateand y > 2 Wetec andy elects) Than (220s) = aay) * ayI7HG0) + Thevieo ihustatesa big ecm pe Computing derivatives ac — F Se Sareea a5 26201 ven oven | Soin ares + Wecomputethederiatuesona graph tow right fare wilbea lot more casi + ar means thedetiatizes of fra ouput vatable with respect to vaious intermediate quai. Logistic Regression Gradient Descent + Inthe ideo he lexus the drvatives ot radon decent eam pl ft onesauple wth vo features and 2Logistic regression derivatives wy — & wii t Won +b a= o@) {£@y)) we! _ Mb Ye v 7 Gee ee wit, Ady, gar teat ao, o STAR Shh Cubed Gradient Descent on m Examples + essay we have these aril: “o lane of tne fur Festus 4+ Thentom right ek ve illu desvations compare to the su: ‘+ hom the above we can concise the gist region pseudocode: 3) = Sigatettsn +The above code should runforsome Renton o minim 2e eo, + Sothare wil e100 inet oops to in plement the gist ragression + Vectoeaton sso im poranton deep karin to radu oops. Inthe st cde wean mate te whole op inonestep sing veroteation! \Vectorization + Deep kaming shines when the cate ar big, However for oop ill maleyou ait fot ora vcut. Thtey e rec vectoyzationto ge tid some our for bop+ NumPy ayo function ung vectoraton by tat + Thevetotzaton an bedoneon PU0! GPU thought the SH operation Bu sas on GPU + Whenever possible avoid oops. 4+ Mest ofthe umPy ibrar methods ate vectored vation, Vectorizing Logistic Regression + Wewilimploment Logit Regresion using one fot op thn without ay for bop + Asaninputvehavea matic x ards (mn) anda matic ¥ and As (Hy, + Wewilthen compute at instance (2122.2) = W +x (88,8) Thisean bevritenin pthonas: + Vectoring Logistic Ragessions Gradient Output Notes on Python and NumPy + InMumPy, ots.2n(auis = 0) sumsthecolumaswhilec.su(aie = 5) sums the ons. + TntdumPy, 2s. enous.4) changes the shape ofthe matic by broadest the ales + festnpe chap ncakustionsso pitt everywhere youre not sie about the autos, + Bteackastng werls when youdo 2 mati opetion wth matics that doesnt match forthe operation in thiscase Nun, automata males the shapes rend fr the operation by broackastng the vals. Ingener principle of broadcasting. Myouhavean a.N maticand youadel) or subtract) or multiply or duit) vith (I wat then the villeopy fm tines ino ann. matic The same with fou we those operations witha (a1) matic then ths willeopy it times im fa, ri mati Ae then app theadkdtionsubnaction ant nuitpliaton of diison element wee Some tks elimiateal the strange bugs nth code: © Hyoudeint spect thestapecta vector, twiltalea stapeot (a,) andthe tanspaseopertion wont wo. You vet restape tio (3) © Ty to motwethe ak one matic in ANN © Dont hestateto ue sear(a.ape == (5,1)) tochack your matic shape’ the aquired ore © youve founda rank one mati ty to run tape ont Jupnet Python notebooks reso welt in python that males tas to magiatecode and document atthe ‘aime tive Kune inthe bree and doen’ paca IDE un © Toopen ute Notebook, open the comand ean al supernates should be alld to wok ToCompuethedeatieot Souci + Tomaleanimageot (ust, telhtept) bea vero seth: = smge recap lnage. shape} nage. chape)sinage.stpe2].2)_trechages te Sage + Grint descent cones fst ater nomaleaionot the input mates General Notes 1+ Themain eps tfor buiinga Neural Netvon ate © Deine the model