ssanhen- (Page No.

Data.:
_
Page No.
Date

ren
. 2 Desian Bayes classik1erito:reco RCXs)=
minmi
minioite
immend decisions+h9t
expec-ed sk
some:ola
he Nerall_risk,RS
The simplest risk1s Le ce all candi. he Suma
risksRKil
assseiaed Oth_slassi}-1saion
erro
he risk include_he ceSH 9o
cigted oitb. difterent decision.
The Boyesign deCS10n_ule becomes
Suppose de hgve.Ssaes o select he gcHon di for_hich thbe
nature Cecaeaaries) condiHo nglisk R(i is
minimum:
Thot is the gcion iGe decideoi
|A

he
feature yector
=
poss b)e
X1Za
gcHon
- - Xd

X=3dd--- a
And be loss 3A(i] 03)
incrreg r aking_gcon Xi
hen he_siate ok gture 1s
The caDditional risk R_ (x )
rseleat_he actio n i13
1Nen by
 Pago No.
Data:
PageNo.

3 iide o shir minan

naie 0o diSerimin There is4 options
uncion.- kn to clas
SopHon Ls0e can
We can detine as iscriminon have
unctoD i(a=p(ojx)
A unctian a a se aVorniabe _i (s= p(alOi). po1)
thal is evaluoied arSampie ot
eyen ar oiect and USed a an 1 aptonjs-
aid óndiscriminaiDg_bett) een or
classiping- them i =-R.(&ilx)

so here gi(a s mgximum e can_

Hake hot carresponding decision
(gy()can be ised asdiserimina-
tive incton dheregs9ics) is_
maximum then giC)) is maximum
Here s Unknouan eoture yeckor
X

ond or every cla3s Di compuHni p (oilx) =pCcloi) P(Oi)

auneHon gi(e, dhicheyer i bich posteriocpmbabilit
unout o he maximnum decisloN
in ovour o that perticular e condider apHon
class_ sr ha perticulor udj Naturali lbais used oitb tbi un?
p(ilx)= PCax loi) pCO)

naxinum kDO apTons1

-8iil laip(aioi)+ lsg p (oi-
Coc)
de This is discriminant
ncons
 Page No.
Data. _
Page No.
Date:
-
5 hat oil be he nature adecismo as)iZX-iz'u+inLe(o
surkace dhen the coyarience e mal
o ko diterent classes 15 go acH similau for j
identisel toe9ch _ather ) Deriye
is e9yolionaith +he belp of s
Sxomple._

Eor al hose conponernt ofI

eeiure vecior A the yarience is ac)-Cuiz'-4fEH1uui-_
Same hotcas gll be dlSaongl
element udbich_ gre non-zEro shey
i be eqygi
PCO)
ierent campaneni oFeatun
Nec lor illbe sta isticoliy
inden d noteyen
indepe
necesgorYVhai
Reptete =
Compnent il he's9meiYgniene. -
acz=E'(ui- x
( =u
np(t0i)_
P(oJ)
o
Uhere.
i A Replace by Zi ECI

3c=Jia)-3s)=a . 20
in PcOi).
Po)
eqyA 2 8 put in'squ O
 Pago No.
Date. I

PagoNo.
Date

Mulliply hy
MeabaHa)=lT
= (ui-u'x -1(Ui- i-Ht
in P(0i= ou 3
P()

A}ter simpiiFication de a0rite [X-lX-U,JE=

cox-xo)=o HS-31
(U-J) M

Luitu)-n (Ui-
(-)si)

Example

.3-4l3 -4J
M2 1[i-11L

Ma
Mear l) =1
1

.
 Page No.
Data.:
Page No.
Date

a-[Xa-A Ma Xa-lalxa-a.
T22] L4-13 Li-13J

M+M+Ma t M4_
E Ma X-N] [XG-a

L1o-3
IS-13JLis0-21t
-13J

or 1

No. Ja
M -UYh]

MitN2 + M3 +M
l 4} -
13JII -13J

2 [-2 -211 60J

4J here
 Pago No.
Dato.
Page No.
Date

Naure at baundoy Q.6Explain is is4he role Mahalo-

nabis distanre nminimum stahalo--
passes }hrouah Xo- lassitier eplain n detail. dislane
linkina ram Lo l > oLnlmundistSNLE_Sgssiicatiac
rle here he sStance hat you gre-
coopuHng S he eculisian sistan
he he unknon Nectr X gnd he
means O the claSes
Tn other ase
ahere the coyariance-
rmatrix ia he siasses or Samc_
gll
|but_he com ponent othe egture
Nestor maynot be_statisHcally
independentthat meana a} dizanal-
element o hei covarience mgtfix
mayheinon-zer0:
7 r
under thissitugton the assunptiin-

aund tha deciSian b0Undary

bisector a he line 1oing uI4 J.
is bisectbutnot g ethoons
Ho the line jainingiA-
sipier
clgssS1
he he minmym_disance
easyre by! 4 is nofesulidian
 Pag No. Page No.

Data. Dste.

stance any matethiS rs ne

arest nei
ashorfD0te Sn nearest
dlsiane
s knodn as maba donohis iston hhouurrule
1e allkaboui he siSCriminont.
unstioo dbich legds fathe decisisn
houndaryibetieen heit0o ditterent
clgsses:

To the nearest neighbour rule he

coyarisnie mgtrX af all +he diterent
classes ae 9me_ans ofBesnrm
T means ths ditterent com=
So ahelon9sto class panent afthe yecor abers staisti
cally1Odependent ond all athe
lAlhen he caNarjance mgtrik iSii component have 39ne VaE9ncS
ia the form he T land assy hich1s equalo g2I abere
mina hot 1s equg to 1
Tis unily ngtrix
mahalanohisdistance sill bse sane
seculidian distanre. The prior prababilty afths classex
eCi=p(a the decision boundary-
bere matrix zi
he.coygrience betthe classe i O 0as a
al theclosses more IS
byE Phe inegr boundery
may nat and td9s perpen-
feature ectarLCompanenti dicular the linear haundar neon
be stazlicallyindepen deni_in- pointot uignd ly
hiscage it is mahalanabisdislast
 (0

(D

LELL
 Paga No,
Dato
Page No.
Date.

Among be
Compuie a aknu
Yaie
mberia maaes
vade hat is dhiiheve Hhat haha is heiinear sassiier2
A
slgss
closs_st image is malarHy Lproblem 2DISCUSs îndetaii
In
Knumbe r. of maseS gnd conside ha
is unknonimaa }6be In incar clgssiier-2
classikied o hat Corresponding alll te Vec-ar ore tineaily Seperq-
eless. ble
Thispericular gX t bxtC20
case you nd Ha
he oUE s gll
these iimagc dhich
here
s
ore nearest Cab orientation_change
position ch9nge.
al his images dhicb idhere
inearest fo. bis nkn0.unimaaes
have O0 imgge obich_ belon S
to bird u0 rom soqiandi rom
carclassS
Bo bs car lmajes re în malarit
So ciassibY hS Unkhoidn imgge
Ho be i one óphe c9ri\ 9aEs And- oearr -
In clgssitler 2 class_insteo
class1icat0n in his_Is correch campui ngi tho3e distgnces or
SaVina all tbis :{eature vector in
Soknegres} ineighbaILrulein computer nemary instead of thesE
general giNes beLer resulu Hhan tins out aboundary
neare3tneighhourl'rule because bskieen hese
2casses.
a gre faking esicionbsses
da on Hhe mulipiseinumberi a AHe hal assuming that l heie
im9e or muiipleDumber
yecar_
at- eaureiNeckar are inegrySeprablk.
egiure ansepra e these 2 elgsSes o
 Page No.
Dato.: Page No.
Date.:

eaure vecor by 9
in toodinentionallineai 6ouns Need aure Nectaiaf too dikkereent
be sraia ht inein caSe it oil lasses ansassumingtbat feature
seit 3-dimensin
oill_bp hyperplgne. Veeto grelinearly Sepable.

The linsar boundary in_case

2dinension_case he eqy) oFof s WEy + Ws20
bauneary oill be
>amneter are dbere gbs plane the sáture Space
deyide
abis ortboganai o he seprg Linto 0aibalf space one hal
Hna line and crepresernti the Space1s +Ne sanather is -ye
positon a he line în 20
Ob iS Vary orien tation is die
estre yectOL Haken romclass cO
heybelang to Ye
bal
s yvary
orientation s
diterent
sSpace
belons to a ins+ie 2spgce
in ca3eo aD Spqce_mylHdimens lon
Lkegture yector +he eg is

his squatio0 simila

the decision_ bounday bet?lo
rent claasesusiDanarma
mullivarte disribyton
2
 Paga No.
Page No
Dato. /
Date.:1

the equation_OL Robust

Derive Dot product Af ector X-i with
2
Linear BounsarySIN i marin inthe_direction o
equaion X+- X-\
Yi(a'xith)20
Thedistence ak se pratinJ-Planhe
hreshalg atx-+b=-1
shouid be mare hgn
Subtract om
ati+b=o 'aninj-
aXith> d 2Tue torall
S9mples. diyided by lg
gtxi+b 4-d
X+ X-))=2 Ckineti
huS
y:atx+b)>dL
Y atx+b)S Cpotentioenert

he sSeprating plane sbould be. by usiDg leannges equuation_-

chasen guch aS
attb=o-
Y: CatX+h -ater norma itation
a iLyi (otX}+b)-11-
=o
-atxi=L-
iYi xi
 Page No0.

Date.
1 Page No.
Date.

3b Q.4Explaino detailisctiminant u
Unde mulHNarige normgi:distribu
ion
XiYi o
enye he eaugHon_orecision
sulece using nulHyarig tendLm
L lal-sKi i atxitb)- L Jistribution or thegiven mage
put a in y .

Diserininant uncHon
1
Soi ioYiYI XiXi I} eassum perticular .disttl.
hution unsian prababliydensiy.
uncton dhich usually ede Use as
Ihis is Hhe Robyst lineQ boundan hormg prababilitydensiy
unction
e all knn hat he narma isiri-
butionip Ihane single vaniabls
sayip -
 Page No.

Dat. Page No.

1_
Date.

xp( Cx-u20)
d numbér a eature snbich arex
Dackedino this egure veciar
SA A muHNa N ie norma siari-.
dhere 0snthin butsiandard 9yen by
buHon
deiaHon gnd giS be varence
and J is meán exp -1/a. (a-u)tži
(aT)a fs:)a
Ca-u)11
ean o that iS u isdepend
and Nalue a his envelap epend
upon
. Nalue_af c9nd ri P (li ep /2 (-UiJt

- Cx-uJ202
z -i)
PC)=
2TT COVareue_Inq meas ure of bao
much2 random Narisble Nary
Hoge thtrdbtre variene s ho
2 Nariable Ngry gether
PCa)
i) p (ilx)= P (slsoi) p(i

I) =in p (0i x) n p(0i)

SoHype a sistribution tbat is. (a-i)'S'(a-n11
mpatant inOYr case.is at 9p
asisle veriontdistibytion
but it is mut aHen istrib
jon
 Page No.

Date.

(a-ui)E (-i+n PCO