This full text paper was peer-reviewed at the direction of IEEE Instrumentation and Measurement Society prior to the

acceptance and publication.

$'HHS&11EDVHG0XOWLFODVV&ODVVLILFDWLRQRI
$O]KHLPHU¶V'LVHDVHXVLQJ05,
Ammarah Farooq1, Syed Muhammad Anwar2, Muhammad Awais3, Saad Rehman1


'HSDUWPHQWRI&RPSXWHU(QJLQHHULQJ&(0(1DWLRQDO8QLYHUVLW\RI6FLHQFHVDQG7HFKQRORJ\1867
,VODPDEDG3DNLVWDQ

'HSDUWPHQWRI6RIWZDUH(QJLQHHULQJ8(77D[LOD3DNLVWDQ

&HQWHUIRU9LVLRQ6SHHFKDQG6LJQDO3URFHVVLQJ6XUUH\8QLYHUVLW\8.


Abstract²,Q WKH UHFHQW \HDUV GHHS OHDUQLQJ KDV JDLQHG
KXJH IDPH LQ VROYLQJ SUREOHPV IURP YDULRXV ILHOGV LQFOXGLQJ
PHGLFDO LPDJH DQDO\VLV 7KLV ZRUN SURSRVHV D GHHS
FRQYROXWLRQDO QHXUDO QHWZRUN EDVHG SLSHOLQH IRU WKH GLDJQRVLV
RI$O]KHLPHU¶VGLVHDVHDQGLWVVWDJHVXVLQJPDJQHWLFUHVRQDQFH
H[DPLQDWLRQ 006( QHXURSV\FKLDWULF LQYHQWRU\
TXHVWLRQQDLUH FOLQLFDO GHPHQWLD UDWLQJ DQG RWKHU
SDWKRORJLFDO HYDOXDWLRQV 1DWLRQDO ,QVWLWXWH RI $JLQJ
$O]KHLPHU¶V$VVRFLDWLRQGHYHORSHGWKH ILUVWFOLQLFDOFULWHULD
IRU$'GLDJQRVLV>@,QDGGLWLRQWRWKHVHFOLQLFDOPHWKRGV
LPDJLQJ 05, VFDQV $O]KHLPHU¶V GLVHDVH FDXVHV SHUPDQHQW PRGHUQWHFKQLTXHVXVHYDULRXVLPDJLQJWHFKQRORJLHVIRUWKH
GDPDJHWRWKHEUDLQFHOOVDVVRFLDWHGZLWKPHPRU\DQGWKLQNLQJ SXUSRVH 0DJQHWLF UHVRQDQFH LPDJLQJ 05, DQG SRVLWURQ
VNLOOV 7KH GLDJQRVLV RI $O]KHLPHU¶V LQ HOGHUO\ SHRSOH LV TXLWH HPLVVLRQ WRPRJUDSK\ 3(7 WHFKQLTXHV DUH SRSXODU DQG
GLIILFXOW DQG UHTXLUHV D KLJKO\ GLVFULPLQDWLYH IHDWXUH
QRQLQYDVLYHO\ FKDUDFWHUL]H WKH VWUXFWXUH RI EUDLQ
UHSUHVHQWDWLRQ IRU FODVVLILFDWLRQ GXH WR VLPLODU EUDLQ SDWWHUQV
&HUHEURVSLQDOIOXLG&6)DQDO\VLVLVDOVRXVHGLQSUDFWLFH
DQG SL[HO LQWHQVLWLHV 'HHS OHDUQLQJ WHFKQLTXHV DUH FDSDEOH RI
OHDUQLQJVXFKUHSUHVHQWDWLRQVIURPGDWD,QWKLVSDSHUDZD\
FODVVLILHU LV LPSOHPHQWHG WR FODVVLI\ $O]KHLPHU¶V $' PLOG 7RQJHWDO>@SURSRVHGDPXOWLPRGDOIUDPHZRUNZKLFK
FRJQLWLYH LPSDLUPHQW 0&, ODWH PLOG FRJQLWLYH LPSDLUPHQW ILUVW FDOFXODWHV SDLUZLVH VLPLODULW\ RI IHDWXUHV IRU HDFK
/0&, DQG KHDOWK\ SHUVRQV ([SHULPHQWV DUH SHUIRUPHG
XVLQJ $'1, GDWDVHW RQ D KLJK SHUIRUPDQFH JUDSKLFDO
SURFHVVLQJ XQLW EDVHG V\VWHP DQG QHZ VWDWHRIWKHDUW UHVXOWV
DUH REWDLQHG IRU PXOWLFODVV FODVVLILFDWLRQ RI WKH GLVHDVH 7KH
SURSRVHGWHFKQLTXHUHVXOWVLQDSUHGLFWLRQ DFFXUDF\RI
ZKLFKLVDQRWLFHDEOHLQFUHDVHLQDFFXUDF\DV FRPSDUHGWR WKH
SUHYLRXV VWXGLHV DQG FOHDUO\ UHYHDOV WKH HIIHFWLYHQHVV RI WKH
SURSRVHGPHWKRG
Keywords—Alzheimer's disease; deep learning; MRI; multi-
class
, ,1752'8&7,21
PRGDOLW\ VHSDUDWHO\ DQG WKHQ FRPELQHV VLPLODULWLHV IURP
GLIIHUHQW PRGDOLWLHV LQWR D XQLILHG JUDSK IRU FODVVLILFDWLRQ
XVLQJ QRQOLQHDU JUDSK IXVLRQ WHFKQLTXH 6LPLODUO\
6RUHQVRQ HW DO >@ FRPELQHG YDULRXV 05, ELRPDUNHUV
FRUWLFDOWKLFNQHVVPHDVXUHPHQWVYROXPHWULFPHDVXUHPHQWV
KLSSRFDPSDO VKDSH DQG KLSSRFDPSDO WH[WXUH IRU PXOWL
FODVVFODVVLILFDWLRQ=KDQJHWDO>@XVHGDFRPELQHGNHUQHO
WHFKQLTXH ZLWK 690 FODVVLILHU WR FODVVLI\ $' DQG QRUPDO
7KH FRPELQHG NHUQHO LV PDGH E\ D IXVLRQ RI IHDWXUHV IURP
WKHDERYHPHQWLRQHGWKUHHPRGDOLWLHV
 7KH ODWHVW UHVHDUFKHV LQ FRPSXWHU YLVLRQ DQG PDFKLQH
OHDUQLQJ DUH PRWLYDWHG E\ QHXUDO QHWZRUNV DQG GHHS
OHDUQLQJ 'HHS /HDUQLQJ LV D UHSUHVHQWDWLRQ OHDUQLQJ
$O]KHLPHU¶V GLVHDVH $' LV D QHXURORJLFDO EUDLQ WHFKQLTXH ZKLFK DOORZV D PDFKLQH WR OHDUQ GLVWLQFWLYH
GLVRUGHU ZKLFK FDXVHV SHUPDQHQW GDPDJH RI EUDLQ FHOOV UHSUHVHQWDWLRQV IURP UDZ GDWD 7KH UHDVRQ EHKLQG WKH
DVVRFLDWHG ZLWK WKH DELOLW\ RI WKLQNLQJ DQG PHPRUL]LQJ ,W SRSXODULW\ LV WKH KLHUDUFKDO DQG OD\HUHG VWUXFWXUH RI WKH
EHJLQV ZLWK PLOG GHWHULRUDWLRQ RI QHUYH FHOOV ZKLFK
JUDGXDOO\ OHDGV WR LQWHQVH IRUP RI GHPHQWLD PDNLQJ D
SDWLHQW XQDEOH WR SHUIRUP WKHLU VLPSOH GD\ WR GD\ WDVNV
$FFRUGLQJ WR $O]KHLPHU¶V DVVRFLDWLRQ $' LV WKH VL[WK
OHDGLQJFDXVH RIGHDWKLQ8QLWHG6WDWHV>@,WLVFDXVHGE\
PDQ\ IDFWRUV DPRQJ ZKLFK DJH LV WKH PRVW VLJQLILFDQW
3HRSOH ZLWK DJH JUHDWHU WKDQ  DUH DW D KLJK ULVN RI
VXIIHULQJ IURP WKLV GLVHDVH >@ 7KH EUDLQ FRUWH[ RI WKH
SDWLHQWVKULYHOVXSDQGVHYHUHVKULQNDJHRFFXUVSDUWLFXODUO\
LQ WKH KLSSRFDPSXV DUHD 7KLV UHJLRQ LV LQYROYHG LQ
WKLQNLQJ UHDVRQLQJ DQG PDNLQJ QHZ PHPRULHV %UDLQ
YHQWULFOHV ZKLFK SURGXFH FHUHEURVSLQDO IOXLG DOVR EHFRPH
QHWZRUN&RQYROXWLRQDOQHXUDOQHWZRUNV&11DUHLQVSLUHG
E\ KXPDQ YLVXDO V\VWHP DQG OHDUQV WKH IHDWXUHV WKURXJK
FRPSRVLWLRQDOKLHUDUFK\RIREMHFWVWDUWLQJZLWKVLPSOHHGJHV
DQG PRYLQJ WRZDUGV PRUH FRPSOH[ IRUPV $ VWDFN RI
FRQYROXWLRQDO DQG SRROLQJ OD\HUV DFKLHYHV WKLV (DFK
FRQYROXWLRQDOOD\HUILQGVORFDOFRQMXQFWLRQVRIIHDWXUHVIURP
WKH SUHFHGLQJ OD\HU DQG SRROLQJ FRPELQHV WKH VLPLODU
IHDWXUHV LQWR RQH E\ GRZQVL]LQJ WKH IHDWXUH PDS >@ 'HHS
OHDUQLQJ KDV DOVR VWLPXODWHG WKH QHXURVFLHQFH UHVHDUFKHUV
DQG WKH\ VWDUWHG WR ILQG WKHLU VROXWLRQV IRU SUREOHPV
DVVRFLDWHG ZLWK QHXURLPDJLQJ /XL HW DO >@ XVHG ]HUR
PDVNLQJ VWUDWHJ\ IRU IXVLQJ GDWD IURP GLIIHUHQW PRGDOLWLHV
ODUJHU LQ DQ $' SDWLHQW $ ZHOOWLPHG GLDJQRVLV RI WKLV DQG WKHQ WUDLQHG D VWDFNHG DXWRHQFRGHU 6$( QHWZRUN IRU
GLVHDVH LV FUXFLDO DQG UHTXLUHV JRRG FOLQLFDO DVVHVVPHQW FODVVLILFDWLRQ,QDQRWKHUZRUN/XLHWDO>@XVHGWKHLGHDRI
EDVHG RQ SDWLHQW¶V PHGLFDO KLVWRU\ VHYHUDO XVLQJPXOWLSKDVHIHDWXUHVIROORZHGE\6$(DQGDOLQHDUDV
QHXURSV\FKRORJLFDO WHVWV VXFK DV PLQLPHQWDO VWDWH ZHOODVVRIWPD[FODVVLILHU7KH\WRRN006(DVORZOHYHO

978-1-5386-1620-8/17/$31.00 ©2017 IEEE

 'DWD 3UHSURFHVVLQJ 'HHS
05, 6FDQ DQG &RQYHUVLRQ WR *0 VOLFH &RQYROXWLRQDO 'LDJQRVLV *URXS
' VOLFHV 1HXUDO 1HWZRUN $'0&,/0&,1&


)LJ7KHSURSRVHGGHHSOHDUQLQJSLSHOLQHIRUZD\FODVVLILFDWLRQRI$O]KHLPHU¶VLQWR$'0&,/0&,DQG1&

 
IHDWXUH DQG KLJK OHYHO IHDWXUH LQFOXGHG PXOWLPRGDO
QHXURLPDJLQJGDWD6KLHWDO>@LPSOHPHQWHGPXOWLPRGDO DUHSUHVHQWHGLQWKHIROORZLQJVXEVHFWLRQV
VWDFNHG GHHS SRO\QRPLDO QHWZRUNV 6'31V IRU
FODVVLILFDWLRQ7ZRVHSDUDWH6'31OHDUQWIHDWXUHVIURP05, A. Data Preprocessing
DQG3(7GDWDDQGWKHRXWSXWVZHUHWKHQIXVHGDQGSDVVHGWR
DILQDOVWDJH6'317KH\DFKLHYHGDERXWDFFXUDF\IRU  05, VFDQV DUH SURYLGHG LQ WKH IRUP RI ' 1LIWL
GLDJQRVLQJ $' IURP QRUPDO +RZHYHU UHVXOWV RI WKHVH YROXPHV $W ILUVW VNXOO VWULSSLQJ DQG JUD\ PDWWHU *0
UHVHDUFKHV ZHUH DV JRRG DV UHVXOWV IURP XVLQJ LPDJH VHJPHQWDWLRQ LV FDUULHG RXW RQ D[LDO VFDQV WKURXJK VSDWLDO
SURFHVVLQJWHFKQLTXHVIRUPXOWLFODVVFODVVLILFDWLRQ QRUPDOL]DWLRQ ELDV FRUUHFWLRQ DQG PRGXODWLRQ XVLQJ 630
  WRRO *0 YROXPHV DUH WKHQ FRQYHUWHG WR -3(* VOLFHV
 $ JRRG LPSURYHPHQW LQ FODVVLILFDWLRQ DFFXUDF\ LV VHHQ XVLQJ 3\WKRQ 1LEDEHO SDFNDJH 6OLFHV IURP VWDUW DQG HQG
LQ WKH ZRUN E\ *XSWD HW DO >@ ZKHUH WKH\ ILUVW OHDUQW ZKLFK FRQWDLQ QR LQIRUPDWLRQ DUH GLVFDUGHG IURP WKH
EDVHV IURP QDWXUDO LPDJHV DQG 05, VFDQV XVLQJ D 6$( GDWDVHW3URFHVVHGVOLFHVIRUHDFKFODVVLVVKRZQLQ)LJXUH
QHWZRUN DQG WKHQ FRQYROYHG WKHVH EDVHV ZLWK 05, GDWD WR
OHDUQ IHDWXUHV ZKLOH WUDLQLQJ 7KH\ REWDLQHG  DFFXUDF\
EXW XVLQJ RQHYVDOO VWUDWHJ\ IRU WKUHH FODVVHV 3D\DQ HW DO
>@XVHGVLPLODUPHWKRGSHUIRUPHG'FRQYROXWLRQRISUH
WUDLQHGEDVHVZLWK05,GDWDDQGSDVVHGWKHIHDWXUHPDSVWR
IXOO\FRQQHFWHGQHWZRUN7KH\DFKLHYHGDFFXUDF\IRU
FODVVLI\LQJ$'0&,DQGQRUPDOLQDVLQJOHVHWXS+RVVHLQL
HW DO >@ H[SDQGHG WKH FRQFHSW RI XVLQJ SUHWUDLQHG EDVHV
DQG LPSOHPHQWHG ' FRQYROXWLRQDO DXWRHQFRGHUV &$(
ZLWKWKUHHGLIIHUHQWVFDOHVWROHDUQIHDWXUHEDVHVIRUWKHWKUHH
FRQYROXWLRQDO OD\HUV RI &11 DUFKLWHFWXUH 0XOWLSOH IXOO\
FRQQHFWHG OD\HUV ZHUH XVHG RQ WRS RI FRQYROXWLRQDO OD\HUV
  
IRUFODVVHYDOXDWLRQV7KLVPHWKRGLPSURYHGWKHDFFXUDF\WR
+RZHYHU6DUUDIHWDO>@ZHUHWKHILUVWWRLPSOHPHQW
WKH GLDJQRVLQJ SLSHOLQH ZLWK SXUH &11 DQG ZLWKRXW DQ\
SUHWUDLQLQJ7KH\WUDLQHGWKHLUQHWZRUNIRU05,DVZHOODV
UHVWLQJ VWDWH IXQFWLRQDO 05, GDWD VHSDUDWHO\ XVLQJ /H1HW
DQG*RRJ/H1HWPRGHOVDQGDFKLHYHGEHVWUHVXOWVIRUELQDU\
FODVVLILFDWLRQ
 ,QWKLV ZRUND &11 EDVHGSLSHOLQHLVLPSOHPHQWHG IRU
PXOWLFODVV FODVVLILFDWLRQ RI $O]KHLPHU¶V GLVHDVH 0XOWL
FODVV SLSHOLQH LV D ZD\ FODVVLILHU ZKLFK FODVVLILHV $'
HDUO\ DQG ODWH VWDJHV RI PLOG FRJQLWLYH LPSDLUPHQW DV 0&,
DQG /0&, UHVSHFWLYHO\ DQG QRUPDO FRJQLWLYH DV 1& 7KH
  
UHVWRIWKHSDSHUSUHVHQWVPHWKRGRORJ\DQGLPSOHPHQWDWLRQ
LQ 6HFWLRQ  H[SHULPHQWV DQG UHVXOWV LQ 6HFWLRQ  DQG )LJ*UD\0DWWHUVOLFHVIRUHDFKGLDJQRVLVJURXS
FRQFOXVLRQLQ6HFWLRQ DIWHUSUHSURFHVVLQJTop left: AD, right: LMCI, bottom
left: MCI, right: NC). ,PDJHVDUHYHU\VLPLODUDQG
,, 0(7+2'2/2*<$1',03/(0(17$7,21 UHTXLUHKLJKO\GLVFULPLQDWLYHIHDWXUHVIRUFRUUHFW
GLDJQRVLV
)LJXUHVKRZVWKHSURSRVHGSLSHOLQHZKLFKFRQVLVWVRI
WZRVWHSVSUHSURFHVVLQJDQGQHWZRUNWUDLQLQJ7KHGHWDLOV

DYDLODEOHDWKWWSZZZILOLRQXFODFXNVSPVRIWZDUHVSP
 


)LJ*RRJ/H1HW,QFHSWLRQPRGXOH

B. Network Architecture
 $V PHQWLRQHG HDUOLHU KXPDQ YLVXDO FRUWH[ LQVSLUHV
FRQYROXWLRQDO QHXUDO QHWZRUNV (DFK QHXURQ UHVSRQGV WR
VWLPXOL RFFXUULQJ LQ LWV UHFHSWLYH ILHOG 7KLV RSHUDWLRQ LV
VLPLODU WR FRQYROXWLRQ DQG LQSXW LPDJH SDWFK ZRUNV DV LWV
VPDOO UHFHSWLYH ILHOG :KHQ LQSXW SDWWHUQ PDWFKHV ZLWK WKH
FRQYROYLQJ ILOWHU UHVSRQVH LV SURGXFHG LQ WKH IRUP RI
IHDWXUH PDSV $SDUW IURP FRQYROXWLRQ &11 DOVR LQFOXGH

)LJ5HVLGXDOOHDUQLQJEORFN
WKLV PRGXOH LV FRQVLGHULQJ PD[LPXP LQIRUPDWLRQ
FRPLQJ IURP WKH LQSXW SDWFK 'LIIHUHQW VL]HV RI ILOWHU
H[WUDFWLQIRUPDWLRQRQILQHVFDOHDVZHOODVFRYHUODUJH
VFDOH ZKHUHDV PD[SRRO DQG î FRQYROXWLRQ OD\HUV
UHGXFH GLPHQVLRQDOLW\ 7KH LQIRUPDWLRQ LV DJJUHJDWHG
DQG SDVVHG WR WKH QH[W OD\HU 2YHUDOO WKH PRGHO WDNH
FRQWURO RYHU WKH QXPEHU RI OHDUQDEOH SDUDPHWHUV DQG
KDVWLPHVIHZHUSDUDPHWHUVWKDQ$OH[1HW>@
2. ResNet
RWKHU OD\HUV OLNH UHFWLILHG OLQHDU XQLW 5H/8 DFWLYDWLRQV
SRROLQJ OD\HUV QRUPDOL]DWLRQ DQG IXOO\ FRQQHFWHG )&
OD\HUV 7KH REWDLQHG IHDWXUH PDSV DUH SDVVHG WKURXJK
VHYHUDO FRQY5H/8SRRO RSHUDWLRQV DQG UHDFK WKH ILQDO
VLQJOH RU PXOWLSOH IXOO\ FRQQHFWHG OD\HUV &RQYROXWLRQ
RSHUDWLRQ FRQVLGHUV ORFDO FRQQHFWLYLW\ SDUDPHWHU VKDULQJ
DQG VKLIW LQYDULDQFH KHQFH EHFRPLQJ PRUH SRZHUIXO WKDQ
OHDUQLQJIHDWXUHWKURXJKIXOO\FRQQHFWHGQHXURQV
 5HVLGXDO 1HWZRUN 5HV1HW ZDV GHYHORSHG E\
.DLPLQJ HW DO >@ DQG ZDV ZLQQHU RI ,/695&
7KH DUFKLWHFWXUH LQFOXGHGD FHQWUDOFRQFHSWRIVKRUWFXW
RU VNLS FRQQHFWLRQV ZKLFK DUH DGGHG DV E\SDVV WR
FRQYROXWLRQDO OD\HUV RI UHJXODU IHHGIRUZDUG QHWZRUN
PDNLQJWKHEORFNDUHVLGXDOEORFNDVVKRZQLQ)LJXUH
7KH PDLQ LGHD LV WKDW DW HDFK VWHS LQVWHDG RI OHDUQLQJ
IHDWXUHV IURP D IXQFWLRQ )[ WKH IHDWXUHV DUH OHDUQW
 +LJKO\FRPSOH[&11DUFKLWHFWXUHVKDYHEHHQGHYHORSHG
IURP )[ SOXV RULJLQDO [ ZKLFK PDNHV RSWLPL]DWLRQ
VRIDULQFOXGLQJ$OH[1HW=)1HW9**1HW*RRJOH1HWDQG
HDVLHU DQG PDNHV WKH PRGHO WR FRQYHUJH IDVWHU )RU
5HV1HW IURP ,PDJH1HW FKDOOHQJH >@ 7KHVH PRGHOV DUH
QRUPDOIHHGIRUZDUGQHWZRUNVWKHSUHGLFWLRQDFFXUDF\
VXFFHVVIXOO\EHLQJXVHGLQQXPHURXVDSSOLFDWLRQVOLNHREMHFW
GHFUHDVHV DV WKH GHSWK RI QHWZRUN LQFUHDVHV 0DQ\
UHFRJQLWLRQ GHWHFWLRQ VHJPHQWDWLRQ DQG PRUH 7KH
IDFWRUV DUH UHVSRQVLEOH IRU VXFK UHVXOWV LQFOXGLQJ
SURSRVHG IUDPHZRUN LV DOVR H[SHULPHQWHG XSRQ WZR VWDWH
YDQLVKLQJJUDGLHQWSUREOHPVDWXUDWLRQVL]H RIWUDLQLQJ
RIWKHDUW PRGHOV QDPHO\ *RRJ/H1HW DQG 5HV1HW WKH
GDWDDQGRYHUILWWLQJ5HVLGXDOOHDUQLQJDOORZVQHWZRUN
GHWDLOVRIZKLFKDUHDVIROORZV
GHSWKWREHFRPHDVGHHSDVPRUHWKDQWKRXVDQGOD\HUV
1. GoogLeNet 'XULQJ EDFNZDUG SDVV VNLS FRQQHFWLRQV PDNH IORZ RI
JUDGLHQWHDV\DQG VROYH YDQLVKLQJ JUDGLHQWSUREOHP $
 ,WLVOD\HUPRGHOLQWURGXFHGLQE\*RRJOH 5HV1HW ZLWK  OD\HUV LV  WLPHV GHHSHU WKDQ 9**
WHDP DQG ZDV WKH ZLQQHU RI ,/695& >@ ,W LV QHWZRUNEXWVWLOOKDYHORZHUFRPSXWDWLRQDOFRPSOH[LW\
WKH ILUVW DUFKLWHFWXUH WKDW GLIIHUV IURP WUDGLWLRQDO &11 >@
DUFKLWHFWXUHV LH VWDFNLQJ PRUH OD\HUV RQ WRS ,,, (;3(5,0(176$1'5(68/7',6&866,21
VHTXHQWLDOO\ 7KLV PRGHO WDNHV FDUH RI WKH
FRPSXWDWLRQDO EXGJHW ZKLOH DOORZLQJ SURFHVVLQJ LQ
GHSWK DV ZHOO DV ZLGWK ,QFUHDVLQJ GHSWK RQ RQH KDQG A. Dataset
PD\ SURGXFH EHWWHU UHVXOWV EXW RQ RWKHU KDQG LW DOVR
 7KH GDWDVHW XVHG LQ WKLV VWXG\ LV SURYLGHG E\
LQFUHDVHV OHDUQDEOH SDUDPHWHUV DQG FKDQFHV RI RYHU
$O]KHLPHU¶VGLVHDVH1HXURLPDJLQJ,QLWLDWLYH$'1,
>@
ILWWLQJ LQ FDVH RI VPDOO ODEHOHG GDWD DYDLODEOH
7KHGHPRJUDSKLFLQIRUPDWLRQRIWKHGDWDVHWLVSUHVHQWHGLQ
8QLTXHQHVV RI WKLV QHWZRUN OLHV LQ LWV ³,QFHSWLRQ
7DEOH7KHVHOHFWHGVHWRI05,VFDQVLVDFTXLUHGIURP7
PRGXOH´IRUPHGEDVHGRQ+HEELDQSULQFLSOHDQGPXOWL
VFDQQHUV$VXEMHFWLVVFDQQHGDWGLIIHUHQWSRLQWRIWLPHVLQ
VFDOHSURFHVVLQJDVVKRZQLQ)LJXUH7KHLGHDEHKLQG
GLIIHUHQW YLVLWVLHEDVHOLQH DIWHU RQH WZRDQGWKUHH \HDUV

GDWDVHWDYDLODEOHDWKWWSDGQLORQLXVFHGX 

 
(DFK VXFK VFDQ LV FRQVLGHUHG DV D VHSDUDWH VXEMHFW LQ WKLV 7$%/(
ZRUN 7KH GDWDVHW FRQVLVWV RI  $'  /0&,  0&, '(7$,/('3(5)250&(2)352326(')5$0(:25.)25
SDWLHQWV DQG  KHDOWK\ FRQWUROV ZKLFK PDNHV D WRWDO  ($&+02'(/
05, YROXPHV $ EDODQFHG PXOWLFODVV GDWD LV SUHSDUHG IRU
FODVVLILFDWLRQ E\ XVLQJ GDWD DXJPHQWDWLRQ IRU WKH FODVV SPE SEN PPV Overall
Model Class
ZKLFK KDV VPDOOHU QXPEHU RI LPDJHV WR JHW EDODQFHG ZLWK (%) (%) (%) ACC (%)
RWKHUFODVVHV$XJPHQWDWLRQLVGRQH E\ VLPSO\ IOLSSLQJWKH $'   
LPDJHDORQJKRUL]RQWDOD[LV7KLVRSHUDWLRQLVYDOLGEHFDXVH
RI WKH OHIW DQG ULJKW V\PPHWU\ RI EUDLQ UHJLRQV 7KH /0&,   
*RRJ/H1HW 
EDODQFHGVHWLQFOXGHVDWRWDORILPDJHVIRUHDFKFODVV 0&,   
DQGDWRWDORILPDJHVIRUDOOFODVVHV 1&   
7$%/(
$'   
'(02*5$3+,&,1)250$7,212)'$7$6(7
/0&,   
5HV1HW 
 No. of No. of MRI 0&,   
Classes Sex Age
Subjects Volumes
 1&   
$'  )0 “ 
/0&,  )0 “ 
$'   
 /0&,   
0&,  )0 “ 
5HV1HW 
 1&  )0 “  0&,   
1&   

B. Experimental setup and Evaluation GHWDLOHG UHVXOWV RI WKH SURSRVHG &11 IUDPHZRUN 7KH
FRPSDULVRQ RI SURSRVHG SLSHOLQH ZLWK WKH OLWHUDWXUH DORQJ
 1HWZRUNVDUHWUDLQHGIURPVFUDWFKRQGDWD IRU ZLWKWHFKQLTXHVDQGGDWDPRGDOLWLHVLVGLVFXVVHGLQ7DEOH
HSRFKV ZLWK HDFK HSRFK FRQVLVWLQJ RI  EDWFKHV $OO $OO RI WKH PHQWLRQHG DSSURDFKHV KDYH ZRUNHG ZLWK $'1,
H[SHULPHQWVDUHSHUIRUPHGE\VSOLWWLQJGDWDLQWRDVWHVW GDWDVHW 3HUIRUPDQFH LV HYDOXDWHG LQ WHUPV RI DFFXUDF\
DQG  DV WUDLQ GDWD  GDWD IURP WUDLQ VHW LV XVHG DV $&& VHQVLWLYLW\ 6(1 VSHFLILFLW\ 63( DQG SRVLWLYH
YDOLGDWLRQVHW;DYLHULQLWLDOL]DWLRQRIZHLJKWVLVDGRSWHGWR SUHGLFWLYHYDOXH339RUSUHFLVLRQ )RU5HV1HWPRGHOZH
VSHHGXSWKHWUDLQLQJRIGHHSHUQHWZRUNV,PSOHPHQWDWLRQLV KDYHREWDLQHGUHVXOWVIRUOD\HUVDQGOD\HUV,QWHUPV
GRQH XVLQJ WKH 7RUFK IUDPHZRUN >@ 7DEOH  VKRZV RI FODVVLILFDWLRQ DFFXUDF\ WKH SUHVHQWHG IUDPHZRUN KDV

7$%/(
&203$5,6212)&/$66,),&$7,213(5)250$1&(2)352326(')5$0(:25.:,7+27+(57(&+1,48(6

$SSURDFK 7HFKQLTXH 0RGDOLWLHV &ODVVLILFDWLRQ $FFXUDF\

/XLHWDO 6$(=HURPDVN 05,3(7 ZD\$'F0&,QF0&,1& 
-XQVKLHWDO 6'31 05,3(7 ZD\$'F0&,QF0&,1& 
/XLHWDO
03)5 05,3(7
ZD\$'0&,1& 
 &OLQLFDO

7RQJHWDO 1*) 05,3(7&6) ZD\ 

6RUHQVHQHWDO
&RPELQHG
05, ZD\ 
ELRPDUNHUV

6XNHWDO ':607/ 05,3(7&6) ZD\ 

*XSWDHWDO
ZLWKQDWXUDOLPDJHEDVHV
6$( 05, ZD\
ZLWK05,EDVHV

3D\DQHWDO
ZLWK'FRQYROXWLRQ
6$(&11 05, ZD\
ZLWK'FRQYROXWLRQ
+RVVHQLHWDO '6$'&11 05, ZD\ 
3URSRVHG
*RRJ/H1HW 05, ZD\$'0&,/0&,1& 

3URSRVHG
5HV1HW 05, ZD\ 

3URSRVHG
5HV1HW 05, ZD\ 
 7$%/(
&/$6663(&,),&3(5)250$1&(&203$5,6212)352326(')5$0(:25.:,7+27+(57(&+1,48(6

$' 0&, 1&

Models
63( 6(1 339 63( 6(1 339 63( 6(1 339
/XLHWDO         
6RUHQVHQHWDO         
*XSWDHWDO         
+RVVHLQLHWDO         
*RRJ/H1HW         
5HV1HW         
5HV1HW         

FOHDUO\ RXWSHUIRUPHG RWKHU DSSURDFKHV IRU DOO RI WKH WKUHH
PRGHOV 7KH KLJKHVW DFFXUDF\ RI  LV DFKLHYHG E\
*RRJ/H1HW ZKLOH 5HV1HW JRW  DQG  IRU
5HV1HW $OWKRXJK WKH GLIIHUHQFH LQ WKUHH YDOXHV LV
TXLWH VPDOO EXW 5HV1HW SHUIRUPHG ORZHU LQ DFFXUDF\
WKDQ *RRJ/H1HW ZKLFK ZDV DJDLQVW WKH H[SHFWDWLRQ PDGH
IURP,PDJH1HWUHVXOWV$OVRPRYLQJIURPOD\HUVWR
OD\HUVRQO\LPSURYHGDFFXUDF\E\7KLVSHUIRUPDQFH
PD\DFFRXQWIRUPRUHDPRXQWRIWUDLQLQJGDWDIRUYHU\GHHS
QHWZRUNV +RZHYHU LQ WHUPV RI WUDLQLQJ WLPH 5HV1HW
ZDVIDVWRZLQJWRLWVVPDOOHUQXPEHURIOD\HUVZKHUHDVRWKHU
WZRPRGHOVWRRNVLPLODUWLPH2YHUDOOJDLQLQDFFXUDF\
LVDFKLHYHGE\RXU IUDPHZRUN ZLWKRXWXVLQJDQ\SUHOHDUQW
IHDWXUHV
&ODVVZLVH SHUIRUPDQFH FRPSDULVRQ RI HDFK PRGHO
ZLWK OLWHUDWXUH LV VKRZQ LQ WDEOH  $PRQJ WKH WKUHH
V $VVRFLDWLRQ  $O]KHLPHU
V GLVHDVH IDFWV DQG
FODVVLILFDWLRQ $ERXWLQFUHDVH LQFODVVLILFDWLRQDFFXUDF\
LVDFKLHYHGE\SURSRVHGDSSURDFK$VFRPSDUHGWRPRVWRI
WKH SUHYLRXV ZRUNV SUHWUDLQHG IHDWXUH OHDUQLQJ LV QRW
UHTXLUHG DQ\PRUH DQG VWLOO WKH QHWZRUN FDQ DFFXUDWHO\
SUHGLFW WKH FODVVHV &ODVV VSHFLILF SHUIRUPDQFH JDLQ LV DOVR
DFFRPSOLVKHGLPSURYLQJSHUIRUPDQFHIRUDOOFODVVHV+HQFH
LW GHPRQVWUDWHV WKH SRWHQWLDO RI LQFRUSRUDWLQJ GHHS PRGHOV
GLUHFWO\ IURP VFUDWFK IRU OHDUQLQJ GLVWLQFWLYH IHDWXUHV IURP
QHXURLPDJLQJ GDWD DQG KDV KLJKOHYHO RI LPSOLFDWLRQV IRU
PHGLFDO DV ZHOO DV QHXUR LPDJH SURFHVVLQJ 6XFK V\VWHPV
DUH UHOLDEOH DV ZHOO DV HUURU IUHH )XWXUH ZRUN PD\ LQFOXGH
LQFRUSRUDWLQJ FOLQLFDO GDWD RI SDWLHQWV DORQJ ZLWK LPDJLQJ
GDWDDQGGHDOLQJZLWKPXOWLPRGDOGDWDWREXLOGPRUHUREXVW
V\VWHP
5()(5(1&(6
>@ $O]KHLPHU
ILJXUHV$O]KHLPHU
V 'HPHQWLDYROSS
FRPSHWLQJDSSURDFKHV>@RQO\>@DQG>@KDYH
HYDOXDWHG FODVVZLVH SHUIRUPDQFHV 6HQVLWLYLW\ LV D FODVV
>@ , 2 .RUROHY $O]KHLPHU¶V GLVHDVH D FOLQLFDO DQG EDVLF VFLHQFH
DFFXUDF\LQRWKHUZRUGV+RVVHLQLHWDO>@DQG*XSWDHWDO UHYLHZ0HGLFDO6WXGHQW5HVHDUFK-RXUQDOYROSS
>@ DFKLHYHG FODVV VHQVLWLYLWLHV $'0&,1&  RI
 DQG  UHVSHFWLYHO\ $OWKRXJK WKH
VHQVLWLYLW\ IRU $' FODVV LV EHWWHU EXW IRU QRUPDO FODVV LW LV
LQGLFDWLQJDFRQVLGHUDEOHVLWXDWLRQZKHUHDQGDUH
>@ * 0 0F.KDQQ HW DO ³7KH GLDJQRVLV RI GHPHQWLD GXH WR
$O]KHLPHU¶V GLVHDVH UHFRPPHQGDWLRQV IURP WKH 1DWLRQDO
,QVWLWXWH RQ $JLQJ$O]KHLPHU¶V $VVRFLDWLRQ ZRUNJURXSV RQ
GLDJQRVWLF JXLGHOLQHV IRU $O]KHLPHU¶V GLVHDVH´ $O]KHLPHUV DQG
PLVFODVVLILHG DV SDWLHQW 2XU ZRUN DOVR LPSURYHG WKH FODVV 'HPHQWLDYROSS
SHUIRUPDQFHV :H DFKLHYHG WKH VHQVLWLYLWLHV DV KLJK DV
 IRU WKH WKUHH FODVVHV DQG HYHQ KLJKHU IRU /0&, >@ 77RQJ.*UD\4*DR/&KHQ'5XHFNHUW$O]KHLPHU
V'LVHDVH
6LPLODUSDWWHUQDQGFRPSDULVRQLVSUHVHQWIRUVSHFLILFLW\DQG 1HXURLPDJLQJ ,QLWLDWLYH ³0XOWLPRGDO FODVVLILFDWLRQ RI $O]KHLPHU
V
GLVHDVH XVLQJ QRQOLQHDU JUDSK IXVLRQ´ 3DWWHUQ 5HFRJQLWLRQ YRO
FODVVLILFDWLRQ SUHFLVLRQ ZLWK > @ ,Q DOO FDVHV WKH SS
SURSRVHGPHWKRGLPSURYHGSHUIRUPDQFHRIHDFKFODVV
>@ / 6¡UHQVHQ HW DO 'LIIHUHQWLDO GLDJQRVLV RI PLOG FRJQLWLYH
,9 &21&/86,21 LPSDLUPHQW DQG $O]KHLPHU
V GLVHDVH XVLQJ VWUXFWXUDO 05, FRUWLFDO
,Q WKLV VWXG\ ZH SUHVHQWHG D FRQYROXWLRQDO QHWZRUN WKLFNQHVV KLSSRFDPSDO VKDSH KLSSRFDPSDO WH[WXUH DQG
YROXPHWU\1HXUR,PDJH&OLQLFDOYROSS
EDVHG IUDPHZRUN IRU FODVVLI\LQJ VWUXFWXUDO 05, LPDJHV WR
GLDJQRVH$O]KHLPHU¶VGLVHDVHLWVSURGURPDOVWDJHV0&,DQG
>@ '=KDQJHWDO0XOWLPRGDOFODVVLILFDWLRQRI$O]KHLPHU
VGLVHDVHDQG
/0&,DQGQRUPDOFRQWUROV([SHULPHQWDOGDWDZDVREWDLQHG PLOG FRJQLWLYH LPSDLUPHQW1HXUR,PDJH YRO  SS 
IURP $'1,DQGWRWDO YROXPHV IURPVXEMHFWV ZHUH 
XVHG05,VFDQVZHUHILUVWSUHSURFHVVHGWRJHW*0LPDJHV
ZKLFK ZHUH WKHQ SDVVHG WR &11 QHWZRUN 1HWZRUNV ZHUH >@ < /H&XQQ < %HQJLR * +LQWRQ 'HHS OHDUQLQJ 1DWXUH YRO
WUDLQHG DQG WHVWHG XVLQJ GHHS *RRJ/H1HW DQG 5HV1HW SS
PRGHOV5HVXOWVIURPERWKWKHPRGHOVRXWSHUIRUPHGDOOWKH
RWKHU PHWKRGV RI OLWHUDWXUH LQ UHJDUG RI PXOWLFODVV
>@ 6 /LX 6 /LX : &DL + &KH 6 3XMRO 5 .LNLQLV ' )HQJ 0-
)XOKDP ³0XOWLPRGDO QHXURLPDJLQJ IHDWXUH OHDUQLQJ IRU PXOWLFODVV
GLDJQRVLVRI$O]KHLPHU¶VGLVHDVH´,(((7UDQVDFWLRQVRQ%LRPHGLFDO
(QJLQHHULQJYROSS

>@ 6 /LX 6 /LX : &DL 6 3XMRO 5 .LNLQLV ' )HQJ ³0XOWLSKDVH
IHDWXUH UHSUHVHQWDWLRQ OHDUQLQJ IRU QHXURGHJHQHUDWLYH GLVHDVH
GLDJQRVLV´ $XVWUDODVLDQ &RQIHUHQFH RQ $UWLILFLDO /LIH DQG
&RPSXWDWLRQDO,QWHOOLJHQFHSS±

>@ -6KL;=KHQJ</4=KDQJ6<LQJ0XOWLPRGDOQHXURLPDJLQJ
IHDWXUH OHDUQLQJ ZLWK PXOWLPRGDO VWDFNHG GHHS SRO\QRPLDO QHWZRUNV
IRU GLDJQRVLV RI $O]KHLPHU
V GLVHDVH ,((( -RXUQDO RI %LRPHGLFDO
DQG+HDOWK,QIRUPDWLFVYRO33

>@ $ *XSWD 0 $\KDQ $ 0DLGD ³1DWXUDO LPDJH EDVHV WR UHSUHVHQW
QHXURLPDJLQJGDWD´ ,QWHUQDWLRQDO &RQIHUHQFH RQ 0DFKLQH /HDUQLQJ
SS±

>@ $ 3D\DQ * 0RQWDQD ³3UHGLFWLQJ $O]KHLPHU

V GLVHDVH D
QHXURLPDJLQJ VWXG\ ZLWK ' FRQYROXWLRQDO QHXUDO QHWZRUNV´ DU;LY
SUHSULQWDU;LY

>@ ( +RVVHLQL$VO * *LPHO

IDUE $ (O%D] ³$O]KHLPHU
V GLVHDVH
GLDJQRVWLFV E\ D GHHSO\ VXSHUYLVHG DGDSWDEOH ' FRQYROXWLRQDO
QHWZRUN´DU;LYSUHSULQWDU;LY

>@ 6 6DUUDI * 7RILJKL ³'HHS$' $O]KHLPHUƍV GLVHDVH FODVVLILFDWLRQ

YLD GHHS FRQYROXWLRQDO QHXUDO QHWZRUNV XVLQJ 05, DQG I05,´
ELR5[LYSUHSULQWELR5[LY

>@ 2 5XVVDNRYVN\ HW DO ,PDJHQHW ODUJH VFDOH YLVXDO UHFRJQLWLRQ
FKDOOHQJH,QWHUQDWLRQDO-RXUQDORI&RPSXWHU9LVLRQYROSS


>@ & 6]HJHG\ : /LX < -LD 3 6HUPDQHW 6 5HHG ' $QJXHORY '
(UKDQ 9 9DQKRXFNH $ 5DELQRYLFK *RLQJ GHHSHU ZLWK
FRQYROXWLRQV´ 3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ &RPSXWHU
9LVLRQDQG3DWWHUQ5HFRJQLWLRQSS

>@ . +H ; =KDQJ 6 5HQ DQG - 6XQ ³'HHS UHVLGXDO OHDUQLQJ IRU
LPDJHUHFRJQLWLRQ´DU;LY

>@ & 5 -DFN HW DO ³7KH $O]KHLPHU¶V GLVHDVH QHXURLPDJLQJ LQLWLDWLYH
$'1, 05, PHWKRGV´ -RXUQDO RI 0DJQHWLF 5HVRQDQFH ,PDJLQJ
YROSS±

>@ 5 &ROOREHUW . .DYXNFXRJOX DQG & )DUDEHW ³7RUFK $

0$7/$%OLNH HQYLURQPHQW IRU PDFKLQH OHDUQLQJ´ %LJ/HDUQ 1,36
:RUNVKRS

>@ +, 6XN 6: /HH ' 6KHQ ³$O]KHLPHU¶V 'LVHDVH 1HXURLPDJLQJ
,QLWLDWLYH 'HHS VSDUVH PXOWLWDVN OHDUQLQJ IRU IHDWXUH VHOHFWLRQ LQ
$O]KHLPHU¶V GLVHDVH GLDJQRVLV´ %UDLQ 6WUXFWXUH DQG )XQFWLRQ YRO
SS

>@ 6 9LHLUD : + / 3LQD\D $ 0HFKHOOL 8VLQJ GHHS OHDUQLQJ WR
LQYHVWLJDWH WKH QHXURLPDJLQJ FRUUHODWHV RI SV\FKLDWULF DQG
QHXURORJLFDO GLVRUGHUV PHWKRGV DQG DSSOLFDWLRQV 1HXURVFLHQFH 
%LREHKDYLRUDO5HYLHZV