Available online at www.sciencedirect.

com

ScienceDirect
Procedia Engineering 171 (2017) 1250 – 1255

6XVWDLQDEOH&LYLO(QJLQHHULQJ6WUXFWXUHVDQG&RQVWUXFWLRQ0DWHULDOV6&(6&0

'HYHORSPHQWRIDQDXWRPDWLFGHWHFWRURIFUDFNVLQFRQFUHWH
XVLQJPDFKLQHOHDUQLQJ
6XJXUX<RNR\DPDD 7DNDVKL0DWVXPRWRE
a
Division of Engineering and Policy for Sustainable Environment, Hokkaido University, Kita 13 Nishi 8 Kita-ku Sapporo, 060-8628, Japan
b
Faculty of Engineering, Hokkaido University, Kita 13 Nishi 8 Kita-ku Sapporo, 060-8628, Japan

$EVWUDFW

7KLV VWXG\ LV WR GHYHORS D GHWHFWRU WKDW DXWRPDWLFDOO\ GHWHFWV FUDFNV IURP WKH SKRWRJUDSKV RI FRQFUHWH VWUXFWXUHV XVLQJ
FRQYROXWLRQ QHXUDO QHWZRUN ZKLFK LV D NLQG RI GHHS OHDUQLQJ )LUVWO\ SKRWRJUDSKV RI FRQFUHWH ZHUH FROOHFWHG IRU WKH OHDUQLQJ
GDWD 6HFRQGO\ SLFWXUHV RI FUDFNHG SDUW FKDON OHWWHU SDUW MRLQW SDUW VXUIDFH SDUW DQG RWKHUV SDUW ZHUH SURGXFHG IURP WKHVH
SKRWRJUDSKV IRU WKH GDWDVHW 7KLUGO\ FODVVLILHU WR FODVVLI\ LQWR WKHVH  FODVV IURP SLFWXUHV ZDV FUHDWHG XVLQJ WKH GDWDVHW DQG
FRQYROXWLRQQHXUDOQHWZRUN)LQDOO\WKHDXWRPDWLFGHWHFWRUZDVSURGXFHGXVLQJWKLVFODVVLILHU
‹7KH$XWKRUV3XEOLVKHGE\(OVHYLHU/WG
© 2017 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIWKHRUJDQL]LQJFRPPLWWHHRI6&(6&0
Peer-review under responsibility of the organizing committee of SCESCM 2016.
Keywords:PDFKLQHOHDUQLQJGHHSOHDUQLQJFUDFNHGFRQFUHWHDXWRPDWLFGHWHFWLRQ

,QWURGXFWLRQ

5HFHQWO\WKHDJLQJRIVWUXFWXUHVLVEHFRPLQJDVHULRXVSUREOHPDQGWKHDPRXQWRIPDLQWHQDQFHZRUNVLQFUHDVHV
DFFRUGLQJO\WRNHHSVWUXFWXUHKHDOWK\DQGRSHUDWLRQDO,QRUGHUWRUHGXFHWKHPDLQWHQDQFHZRUNFRVWLWLVXVHIXOWR
GHYHORSDGHWHFWRUZKLFKDXWRPDWLFDOO\GHWHFWVFUDFNVLQFRQFUHWHIURPWKHSKRWRJUDSKVRIVWUXFWXUHV2QWKHRWKHU
KDQG GHHS OHDUQLQJ KDV DWWUDFWHG DWWHQWLRQ LQ WKH ILHOG RI LPDJH UHFRJQLWLRQ UHFHQWO\ >@ 'HHS OHDUQLQJ LV D
PDFKLQH OHDUQLQJ PHWKRG XVLQJ DQ DUWLILFLDO QHXUDO QHWZRUN ZKLFK PLPLFV WKH QHXUDO QHWZRUNV RI D EUDLQ ,Q WKH
EHQFKPDUNWHVWVRILPDJHUHFRJQLWLRQWKHLPDJHUHFRJQLWLRQWHFKQRORJ\XVLQJGHHSOHDUQLQJVHWVDQHZUHFRUGRYHU
WKHSDVWRQHVKRZLQJLWVXVHIXOQHVVLQWKHILHOG>@%DVHGRQWKHVHE\XVLQJGHHSOHDUQLQJLQWKHLPDJHUHFRJQLWLRQ


&RUUHVSRQGLQJDXWKRU7HOID[
E-mail address:IUHHGRPVDOHVLDQ#JPDLOFRP

1877-7058 © 2017 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/).
Peer-review under responsibility of the organizing committee of SCESCM 2016.
doi:10.1016/j.proeng.2017.01.418
 Suguru Yokoyama and Takashi Matsumoto / Procedia Engineering 171 (2017) 1250 – 1255 1251

LWLVFRQVLGHUHGSRVVLEOHWRH[SHFWDVXIILFLHQWGHWHFWLRQDFFXUDF\RIFUDFNVLQFRQFUHWH7KLVVWXG\LVWRGHYHORSD
GHWHFWRU WKDW DXWRPDWLFDOO\ GHWHFWV FUDFNV IURP WKH SKRWRJUDSKV RI FRQFUHWH VWUXFWXUHV XVLQJ FRQYROXWLRQ QHXUDO
QHWZRUNZKLFKLVDNLQGRIGHHSOHDUQLQJ

&RQYROXWLRQQHXUDOQHWZRUN

$FRQYROXWLRQQHXUDOQHWZRUNLVDPDFKLQHOHDUQLQJPHWKRGVSHFLILFWRLPDJHUHFRJQLWLRQ%\FRQYROXWLRQLWLV
SRVVLEOHWRH[WUDFWIHDWXUHLQDQDUHDUDWKHUWKDQDWDSRLQWDQGXQLYHUVDOLW\DJDLQVWGHIRUPDWLRQDQGPRYHPHQWRIWKH
LPDJHFDQEHDFTXLUHG


)LJ&RQYROXWLRQQHXUDOQHWZRUN

2.1. Convolution layer

&RQYROXWLRQOD\HULVDOD\HUSHUIRUPLQJWKHFRQYROXWLRQRIWKHIHDWXUH3DWWHUQLQLPDJHVLVWREHGHWHFWHGE\WKH
FRQYROXWLRQRIWKHIHDWXUH7KHIHDWXUHLVDXWRPDWLFDOO\DFTXLUHGE\OHDUQLQJ2XWSXWLPDJHFRQYROXWLRQRIILOWHULV
FDOOHGIHDWXUHPDS

2.2. Pooling layer

3RROLQJOD\HUGLVFDUGVVRPHLQIRUPDWLRQDVWRWKHVWURQJUHVSRQVHRIWKHILOWHUDWDQ\SRVLWLRQRIWKHLPDJHDQG
LPSOHPHQWVWKHXQLYHUVDOLW\RIUHVSRQVHVWRWKHIHDWXUHVDSSHDULQJLQWKHLPDJH3ODFLQJDQGUDVWHUVFDQQLQJHൈH
SL[HO UHJLRQ RQ WKH W ൈW SL[HO LQSXW LPDJH WKH PD[LPXP YDOXH LV WDNHQ IURP WKH DUHD E\ PD[ SRROLQJ )RU
H[DPSOHWKHUHLVൈSL[HOLPDJHDV)LJ D $VWKHPD[LPXPYDOXHLVWDNHQIURPHDFKൈSL[HODUHDE\PD[
SRROLQJWKLVLPDJHLVFKDQJHGWR)LJ E 


)LJ3RROLQJOD\HU

2.3. Fully connected layer

([WUDFWHG IHDWXUH IURP FRQYROXWLRQ OD\HU LV LQSXW WR IXOO\ FRQQHFWHG OD\HU DQG IXOO\ FRQQHFWHG OD\HU OHDUQV WKH
IHDWXUHIRUFODVVLILFDWLRQ
1252 Suguru Yokoyama and Takashi Matsumoto / Procedia Engineering 171 (2017) 1250 – 1255

2.4. Softmax

6RIWPD[LVXVHGWRRXWSXWOD\HURIWKHPXOWLFODVVFODVVLILFDWLRQRIWKHQHWZRUN,WLQGLFDWHVDSUREDELOLW\WKDWWKH
LQSXWLPDJHLVFODVVLILHGLQWRHDFKFODVV7KHLQSXWLPDJHLVFODVVLILHGLQWRFODVVRIPD[LPXPSUREDELOLW\

/HDUQLQJGDWDVHW

)LUVWO\SKRWRJUDSKVRIFUDFNHGFRQFUHWHVXFKDV)LJZHUHFROOHFWHGDERXWVKHHWV6HFRQGO\SLFWXUHVRI
FUDFNHGSDUWFKDONOHWWHUSDUWMRLQWSDUWVXUIDFHSDUWDQGRWKHUVSDUWVXFKDV)LJZHUHSURGXFHG
DQGSLHFHVRILPDJHVUHVSHFWLYHO\IURPWKHVHSKRWRJUDSKV7KLUGO\E\KRUL]RQWDOLQYHUVLRQDQGFXWWLQJ
RXWWKHIRXUFRUQHUVWKHQXPEHURILPDJHVZHUHH[SDQGHGXSWRWLPHVPRUH)LQDOO\E\UHVL]HGWKHLPDJHVWR
ൈSL[HOWKHOHDUQLQJGDWDVHWZDVSUHSDUHG


)LJ3KRWRRIFUDFNHGFRQFUHWH


)LJ/HDUQLQJGDWDVHW

0HWKRGRIOHDUQLQJDQGHYDOXDWLRQUHVXOWV

$IWHU VXEWUDFWLQJ WKH 5*% DYHUDJH RI WKH SL[HOV LQ HDFK LPDJH RI WKH FROOHFWHG OHDUQLQJ GDWDVHW WKH QHXUDO
QHWZRUNSDUDPHWHUVLQ7DEOHZHUHXVHGLQWKHOHDUQLQJIRUWLPHVDVFODVVFODVVLILFDWLRQ7KHDFWLYDWLRQIXQFWLRQ
RIFRQYROXWLRQOD\HUDQGIXOO\FRQQHFWHGOD\HUXVHV5H/82XWSXWFDOFXODWLRQJUDGLHQWFDOFXODWLRQFDQEHIDVWHUE\
5H/8/5H/8LV5H/8JLYHQDOLWWOHVORSHWRWKHQHJDWLYHVLGH$OVRGURSRXWLVXVHGLQFRQYROXWLRQOD\HUDQGIXOO\
FRQQHFWHGOD\HU$VGURSRXWLVWRGLVDEOHWKHQRGHHYHU\WLPHRIOHDUQLQJLWSUHYHQWVRYHUWUDLQLQJRIWKHQHWZRUN
$OVRHDFKQRGHGRHVQRWH[SHFWWKHDFWLYLWLHVRIWKHRWKHUQRGHVDQGOHDUQVWRLGHQWLI\LQGHSHQGHQWO\
7RH[SHULPHQW*38LQVWDQFHRI$PD]RQ:HE6HUYLFHZDVXVHG,QPDFKLQHOHDUQLQJWRFDOFXODWHE\WKH*38LV
IDVWHUWKDQWRFDOFXODWHE\WKH&38$:6LVFORXGFRPSXWLQJVXSSOLHGE\$PD]RQFRP,QF,WLVSRVVLEOHWREXLOGD
WHPSRUDU\KLJKSHUIRUPDQFHHQYLURQPHQWDWDORZFRVWE\$:6
&RQGXFWLQJFODVVFODVVLILFDWLRQRIFUDFNHGFRQFUHWHDQGRWKHUVDQGFODVVLILFDWLRQRIFUDFNHGFRQFUHWHFKDON
OHWWHUDQGRWKHUVHYDOXDWLRQZDVFRQGXFWHGE\XVLQJHDFKQHZSLFWXUHVRIFUDFNHGFRQFUHWHFKDONOHWWHUDQG
RWKHUV7KHUHVXOWVDUHVKRZQLQ)LJ0D[YDOXHRIFODVVFODVVLILFDWLRQLVDQGFODVVFODVVLILFDWLRQZDV
,QFLGHQWDOO\FDOFXODWLRQWLPHZDVDERXWKRXUV


 Suguru Yokoyama and Takashi Matsumoto / Procedia Engineering 171 (2017) 1250 – 1255 1253

7DEOH1HWZRUNSDUDPHWHU
/D\HU .HUQHO 6WULGH )HDWXUHPDS )XQFWLRQ 'URSRXW
GDWD   ൈൈ  
FRQY ൈ  ൈൈ /5H/8 
FRQY ൈ  ൈൈ /5H/8 
SRRO ൈ  ൈൈ  
FRQY ൈ  ൈൈ /5H/8 
FRQY ൈ  ൈൈ /5H/8 
SRRO ൈ  ൈൈ  
FRQY ൈ  ൈൈ /5H/8 
FRQY ൈ  ൈൈ /5H/8 
SRRO ൈ  ൈൈ  
IF  㻌  ൈൈ /5H/8 
IF   ൈൈ VRIWPD[ 


)LJ(YDOXDWLRQUHVXOWV

,PSOHPHQWDWLRQRIWKHDXWRPDWLFGHWHFWRU

$GHWHFWRUZDVFUHDWHGXVLQJOHDUQHGFODVVLILHUWRGHWHFWFUDFNHGSDUWDQGFKDONOHWWHUSDUWIURPSKRWRJUDSKVVXFK
DV)LJ)LJ D LVDSKRWRJUDSKWKDWWKHUHDUHFUDFNVSDUWRQFRDWHGFRQFUHWHZKLOH)LJ E LVDSLFWXUHWKDW
WKHUHDUHFUDFNHGSDUWDQGFKDONOHWWHUSDUWRQQRQFRDWHGFRQFUHWH&UDFNHGSDUWFDQEHVHHQVRFOHDUO\ZLWKQDNHG
H\HVLQFRDWHGFRQFUHWH%XWQRQFRDWHGFRQFUHWHKDVPDQ\VWDLQVVRFUDFNHGSDUWFDQ¶WEHVHHQZLWKWKHQDNHGH\HV

 
D   E 

)LJ3KRWRJUDSKVRIFRQFUHWH D &RDWHGFRQFUHWHZLWKFUDFNV E 1RQFRDWHGFRQFUHWHZLWKFUDFNVDQGFKDONOHWWHUV

1254 Suguru Yokoyama and Takashi Matsumoto / Procedia Engineering 171 (2017) 1250 – 1255

%\ UDVWHU VFDQ RI D FRQVWDQW UHFWDQJOH RQ WKH SKRWRJUDSK WKH LPDJH RQ WKH UHFWDQJOH ZDV SXW LQ FODVVLILHU DQG
FODVVLILHG LQWR FUDFNHG SDUW RU FKDON OHWWHU SDUW RU RWKHUV SDUW DW DQ\ WLPH $ UHFWDQJOH ZDV GLVSOD\HG LQ D UHJLRQ
ZKHUHZDVGHWHUPLQHGFUDFNHGSDUWRUFKDONOHWWHUSDUWRQWKHSKRWRJUDSK

'HWHFWLRQUHVXOWV

7KH UHVXOW LV )LJ  WKDW GHWHFWHG FUDFNHG SDUW IURP )LJ  D  $V WKH UHVXOW KDV RQO\ D OLWWOH IDOVH DQG PLVVHG
GHWHFWLRQ VXFK DV EOXH DQG RUDQJH FLUFOHV UHVSHFWLYHO\ LW FDQ EH VHHQ WKDW ZHOO GHWHFWHG DQG VDLG VXFFHVVIXO 7KH
UHVXOWLV)LJ D WKDWGHWHFWHGFKDONOHWWHUSDUWIURP)LJ E $VWKHUHVXOWGRQ¶WKDYHIDOVHGHWHFWLRQLWFDQEH
VHHQWKDWZHOOGHWHFWHGDQGVDLGVXFFHVVIXOWRR7KHUHVXOWLV)LJ E WKDWGHWHFWHGFUDFNHGSDUWIURP)LJ E $V
GHWHFWRUGRQ¶WUHFRJQL]HVWDLQEXWFUDFNHGSDUWDQGGRQ¶WGHWHFWFUDFNHGSDUWQH[WWRWKHFKDONOHWWHUSDUWLWFDQEH
VHHQWKDWVDLGIDLO,QFLGHQWDOO\FDOFXODWLRQWLPHZDVDERXWVHFRQGV


)LJ'HWHFWLRQUHVXOWIURP)LJ D 

 
D   E 

)LJ'HWHFWLRQUHVXOWIURP)LJ E  D FKDONOHWWHUVSDUW E 'HWHFWLRQRIFUDFNHGSDUW

'LVFXVVLRQ

'HWHFWLRQUDWHRIFUDFNHGSDUWLQFRQFUHWHZLWKQRVWDLQVLVKLJKZKLOHGHWHFWLRQUDWHLQFRQFUHWHZLWKVWDLQVLV
YHU\ORZ$VUHFWDQJOHDUHJDWKHUHGLQSDUWVRIWKHVWDLQLWFDQEHVHHQWKDWWKHGHWHFWRUGHWHFWHGVWDLQDVFUDFN)RU
WKLVUHDVRQLWLVQHFHVVDU\WRFROOHFWLPDJHVRIVWDLQFRQFUHWHDQGPDNHWKHGHWHFWRUOHDUQWKHP$OVRSUHSURFHVVLQJ
VXFK DV UHGXFLQJ ELDV LV QHFHVVDU\ DV ELDV RI GDWD EHWZHHQ WKH WUDLQLQJ GDWD LV FRQVLGHUHG WR LQWHUIHUH ZLWK WKH
OHDUQLQJ
 Suguru Yokoyama and Takashi Matsumoto / Procedia Engineering 171 (2017) 1250 – 1255 1255

&RQFOXVLRQV

7KLV SDSHU SUHVHQWHG DQ DXWRPDWLF GHWHFWRU RI FUDFNV LQ FRQFUHWH XVLQJ FRQYROXWLRQ QHXUDO QHWZRUN ZKLFK LV D
NLQG RI GHHS OHDUQLQJ ,Q WKH FDVH RI FUDFNHG SDUW GHWHFWLRQ FUDFNV LQ FRDWHG FRQFUHWH ZDV ZHOO GHWHFWHG ZKLOH
FUDFNVLQQRQFRDWHGFRQFUHWHZDVQRWZHOOGHWHFWHG,QWKHFDVHRIFKDONOHWWHUSDUWGHWHFWLRQFKDONOHWWHULQQRQ
FRDWHGSDUWZDVZHOOGHWHFWHG7REHDEOHWRGHWHFWFUDFNVLQFRQFUHWHLQDQ\FRQGLWLRQLVIXWXUHWDVNRIWKLVVWXG\

5HIHUHQFHV

>@ 72NDWDQL'HHS/HDUQLQJ.RXGDQVKD7RN\R LQMDSDQHVH 

>@ <0DWVXR+0DWVXEDUD'HHS/HDUQLQJ.LQGDLNDJDNXVKD7RN\RSS LQMDSDQHVH 
>@ 72NDWDQL5HVHUFK7UHQGLQ'HHS/HDUQLQJIRU9LVXDO5HFRJQLWLRQ$GYDQFHVRI&RQYROXWLRQDO1HXUDO1HWZRUNVDQG7KHLU8VH-RXUQDORI
WKH-DSDQHVH6RFLHW\IRU$UWLILFDO,QWHOOLJHQFH-6$,9ROSS LQMDSDQHVH