,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

0LFURVWUXFWXUH$QDO\VLVRI&DVW,URQ&,XVLQJ

,PDJH3URFHVVLQJ

$QDJKD0LUDVKL
Assistant Professor: Department of Electronics and Telecommunication
Sanjay Ghodawat Institute , Atigre

'U0UV9-D\DVKUHH
Professor: Department of Electronics
Textile and Engineering Institute, Ichalkaranji

$EVWUDFW7KHPLFURVWUXFWXUHDQDO\VLVRIFDVWLURQLVFDUULHGRXWRQUHDG\FDVWLQJVLQIRXQGU\,QWKLVSDSHU
ZH SUHVHQW WKH LPDJH SURFHVVLQJ PHWKRGRORJ\ IRU PLFURVWUXFWXUH DQDO\VLV RI &DVW ,URQ &, FDVWLQJV WR
GHWHUPLQH WKH TXDOLW\ DVVHVVPHQW SDUDPHWHUV RI &, FDVWLQJV VXFK DV IODNH VL]H IODNH W\SH DQG SHUFHQWDJH RI
IHUULWH DQG SHDUOLWH 6DPSOH LPDJHV RI &, FDVWLQJ REWDLQHG IURP LQYHUWHG PLFURVFRSH ZHUH VXEMHFWHG WR
VHJPHQWDWLRQ HGJH GHWHFWLRQ IRU PLFURVWUXFWXUH DQDO\VLV DQG ILQDOO\ WKH VHFRQG RUGHU PRPHQWV RI FR
RFFXUUHQFHPDWUL[ZHUHREWDLQHGIRUWKHFODVVLILFDWLRQRIIODNHW\SH7KLVFODVVLILFDWLRQRIIODNHVL]HDQGIODNH
W\SHZDVFDUULHGRXWXVLQJ$670VWDQGDUGVDVUHIHUHQFH2XUGDWDEDVHFRQVLVWHGRIRQHKXQGUHGDQGVHYHQW\
ILYH LPDJH VDPSOHV RI &, FDVWLQJV 4XDOLW\ SDUDPHWHUV YL] IODNH VL]H DQG IODNH W\SH ZHUH FRPSXWHG 7KH
DFFXUDF\DFKLHYHGLVQHDUO\IRUERWKIODNHVL]HDQGIODNHW\SHXVLQJWKLVPHWKRG7KHUHVXOWVIRUSHUFHQW
IHUULWHSHDUOLWHDOVRDJUHHDSSUR[LPDWHO\ZLWKWKRVHIURPODERUDWRU\

.H\:RUGV(GJHGHWHFWLRQ&RRFFXUUHQFHPDWUL[0LFURVWUXFWXUH

,,1752'8&7,21

&DVWLURQLVDOVRFDOOHGJUD\LURQRUZKLWHLURQ,WLVFRPSRVHGRILURQ)HFDUERQ&DQGVLOLFRQ6LEXW

DOVRFRQWDLQVWUDFHVRIVXOSKXU6PDQJDQHVH0QDQGSKRVSKRUXV3,WKDVDUHODWLYHO\KLJKFDUERQFRQWHQWRI
WR,WLVKDUGEULWWOHQRQPDOOHDEOHDQGPRUHIXVLEOHWKDQVWHHO,WKDVDFU\VWDOOLQHVWUXFWXUHDQGLVUHODWLYHO\
EULWWOHDQGZHDNLQWHQVLRQ+HQFHLWLVXVHGLQFRQVWUXFWLRQDQGRXWGRRURUQDPHQW

7KH PLFURVWUXFWXUH RI FDVW LURQ FRQVLVWV RI IODNH W\SH IODNH VL]H DQG SHUFHQW RI IHUULWH SHDUOLWH SUHVHQW LQ WKH
FDVWLQJ,QWKHWUDGLWLRQDOPHWKRGVWKHPLFURVFRSLFLPDJHRIWKH&,FDVWLQJLVREVHUYHGE\WKHPHWDOOXUJLVWDQGDQDO\VHG
PDQXDOO\)RUDQDO\VLVRIWKHTXDOLW\SDUDPHWHUVWKHH[SHUWVUHIHUWRWKHVWDQGDUGGHILQHG$670YDOXHV
)URPWKHOLWHUDWXUHVXUYH\ZHVHHWKDWPXFK UHVHDUFKKDVEHHQFDUULHGRXWRQWKH PLFURVWUXFWXUHDQDO\VLVRI
GLIIHUHQWPHWDOVDQGPDWHULDOVOLNHJODVVZRRGSODVWLFHWF%XWWKHPLFURVWUXFWXUHTXDOLW\SDUDPHWHUVRI&,KDYHQRW
EHHQIRFXVVHGPRUH+RQJ-LDQJHWDOKDYHSUHVHQWHGWKHDXWRDQDO\VLVV\VWHPIRUJUDSKLWHPRUSKRORJ\RIJUH\FDVW
LURQ XVLQJ EDFN SURSDJDWLRQ QHXUDO QHWZRUN IRU TXDQWLWDWLYH DQDO\VLV 7KUHH NLQGV RI WH[WXUH IHDWXUHV IRXQG ZHUH
IUDFWDO GLPHQVLRQ URXJKQHVV DQG WZRGLPHQVLRQ DXWR UHJUHVVLRQ ZKLFK ZHUH JLYHQ DV LQSXW YHFWRU RI EDFN
SURSDJDWLRQQHXUDOQHWZRUNFODVVLILHU7KHUHVXOWVREWDLQHGE\WKHPJLYHDFFXUDF\>@&$,0LQJGRQJDQG
681 *XR[LRQJ GHILQHG D TXDQWLWDWLYH DQDO\VLV RI JUDSKLWH OHQJWK LQ JUH\ LURQ PHWDOORJUDSK\ %DVHGPRPHQW
7KUHVKROG 0HWKRG ZDV SURYHG WR DGHTXDWH LQ ELQDUL]LQJ WKH PHWDOORJUDSKLF LPDJHV :LWK WKH DFFHVV WR WKH
TXDQWLWDWLYH GDWD RI JUDSKLWH OHQJWK LQ JUH\ LURQ LW FDQ EH DQWLFLSDWHG WKDW WKLV ZRUN ZRXOG FRQWULEXWH WR WKH
GHYHORSPHQWRIWKHPRGHOVFRUUHODWLQJDQGTXDQWLI\LQJPLFURVWUXFWXUHDQGPHFKDQLFDOSURSHUWLHV>@
)RFXVRQWKHDQDO\VLVRIFDVWLURQLQSDUWLFXODULVJLYHQE\YHU\IHZUHVHDUFKHUVEXWPDQ\UHVHDUFKHUVKDYH
ZRUNHGRQDSDUDOOHOOLQHZKLFKLVYHU\KHOSIXOZKLOHDQDO\VLQJWKHFDVWLURQFDVWLQJVPLFURVWUXFWXUH'RPLQJR0HU\
HW DO DSSOLHG LPDJH SURFHVVLQJ DOJRULWKPV OLNH HURVLRQ DQG GLODWLRQ IRU WKH SUHSURFHVVLQJ +H KDG ZRUNHG RQ WKH
$OXPLQLXPFDVWLQJ¶V;UD\LPDJHVDQGDSSOLHGWKHPHGLDQILOWHULQJDQGODSODFLDQRI*DXVVLDQIRUWKHVHJPHQWDWLRQ
DQGWKH]HURFURVVLQJDOJRULWKPVIRUHGJHGHWHFWLRQ)XUWKHUWKHGHIHFWVLQWKH$OFDVWLQJVKDYHEHHQFODVVLILHGXVLQJ
%D\H¶VFODVVLILHU7KHUHVXOWVKHGLVFXVVHGZHUHTXLWHVDWLVIDFWRU\DQGEXWWKHSURFHGXUHXVHGLVWLPHFRQVXPLQJDQG
KDG LQVXIILFLHQW UHVROXWLRQ WR GHWHFW VPDOO GHIHFWV >@ +HUEHUW %RHUQHU HWDO H[SODLQ WKH H[SHULHQFH JDLQHG ZLWK

 
9ROXPH,VVXH'HFHPEHU  ,661±
 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

VHYHUDO DSSURDFKHV WR DXWRPDWLF IODZ GHWHFWLRQ LQ ;UD\ LPDJHV RI FDVW DOXPLQXP ZKHHOV RQ H[WUDFWLRQ RI ORFDO
IHDWXUHVIRUSL[HOFODVVLILFDWLRQ7KH\XVHGDQDXWRPDWHG;UD\LQVSHFWLRQV\VWHPFRQVLVWLQJRIIRXUPDLQEXLOGLQJ
EORFNVDV\VWHPIRUKDQGOLQJWKHREMHFWVWREHWHVWHGWKH;UD\VHWWKHVHQVRUZKLFKFRQYHUWVWKH;UD\LQWHQVLW\
LQWRDQHOHFWULFDOVLJQDODQGILQDOO\WRWKHLPDJHSURFHVVRU>@:HQIHL&KHQHWDOKDVDGRSWHGWKHPRUSKRORJLFDO
PHWKRGWRH[WUDFWGHIHFWIHDWXUHRIFDVWLQJ[UD\LPDJHV'LIIHUHQWKLJKVSHHGSURFHVVLQJPDFKLQHYLVLRQDOJRULWKPV
VXFK DV WKH WRSKDW WUDQVIRUP LQ PRUSKRORJ\ WKH FRQJORPHUDWLRQ RI SL[HOV WR GLVWLQJXLVK SL[HOV IURP GDUN
EDFNJURXQG7KHWRSKDWRSHUDWRULVGHILQHGDV+DWI IIRJZKHUHJLVWKHVWUXFWXUDOHOHPHQWIRJLVWR
DSSO\ RSHQLQJ RSHUDWLRQ WR WKH RULJLQDO LPDJH I XVLQJ WKH VWUXFWXUDO HOHPHQW J 6HJPHQWDWLRQ LV SHUIRUPHG WR
VHSDUDWH WKH GHIHFW DIWHU DSSO\LQJ WKH WRS KDW RSHUDWLRQ RQ WKH RULJLQDO LPDJH %DVHG RQ WKH IDFW WKDW PRVW SL[HOV
FRQFHQWUDWHLQWKHORZJUD\YDOXHDUHDELQDU\SURFHVVLQJLVSHUIRUPHGXVLQJWKHWKUHVKROGJHQHUDWHGE\HTXDWLRQ7
PNYZKHUHP LVWKHPHDQRIJUD\YDOXHVRILPDJHSL[HOVv LVWKHVWDQGGLIIHUHQFHN LVDFRQVWDQWYDOXHZKLFK
UDQJHVIURPWR>@
5HYLHZRIWKHSUHVHQWVWDWHRIDUWVKRZVWKDWWKHQHZWHFKQRORJLHVIRUWKHPLFURVWUXFWXUHDQDO\VLVRI&,DUHQRW
YHU\ HDVLO\ DYDLODEOH IRU WKH VPDOO VFDOH IRXQGULHV 7KRXJK WKH FRPSXWHU EDVHG LPDJH DQDO\VHUV DUH DYDLODEOH WKH
LQWHUSUHWDWLRQVDUHGRQHPDQXDOO\E\PHWDOOXUJ\H[SHUWV6RNHHSLQJLQYLHZWKHUHVHDUFKUHYLHZDQGSUHVHQWVWDWHRIDUWZH
KDYH GHYHORSHG D PHWKRG IRU WKH PLFURVWUXFWXUH DQDO\VLV RI &, XVLQJ LPDJH SURFHVVLQJ DQG QHXUDO QHWZRUN ZKLFK
HOLPLQDWHV QHHG RI PHWDOOXUJLFDO H[SHUW 7KH EULHI UHODWHG WKHRU\ H[SHULPHQWDWLRQ FDUULHG RXW UHVXOWV DQG IXWXUH VFRSH
WKHUHRIDUHSUHVHQWHGIXUWKHU
,,7+(2527,&$/%$&.*5281'
,QWKHZRUNIRUWKHPLFURVWUXFWXUHDQDO\VLVZHKDYHXVHG5*%WRJUD\FRQYHUVLRQHGJHGHWHFWLRQH[WUDFWLRQRI
FRQQHFWHGFRPSRQHQWVVHFRQGRUGHUPRPHQWVRIFRRFFXUUHQFHPDWUL[DQGDUWLILFLDOQHXUDOQHWZRUN7KHEULHIWKHRU\
RQDOOWKHVHLVH[SODLQHGIXUWKHU
a. RGB to Gray:
:HNQRZWKDWLQ5*%LPDJHZHKDYH0DWUL[HV5HG*UHHQDQG%OXH%XWLQJUD\VFDOHLPDJHZHKDYHRQO\RQH
PDWUL[7KH0$7/$%FRPPDQGUJEJUD\LVXVHGWRFRQYHUW5*%YDOXHVWRJUD\VFDOHYDOXHVE\IRUPLQJDZHLJKWHG
VXPRIWKH5*DQG%FRPSRQHQWV
 * %
b. Canny Edge Detection Algorithm:
7KHFDQQ\HGJHGHWHFWRUILUVWVPRRWKHQVWKHLPDJHWRHOLPLQDWHQRLVH,WWKHQILQGVWKHLPDJHJUDGLHQWWRKLJKOLJKW
UHJLRQVZLWKKLJKVSDWLDOGHULYDWLYHV7KHDOJRULWKPWKHQWUDFNVDORQJWKHVHUHJLRQVDQGVXSSUHVVHVDQ\SL[HOWKDWLV
QRWDWWKHPD[LPXP7KHJUDGLHQWDUUD\LVQRZIXUWKHUUHGXFHGE\K\VWHUHVLV+\VWHUHVLVLVXVHGWRWUDFNDORQJWKH
UHPDLQLQJSL[HOVWKDWKDYHQRWEHHQVXSSUHVVHG+\VWHUHVLVXVHVWZRWKUHVKROGVDQGLIWKHPDJQLWXGHLVEHORZWKH
ILUVWWKUHVKROGLWLVVHWWR]HURPDGHDQRQHGJH,IWKHPDJQLWXGHLVDERYHWKHKLJKWKUHVKROGLWLVPDGHDQHGJH
$QGLIWKHPDJQLWXGHLVEHWZHHQWKHWKUHVKROGVWKHQLWLVVHWWR]HURXQOHVVWKHUHLVDSDWKIURPWKLVSL[HOWRDSL[HO
ZLWKDJUDGLHQWDERYH7
x /HWI[\GHQRWHWKHLQSXWLPDJHDQG*[\GHQRWHWKH*DXVVLDQIXQFWLRQ
x 7KHLPDJHLVVPRRWKHGE\FRQYROYLQJ*DQGI
IV[\ *[\ I[\
x 7KLVRSHUDWLRQLVIROORZHGE\JUDGLHQWPDJQLWXGHDQGDQJOHJLYHQE\DQG
0[\ ¥J[J\


 >J[J\@
  :LWKJ[ įIVį[DQGJ\ įIVį\
 7KH PDVNV XVHG IRU FDQQ\ HGJH GHWHFWRUV DUH DV VKRZQ EHORZ $V FDQQ\ HGJH LV DQ DGDSWLYH W\SH
WKUHVKROGLQJPHWKRGLWDSSOLHVOHVVHUWKUHVKROGYDOXHDWWKHSRLQWVRIORZLQWHQVLW\DQGDKLJKHUWKUHVKROGDW
WKHOHYHOVRIKLJKHULQWHQVLW\SRLQWV6RDOOWKHHGJHVORZDQGKLJKLQWHQVLW\DUHGHWHFWHGXVLQJFDQQ\HGJH
GHWHFWRUV$Q\RIWKHPDVNVVKRZQFDQEHXVHGKHUH





9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

            

   
           
            
  
5REHUWV3UHZLWW6REHO
)LJXUH9DULRXVPDVNVXVHGIRUHGJHGHWHFWLRQ


c. Extraction of Connected Components:
([WUDFWLRQ RI FRQQHFWHG FRPSRQHQWV LV GRQH IURP WKH VHJPHQWHG LPDJH /HW $ EH D VHW FRQWDLQLQJ RQH RU PRUH
FRQQHFWHGFRPSRQHQWV:HIRUPDQDUUD\;RIWKHVDPHVL]HDVWKHDUUD\FRQWDLQLQJ$ZKRVHHOHPHQWVDUH]HURV
EDFNJURXQG YDOXHV H[FHSW DW HDFK ORFDWLRQ NQRZQ WR FRUUHVSRQG WR D SRLQW LQ HDFK FRQQHFWHG FRPSRQHQW LQ $
ZKLFK ZH VHW WR RQH IRUHJURXQG YDOXH 7KH REMHFWLYH LV WR VWDUW ZLWK ; DQG ILQG DOO WKH FRQQHFWHG FRPSRQHQWV
XVLQJWKHHTXDWLRQDVIROORZV
;N ;Nْ%ୈ$N ««

ZKHUH%LVDVXLWDEOHVWUXFWXULQJHOHPHQW7KHSURFHGXUHWHUPLQDWHVZKHQ;N ;NFRQWDLQLQJDOOWKHFRQQHFWHG
FRPSRQHQWVRILQSXWLPDJH


d. Second order moments from co-occurrence:
7KHVHFRQGRUGHUPRPHQWVREWDLQHGIURPWKHFRRFFXUUHQFHPDWUL[DUHFDOFXODWHGXVLQJPRPHQWVVSHFLILHGEHORZ
x &RQWUDVW ,W UHWXUQV D PHDVXUH RI WKH ORFDO YDULDWLRQ RI WH[WXUH EHWZHHQ D SL[HO DQG LWV
QHLJKERURYHUWKHZKROHLPDJH&RQWUDVWLVIRUDFRQVWDQWLPDJH
x &RUUHODWLRQ5HWXUQVDPHDVXUHRIKRZFRUUHODWHGDSL[HOLVWRLWVQHLJKERURYHUWKHZKROH
LPDJH&RUUHODWLRQLVRUIRUDSHUIHFWO\SRVLWLYHO\RUQHJDWLYHO\FRUUHODWHGLPDJH
x (QHUJ\ 5HWXUQV WKH VXP RI VTXDUHG HOHPHQWV LQ WKH */&0 *UH\ OHYHO FRRFFXUUHQFH
0DWUL[(QHUJ\LVIRUDFRQVWDQWLPDJH
x +RPRJHQHLW\5HWXUQVDYDOXHWKDWPHDVXUHVWKHFORVHQHVVRIWKHGLVWULEXWLRQRIHOHPHQWVLQ
WKH*/&0WRWKH*/&0GLDJRQDO,WJLYHVWKHXQLIRUPLW\RIWH[WXUH+RPRJHQHLW\LVIRUDGLDJRQDO
*/&0
Quality parameters for CI
7KHTXDOLW\SDUDPHWHUVRI&,VXFKDVIODNHOHQJWKIODNHW\SHDQGWKHSHUFHQWDJHRIIHUULWHDQGSHDUOLWHDUHDQDO\VHG
)ODNH/HQJWKLQLQFKHV OHQJWKRIHGJHGHWHFWHGLQSL[HOVGSL
Artificial neural network:
$UWLILFLDOQHXUDOQHWZRUNLVXVHGKHUHIRUWKHFODVVLILFDWLRQRIIODNHW\SHVYL]W\SH$W\SH%W\SH&W\SH'DQG
W\SH(
ANN configuration:
/HYHQEHUJ0DUTXDUGW EDFN SURSDJDWLRQ WUDLQLQJ IXQFWLRQ LV XVHG IRU $11 ZLWK D FRQILJXUDWLRQ RI  7KH
VHFRQG RUGHU PRPHQWV REWDLQHG IURP WKH FRRFFXUUHQFH PDWUL[ VXFK DV FRQWUDVW FRUUHODWLRQ HQHUJ\ DQG
KRPRJHQHLW\DUHJLYHQDVLQSXWWR$11)RUWUDLQLQJWHVWLQJWKHQXPEHUVRIVDPSOHVXVHGZHUH



)LJXUH&RQILJXUDWLRQRI$11IRU)ODNHVL]HFODVVLILFDWLRQ




9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7


,,, ,0$*($&48,6,7,21$1''$7$%$6(35(3$5$7,21

)RU DQDO\VLV RI PHWDO VXUIDFH LW LV QHFHVVDU\ WR DFTXLUH PHWDO LPDJHV IRU WZR NLQGV RI VXE VXUIDFHV LH PLUURU
ILQLVKHGVXUIDFHEHIRUHHWFKLQJSURFHVVDQGIRUHWFKHGVXUIDFH7ZRLPDJHVIRUHDFKVDPSOHWREHWHVWHGZHUHWDNHQ
IURPLQYHUWHGPHWDOOXUJLFDOPLFURVFRSHZLWK;RSWLFVREMHFWLYHPDJQLILFDWLRQDQG;H\HSLHFHPDJQLILFDWLRQ
2XUGDWDEDVHFRQVLVWHGRIVDPSOHVDVVKRZQLQ7DEOH7KHLPDJHVREWDLQHGIURPWKHODERUDWRU\ZHUHXVHGIRU
WKH IXUWKHU DXWRPDWLRQ RI PLFURVWUXFWXUH DQDO\VLV 6DPSOH LPDJHV RI FDVWLQJV EHIRUH HWFKLQJ SURFHVV DQG DIWHU
HWFKLQJSURFHVVDUHDVVKRZQLQILJXUH


  
)LJXUHD&,EHIRUHHWFKLQJE&,DIWHUHWFKLQJ
7DEOH'DWDEDVHFROOHFWLRQ
7\SHRI0HWDO 1RRIVDPSOHVEHIRUHHWFKLQJ 1RRIVDPSOHVDIWHUHWFKLQJ
6*,  

,9 (;3(5,0(17$7,2121&,0,&526758&785($1$/<6,6

7KHSURFHGXUHFDUULHGRXWIRUWKHPLFURVWUXFWXUHDQDO\VLVRI&,LVFDUULHGRXWLQWZRSDUWV7KHILUVWSDUWHZRUNIORZ
SDUW,LVIRUWKHPLFURVWUXFWXUHDQDO\VLVIRUWKHTXDOLW\SDUDPHWHUVOLNHIODNHOHQJWKDQGIODNHVL]H7KHVHFRQGSDUW
LHZRUNIORZSDUW,,LVIRUWKHDQDO\VLVRISHUFHQWDJHRIIHUULWHSHDUOLWHSUHVHQWLQWKHFDVWLQJV7KHIORZFKDUWVIRU
ZRUNIORZSDUWVDUHDVVKRZQLQILJXUHDQGILJXUHUHVSHFWLYHO\
7KHVWHSVIRUZRUNIORZSDUW,DUHGLYLGHGLQWKUHHSKDVHVDEDQGF,QSKDVHDZHFDOFXODWHGWKHQGRUGHUPRPHQWV
RIFRRFFXUUHQFHPDWUL[DUHREWDLQHGIRUHDFKRIWKHVWDQGDUGIODNHW\SHLPDJHDVGHILQHGE\$670
Steps for phase a:
L 7DNHWKHVWDQGDUGIODNHW\SHLPDJHVDVGHILQHGE\$670
LL $SSO\ WKH &RRFFXUUHQFH PDWUL[ RQ WKH LPDJH DQG FRPSXWH WKH QG RUGHU PRPHQWV OLNH &RQWUDVW
&RUUHODWLRQ(QHUJ\DQG+RPRJHQHLW\
LLL 'HFLGHWKHUDQJHIRUPRPHQWVIRUWKHVWDQGDUGLPDJHVDQGZHXVHWKHVHYDOXHVIRUGHFLGLQJWKHIODNHW\SH
Steps for phase b:
,QSKDVHEZHDSSOLHGPRUSKRORJLFDORSHUDWLRQVDQGIRXQGWKHIODNHOHQJWK
L 7DNHWKHUHDOPLFURVFRSLFLPDJHRIWKH&,FDVWLQJEHIRUHHWFKLQJSURFHVV
LL $IWHULPDJHDFTXLVLWLRQFKHFNLIWKHLPDJHLVFRORXUHG,ILWLVFRORXULPDJHFRQYHUWLWWR
JUD\LPDJH
LLL 5HVL]HWKHJUD\LPDJHWR;IRUIXUWKHUSURFHVVLQJ
LY $SSO\ 0RUSKRORJLFDO DOJRULWKPV OLNH GLODWLRQ DQG HURVLRQ WR UHPRYH WKH HGJHV ZKLFK DUH
QRWVLJQLILFDQW
Y $SSO\FDQQ\HGJHGHWHFWRUWRGHWHFWWKHIODNHVSUHVHQWLQWKHFDVWLQJ
YL )LQGWKHOHQJWKRIHGJHVXVLQJWKHFRQQHFWHGFRPSRQHQWDOJRULWKP
YLL &RQYHUWWKLVOHQJWKLQLQFKHVZLWKNQRZQGSLDVLQ
YLLL &RPSDUHWKLVREWDLQHGOHQJWKZLWKWKH$670VWDQGDUGYDOXHVWRGHILQHWKH)ODNH6L]H

Steps for phase c:

,QSKDVHFZHFDOFXODWHGWKHQGRUGHUPRPHQWVRIFRRFFXUUHQFHPDWUL[REWDLQHGIRUVDPSOHLPDJHREWDLQHGIURP
ODERUDWRU\DQGWKHQGHFLGHGWKHIODNHW\SHXVLQJDUWLILFLDOQHXUDOQHWZRUN
L 7DNHWKHODERUDWRU\LPDJHRI&,FDVWLQJVEHIRUHHWFKLQJ

9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

LL $SSO\ WKH &RRFFXUUHQFH PDWUL[ RQ WKH LPDJH WR JHW WKH QG RUGHU PRPHQWV OLNH &RQWUDVW &RUUHODWLRQ
(QHUJ\DQG+RPRJHQHLW\
LLL 8VHWKHQGRUGHUPRPHQWVREWDLQHGLQVWHSDQGWKRVHREWDLQHGIURPSKDVHDDVLQSXWWRWKH$11
LY $UWLILFLDO QHXUDO QHWZRUN LV XVHG IRU FODVVLILFDWLRQ RI IODNH W\SH 7R GHILQH IODNH W\SH LQ FDVW LURQ
/HYHQEHUJ0DUTXDUGW EDFN SURSDJDWLRQ FRPPDQG LV XVHG IRU $11 ZLWK D FRQILJXUDWLRQ RI  DV
VKRZQLQILJXUH


 

6WDUW 

3KDVHD
6HOHFWWKHUHDOLPDJH 
 7DNHWKHVWDQGDUGLPDJHVRI
RI&,EHIRUHHWFKLQJ 7\SH$(IURP$670FKDUW



 )RUHDFKW\SHRILPDJHFRPSXWHIURPFR
5HDGLPDJHLILPDJHLVFRORXUHGFRQYHUW RFFXUUHQFHPDWUL[QGRUGHUPRPHQWV
WRJUD\DQG5HVL]HWR; 
&RQWUDVW&RUUHODWLRQ(QHUJ\DQG


3KDVHESKDVHF
$SSO\ )RUHDFKLPDJHFRPSXWH )L[WKHUDQJHRIPRPHQWVZLWKWKH
0RUSKRORJLFDO IURPFRRFFXUUHQFHPDWUL[  KHOSRIPRPHQWVIRXQGLQVWHS

2SHUDWLRQVOLNH QGRUGHUPRPHQWV IRUVWDQGDUGLPDJHV
&RQWUDVW&RUUHODWLRQ 
(QHUJ\DQG+RPRJHQHLW\ 
&DQQ\(GJH'HWHFWRU 
 &RPSDUHPRPHQWYDOXHV
 ZLWKVWDQGDUGLPDJHPRPHQW
 YDOXHVDVVKRZQE\$670
&DOFXODWHWKHOHQJWKRIHGJHVXVLQJ
&ODVVLILFDWLRQRIIODNHW\SH  WRGHILQHWKHIODNHW\SH
FRQQHFWHGFRPSRQHQWDOJRULWKP
DQGFRQYHUWLWLQLQFKHVZLWKNQRZQ ,QSXWWR$11
x 2ndordermomentsfrom 
CoͲoccurrencematrix 


'LVSOD\IODNHVL]HDQGIODNH 

)LJXUH:RUNIORZ3DUW,)ORZFKDUWIRUWKHPLFURVWUXFWXUHDQDO\VLVRI&,


6HOHFW&,FDVWLQJLPDJHDIWHUHWFKLQJ



x Resizetheimage 
x Segmenttheimageusingthresholding



&DOFXODWHWKHQXPEHURIZKLWHSL[HOVDQGEODFNSL[HOV




'LVSOD\1RRIZKLWHSL[HOV )HUULWH

1RRIEODFNSL[HOV 3HDUOLWH

)LJXUH:RUNIORZSDUW,,&RPSXWHIHUULWHSHDUOLWHLQ&,FDVWLQJV

9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

)LJXUH  VKRZV WKH VWHSV IRU ZRUNIORZ SDUW,, RI WKH H[SHULPHQWDWLRQ RQ WKH IHUULWHSHDUOLWH SHUFHQWDJH LQ WKH &,
FDVWLQJVDVIROORZV
D0LFURVFRSLFLPDJHVZHJHWIURPODERUDWRU\ZHUHUHVL]HGEHIRUHSURFHVVLQJ
E$IWHUUHVL]LQJWKHLPDJHZDVVHJPHQWHGWRILQGSHUFHQWDJHRIIHUULWHDQGSHDUOLWH
F:KLWHUHJLRQLQLPDJHFRUUHVSRQGWRIHUULWHDQGEODFNUHJLRQFRUUHVSRQGWRSHDUOLWHZKLFKZHFRPSXWH
WKHSHUFHQWDJHRI)HUULWHDQG3HDUOLWHSUHVHQWLQWKHJLYHQFDVWLQJVDPSOHVXVLQJIROORZLQJHTXDWLRQV
3HDUOLWH QXPEHURI%ODFN3L[HOV 7RWDOQRRISL[HOV
)HUULWH QXPEHURI:KLWH3L[HOV 7RWDOQRRISL[HOV
G7KHVWHSVIURPDWRFLVIROORZHGIRUDOOWKHVDPSOHVRI&,
F &RPSDUHWKHUHVXOWVZLWKWKRVHREWDLQHGIURPWKHH[SHUWV

9 5(68/76$1'2%6(59$7,216
7KH LPDJHV VKRZQ LQ )LJXUH  DUH WKH LQWHUPHGLDWH UHVXOWV REWDLQHG LQ WKH ZRUNIORZ SDUW, LH FDOFXODWLRQ RI
IODNH OHQJWK DQG IODNH VL]H7KH LPDJHV LQ WKH )LJXUH FROXPQ DVKRZ WKHRULJLQDO LPDJHV 7KHLPDJHV LQ
FROXPQ E DUH WKH HURGHG LPDJHV RI WKH VDPSOHV 7KH LPDJHV LQ FROXPQ F DUH WKH GLODWHG LPDJHV DQG WKH
LPDJHVLQFROXPQGVKRZWKHILQDOLPDJHVDIWHUHGJHGHWHFWLRQ7KHUHVXOWLPDJHVRIWKHH[SHULPHQWDWLRQIRU
ZRUNIORZSDUW,,DUHDVVKRZQLQ)LJXUH7KHLPDJHFRUUHVSRQGLQJWRILJDLVWKHLPDJHDIWHUHWFKLQJSURFHVV
DQGWKDWFRUUHVSRQGLQJWRILJELVWKHLPDJHRI&,DIWHUVHJPHQWDWLRQXVLQJVXLWDEOHWKUHVKROGLQJRI)URP
WKHVH LPDJHV ZH FRPSXWHG WKH IHUULWHSHDUOLWH SHUFHQWDJH XVLQJ HTXDWLRQV  DQG  7KH H[SHULPHQWDO VWHSV
VKRZQLQILJXUHDUHUHSHDWHGIRUDOOWKHLPDJHVLQGDWDEDVHDQGWKHUHVXOWVRIDIHZVDPSOHVDUHVXPPDUL]HGLQ
WKH7DEOHDQG7DEOH



6

   




 6

   



 6

    

DEFG


)LJXUH5HVXOWVRIEHQFKPDUNVDPSOHVDIWHUSURFHVVLQJ&,LPDJHV
D2ULJLQDOLPDJHVEHIRUHHWFKLQJ
E(URGHGLPDJH
F'LODWHGLPDJH
G(GJHGHWHFWHGLPDJHXVLQJFDQQ\HGJHGHWHFWLRQ



9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

 
D E

)LJXUH2XWSXWUHVXOWVIRU)HUULWH3HDUOLWH$QDO\VLVLQ&,
D ,PDJHDIWHUHWFKLQJ
E ,PDJHDIWHUVHJPHQWDWLRQ

7DEOH&,5HVXOWV&RPSDULVRQ

 )ODNH7\SH )ODNH6L]H
%HIRUH /DERUDWRU\ 2XU,3 /DERUDWRU\ 2XU,3
HWFKLQJ 5HSRUW 5HVXOW 5HSRUW 5HVXOW
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 
SQJ $ $ WR 

7DEOH5HVXOWFRPSDULVRQIRUIHUULWHSHDUOLWHLQ&,

&, 3HDUOLWHLQSHUFHQW )HUULWHLQSHUFHQW

 5HVXOWVIURP/DE 5HVXOWVE\,3 “HUURU 5HVXOWVIURP/DE 5HVXOWVE\,3 “HUURU
SQJ      
SQJ      
SQJ      
SQJ      
SQJ      
SQJ      
SQJ      
SQJ      

1RWH“HUURULVWROHUDWHGLQSHDUOLWHDQGIHUULWH

9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

DE

)LJXUH*UDSKLFDOUHSUHVHQWDWLRQRIUHVXOWFRPSDULVRQRIIHUULWHSHDUOLWHLQ&,

7DEOH$FFXUDF\DQDO\VLVIRU&,

0HWDO 7RWDOVDPSOHVRI&,REWDLQHGIURPODERUDWRU\ 

3HUIRUPDQFH 0DQXDO /DERUDWRU\ 5HVXOWVE\RXU $FFXUDF\LQ

3DUDPHWHUV 5HVXOWV PHWKRGRORJ\
&,  
)ODNHVL]HWR   a
)ODNH7\SH$   a

7DEOHVKRZVWKHUHVXOWVRIWKHLPSOHPHQWHGLPDJHSURFHVVLQJDSSURDFKDQGWKDWREWDLQHGIURPODERUDWRU\IRUWKH
VDPH VDPSOHV WR GHWHUPLQH IODNH W\SH DQG IODNH VL]H ,W LV VHHQ WKDW WKH LPSOHPHQWHG UHVXOWV IDLUO\ DJUHH ZLWK WKH
ODERUDWRU\UHVXOWV&RPSDULVRQRIIHUULWHDQGSHDUOLWHSHUFHQWDJHREWDLQHGIURPRXUPHWKRGDQGODERUDWRU\PHWKRG
DUHDVVKRZQLQILJXUHDDQGE
9,&21&/86,21
)ODNHOHQJWKDQGIODNHW\SHDUHWKHWZRLPSRUWDQWTXDOLW\SDUDPHWHUVRIFDVWLURQFDVWLQJVWRGHFLGHWKHVWUHQJWKRI
WKHFDVWLQJ)URPWKHZRUNIORZSDUW,,IRUWKHPLFURVWUXFWXUHDQDO\VLVRIFDVWLURQLWLVVHHQWKDWWKHUHVXOWVRIIODNH
VL]HDQGIODNHW\SHFRPSXWHG\LHOGHGDQDFFXUDF\RIaE\LPDJHSURFHVVLQJDOJRULWKPVVXFKDVVHJPHQWDWLRQ
HGJHGHWHFWLRQFRRFFXUUHQFHPDWUL[IHDWXUHVDQGDUWLILFLDOQHXUDOQHWZRUN7KHPHWKRGLVQRWWLPHFRQVXPLQJDQG
LVLQH[SHQVLYHWREHDSSOLHGLQWKHVPDOOVFDOHIRXQGU\LQGXVWULHV

9,,)8785(6&23(
7KHDQDO\VLVUHVXOWIRUIODNHVL]HDQGIODNHW\SHZDVIRXQGWREHDFFXUDWHXSWR,WLQGLFDWHVWKDWRXUDOJRULWKPV
IRU &, DUH SURSHUO\ DUUDQJHG EDVHG RQ FXVWRPHUV QHHG <HW PRUH DFFXUDF\ FDQ DFKLHYHG LQ WKH IHUULWH SHDUOLWH
DQDO\VLV7KLVLVDIXWXUHVFRSHRIRXUZRUN7KLVDXWRPDWLRQFDQEHIXUWKHUH[WHQGHGWRWKHPLFURVWUXFWXUHDQDO\VLV
RIGLIIHUHQWPDWHULDOVVXFKDVZRRGJODVVVWHHODOXPLQLXPDQGPHWDODOOR\V

5()(5(1&(6

>@ +RQJ-LDQJ<L\RQJ7DQ-XQIHQJ/HL/LER=HQJ=HODQ=KDQJDQG-LPLQJ+X³Auto-analysis system for graphite morphology of grey cast
iron,”-RXUQDORI$XWRPDWHG0HWKRGVDQG0DQDJHPHQWLQ&KHPLVWU\YRO1R-XO\±$XJXVWSS±
>@ &$,0LQJGRQJHWDO³Quantitative inspection on graphite length of grey iron”6FKRRORI0DWHULDOV6FLHQFHDQG(QJLQHHULQJ6RXWKHDVW
8QLYHUVLW\1DQMLQJ&KLQD5HVHDUFK 'HYHORSPHQW0D\$UWLFOH,'
>@ 'RPLQJR0HU\'LHWHU)LOEHUW7KRPDV-DHJHU³Image Processing for Fault Detection in Aluminum Castings, Analytical Characterization
of Aluminum, Steel, and Super-alloys´ %RRN RI $QDO\WLFDO &KDUDFWHUL]DWLRQ RI $OXPLQXP 6WHHO DQG 6XSHUDOOR\V 3XEOLVKHU 7D\ORU 
)UDQFLV(GLWLRQSS

9ROXPH,VVXH'HFHPEHU  ,661±

 ,QWHUQDWLRQDO-RXUQDORI,QQRYDWLRQVLQ(QJLQHHULQJDQG7HFKQRORJ\,-,(7

>@ +HUEHUW%RHUQHU DQG +HOPXW6WUHFNHU³Automated X-Ray Inspection of Aluminum Castings,” ,(((7UDQVDFWLRQVRQ3DWWHUQ$QDO\VLV DQG
0DFKLQH,QWHOOLJHQFHYRO1R,-DQXDU\SS
>@ :HQIHL&KHQ=XRKXD0LDRDQG'HOLH0LQJ]³Automated Inspection using X-ray Imaging”,(((WK,QWHUQDWLRQDO&RQIHUHQFHRQ
7UXVW6HFXULW\DQG3ULYDF\LQ&RPSXWLQJDQG&RPPXQLFDWLRQV1RYSS


9ROXPH,VVXH'HFHPEHU  ,661±